climateprediction.net home page
Task 13661449

Task 13661449

Name hadcm3n_yleb_1900_40_007513970_3
Workunit 7711445
Created 25 Nov 2011, 15:00:56 UTC
Sent 25 Nov 2011, 16:18:04 UTC
Report deadline 24 Feb 2012, 23:45:15 UTC
Received 10 Jan 2012, 7:15:36 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1158608
Run time 10 days 4 hours 1 min 40 sec
CPU time 8 days 23 hours 24 min 48 sec
Validate state Invalid
Credit 5,598.72
Device peak FLOPS 2.22 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:09:05 (4332): No heartbeat from core client for 30 sec - exiting
07:09:06 (4332): No heartbeat from core client for 30 sec - exiting
07:09:07 (4332): No heartbeat from core client for 30 sec - exiting
07:09:08 (4332): No heartbeat from core client for 30 sec - exiting
07:09:09 (4332): No heartbeat from core client for 30 sec - exiting
07:09:10 (4332): No heartbeat from core client for 30 sec - exiting
07:09:11 (4332): No heartbeat from core client for 30 sec - exiting
07:09:12 (4332): No heartbeat from core client for 30 sec - exiting
07:09:13 (4332): No heartbeat from core client for 30 sec - exiting
07:09:15 (4332): No heartbeat from core client for 30 sec - exiting
07:09:16 (4332): No heartbeat from core client for 30 sec - exiting
07:09:17 (4332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:09:18 (4332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
08:29:44 (4308): No heartbeat from core client for 30 sec - exiting
08:29:46 (4308): No heartbeat from core client for 30 sec - exiting
08:29:47 (4308): No heartbeat from core client for 30 sec - exiting
08:29:48 (4308): No heartbeat from core client for 30 sec - exiting
08:29:49 (4308): No heartbeat from core client for 30 sec - exiting
08:29:50 (4308): No heartbeat from core client for 30 sec - exiting
08:29:51 (4308): No heartbeat from core client for 30 sec - exiting
08:29:52 (4308): No heartbeat from core client for 30 sec - exiting
08:29:53 (4308): No heartbeat from core client for 30 sec - exiting
08:29:54 (4308): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2660, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5572, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5844, iMonCtr=1
Model crash detected, will try to restart...
08:31:20 (5804): No heartbeat from core client for 30 sec - exiting
08:31:22 (5804): No heartbeat from core client for 30 sec - exiting
08:31:23 (5804): No heartbeat from core client for 30 sec - exiting
08:31:24 (5804): No heartbeat from core client for 30 sec - exiting
08:31:25 (5804): No heartbeat from core client for 30 sec - exiting
08:31:26 (5804): No heartbeat from core client for 30 sec - exiting
08:31:27 (5804): No heartbeat from core client for 30 sec - exiting
08:31:29 (5804): No heartbeat from core client for 30 sec - exiting
08:31:30 (5804): No heartbeat from core client for 30 sec - exiting
08:31:31 (5804): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7700, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5764, iMonCtr=1
Model crash detected, will try to restart...
08:14:22 (6028): No heartbeat from core client for 30 sec - exiting
08:14:23 (6028): No heartbeat from core client for 30 sec - exiting
08:14:24 (6028): No heartbeat from core client for 30 sec - exiting
08:14:25 (6028): No heartbeat from core client for 30 sec - exiting
08:14:26 (6028): No heartbeat from core client for 30 sec - exiting
08:14:28 (6028): No heartbeat from core client for 30 sec - exiting
08:14:29 (6028): No heartbeat from core client for 30 sec - exiting
08:14:30 (6028): No heartbeat from core client for 30 sec - exiting
08:14:31 (6028): No heartbeat from core client for 30 sec - exiting
08:14:32 (6028): No heartbeat from core client for 30 sec - exiting
08:14:33 (6028): No heartbeat from core client for 30 sec - exiting
08:14:34 (6028): No heartbeat from core client for 30 sec - exiting
08:14:35 (6028): No heartbeat from core client for 30 sec - exiting
08:14:36 (6028): No heartbeat from core client for 30 sec - exiting
08:14:37 (6028): No heartbeat from core client for 30 sec - exiting
08:14:39 (6028): No heartbeat from core client for 30 sec - exiting
08:14:40 (6028): No heartbeat from core client for 30 sec - exiting
08:14:41 (6028): No heartbeat from core client for 30 sec - exiting
08:14:42 (6028): No heartbeat from core client for 30 sec - exiting
08:14:43 (6028): No heartbeat from core client for 30 sec - exiting
08:14:44 (6028): No heartbeat from core client for 30 sec - exiting
08:14:45 (6028): No heartbeat from core client for 30 sec - exiting
08:14:46 (6028): No heartbeat from core client for 30 sec - exiting
08:14:47 (6028): No heartbeat from core client for 30 sec - exiting
08:14:48 (6028): No heartbeat from core client for 30 sec - exiting
08:14:49 (6028): No heartbeat from core client for 30 sec - exiting
08:14:51 (6028): No heartbeat from core client for 30 sec - exiting
08:14:52 (6028): No heartbeat from core client for 30 sec - exiting
08:14:53 (6028): No heartbeat from core client for 30 sec - exiting
08:14:54 (6028): No heartbeat from core client for 30 sec - exiting
08:14:55 (6028): No heartbeat from core client for 30 sec - exiting
08:14:56 (6028): No heartbeat from core client for 30 sec - exiting
08:14:57 (6028): No heartbeat from core client for 30 sec - exiting
08:14:58 (6028): No heartbeat from core client for 30 sec - exiting
08:14:59 (6028): No heartbeat from core client for 30 sec - exiting
08:15:00 (6028): No heartbeat from core client for 30 sec - exiting
08:15:01 (6028): No heartbeat from core client for 30 sec - exiting
08:15:03 (6028): No heartbeat from core client for 30 sec - exiting
08:15:04 (6028): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:13:43 (4468): No heartbeat from core client for 30 sec - exiting
08:13:44 (4468): No heartbeat from core client for 30 sec - exiting
08:13:45 (4468): No heartbeat from core client for 30 sec - exiting
08:13:46 (4468): No heartbeat from core client for 30 sec - exiting
08:13:47 (4468): No heartbeat from core client for 30 sec - exiting
08:13:49 (4468): No heartbeat from core client for 30 sec - exiting
08:13:50 (4468): No heartbeat from core client for 30 sec - exiting
08:13:51 (4468): No heartbeat from core client for 30 sec - exiting
08:13:52 (4468): No heartbeat from core client for 30 sec - exiting
08:13:53 (4468): No heartbeat from core client for 30 sec - exiting
08:13:54 (4468): No heartbeat from core client for 30 sec - exiting
08:13:55 (4468): No heartbeat from core client for 30 sec - exiting
08:13:56 (4468): No heartbeat from core client for 30 sec - exiting
08:13:57 (4468): No heartbeat from core client for 30 sec - exiting
08:13:58 (4468): No heartbeat from core client for 30 sec - exiting
08:13:59 (4468): No heartbeat from core client for 30 sec - exiting
08:14:01 (4468): No heartbeat from core client for 30 sec - exiting
08:14:02 (4468): No heartbeat from core client for 30 sec - exiting
08:14:03 (4468): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:14:04 (4468): No heartbeat from core client for 30 sec - exiting
08:14:51 (5580): No heartbeat from core client for 30 sec - exiting
08:14:53 (5580): No heartbeat from core client for 30 sec - exiting
08:14:54 (5580): No heartbeat from core client for 30 sec - exiting
08:14:55 (5580): No heartbeat from core client for 30 sec - exiting
08:14:56 (5580): No heartbeat from core client for 30 sec - exiting
08:14:57 (5580): No heartbeat from core client for 30 sec - exiting
08:14:58 (5580): No heartbeat from core client for 30 sec - exiting
08:14:59 (5580): No heartbeat from core client for 30 sec - exiting
08:15:00 (5580): No heartbeat from core client for 30 sec - exiting
08:15:01 (5580): No heartbeat from core client for 30 sec - exiting
08:15:02 (5580): No heartbeat from core client for 30 sec - exiting
08:15:03 (5580): No heartbeat from core client for 30 sec - exiting
08:15:05 (5580): No heartbeat from core client for 30 sec - exiting
08:15:06 (5580): No heartbeat from core client for 30 sec - exiting
08:15:07 (5580): No heartbeat from core client for 30 sec - exiting
08:15:08 (5580): No heartbeat from core client for 30 sec - exiting
08:15:09 (5580): No heartbeat from core client for 30 sec - exiting
08:15:10 (5580): No heartbeat from core client for 30 sec - exiting
08:15:11 (5580): No heartbeat from core client for 30 sec - exiting
08:15:12 (5580): No heartbeat from core client for 30 sec - exiting
08:15:13 (5580): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:41:18 (4092): No heartbeat from core client for 30 sec - exiting
12:41:19 (4092): No heartbeat from core client for 30 sec - exiting
12:41:20 (4092): No heartbeat from core client for 30 sec - exiting
12:41:21 (4092): No heartbeat from core client for 30 sec - exiting
12:41:22 (4092): No heartbeat from core client for 30 sec - exiting
12:41:23 (4092): No heartbeat from core client for 30 sec - exiting
12:41:24 (4092): No heartbeat from core client for 30 sec - exiting
12:41:25 (4092): No heartbeat from core client for 30 sec - exiting
12:41:26 (4092): No heartbeat from core client for 30 sec - exiting
12:41:27 (4092): No heartbeat from core client for 30 sec - exiting
12:41:28 (4092): No heartbeat from core client for 30 sec - exiting
12:41:29 (4092): No heartbeat from core client for 30 sec - exiting
12:41:30 (4092): No heartbeat from core client for 30 sec - exiting
12:41:31 (4092): No heartbeat from core client for 30 sec - exiting
12:41:32 (4092): No heartbeat from core client for 30 sec - exiting
12:41:33 (4092): No heartbeat from core client for 30 sec - exiting
12:41:34 (4092): No heartbeat from core client for 30 sec - exiting
12:41:35 (4092): No heartbeat from core client for 30 sec - exiting
12:41:36 (4092): No heartbeat from core client for 30 sec - exiting
12:41:37 (4092): No heartbeat from core client for 30 sec - exiting
12:41:38 (4092): No heartbeat from core client for 30 sec - exiting
12:41:39 (4092): No heartbeat from core client for 30 sec - exiting
12:41:40 (4092): No heartbeat from core client for 30 sec - exiting
12:41:41 (4092): No heartbeat from core client for 30 sec - exiting
12:41:42 (4092): No heartbeat from core client for 30 sec - exiting
12:41:43 (4092): No heartbeat from core client for 30 sec - exiting
12:41:44 (4092): No heartbeat from core client for 30 sec - exiting
12:41:45 (4092): No heartbeat from core client for 30 sec - exiting
12:41:46 (4092): No heartbeat from core client for 30 sec - exiting
12:41:47 (4092): No heartbeat from core client for 30 sec - exiting
12:41:48 (4092): No heartbeat from core client for 30 sec - exiting
12:41:49 (4092): No heartbeat from core client for 30 sec - exiting
12:41:50 (4092): No heartbeat from core client for 30 sec - exiting
12:41:51 (4092): No heartbeat from core client for 30 sec - exiting
12:41:52 (4092): No heartbeat from core client for 30 sec - exiting
12:41:53 (4092): No heartbeat from core client for 30 sec - exiting
12:41:55 (4092): No heartbeat from core client for 30 sec - exiting
12:41:56 (4092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:41:57 (4092): No heartbeat from core client for 30 sec - exiting
08:45:29 (5904): No heartbeat from core client for 30 sec - exiting
08:45:30 (5904): No heartbeat from core client for 30 sec - exiting
08:45:31 (5904): No heartbeat from core client for 30 sec - exiting
08:45:32 (5904): No heartbeat from core client for 30 sec - exiting
08:45:33 (5904): No heartbeat from core client for 30 sec - exiting
08:45:35 (5904): No heartbeat from core client for 30 sec - exiting
08:45:36 (5904): No heartbeat from core client for 30 sec - exiting
08:45:37 (5904): No heartbeat from core client for 30 sec - exiting
08:45:38 (5904): No heartbeat from core client for 30 sec - exiting
08:45:39 (5904): No heartbeat from core client for 30 sec - exiting
08:45:40 (5904): No heartbeat from core client for 30 sec - exiting
08:45:41 (5904): No heartbeat from core client for 30 sec - exiting
08:45:42 (5904): No heartbeat from core client for 30 sec - exiting
08:45:43 (5904): No heartbeat from core client for 30 sec - exiting
08:45:44 (5904): No heartbeat from core client for 30 sec - exiting
08:45:46 (5904): No heartbeat from core client for 30 sec - exiting
08:45:47 (5904): No heartbeat from core client for 30 sec - exiting
08:45:48 (5904): No heartbeat from core client for 30 sec - exiting
08:45:49 (5904): No heartbeat from core client for 30 sec - exiting
08:45:50 (5904): No heartbeat from core client for 30 sec - exiting
08:45:51 (5904): No heartbeat from core client for 30 sec - exiting
08:45:52 (5904): No heartbeat from core client for 30 sec - exiting
08:45:54 (5904): No heartbeat from core client for 30 sec - exiting
08:45:55 (5904): No heartbeat from core client for 30 sec - exiting
08:45:56 (5904): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5040, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6056, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPIController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5028, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5652, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6032, iMonCtr=1
Model crash detected, will try to restart...
11:35:03 (1220): No heartbeat from core client for 30 sec - exiting
11:35:04 (1220): No heartbeat from core client for 30 sec - exiting
11:35:05 (1220): No heartbeat from core client for 30 sec - exiting
11:35:06 (1220): No heartbeat from core client for 30 sec - exiting
11:35:07 (1220): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:35:08 (1220): No heartbeat from core client for 30 sec - exiting
11:35:10 (1220): No heartbeat from core client for 30 sec - exiting
11:35:11 (1220): No heartbeat from core client for 30 sec - exiting
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5032, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
cpdnmonitor: cannot open input file C:\MH\BOINC\projects/projects/climateprediction.net/hadcm3n_yleb_1900_40_007513970/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\MH\BOINC\projects/projects/climateprediction.net/hadcm3n_yleb_1900_40_007513970/dataout/ocean_restart.day after 11 attempts
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2668, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\MH\BOINC\projects/projects/climateprediction.net/hadcm3n_yleb_1900_40_007513970/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\MH\BOINC\projects/projects/climateprediction.net/hadcm3n_yleb_1900_40_007513970/dataout/ocean_restart.day after 11 attempts
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2668, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\MH\BOINC\projects/projects/climateprediction.net/hadcm3n_yleb_1900_40_007513970/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\MH\BOINC\projects/projects/climateprediction.net/hadcm3n_yleb_1900_40_007513970/dataout/ocean_restart.day after 11 attempts
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2668, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\MH\BOINC\projects/projects/climateprediction.net/hadcm3n_yleb_1900_40_007513970/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\MH\BOINC\projects/projects/climateprediction.net/hadcm3n_yleb_1900_40_007513970/dataout/ocean_restart.day after 11 attempts
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2668, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\MH\BOINC\projects/projects/climateprediction.net/hadcm3n_yleb_1900_40_007513970/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\MH\BOINC\projects/projects/climateprediction.net/hadcm3n_yleb_1900_40_007513970/dataout/ocean_restart.day after 11 attempts
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2668, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\MH\BOINC\projects/projects/climateprediction.net/hadcm3n_yleb_1900_40_007513970/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\MH\BOINC\projects/projects/climateprediction.net/hadcm3n_yleb_1900_40_007513970/dataout/ocean_restart.day after 11 attempts
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2668, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
07 Jan 2012 19:21:04 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 466,560 767,121 1.6442
05 Jan 2012 08:24:26 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 440,640 723,579 1.6421
04 Jan 2012 07:56:02 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 414,720 680,673 1.6413
01 Jan 2012 21:21:55 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 388,800 638,107 1.6412
01 Jan 2012 15:13:49 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 362,880 595,627 1.6414
01 Jan 2012 15:13:49 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 336,960 553,236 1.6418
01 Jan 2012 15:13:49 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 311,040 510,432 1.6410
19 Dec 2011 08:52:42 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 285,120 467,461 1.6395
16 Dec 2011 13:18:01 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 259,200 424,547 1.6379
15 Dec 2011 08:24:23 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 233,280 381,693 1.6362
13 Dec 2011 15:08:11 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 207,360 339,126 1.6354
12 Dec 2011 11:34:24 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 181,440 296,858 1.6361
08 Dec 2011 09:03:19 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 155,520 254,267 1.6349
06 Dec 2011 17:48:01 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 129,600 211,498 1.6319
05 Dec 2011 12:01:47 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 103,680 168,418 1.6244
01 Dec 2011 14:12:48 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 77,760 126,030 1.6208
29 Nov 2011 22:58:28 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 51,840 84,303 1.6262
29 Nov 2011 11:00:59 1158608 13661449 hadcm3n_yleb_1900_40_007513970_3 25,920 41,994 1.6201


©2024 cpdn.org