climateprediction.net home page
Task 16178174

Task 16178174

Name hadcm3n_4daf_1980_40_008391909_2
Workunit 8542768
Created 31 Dec 2013, 2:47:48 UTC
Sent 31 Dec 2013, 2:47:52 UTC
Report deadline 1 Apr 2014, 10:15:03 UTC
Received 17 Jan 2014, 7:34:55 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1179507
Run time 10 days 15 hours 10 min 20 sec
CPU time 5 days 21 hours 12 min 53 sec
Validate state Invalid
Credit 7,153.92
Device peak FLOPS 3.28 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.64</core_client_version>
<![CDATA[
<message>
The device does not recognize the command.
 (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8688, iMonCtr=1
Model crash detected, will try to restart...
20:13:02 (6032): No heartbeat from core client for 30 sec - exiting
20:13:03 (6032): No heartbeat from core client for 30 sec - exiting
20:13:04 (6032): No heartbeat from core client for 30 sec - exiting
20:13:05 (6032): No heartbeat from core client for 30 sec - exiting
20:13:06 (6032): No heartbeat from core client for 30 sec - exiting
20:13:07 (6032): No heartbeat from core client for 30 sec - exiting
20:13:08 (6032): No heartbeat from core client for 30 sec - exiting
20:13:09 (6032): No heartbeat from core client for 30 sec - exiting
20:13:10 (6032): No heartbeat from core client for 30 sec - exiting
20:13:11 (6032): No heartbeat from core client for 30 sec - exiting
20:13:12 (6032): No heartbeat from core client for 30 sec - exiting
20:13:13 (6032): No heartbeat from core client for 30 sec - exiting
20:13:14 (6032): No heartbeat from core client for 30 sec - exiting
20:13:15 (6032): No heartbeat from core client for 30 sec - exiting
20:13:16 (6032): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:37:56 (6036): No heartbeat from core client for 30 sec - exiting
21:37:57 (6036): No heartbeat from core client for 30 sec - exiting
21:37:58 (6036): No heartbeat from core client for 30 sec - exiting
21:37:59 (6036): No heartbeat from core client for 30 sec - exiting
21:38:00 (6036): No heartbeat from core client for 30 sec - exiting
21:38:01 (6036): No heartbeat from core client for 30 sec - exiting
21:38:02 (6036): No heartbeat from core client for 30 sec - exiting
21:38:03 (6036): No heartbeat from core client for 30 sec - exiting
21:38:04 (6036): No heartbeat from core client for 30 sec - exiting
21:38:05 (6036): No heartbeat from core client for 30 sec - exiting
21:38:06 (6036): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:11:24 (2628): No heartbeat from core client for 30 sec - exiting
22:11:25 (2628): No heartbeat from core client for 30 sec - exiting
22:11:26 (2628): No heartbeat from core client for 30 sec - exiting
22:11:27 (2628): No heartbeat from core client for 30 sec - exiting
22:11:28 (2628): No heartbeat from core client for 30 sec - exiting
22:11:29 (2628): No heartbeat from core client for 30 sec - exiting
22:11:30 (2628): No heartbeat from core client for 30 sec - exiting
22:11:31 (2628): No heartbeat from core client for 30 sec - exiting
22:11:32 (2628): No heartbeat from core client for 30 sec - exiting
22:11:33 (2628): No heartbeat from core client for 30 sec - exiting
22:11:34 (2628): No heartbeat from core client for 30 sec - exiting
22:11:35 (2628): No heartbeat from core client for 30 sec - exiting
22:11:36 (2628): No heartbeat from core client for 30 sec - exiting
22:11:37 (2628): No heartbeat from core client for 30 sec - exiting
22:11:38 (2628): No heartbeat from core client for 30 sec - exiting
22:11:39 (2628): No heartbeat from core client for 30 sec - exiting
22:11:40 (2628): No heartbeat from core client for 30 sec - exiting
22:11:41 (2628): No heartbeat from core client for 30 sec - exiting
22:11:42 (2628): No heartbeat from core client for 30 sec - exiting
22:11:43 (2628): No heartbeat from core client for 30 sec - exiting
22:11:44 (2628): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:43:41 (5652): No heartbeat from core client for 30 sec - exiting
22:43:42 (5652): No heartbeat from core client for 30 sec - exiting
22:43:43 (5652): No heartbeat from core client for 30 sec - exiting
22:43:44 (5652): No heartbeat from core client for 30 sec - exiting
22:43:45 (5652): No heartbeat from core client for 30 sec - exiting
22:43:46 (5652): No heartbeat from core client for 30 sec - exiting
22:43:47 (5652): No heartbeat from core client for 30 sec - exiting
22:43:48 (5652): No heartbeat from core client for 30 sec - exiting
22:43:49 (5652): No heartbeat from core client for 30 sec - exiting
22:43:50 (5652): No heartbeat from core client for 30 sec - exiting
22:43:51 (5652): No heartbeat from core client for 30 sec - exiting
22:43:52 (5652): No heartbeat from core client for 30 sec - exiting
22:43:53 (5652): No heartbeat from core client for 30 sec - exiting
22:43:54 (5652): No heartbeat from core client for 30 sec - exiting
22:43:55 (5652): No heartbeat from core client for 30 sec - exiting
22:43:56 (5652): No heartbeat from core client for 30 sec - exiting
22:43:57 (5652): No heartbeat from core client for 30 sec - exiting
22:43:58 (5652): No heartbeat from core client for 30 sec - exiting
22:43:59 (5652): No heartbeat from core client for 30 sec - exiting
22:44:00 (5652): No heartbeat from core client for 30 sec - exiting
22:44:01 (5652): No heartbeat from core client for 30 sec - exiting
22:44:02 (5652): No heartbeat from core client for 30 sec - exiting
22:44:03 (5652): No heartbeat from core client for 30 sec - exiting
22:44:04 (5652): No heartbeat from core client for 30 sec - exiting
22:44:05 (5652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:00:52 (5984): No heartbeat from core client for 30 sec - exiting
23:00:53 (5984): No heartbeat from core client for 30 sec - exiting
23:00:54 (5984): No heartbeat from core client for 30 sec - exiting
23:00:55 (5984): No heartbeat from core client for 30 sec - exiting
23:00:56 (5984): No heartbeat from core client for 30 sec - exiting
23:00:57 (5984): No heartbeat from core client for 30 sec - exiting
23:00:58 (5984): No heartbeat from core client for 30 sec - exiting
23:00:59 (5984): No heartbeat from core client for 30 sec - exiting
23:01:00 (5984): No heartbeat from core client for 30 sec - exiting
23:01:01 (5984): No heartbeat from core client for 30 sec - exiting
23:01:02 (5984): No heartbeat from core client for 30 sec - exiting
23:01:03 (5984): No heartbeat from core client for 30 sec - exiting
23:01:04 (5984): No heartbeat from core client for 30 sec - exiting
23:01:05 (5984): No heartbeat from core client for 30 sec - exiting
23:01:06 (5984): No heartbeat from core client for 30 sec - exiting
23:01:07 (5984): No heartbeat from core client for 30 sec - exiting
23:01:08 (5984): No heartbeat from core client for 30 sec - exiting
23:01:09 (5984): No heartbeat from core client for 30 sec - exiting
23:01:10 (5984): No heartbeat from core client for 30 sec - exiting
23:01:11 (5984): No heartbeat from core client for 30 sec - exiting
23:01:12 (5984): No heartbeat from core client for 30 sec - exiting
23:01:13 (5984): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:01:14 (5984): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
23:22:43 (740): No heartbeat from core client for 30 sec - exiting
23:22:44 (740): No heartbeat from core client for 30 sec - exiting
23:22:45 (740): No heartbeat from core client for 30 sec - exiting
23:22:46 (740): No heartbeat from core client for 30 sec - exiting
23:22:47 (740): No heartbeat from core client for 30 sec - exiting
23:22:48 (740): No heartbeat from core client for 30 sec - exiting
23:22:49 (740): No heartbeat from core client for 30 sec - exiting
23:22:50 (740): No heartbeat from core client for 30 sec - exiting
23:22:51 (740): No heartbeat from core client for 30 sec - exiting
23:22:52 (740): No heartbeat from core client for 30 sec - exiting
23:22:53 (740): No heartbeat from core client for 30 sec - exiting
23:22:54 (740): No heartbeat from core client for 30 sec - exiting
23:22:55 (740): No heartbeat from core client for 30 sec - exiting
23:22:56 (740): No heartbeat from core client for 30 sec - exiting
23:22:57 (740): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:47:04 (5560): No heartbeat from core client for 30 sec - exiting
23:47:05 (5560): No heartbeat from core client for 30 sec - exiting
23:47:06 (5560): No heartbeat from core client for 30 sec - exiting
23:47:07 (5560): No heartbeat from core client for 30 sec - exiting
23:47:08 (5560): No heartbeat from core client for 30 sec - exiting
23:47:09 (5560): No heartbeat from core client for 30 sec - exiting
23:47:10 (5560): No heartbeat from core client for 30 sec - exiting
23:47:11 (5560): No heartbeat from core client for 30 sec - exiting
23:47:12 (5560): No heartbeat from core client for 30 sec - exiting
23:47:13 (5560): No heartbeat from core client for 30 sec - exiting
23:47:14 (5560): No heartbeat from core client for 30 sec - exiting
23:47:15 (5560): No heartbeat from core client for 30 sec - exiting
23:47:16 (5560): No heartbeat from core client for 30 sec - exiting
23:47:17 (5560): No heartbeat from core client for 30 sec - exiting
23:47:18 (5560): No heartbeat from core client for 30 sec - exiting
23:47:19 (5560): No heartbeat from core client for 30 sec - exiting
23:47:20 (5560): No heartbeat from core client for 30 sec - exiting
23:47:21 (5560): No heartbeat from core client for 30 sec - exiting
23:47:22 (5560): No heartbeat from core client for 30 sec - exiting
23:47:23 (5560): No heartbeat from core client for 30 sec - exiting
23:47:24 (5560): No heartbeat from core client for 30 sec - exiting
23:47:25 (5560): No heartbeat from core client for 30 sec - exiting
23:47:26 (5560): No heartbeat from core client for 30 sec - exiting
23:47:27 (5560): No heartbeat from core client for 30 sec - exiting
23:47:28 (5560): No heartbeat from core client for 30 sec - exiting
23:47:29 (5560): No heartbeat from core client for 30 sec - exiting
23:47:30 (5560): No heartbeat from core client for 30 sec - exiting
23:47:31 (5560): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
23:54:02 (5628): No heartbeat from core client for 30 sec - exiting
23:54:03 (5628): No heartbeat from core client for 30 sec - exiting
23:54:04 (5628): No heartbeat from core client for 30 sec - exiting
23:54:05 (5628): No heartbeat from core client for 30 sec - exiting
23:54:06 (5628): No heartbeat from core client for 30 sec - exiting
23:54:07 (5628): No heartbeat from core client for 30 sec - exiting
23:54:08 (5628): No heartbeat from core client for 30 sec - exiting
23:54:09 (5628): No heartbeat from core client for 30 sec - exiting
23:54:10 (5628): No heartbeat from core client for 30 sec - exiting
23:54:11 (5628): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
00:17:26 (5628): No heartbeat from core client for 30 sec - exiting
00:17:27 (5628): No heartbeat from core client for 30 sec - exiting
00:17:28 (5628): No heartbeat from core client for 30 sec - exiting
00:17:29 (5628): No heartbeat from core client for 30 sec - exiting
00:17:30 (5628): No heartbeat from core client for 30 sec - exiting
00:17:31 (5628): No heartbeat from core client for 30 sec - exiting
00:17:32 (5628): No heartbeat from core client for 30 sec - exiting
00:17:33 (5628): No heartbeat from core client for 30 sec - exiting
00:17:34 (5628): No heartbeat from core client for 30 sec - exiting
00:17:35 (5628): No heartbeat from core client for 30 sec - exiting
00:17:36 (5628): No heartbeat from core client for 30 sec - exiting
00:17:37 (5628): No heartbeat from core client for 30 sec - exiting
00:17:38 (5628): No heartbeat from core client for 30 sec - exiting
00:17:39 (5628): No heartbeat from core client for 30 sec - exiting
00:17:40 (5628): No heartbeat from core client for 30 sec - exiting
00:17:41 (5628): No heartbeat from core client for 30 sec - exiting
00:17:42 (5628): No heartbeat from core client for 30 sec - exiting
00:17:43 (5628): No heartbeat from core client for 30 sec - exiting
00:17:44 (5628): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:17:45 (5628): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
21:55:28 (5984): No heartbeat from core client for 30 sec - exiting
21:55:29 (5984): No heartbeat from core client for 30 sec - exiting
21:55:30 (5984): No heartbeat from core client for 30 sec - exiting
21:55:31 (5984): No heartbeat from core client for 30 sec - exiting
21:55:32 (5984): No heartbeat from core client for 30 sec - exiting
21:55:33 (5984): No heartbeat from core client for 30 sec - exiting
21:55:34 (5984): No heartbeat from core client for 30 sec - exiting
21:55:35 (5984): No heartbeat from core client for 30 sec - exiting
21:55:36 (5984): No heartbeat from core client for 30 sec - exiting
21:55:37 (5984): No heartbeat from core client for 30 sec - exiting
21:55:38 (5984): No heartbeat from core client for 30 sec - exiting
21:55:39 (5984): No heartbeat from core client for 30 sec - exiting
21:55:40 (5984): No heartbeat from core client for 30 sec - exiting
21:55:41 (5984): No heartbeat from core client for 30 sec - exiting
21:55:42 (5984): No heartbeat from core client for 30 sec - exiting
21:55:43 (5984): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
17 Jan 2014 02:05:32 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 596,160 507,564 0.8514
14 Jan 2014 20:35:48 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 570,240 485,940 0.8522
14 Jan 2014 03:57:12 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 544,320 464,108 0.8526
13 Jan 2014 22:19:30 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 518,400 442,168 0.8529
13 Jan 2014 01:41:24 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 492,480 420,399 0.8536
09 Jan 2014 17:57:08 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 466,560 398,517 0.8542
09 Jan 2014 06:26:30 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 440,640 376,483 0.8544
08 Jan 2014 22:24:10 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 414,720 354,067 0.8537
08 Jan 2014 11:06:31 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 388,800 331,511 0.8527
07 Jan 2014 19:56:46 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 362,880 309,295 0.8523
07 Jan 2014 03:31:44 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 336,960 287,327 0.8527
06 Jan 2014 17:58:12 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 311,040 264,697 0.8510
06 Jan 2014 01:51:45 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 285,120 242,572 0.8508
05 Jan 2014 07:24:41 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 259,200 220,491 0.8507
04 Jan 2014 23:12:47 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 233,280 197,922 0.8484
04 Jan 2014 14:58:09 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 207,360 176,354 0.8505
03 Jan 2014 22:52:04 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 181,440 154,882 0.8536
03 Jan 2014 08:00:30 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 155,520 132,863 0.8543
02 Jan 2014 22:38:16 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 129,600 110,396 0.8518
02 Jan 2014 14:02:06 1179507 16178174 hadcm3n_4daf_1980_40_008391909_2 103,680 88,034 0.8491


©2024 climateprediction.net