climateprediction.net home page
Task 15724521

Task 15724521

Name hadcm3n_49us_1980_40_008324401_1
Workunit 8475536
Created 14 Apr 2013, 18:11:32 UTC
Sent 14 Apr 2013, 18:11:42 UTC
Report deadline 15 Jul 2013, 1:38:53 UTC
Received 31 May 2013, 10:08:27 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1086629
Run time 26 days 10 hours 6 min 14 sec
CPU time 9 days 2 hours 17 min 44 sec
Validate state Invalid
Credit 8,709.12
Device peak FLOPS 2.26 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.10.56</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:13:27 (5744): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
17:13:54 (5744): No heartbeat from core client for 30 sec - exiting
17:13:58 (5744): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:37:06 (5324): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
09:37:11 (5324): No heartbeat from core client for 30 sec - exiting
09:37:13 (5324): No heartbeat from core client for 30 sec - exiting
09:37:14 (5324): No heartbeat from core client for 30 sec - exiting
09:37:15 (5324): No heartbeat from core client for 30 sec - exiting
09:37:16 (5324): No heartbeat from core client for 30 sec - exiting
09:37:17 (5324): No heartbeat from core client for 30 sec - exiting
09:37:19 (5324): No heartbeat from core client for 30 sec - exiting
09:37:21 (5324): No heartbeat from core client for 30 sec - exiting
09:37:22 (5324): No heartbeat from core client for 30 sec - exiting
09:37:23 (5324): No heartbeat from core client for 30 sec - exiting
09:37:25 (5324): No heartbeat from core client for 30 sec - exiting
09:37:27 (5324): No heartbeat from core client for 30 sec - exiting
09:37:29 (5324): No heartbeat from core client for 30 sec - exiting
09:37:30 (5324): No heartbeat from core client for 30 sec - exiting
09:37:31 (5324): No heartbeat from core client for 30 sec - exiting
09:37:32 (5324): No heartbeat from core client for 30 sec - exiting
09:37:33 (5324): No heartbeat from core client for 30 sec - exiting
09:37:34 (5324): No heartbeat from core client for 30 sec - exiting
10:53:25 (5428): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:53:33 (5428): No heartbeat from core client for 30 sec - exiting
10:53:35 (5428): No heartbeat from core client for 30 sec - exiting
10:53:41 (5428): No heartbeat from core client for 30 sec - exiting
10:53:44 (5428): No heartbeat from core client for 30 sec - exiting
10:53:53 (5428): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:28:27 (5032): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:28:29 (5032): No heartbeat from core client for 30 sec - exiting
17:28:30 (5032): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
21:33:08 (6052): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:37:38 (5468): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:37:49 (5468): No heartbeat from core client for 30 sec - exiting
15:37:52 (5468): No heartbeat from core client for 30 sec - exiting
15:37:53 (5468): No heartbeat from core client for 30 sec - exiting
15:37:55 (5468): No heartbeat from core client for 30 sec - exiting
15:38:03 (5468): No heartbeat from core client for 30 sec - exiting
15:38:17 (5468): No heartbeat from core client for 30 sec - exiting
15:38:35 (5468): No heartbeat from core client for 30 sec - exiting
15:38:52 (5468): No heartbeat from core client for 30 sec - exiting
15:38:53 (5468): No heartbeat from core client for 30 sec - exiting
15:38:54 (5468): No heartbeat from core client for 30 sec - exiting
15:38:55 (5468): No heartbeat from core client for 30 sec - exiting
15:38:56 (5468): No heartbeat from core client for 30 sec - exiting
15:38:57 (5468): No heartbeat from core client for 30 sec - exiting
15:38:58 (5468): No heartbeat from core client for 30 sec - exiting
15:38:59 (5468): No heartbeat from core client for 30 sec - exiting
15:39:00 (5468): No heartbeat from core client for 30 sec - exiting
15:39:01 (5468): No heartbeat from core client for 30 sec - exiting
15:39:02 (5468): No heartbeat from core client for 30 sec - exiting
15:39:18 (5468): No heartbeat from core client for 30 sec - exiting
15:39:22 (5468): No heartbeat from core client for 30 sec - exiting
15:41:28 (1084): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:47:44 (4456): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
20:08:36 (5672): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
20:08:47 (5672): No heartbeat from core client for 30 sec - exiting
20:08:48 (5672): No heartbeat from core client for 30 sec - exiting
20:08:49 (5672): No heartbeat from core client for 30 sec - exiting
20:08:50 (5672): No heartbeat from core client for 30 sec - exiting
21:25:15 (4364): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:25:19 (4364): No heartbeat from core client for 30 sec - exiting
21:25:20 (4364): No heartbeat from core client for 30 sec - exiting
21:25:21 (4364): No heartbeat from core client for 30 sec - exiting
21:25:22 (4364): No heartbeat from core client for 30 sec - exiting
21:25:23 (4364): No heartbeat from core client for 30 sec - exiting
21:25:24 (4364): No heartbeat from core client for 30 sec - exiting
21:25:26 (4364): No heartbeat from core client for 30 sec - exiting
21:25:36 (4364): No heartbeat from core client for 30 sec - exiting
21:25:38 (4364): No heartbeat from core client for 30 sec - exiting
21:29:36 (5016): No heartbeat from core client for 30 sec - exiting
21:29:37 (5016): No heartbeat from core client for 30 sec - exiting
21:29:38 (5016): No heartbeat from core client for 30 sec - exiting
21:29:39 (5016): No heartbeat from core client for 30 sec - exiting
21:29:40 (5016): No heartbeat from core client for 30 sec - exiting
21:29:41 (5016): No heartbeat from core client for 30 sec - exiting
21:29:42 (5016): No heartbeat from core client for 30 sec - exiting
21:29:43 (5016): No heartbeat from core client for 30 sec - exiting
21:29:44 (5016): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
22:38:26 (4984): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
22:38:28 (4984): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
30 May 2013 16:39:03 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 725,760 2,095,568 2.8874
28 May 2013 23:19:24 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 699,840 2,021,082 2.8879
27 May 2013 04:47:35 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 673,920 1,946,913 2.8889
25 May 2013 07:11:39 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 648,000 1,873,051 2.8905
23 May 2013 09:33:22 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 622,080 1,799,020 2.8919
21 May 2013 14:35:12 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 596,160 1,724,453 2.8926
20 May 2013 03:39:05 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 570,240 1,650,116 2.8937
18 May 2013 05:57:32 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 544,320 1,575,219 2.8939
16 May 2013 05:36:04 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 518,400 1,500,605 2.8947
14 May 2013 02:31:19 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 492,480 1,425,583 2.8947
12 May 2013 07:50:44 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 466,560 1,350,327 2.8942
10 May 2013 02:14:22 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 440,640 1,274,995 2.8935
08 May 2013 12:35:06 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 414,720 1,200,254 2.8941
06 May 2013 08:28:24 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 388,800 1,125,543 2.8949
04 May 2013 11:41:46 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 362,880 1,050,593 2.8952
02 May 2013 14:25:23 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 336,960 975,245 2.8942
30 Apr 2013 22:41:03 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 311,040 900,235 2.8943
29 Apr 2013 05:46:52 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 285,120 825,168 2.8941
27 Apr 2013 12:44:15 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 259,200 749,715 2.8924
26 Apr 2013 13:09:22 1086629 15724521 hadcm3n_49us_1980_40_008324401_1 233,280 677,473 2.9041


©2024 climateprediction.net