climateprediction.net home page
Task 17354203

Task 17354203

Name hadcm3n_xae5_1940_40_009149763_0
Workunit 9280099
Created 6 Nov 2014, 14:38:07 UTC
Sent 6 Nov 2014, 14:43:38 UTC
Report deadline 5 Feb 2015, 22:10:49 UTC
Received 25 Nov 2014, 22:29:58 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1326825
Run time 17 days 2 hours 3 min 29 sec
CPU time 8 days 20 hours 26 min 47 sec
Validate state Invalid
Credit 9,020.16
Device peak FLOPS 2.69 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.2.42</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
22:15:31 (360): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:26:11 (10864): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:26:12 (10864): No heartbeat from core client for 30 sec - exiting
14:26:13 (10864): No heartbeat from core client for 30 sec - exiting
14:26:14 (10864): No heartbeat from core client for 30 sec - exiting
14:26:15 (10864): No heartbeat from core client for 30 sec - exiting
14:26:16 (10864): No heartbeat from core client for 30 sec - exiting
14:26:17 (10864): No heartbeat from core client for 30 sec - exiting
14:26:18 (10864): No heartbeat from core client for 30 sec - exiting
14:26:19 (10864): No heartbeat from core client for 30 sec - exiting
14:26:20 (10864): No heartbeat from core client for 30 sec - exiting
14:26:21 (10864): No heartbeat from core client for 30 sec - exiting
14:26:22 (10864): No heartbeat from core client for 30 sec - exiting
14:26:23 (10864): No heartbeat from core client for 30 sec - exiting
14:26:24 (10864): No heartbeat from core client for 30 sec - exiting
14:26:25 (10864): No heartbeat from core client for 30 sec - exiting
14:26:26 (10864): No heartbeat from core client for 30 sec - exiting
14:26:27 (10864): No heartbeat from core client for 30 sec - exiting
14:26:28 (10864): No heartbeat from core client for 30 sec - exiting
14:26:29 (10864): No heartbeat from core client for 30 sec - exiting
14:26:30 (10864): No heartbeat from core client for 30 sec - exiting
14:26:31 (10864): No heartbeat from core client for 30 sec - exiting
14:26:32 (10864): No heartbeat from core client for 30 sec - exiting
14:26:33 (10864): No heartbeat from core client for 30 sec - exiting
14:26:34 (10864): No heartbeat from core client for 30 sec - exiting
14:26:35 (10864): No heartbeat from core client for 30 sec - exiting
14:26:36 (10864): No heartbeat from core client for 30 sec - exiting
14:26:37 (10864): No heartbeat from core client for 30 sec - exiting
14:26:38 (10864): No heartbeat from core client for 30 sec - exiting
14:26:39 (10864): No heartbeat from core client for 30 sec - exiting
14:26:40 (10864): No heartbeat from core client for 30 sec - exiting
14:26:41 (10864): No heartbeat from core client for 30 sec - exiting
14:26:42 (10864): No heartbeat from core client for 30 sec - exiting
14:26:43 (10864): No heartbeat from core client for 30 sec - exiting
14:26:44 (10864): No heartbeat from core client for 30 sec - exiting
14:26:45 (10864): No heartbeat from core client for 30 sec - exiting
14:26:46 (10864): No heartbeat from core client for 30 sec - exiting
14:26:47 (10864): No heartbeat from core client for 30 sec - exiting
14:26:48 (10864): No heartbeat from core client for 30 sec - exiting
14:26:49 (10864): No heartbeat from core client for 30 sec - exiting
14:26:50 (10864): No heartbeat from core client for 30 sec - exiting
14:26:51 (10864): No heartbeat from core client for 30 sec - exiting
14:26:52 (10864): No heartbeat from core client for 30 sec - exiting
14:26:53 (10864): No heartbeat from core client for 30 sec - exiting
14:26:54 (10864): No heartbeat from core client for 30 sec - exiting
14:26:55 (10864): No heartbeat from core client for 30 sec - exiting
14:26:56 (10864): No heartbeat from core client for 30 sec - exiting
14:26:57 (10864): No heartbeat from core client for 30 sec - exiting
14:26:58 (10864): No heartbeat from core client for 30 sec - exiting
14:26:59 (10864): No heartbeat from core client for 30 sec - exiting
14:27:00 (10864): No heartbeat from core client for 30 sec - exiting
14:27:01 (10864): No heartbeat from core client for 30 sec - exiting
14:27:02 (10864): No heartbeat from core client for 30 sec - exiting
14:27:03 (10864): No heartbeat from core client for 30 sec - exiting
14:27:04 (10864): No heartbeat from core client for 30 sec - exiting
14:27:05 (10864): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
02:39:31 (51570): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:39:33 (51570): No heartbeat from core client for 30 sec - exiting
02:39:34 (51570): No heartbeat from core client for 30 sec - exiting
02:39:35 (51570): No heartbeat from core client for 30 sec - exiting
02:39:36 (51570): No heartbeat from core client for 30 sec - exiting
02:39:37 (51570): No heartbeat from core client for 30 sec - exiting
02:39:38 (51570): No heartbeat from core client for 30 sec - exiting
02:39:39 (51570): No heartbeat from core client for 30 sec - exiting
02:39:40 (51570): No heartbeat from core client for 30 sec - exiting
02:39:41 (51570): No heartbeat from core client for 30 sec - exiting
02:39:42 (51570): No heartbeat from core client for 30 sec - exiting
02:39:43 (51570): No heartbeat from core client for 30 sec - exiting
02:39:44 (51570): No heartbeat from core client for 30 sec - exiting
02:39:45 (51570): No heartbeat from core client for 30 sec - exiting
02:39:46 (51570): No heartbeat from core client for 30 sec - exiting
02:39:47 (51570): No heartbeat from core client for 30 sec - exiting
02:39:48 (51570): No heartbeat from core client for 30 sec - exiting
02:39:49 (51570): No heartbeat from core client for 30 sec - exiting
02:39:50 (51570): No heartbeat from core client for 30 sec - exiting
02:39:51 (51570): No heartbeat from core client for 30 sec - exiting
02:39:52 (51570): No heartbeat from core client for 30 sec - exiting
02:39:53 (51570): No heartbeat from core client for 30 sec - exiting
02:39:54 (51570): No heartbeat from core client for 30 sec - exiting
02:39:55 (51570): No heartbeat from core client for 30 sec - exiting
02:39:56 (51570): No heartbeat from core client for 30 sec - exiting
02:39:57 (51570): No heartbeat from core client for 30 sec - exiting
02:39:58 (51570): No heartbeat from core client for 30 sec - exiting
02:39:59 (51570): No heartbeat from core client for 30 sec - exiting
02:40:00 (51570): No heartbeat from core client for 30 sec - exiting
02:40:01 (51570): No heartbeat from core client for 30 sec - exiting
02:40:02 (51570): No heartbeat from core client for 30 sec - exiting
02:40:03 (51570): No heartbeat from core client for 30 sec - exiting
02:40:04 (51570): No heartbeat from core client for 30 sec - exiting
02:40:05 (51570): No heartbeat from core client for 30 sec - exiting
02:40:06 (51570): No heartbeat from core client for 30 sec - exiting
02:40:07 (51570): No heartbeat from core client for 30 sec - exiting
02:40:08 (51570): No heartbeat from core client for 30 sec - exiting
02:40:09 (51570): No heartbeat from core client for 30 sec - exiting
02:40:10 (51570): No heartbeat from core client for 30 sec - exiting
02:40:11 (51570): No heartbeat from core client for 30 sec - exiting
02:40:12 (51570): No heartbeat from core client for 30 sec - exiting
02:40:13 (51570): No heartbeat from core client for 30 sec - exiting
02:40:14 (51570): No heartbeat from core client for 30 sec - exiting
02:40:15 (51570): No heartbeat from core client for 30 sec - exiting
02:40:16 (51570): No heartbeat from core client for 30 sec - exiting
02:40:17 (51570): No heartbeat from core client for 30 sec - exiting
02:40:18 (51570): No heartbeat from core client for 30 sec - exiting
02:40:19 (51570): No heartbeat from core client for 30 sec - exiting
02:40:20 (51570): No heartbeat from core client for 30 sec - exiting
02:40:21 (51570): No heartbeat from core client for 30 sec - exiting
02:40:22 (51570): No heartbeat from core client for 30 sec - exiting
02:40:23 (51570): No heartbeat from core client for 30 sec - exiting
02:40:24 (51570): No heartbeat from core client for 30 sec - exiting
02:40:25 (51570): No heartbeat from core client for 30 sec - exiting
02:40:26 (51570): No heartbeat from core client for 30 sec - exiting
02:40:27 (51570): No heartbeat from core client for 30 sec - exiting
02:40:28 (51570): No heartbeat from core client for 30 sec - exiting
02:40:29 (51570): No heartbeat from core client for 30 sec - exiting
09:02:48 (74102): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:02:50 (74102): No heartbeat from core client for 30 sec - exiting
09:02:51 (74102): No heartbeat from core client for 30 sec - exiting
09:02:52 (74102): No heartbeat from core client for 30 sec - exiting
09:02:53 (74102): No heartbeat from core client for 30 sec - exiting
09:02:54 (74102): No heartbeat from core client for 30 sec - exiting
09:02:55 (74102): No heartbeat from core client for 30 sec - exiting
09:02:56 (74102): No heartbeat from core client for 30 sec - exiting
09:02:57 (74102): No heartbeat from core client for 30 sec - exiting
09:02:58 (74102): No heartbeat from core client for 30 sec - exiting
09:02:59 (74102): No heartbeat from core client for 30 sec - exiting
09:03:00 (74102): No heartbeat from core client for 30 sec - exiting
09:03:01 (74102): No heartbeat from core client for 30 sec - exiting
09:03:02 (74102): No heartbeat from core client for 30 sec - exiting
09:03:03 (74102): No heartbeat from core client for 30 sec - exiting
09:03:04 (74102): No heartbeat from core client for 30 sec - exiting
09:03:05 (74102): No heartbeat from core client for 30 sec - exiting
09:03:06 (74102): No heartbeat from core client for 30 sec - exiting
09:03:07 (74102): No heartbeat from core client for 30 sec - exiting
09:03:08 (74102): No heartbeat from core client for 30 sec - exiting
09:03:09 (74102): No heartbeat from core client for 30 sec - exiting
09:03:10 (74102): No heartbeat from core client for 30 sec - exiting
09:03:11 (74102): No heartbeat from core client for 30 sec - exiting
09:03:12 (74102): No heartbeat from core client for 30 sec - exiting
09:03:13 (74102): No heartbeat from core client for 30 sec - exiting
09:03:14 (74102): No heartbeat from core client for 30 sec - exiting
09:03:15 (74102): No heartbeat from core client for 30 sec - exiting
09:03:16 (74102): No heartbeat from core client for 30 sec - exiting
09:03:17 (74102): No heartbeat from core client for 30 sec - exiting
09:03:18 (74102): No heartbeat from core client for 30 sec - exiting
09:03:19 (74102): No heartbeat from core client for 30 sec - exiting
09:03:20 (74102): No heartbeat from core client for 30 sec - exiting
09:03:21 (74102): No heartbeat from core client for 30 sec - exiting
09:03:22 (74102): No heartbeat from core client for 30 sec - exiting
09:03:23 (74102): No heartbeat from core client for 30 sec - exiting
09:03:24 (74102): No heartbeat from core client for 30 sec - exiting
09:03:25 (74102): No heartbeat from core client for 30 sec - exiting
09:03:26 (74102): No heartbeat from core client for 30 sec - exiting
09:03:27 (74102): No heartbeat from core client for 30 sec - exiting
09:03:28 (74102): No heartbeat from core client for 30 sec - exiting
09:03:29 (74102): No heartbeat from core client for 30 sec - exiting
09:03:30 (74102): No heartbeat from core client for 30 sec - exiting
09:03:31 (74102): No heartbeat from core client for 30 sec - exiting
09:03:32 (74102): No heartbeat from core client for 30 sec - exiting
09:03:33 (74102): No heartbeat from core client for 30 sec - exiting
09:03:34 (74102): No heartbeat from core client for 30 sec - exiting
09:03:35 (74102): No heartbeat from core client for 30 sec - exiting
09:03:36 (74102): No heartbeat from core client for 30 sec - exiting
09:03:37 (74102): No heartbeat from core client for 30 sec - exiting
09:03:38 (74102): No heartbeat from core client for 30 sec - exiting
09:03:39 (74102): No heartbeat from core client for 30 sec - exiting
09:03:40 (74102): No heartbeat from core client for 30 sec - exiting
09:03:41 (74102): No heartbeat from core client for 30 sec - exiting
09:03:42 (74102): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:52:13 (92490): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:52:14 (92490): No heartbeat from core client for 30 sec - exiting
09:52:15 (92490): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
10:58:29 (8367): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:40:33 (23535): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:40:34 (23535): No heartbeat from core client for 30 sec - exiting
09:40:35 (23535): No heartbeat from core client for 30 sec - exiting
09:40:36 (23535): No heartbeat from core client for 30 sec - exiting
09:40:37 (23535): No heartbeat from core client for 30 sec - exiting
09:40:38 (23535): No heartbeat from core client for 30 sec - exiting
09:40:39 (23535): No heartbeat from core client for 30 sec - exiting
09:40:40 (23535): No heartbeat from core client for 30 sec - exiting
09:40:41 (23535): No heartbeat from core client for 30 sec - exiting
09:40:42 (23535): No heartbeat from core client for 30 sec - exiting
09:40:43 (23535): No heartbeat from core client for 30 sec - exiting
09:40:44 (23535): No heartbeat from core client for 30 sec - exiting
09:40:45 (23535): No heartbeat from core client for 30 sec - exiting
09:40:46 (23535): No heartbeat from core client for 30 sec - exiting
09:40:47 (23535): No heartbeat from core client for 30 sec - exiting
09:40:48 (23535): No heartbeat from core client for 30 sec - exiting
09:40:49 (23535): No heartbeat from core client for 30 sec - exiting
09:40:50 (23535): No heartbeat from core client for 30 sec - exiting
09:40:51 (23535): No heartbeat from core client for 30 sec - exiting
09:40:52 (23535): No heartbeat from core client for 30 sec - exiting
09:40:53 (23535): No heartbeat from core client for 30 sec - exiting
09:40:54 (23535): No heartbeat from core client for 30 sec - exiting
09:40:55 (23535): No heartbeat from core client for 30 sec - exiting
09:40:56 (23535): No heartbeat from core client for 30 sec - exiting
09:40:57 (23535): No heartbeat from core client for 30 sec - exiting
09:40:58 (23535): No heartbeat from core client for 30 sec - exiting
09:40:59 (23535): No heartbeat from core client for 30 sec - exiting
09:41:00 (23535): No heartbeat from core client for 30 sec - exiting
09:41:01 (23535): No heartbeat from core client for 30 sec - exiting
09:41:02 (23535): No heartbeat from core client for 30 sec - exiting
09:41:03 (23535): No heartbeat from core client for 30 sec - exiting
09:41:04 (23535): No heartbeat from core client for 30 sec - exiting
09:41:05 (23535): No heartbeat from core client for 30 sec - exiting
09:41:06 (23535): No heartbeat from core client for 30 sec - exiting
09:41:07 (23535): No heartbeat from core client for 30 sec - exiting
09:41:08 (23535): No heartbeat from core client for 30 sec - exiting
09:41:09 (23535): No heartbeat from core client for 30 sec - exiting
09:41:10 (23535): No heartbeat from core client for 30 sec - exiting
09:41:11 (23535): No heartbeat from core client for 30 sec - exiting
09:41:12 (23535): No heartbeat from core client for 30 sec - exiting
09:41:13 (23535): No heartbeat from core client for 30 sec - exiting
09:41:14 (23535): No heartbeat from core client for 30 sec - exiting
09:41:15 (23535): No heartbeat from core client for 30 sec - exiting
09:41:16 (23535): No heartbeat from core client for 30 sec - exiting
09:41:17 (23535): No heartbeat from core client for 30 sec - exiting
09:41:18 (23535): No heartbeat from core client for 30 sec - exiting
09:41:19 (23535): No heartbeat from core client for 30 sec - exiting
09:41:20 (23535): No heartbeat from core client for 30 sec - exiting
09:41:21 (23535): No heartbeat from core client for 30 sec - exiting
09:41:22 (23535): No heartbeat from core client for 30 sec - exiting
09:41:23 (23535): No heartbeat from core client for 30 sec - exiting
09:41:24 (23535): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Nov 2014 22:33:24 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 751,680 1,124,436 1.4959
25 Nov 2014 22:33:24 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 725,760 1,084,004 1.4936
25 Nov 2014 22:33:24 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 699,840 1,043,588 1.4912
25 Nov 2014 22:33:24 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 673,920 1,003,209 1.4886
25 Nov 2014 22:33:24 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 648,000 962,798 1.4858
25 Nov 2014 22:33:24 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 622,080 922,415 1.4828
25 Nov 2014 22:33:24 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 596,160 881,991 1.4795
25 Nov 2014 22:33:24 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 570,240 841,604 1.4759
25 Nov 2014 22:33:24 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 544,320 801,319 1.4721
17 Nov 2014 14:58:44 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 518,400 761,400 1.4688
17 Nov 2014 14:58:44 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 492,480 723,894 1.4699
17 Nov 2014 14:58:44 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 466,560 686,323 1.4710
17 Nov 2014 14:58:44 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 440,640 648,785 1.4724
17 Nov 2014 14:58:44 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 414,720 611,170 1.4737
17 Nov 2014 14:58:44 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 388,800 573,589 1.4753
17 Nov 2014 14:58:44 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 362,880 535,976 1.4770
17 Nov 2014 14:58:44 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 336,960 498,273 1.4787
17 Nov 2014 14:58:44 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 311,040 460,538 1.4806
17 Nov 2014 14:58:44 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 285,120 422,897 1.4832
17 Nov 2014 14:58:44 1326825 17354203 hadcm3n_xae5_1940_40_009149763_0 259,200 385,473 1.4872


©2024 climateprediction.net