climateprediction.net home page
Task 17361927

Task 17361927

Name hadcm3n_sazj_1940_40_009109838_2
Workunit 9240174
Created 7 Nov 2014, 14:21:30 UTC
Sent 7 Nov 2014, 14:43:13 UTC
Report deadline 6 Feb 2015, 22:10:24 UTC
Received 10 Dec 2014, 17:25:57 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1331501
Run time 22 days 23 hours 20 min 36 sec
CPU time 21 days 7 hours 32 min 5 sec
Validate state Invalid
Credit 10,886.40
Device peak FLOPS 4.20 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.4.27</core_client_version>
<![CDATA[
<message>
The device does not recognize the command.
 (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:16:00 (3672): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
22:05:10 (3436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:05:11 (3436): No heartbeat from core client for 30 sec - exiting
22:05:12 (3436): No heartbeat from core client for 30 sec - exiting
22:05:13 (3436): No heartbeat from core client for 30 sec - exiting
22:05:14 (3436): No heartbeat from core client for 30 sec - exiting
22:05:15 (3436): No heartbeat from core client for 30 sec - exiting
22:05:16 (3436): No heartbeat from core client for 30 sec - exiting
22:05:17 (3436): No heartbeat from core client for 30 sec - exiting
22:05:18 (3436): No heartbeat from core client for 30 sec - exiting
22:05:19 (3436): No heartbeat from core client for 30 sec - exiting
22:05:20 (3436): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:22:34 (3364): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:22:35 (3364): No heartbeat from core client for 30 sec - exiting
21:22:36 (3364): No heartbeat from core client for 30 sec - exiting
21:22:37 (3364): No heartbeat from core client for 30 sec - exiting
21:22:38 (3364): No heartbeat from core client for 30 sec - exiting
21:22:39 (3364): No heartbeat from core client for 30 sec - exiting
21:22:40 (3364): No heartbeat from core client for 30 sec - exiting
21:22:41 (3364): No heartbeat from core client for 30 sec - exiting
21:22:42 (3364): No heartbeat from core client for 30 sec - exiting
21:22:43 (3364): No heartbeat from core client for 30 sec - exiting
21:22:44 (3364): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:27:45 (3236): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:27:46 (3236): No heartbeat from core client for 30 sec - exiting
15:27:47 (3236): No heartbeat from core client for 30 sec - exiting
15:27:48 (3236): No heartbeat from core client for 30 sec - exiting
15:27:49 (3236): No heartbeat from core client for 30 sec - exiting
15:27:50 (3236): No heartbeat from core client for 30 sec - exiting
15:27:51 (3236): No heartbeat from core client for 30 sec - exiting
15:27:52 (3236): No heartbeat from core client for 30 sec - exiting
15:27:53 (3236): No heartbeat from core client for 30 sec - exiting
15:27:54 (3236): No heartbeat from core client for 30 sec - exiting
15:27:55 (3236): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: INITDUMP: Wrong no of ocean prognostic fields                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

Model crashed: INITDUMP: Wrong no of ocean prognostic fields                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

Model crashed: INITDUMP: Wrong no of ocean prognostic fields                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: INITDUMP: Wrong no of ocean prognostic fields                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

Model crashed: INITDUMP: Wrong no of ocean prognostic fields                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

Model crashed: INITDUMP: Wrong no of ocean prognostic fields                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Nov 2014 15:28:02 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 907,200 980,017 1.0803
25 Nov 2014 07:37:53 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 881,280 953,298 1.0817
24 Nov 2014 17:29:38 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 855,360 926,858 1.0836
24 Nov 2014 08:12:21 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 829,440 900,113 1.0852
23 Nov 2014 17:07:10 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 803,520 872,970 1.0864
23 Nov 2014 07:44:50 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 777,600 846,798 1.0890
22 Nov 2014 16:44:52 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 751,680 819,761 1.0906
22 Nov 2014 08:49:21 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 725,760 793,232 1.0930
21 Nov 2014 16:57:32 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 699,840 766,774 1.0956
21 Nov 2014 09:01:37 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 673,920 740,528 1.0988
20 Nov 2014 21:10:59 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 648,000 714,224 1.1022
20 Nov 2014 13:32:48 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 622,080 688,097 1.1061
20 Nov 2014 05:26:31 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 596,160 662,543 1.1114
19 Nov 2014 16:09:33 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 570,240 637,376 1.1177
19 Nov 2014 08:40:37 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 544,320 611,954 1.1243
18 Nov 2014 18:36:07 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 518,400 586,988 1.1323
18 Nov 2014 11:00:26 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 492,480 561,231 1.1396
17 Nov 2014 20:50:56 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 466,560 535,261 1.1473
17 Nov 2014 12:49:19 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 440,640 507,313 1.1513
17 Nov 2014 04:20:52 1331501 17361927 hadcm3n_sazj_1940_40_009109838_2 414,720 478,525 1.1539


©2024 cpdn.org