climateprediction.net home page
Task 15489316

Task 15489316

Name hadcm3n_3hph_1940_40_008261179_0
Workunit 8416303
Created 20 Dec 2012, 21:02:47 UTC
Sent 20 Dec 2012, 21:04:22 UTC
Report deadline 22 Mar 2013, 4:31:33 UTC
Received 10 Jan 2013, 6:21:52 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1105487
Run time 13 days 23 hours 17 min 49 sec
CPU time 12 days 11 hours 57 min 42 sec
Validate state Invalid
Credit 7,776.00
Device peak FLOPS 3.04 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4176, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:15:36 (5300): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:15:37 (5300): No heartbeat from core client for 30 sec - exiting
21:15:38 (5300): No heartbeat from core client for 30 sec - exiting
21:15:39 (5300): No heartbeat from core client for 30 sec - exiting
21:15:40 (5300): No heartbeat from core client for 30 sec - exiting
21:15:41 (5300): No heartbeat from core client for 30 sec - exiting
21:15:42 (5300): No heartbeat from core client for 30 sec - exiting
21:15:43 (5300): No heartbeat from core client for 30 sec - exiting
21:15:44 (5300): No heartbeat from core client for 30 sec - exiting
21:15:45 (5300): No heartbeat from core client for 30 sec - exiting
21:15:46 (5300): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:15:31 (3552): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:01:09 (2000): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:51:41 (3828): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:51:21 (3860): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:57:28 (2768): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
10 Jan 2013 03:57:50 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 648,000 1,138,037 1.7562
09 Jan 2013 15:10:35 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 622,080 1,093,857 1.7584
08 Jan 2013 17:26:22 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 596,160 1,046,838 1.7560
07 Jan 2013 20:27:56 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 570,240 999,883 1.7534
06 Jan 2013 22:48:39 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 544,320 952,730 1.7503
05 Jan 2013 15:05:46 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 518,400 905,678 1.7471
04 Jan 2013 18:04:25 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 492,480 858,663 1.7435
03 Jan 2013 21:47:18 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 466,560 812,607 1.7417
03 Jan 2013 08:50:58 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 440,640 767,113 1.7409
02 Jan 2013 12:25:18 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 414,720 722,224 1.7415
01 Jan 2013 15:20:54 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 388,800 675,053 1.7362
01 Jan 2013 02:35:02 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 362,880 629,813 1.7356
31 Dec 2012 12:20:09 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 336,960 584,852 1.7357
30 Dec 2012 16:16:09 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 311,040 539,797 1.7355
30 Dec 2012 02:22:55 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 285,120 494,356 1.7339
29 Dec 2012 13:36:41 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 259,200 449,410 1.7338
28 Dec 2012 17:01:20 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 233,280 404,788 1.7352
28 Dec 2012 04:33:34 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 207,360 360,672 1.7394
27 Dec 2012 15:35:56 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 181,440 316,249 1.7430
26 Dec 2012 18:59:28 1105487 15489316 hadcm3n_3hph_1940_40_008261179_0 155,520 271,197 1.7438


©2024 climateprediction.net