climateprediction.net home page
Task 13821705

Task 13821705

Name hadcm3n_yeet_1980_40_007538189_4
Workunit 7735421
Created 26 Dec 2011, 17:21:23 UTC
Sent 26 Dec 2011, 17:21:29 UTC
Report deadline 27 Mar 2012, 0:48:40 UTC
Received 8 Jan 2012, 20:24:24 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1144522
Run time 12 days 19 hours 58 min 11 sec
CPU time 9 days 18 hours 24 min 10 sec
Validate state Invalid
Credit 8,087.04
Device peak FLOPS 2.97 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Ocean Restart file copy failed on yeetko.daj0290
Ocean Restart file copy failed on yeetko.daj02a0
Ocean Restart file copy failed on yeetko.daj06c0
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4652, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on yeetko.daj6bn0
Ocean Restart file copy failed on yeetko.daj6bo0
Ocean Restart file copy failed on yeetko.daj6bp0
Ocean Restart file copy failed on yeetko.daj6bq0
Ocean Restart file copy failed on yeetko.daj6br0
Ocean Restart file copy failed on yeetko.daj6bs0
Ocean Restart file copy failed on yeetko.daj6bt0
Ocean Restart file copy failed on yeetko.daj6bu0
Ocean Restart file copy failed on yeetko.daj6c10
Ocean Restart file copy failed on yeetko.daj6c20
Ocean Restart file copy failed on yeetko.daj6c30
Ocean Restart file copy failed on yeetko.daj6c40
Ocean Restart file copy failed on yeetko.daj6c50
Ocean Restart file copy failed on yeetko.daj6c60
Ocean Restart file copy failed on yeetko.daj6c70
Ocean Restart file copy failed on yeetko.daj6c80
Ocean Restart file copy failed on yeetko.daj6c90
Ocean Restart file copy failed on yeetko.daj6ca0
Ocean Restart file copy failed on yeetko.daj6cb0
Ocean Restart file copy failed on yeetko.daj6cc0
Ocean Restart file copy failed on yeetko.daj6cd0
Ocean Restart file copy failed on yeetko.daj6ce0
Ocean Restart file copy failed on yeetko.daj6cf0
Ocean Restart file copy failed on yeetko.daj6cg0
15:57:51 (3188): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:55:53 (4928): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:57:01 (5404): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:57:28 (5208): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:58:25 (6912): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on yeetko.dak1150
Ocean Restart file copy failed on yeetko.dak1160
Ocean Restart file copy failed on yeetko.dak1170
Ocean Restart file copy failed on yeetko.dak1180
Ocean Restart file copy failed on yeetko.dak1190
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
01:02:33 (5064): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:02:00 (5552): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:02:53 (6028): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:03:20 (5200): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jan 2012 13:41:02 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 673,920 1,051,853 1.5608
08 Jan 2012 02:43:41 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 648,000 1,012,902 1.5631
07 Jan 2012 15:48:42 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 622,080 973,999 1.5657
07 Jan 2012 04:51:27 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 596,160 934,970 1.5683
06 Jan 2012 17:50:25 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 570,240 895,971 1.5712
06 Jan 2012 07:07:42 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 544,320 857,355 1.5751
05 Jan 2012 19:59:14 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 518,400 818,428 1.5788
05 Jan 2012 14:56:02 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 492,480 780,640 1.5851
05 Jan 2012 14:56:02 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 466,560 741,636 1.5896
05 Jan 2012 14:56:02 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 440,640 702,635 1.5946
05 Jan 2012 14:56:02 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 414,720 663,686 1.6003
05 Jan 2012 14:56:02 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 388,800 624,849 1.6071
05 Jan 2012 14:56:02 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 362,880 585,904 1.6146
05 Jan 2012 14:56:02 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 336,960 546,906 1.6231
05 Jan 2012 14:56:02 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 311,040 507,971 1.6331
05 Jan 2012 14:56:02 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 285,120 468,992 1.6449
05 Jan 2012 14:56:02 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 259,200 430,027 1.6591
05 Jan 2012 14:56:02 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 233,280 391,054 1.6763
05 Jan 2012 14:56:02 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 207,360 352,278 1.6989
05 Jan 2012 14:56:02 1144522 13821705 hadcm3n_yeet_1980_40_007538189_4 181,440 313,255 1.7265


©2024 cpdn.org