climateprediction.net home page
Task 15633212

Task 15633212

Name hadcm3n_3dr0_1980_40_008319003_0
Workunit 8470138
Created 24 Feb 2013, 7:46:25 UTC
Sent 24 Feb 2013, 7:46:33 UTC
Report deadline 26 May 2013, 15:13:44 UTC
Received 5 May 2013, 9:41:39 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1224389
Run time 4 days 9 hours 52 min 37 sec
CPU time 3 days 20 hours 29 min 41 sec
Validate state Invalid
Credit 1,555.20
Device peak FLOPS 1.97 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>6.8.42</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:10:46 (3736): No heartbeat from core client for 30 sec - exiting
20:10:47 (3736): No heartbeat from core client for 30 sec - exiting
20:10:48 (3736): No heartbeat from core client for 30 sec - exiting
20:10:49 (3736): No heartbeat from core client for 30 sec - exiting
20:10:50 (3736): No heartbeat from core client for 30 sec - exiting
20:10:51 (3736): No heartbeat from core client for 30 sec - exiting
20:10:52 (3736): No heartbeat from core client for 30 sec - exiting
20:10:53 (3736): No heartbeat from core client for 30 sec - exiting
20:10:54 (3736): No heartbeat from core client for 30 sec - exiting
20:10:55 (3736): No heartbeat from core client for 30 sec - exiting
20:10:56 (3736): No heartbeat from core client for 30 sec - exiting
20:10:57 (3736): No heartbeat from core client for 30 sec - exiting
20:10:58 (3736): No heartbeat from core client for 30 sec - exiting
20:10:59 (3736): No heartbeat from core client for 30 sec - exiting
20:11:00 (3736): No heartbeat from core client for 30 sec - exiting
20:11:01 (3736): No heartbeat from core client for 30 sec - exiting
20:11:02 (3736): No heartbeat from core client for 30 sec - exiting
20:11:03 (3736): No heartbeat from core client for 30 sec - exiting
20:11:04 (3736): No heartbeat from core client for 30 sec - exiting
20:11:05 (3736): No heartbeat from core client for 30 sec - exiting
20:11:06 (3736): No heartbeat from core client for 30 sec - exiting
20:11:07 (3736): No heartbeat from core client for 30 sec - exiting
20:11:08 (3736): No heartbeat from core client for 30 sec - exiting
20:11:09 (3736): No heartbeat from core client for 30 sec - exiting
20:11:10 (3736): No heartbeat from core client for 30 sec - exiting
20:11:11 (3736): No heartbeat from core client for 30 sec - exiting
20:11:12 (3736): No heartbeat from core client for 30 sec - exiting
20:11:13 (3736): No heartbeat from core client for 30 sec - exiting
20:11:14 (3736): No heartbeat from core client for 30 sec - exiting
20:11:15 (3736): No heartbeat from core client for 30 sec - exiting
20:11:16 (3736): No heartbeat from core client for 30 sec - exiting
20:11:17 (3736): No heartbeat from core client for 30 sec - exiting
20:11:18 (3736): No heartbeat from core client for 30 sec - exiting
20:11:19 (3736): No heartbeat from core client for 30 sec - exiting
20:11:20 (3736): No heartbeat from core client for 30 sec - exiting
20:11:21 (3736): No heartbeat from core client for 30 sec - exiting
20:11:22 (3736): No heartbeat from core client for 30 sec - exiting
20:11:23 (3736): No heartbeat from core client for 30 sec - exiting
20:11:24 (3736): No heartbeat from core client for 30 sec - exiting
20:11:25 (3736): No heartbeat from core client for 30 sec - exiting
20:11:26 (3736): No heartbeat from core client for 30 sec - exiting
20:11:27 (3736): No heartbeat from core client for 30 sec - exiting
20:11:28 (3736): No heartbeat from core client for 30 sec - exiting
20:11:29 (3736): No heartbeat from core client for 30 sec - exiting
20:11:30 (3736): No heartbeat from core client for 30 sec - exiting
20:11:31 (3736): No heartbeat from core client for 30 sec - exiting
20:11:32 (3736): No heartbeat from core client for 30 sec - exiting
20:11:33 (3736): No heartbeat from core client for 30 sec - exiting
20:11:34 (3736): No heartbeat from core client for 30 sec - exiting
20:11:35 (3736): No heartbeat from core client for 30 sec - exiting
20:11:36 (3736): No heartbeat from core client for 30 sec - exiting
20:11:37 (3736): No heartbeat from core client for 30 sec - exiting
20:11:38 (3736): No heartbeat from core client for 30 sec - exiting
20:11:39 (3736): No heartbeat from core client for 30 sec - exiting
20:11:40 (3736): No heartbeat from core client for 30 sec - exiting
20:11:41 (3736): No heartbeat from core client for 30 sec - exiting
20:11:42 (3736): No heartbeat from core client for 30 sec - exiting
20:11:43 (3736): No heartbeat from core client for 30 sec - exiting
20:11:44 (3736): No heartbeat from core client for 30 sec - exiting
20:11:45 (3736): No heartbeat from core client for 30 sec - exiting
20:11:46 (3736): No heartbeat from core client for 30 sec - exiting
20:11:47 (3736): No heartbeat from core client for 30 sec - exiting
20:11:48 (3736): No heartbeat from core client for 30 sec - exiting
20:11:49 (3736): No heartbeat from core client for 30 sec - exiting
20:11:50 (3736): No heartbeat from core client for 30 sec - exiting
20:11:51 (3736): No heartbeat from core client for 30 sec - exiting
20:11:52 (3736): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:54:33 (5604): No heartbeat from core client for 30 sec - exiting
21:54:34 (5604): No heartbeat from core client for 30 sec - exiting
21:54:35 (5604): No heartbeat from core client for 30 sec - exiting
21:54:36 (5604): No heartbeat from core client for 30 sec - exiting
21:54:37 (5604): No heartbeat from core client for 30 sec - exiting
21:54:38 (5604): No heartbeat from core client for 30 sec - exiting
21:54:39 (5604): No heartbeat from core client for 30 sec - exiting
21:54:40 (5604): No heartbeat from core client for 30 sec - exiting
21:54:41 (5604): No heartbeat from core client for 30 sec - exiting
21:54:42 (5604): No heartbeat from core client for 30 sec - exiting
21:54:43 (5604): No heartbeat from core client for 30 sec - exiting
21:54:44 (5604): No heartbeat from core client for 30 sec - exiting
21:54:45 (5604): No heartbeat from core client for 30 sec - exiting
21:54:46 (5604): No heartbeat from core client for 30 sec - exiting
21:54:47 (5604): No heartbeat from core client for 30 sec - exiting
21:54:48 (5604): No heartbeat from core client for 30 sec - exiting
21:54:49 (5604): No heartbeat from core client for 30 sec - exiting
21:54:50 (5604): No heartbeat from core client for 30 sec - exiting
21:54:51 (5604): No heartbeat from core client for 30 sec - exiting
21:54:52 (5604): No heartbeat from core client for 30 sec - exiting
21:54:53 (5604): No heartbeat from core client for 30 sec - exiting
21:54:54 (5604): No heartbeat from core client for 30 sec - exiting
21:54:55 (5604): No heartbeat from core client for 30 sec - exiting
21:54:56 (5604): No heartbeat from core client for 30 sec - exiting
21:54:57 (5604): No heartbeat from core client for 30 sec - exiting
21:54:58 (5604): No heartbeat from core client for 30 sec - exiting
21:54:59 (5604): No heartbeat from core client for 30 sec - exiting
21:55:00 (5604): No heartbeat from core client for 30 sec - exiting
21:55:01 (5604): No heartbeat from core client for 30 sec - exiting
21:55:02 (5604): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:26:54 (4684): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:54:58 (4916): No heartbeat from core client for 30 sec - exiting
20:55:00 (4916): No heartbeat from core client for 30 sec - exiting
20:55:01 (4916): No heartbeat from core client for 30 sec - exiting
20:55:02 (4916): No heartbeat from core client for 30 sec - exiting
20:55:03 (4916): No heartbeat from core client for 30 sec - exiting
20:55:04 (4916): No heartbeat from core client for 30 sec - exiting
20:55:05 (4916): No heartbeat from core client for 30 sec - exiting
20:55:06 (4916): No heartbeat from core client for 30 sec - exiting
20:55:07 (4916): No heartbeat from core client for 30 sec - exiting
20:55:08 (4916): No heartbeat from core client for 30 sec - exiting
20:55:09 (4916): No heartbeat from core client for 30 sec - exiting
20:55:10 (4916): No heartbeat from core client for 30 sec - exiting
20:55:11 (4916): No heartbeat from core client for 30 sec - exiting
20:55:12 (4916): No heartbeat from core client for 30 sec - exiting
20:55:14 (4916): No heartbeat from core client for 30 sec - exiting
20:55:15 (4916): No heartbeat from core client for 30 sec - exiting
20:55:16 (4916): No heartbeat from core client for 30 sec - exiting
20:55:17 (4916): No heartbeat from core client for 30 sec - exiting
20:55:18 (4916): No heartbeat from core client for 30 sec - exiting
20:55:19 (4916): No heartbeat from core client for 30 sec - exiting
20:55:20 (4916): No heartbeat from core client for 30 sec - exiting
20:55:21 (4916): No heartbeat from core client for 30 sec - exiting
20:55:22 (4916): No heartbeat from core client for 30 sec - exiting
20:55:23 (4916): No heartbeat from core client for 30 sec - exiting
20:55:24 (4916): No heartbeat from core client for 30 sec - exiting
20:55:25 (4916): No heartbeat from core client for 30 sec - exiting
20:55:26 (4916): No heartbeat from core client for 30 sec - exiting
20:55:27 (4916): No heartbeat from core client for 30 sec - exiting
20:55:28 (4916): No heartbeat from core client for 30 sec - exiting
20:55:29 (4916): No heartbeat from core client for 30 sec - exiting
20:55:30 (4916): No heartbeat from core client for 30 sec - exiting
20:55:31 (4916): No heartbeat from core client for 30 sec - exiting
20:55:32 (4916): No heartbeat from core client for 30 sec - exiting
20:55:33 (4916): No heartbeat from core client for 30 sec - exiting
20:55:34 (4916): No heartbeat from core client for 30 sec - exiting
20:55:35 (4916): No heartbeat from core client for 30 sec - exiting
20:55:36 (4916): No heartbeat from core client for 30 sec - exiting
20:55:37 (4916): No heartbeat from core client for 30 sec - exiting
20:55:38 (4916): No heartbeat from core client for 30 sec - exiting
20:55:39 (4916): No heartbeat from core client for 30 sec - exiting
20:55:40 (4916): No heartbeat from core client for 30 sec - exiting
20:55:41 (4916): No heartbeat from core client for 30 sec - exiting
20:55:42 (4916): No heartbeat from core client for 30 sec - exiting
20:55:43 (4916): No heartbeat from core client for 30 sec - exiting
20:55:44 (4916): No heartbeat from core client for 30 sec - exiting
20:55:45 (4916): No heartbeat from core client for 30 sec - exiting
20:55:46 (4916): No heartbeat from core client for 30 sec - exiting
20:55:47 (4916): No heartbeat from core client for 30 sec - exiting
20:55:48 (4916): No heartbeat from core client for 30 sec - exiting
20:55:49 (4916): No heartbeat from core client for 30 sec - exiting
20:55:50 (4916): No heartbeat from core client for 30 sec - exiting
20:55:51 (4916): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7752, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20864, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9792, iMonCtr=1
Model crash detected, will try to restart...
Atmos Hold Restart file rename failed on atmos_restart.hold
21:51:45 (896): No heartbeat from core client for 30 sec - exiting
21:51:46 (896): No heartbeat from core client for 30 sec - exiting
21:51:47 (896): No heartbeat from core client for 30 sec - exiting
21:51:48 (896): No heartbeat from core client for 30 sec - exiting
21:51:49 (896): No heartbeat from core client for 30 sec - exiting
21:51:51 (896): No heartbeat from core client for 30 sec - exiting
21:51:52 (896): No heartbeat from core client for 30 sec - exiting
21:51:53 (896): No heartbeat from core client for 30 sec - exiting
21:51:54 (896): No heartbeat from core client for 30 sec - exiting
21:51:55 (896): No heartbeat from core client for 30 sec - exiting
21:51:56 (896): No heartbeat from core client for 30 sec - exiting
21:51:57 (896): No heartbeat from core client for 30 sec - exiting
21:51:58 (896): No heartbeat from core client for 30 sec - exiting
21:51:59 (896): No heartbeat from core client for 30 sec - exiting
21:52:00 (896): No heartbeat from core client for 30 sec - exiting
21:52:01 (896): No heartbeat from core client for 30 sec - exiting
21:52:03 (896): No heartbeat from core client for 30 sec - exiting
21:52:04 (896): No heartbeat from core client for 30 sec - exiting
21:52:05 (896): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:19:15 (8488): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:44:33 (4312): No heartbeat from core client for 30 sec - exiting
09:44:34 (4312): No heartbeat from core client for 30 sec - exiting
09:44:35 (4312): No heartbeat from core client for 30 sec - exiting
09:44:36 (4312): No heartbeat from core client for 30 sec - exiting
09:44:37 (4312): No heartbeat from core client for 30 sec - exiting
09:44:38 (4312): No heartbeat from core client for 30 sec - exiting
09:44:39 (4312): No heartbeat from core client for 30 sec - exiting
09:44:40 (4312): No heartbeat from core client for 30 sec - exiting
09:44:41 (4312): No heartbeat from core client for 30 sec - exiting
09:44:43 (4312): No heartbeat from core client for 30 sec - exiting
09:44:44 (4312): No heartbeat from core client for 30 sec - exiting
09:44:45 (4312): No heartbeat from core client for 30 sec - exiting
09:44:46 (4312): No heartbeat from core client for 30 sec - exiting
09:44:47 (4312): No heartbeat from core client for 30 sec - exiting
09:44:48 (4312): No heartbeat from core client for 30 sec - exiting
09:44:49 (4312): No heartbeat from core client for 30 sec - exiting
09:44:50 (4312): No heartbeat from core client for 30 sec - exiting
09:44:51 (4312): No heartbeat from core client for 30 sec - exiting
09:44:52 (4312): No heartbeat from core client for 30 sec - exiting
09:44:53 (4312): No heartbeat from core client for 30 sec - exiting
09:44:55 (4312): No heartbeat from core client for 30 sec - exiting
09:44:56 (4312): No heartbeat from core client for 30 sec - exiting
09:44:57 (4312): No heartbeat from core client for 30 sec - exiting
09:44:58 (4312): No heartbeat from core client for 30 sec - exiting
09:44:59 (4312): No heartbeat from core client for 30 sec - exiting
09:45:00 (4312): No heartbeat from core client for 30 sec - exiting
09:45:01 (4312): No heartbeat from core client for 30 sec - exiting
09:45:02 (4312): No heartbeat from core client for 30 sec - exiting
09:45:03 (4312): No heartbeat from core client for 30 sec - exiting
09:45:04 (4312): No heartbeat from core client for 30 sec - exiting
09:45:05 (4312): No heartbeat from core client for 30 sec - exiting
09:45:07 (4312): No heartbeat from core client for 30 sec - exiting
09:45:08 (4312): No heartbeat from core client for 30 sec - exiting
09:45:09 (4312): No heartbeat from core client for 30 sec - exiting
09:45:10 (4312): No heartbeat from core client for 30 sec - exiting
09:45:11 (4312): No heartbeat from core client for 30 sec - exiting
09:45:12 (4312): No heartbeat from core client for 30 sec - exiting
09:45:13 (4312): No heartbeat from core client for 30 sec - exiting
09:45:14 (4312): No heartbeat from core client for 30 sec - exiting
09:45:15 (4312): No heartbeat from core client for 30 sec - exiting
09:45:16 (4312): No heartbeat from core client for 30 sec - exiting
09:45:17 (4312): No heartbeat from core client for 30 sec - exiting
09:45:19 (4312): No heartbeat from core client for 30 sec - exiting
09:45:20 (4312): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:14:43 (3380): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
03 May 2013 15:10:34 1224389 15633212 hadcm3n_3dr0_1980_40_008319003_0 129,600 312,703 2.4128
26 Mar 2013 15:05:22 1224389 15633212 hadcm3n_3dr0_1980_40_008319003_0 103,680 251,266 2.4235
22 Mar 2013 15:10:26 1224389 15633212 hadcm3n_3dr0_1980_40_008319003_0 77,760 188,425 2.4232
16 Mar 2013 16:50:59 1224389 15633212 hadcm3n_3dr0_1980_40_008319003_0 51,840 126,147 2.4334
11 Mar 2013 12:24:24 1224389 15633212 hadcm3n_3dr0_1980_40_008319003_0 25,920 62,802 2.4229


©2024 cpdn.org