Task 15648291

Name	hadcm3n_4g6j_1940_40_008308973_1
Workunit	8460108
Created	4 Mar 2013, 2:33:49 UTC
Sent	4 Mar 2013, 2:34:03 UTC
Report deadline	3 Jun 2013, 10:01:14 UTC
Received	8 Mar 2013, 1:31:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1232298
Run time	2 days 23 hours 21 min 20 sec
CPU time	2 days 15 hours 29 min 46 sec
Validate state	Invalid
Credit	1,555.20
Device peak FLOPS	2.98 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.52</core_client_version> <![CDATA[ <message> デバイスがコマンドを認識できません。 (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:03:53 (5276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:14:25 (3264): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 07:53:06 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:53:55 (6232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:53 (3208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:59:29 (4320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:01:35 (388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:57 (1384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:08 (1384): No heartbeat from core client for 30 sec - exiting 19:44:09 (1384): No heartbeat from core client for 30 sec - exiting 19:44:10 (1384): No heartbeat from core client for 30 sec - exiting 21:10:32 (5204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:10:52 (5204): No heartbeat from core client for 30 sec - exiting 21:10:53 (5204): No heartbeat from core client for 30 sec - exiting 21:10:54 (5204): No heartbeat from core client for 30 sec - exiting 21:10:55 (5204): No heartbeat from core client for 30 sec - exiting 21:10:56 (5204): No heartbeat from core client for 30 sec - exiting 21:10:57 (5204): No heartbeat from core client for 30 sec - exiting 21:10:58 (5204): No heartbeat from core client for 30 sec - exiting 21:10:59 (5204): No heartbeat from core client for 30 sec - exiting 21:11:00 (5204): No heartbeat from core client for 30 sec - exiting 01:14:39 (6232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:15:07 (6232): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 06:11:16 (6200): No heartbeat from core client for 30 sec - exiting 06:11:17 (6200): No heartbeat from core client for 30 sec - exiting 06:11:19 (6200): No heartbeat from core client for 30 sec - exiting 06:11:20 (6200): No heartbeat from core client for 30 sec - exiting 06:11:21 (6200): No heartbeat from core client for 30 sec - exiting 06:11:22 (6200): No heartbeat from core client for 30 sec - exiting 06:11:23 (6200): No heartbeat from core client for 30 sec - exiting 06:11:24 (6200): No heartbeat from core client for 30 sec - exiting 06:11:25 (6200): No heartbeat from core client for 30 sec - exiting 06:11:26 (6200): No heartbeat from core client for 30 sec - exiting 06:11:27 (6200): No heartbeat from core client for 30 sec - exiting 06:11:28 (6200): No heartbeat from core client for 30 sec - exiting 06:11:29 (6200): No heartbeat from core client for 30 sec - exiting 06:11:31 (6200): No heartbeat from core client for 30 sec - exiting 06:11:32 (6200): No heartbeat from core client for 30 sec - exiting 06:11:33 (6200): No heartbeat from core client for 30 sec - exiting 06:11:34 (6200): No heartbeat from core client for 30 sec - exiting 06:11:35 (6200): No heartbeat from core client for 30 sec - exiting 06:11:36 (6200): No heartbeat from core client for 30 sec - exiting 06:11:37 (6200): No heartbeat from core client for 30 sec - exiting 06:11:38 (6200): No heartbeat from core client for 30 sec - exiting 06:11:39 (6200): No heartbeat from core client for 30 sec - exiting 06:11:40 (6200): No heartbeat from core client for 30 sec - exiting 06:11:41 (6200): No heartbeat from core client for 30 sec - exiting 06:11:43 (6200): No heartbeat from core client for 30 sec - exiting 06:11:44 (6200): No heartbeat from core client for 30 sec - exiting 06:11:45 (6200): No heartbeat from core client for 30 sec - exiting 06:11:46 (6200): No heartbeat from core client for 30 sec - exiting 06:11:47 (6200): No heartbeat from core client for 30 sec - exiting 06:11:48 (6200): No heartbeat from core client for 30 sec - exiting 06:11:49 (6200): No heartbeat from core client for 30 sec - exiting 06:11:50 (6200): No heartbeat from core client for 30 sec - exiting 06:11:51 (6200): No heartbeat from core client for 30 sec - exiting 06:11:52 (6200): No heartbeat from core client for 30 sec - exiting 06:11:53 (6200): No heartbeat from core client for 30 sec - exiting 06:11:55 (6200): No heartbeat from core client for 30 sec - exiting 06:11:56 (6200): No heartbeat from core client for 30 sec - exiting 06:11:57 (6200): No heartbeat from core client for 30 sec - exiting 06:11:58 (6200): No heartbeat from core client for 30 sec - exiting 06:11:59 (6200): No heartbeat from core client for 30 sec - exiting 06:12:00 (6200): No heartbeat from core client for 30 sec - exiting 06:12:01 (6200): No heartbeat from core client for 30 sec - exiting 06:12:02 (6200): No heartbeat from core client for 30 sec - exiting 06:12:03 (6200): No heartbeat from core client for 30 sec - exiting 06:12:04 (6200): No heartbeat from core client for 30 sec - exiting 06:12:05 (6200): No heartbeat from core client for 30 sec - exiting 06:12:07 (6200): No heartbeat from core client for 30 sec - exiting 06:12:08 (6200): No heartbeat from core client for 30 sec - exiting 06:12:09 (6200): No heartbeat from core client for 30 sec - exiting 06:12:10 (6200): No heartbeat from core client for 30 sec - exiting 06:12:11 (6200): No heartbeat from core client for 30 sec - exiting 06:12:12 (6200): No heartbeat from core client for 30 sec - exiting 06:12:13 (6200): No heartbeat from core client for 30 sec - exiting 06:12:14 (6200): No heartbeat from core client for 30 sec - exiting 06:12:15 (6200): No heartbeat from core client for 30 sec - exiting 06:12:16 (6200): No heartbeat from core client for 30 sec - exiting 06:12:18 (6200): No heartbeat from core client for 30 sec - exiting 06:12:19 (6200): No heartbeat from core client for 30 sec - exiting 06:12:20 (6200): No heartbeat from core client for 30 sec - exiting 06:12:21 (6200): No heartbeat from core client for 30 sec - exiting 06:12:22 (6200): No heartbeat from core client for 30 sec - exiting 06:12:23 (6200): No heartbeat from core client for 30 sec - exiting 06:12:24 (6200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:34:03 (1512): No heartbeat from core client for 30 sec - exiting 06:34:08 (1512): No heartbeat from core client for 30 sec - exiting 06:34:09 (1512): No heartbeat from core client for 30 sec - exiting 06:34:10 (1512): No heartbeat from core client for 30 sec - exiting 06:34:11 (1512): No heartbeat from core client for 30 sec - exiting 06:34:12 (1512): No heartbeat from core client for 30 sec - exiting 06:34:13 (1512): No heartbeat from core client for 30 sec - exiting 06:34:14 (1512): No heartbeat from core client for 30 sec - exiting 06:34:15 (1512): No heartbeat from core client for 30 sec - exiting 06:34:16 (1512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:56:42 (3884): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:12:45 (2584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:34:22 (6964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:34:23 (6964): No heartbeat from core client for 30 sec - exiting 22:34:56 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:08 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:58:41 (3016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:24:04 (3596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:24:05 (3596): No heartbeat from core client for 30 sec - exiting 23:24:06 (3596): No heartbeat from core client for 30 sec - exiting 23:24:07 (3596): No heartbeat from core client for 30 sec - exiting 23:24:08 (3596): No heartbeat from core client for 30 sec - exiting 23:24:09 (3596): No heartbeat from core client for 30 sec - exiting 23:24:10 (3596): No heartbeat from core client for 30 sec - exiting 23:24:11 (3596): No heartbeat from core client for 30 sec - exiting 23:24:13 (3596): No heartbeat from core client for 30 sec - exiting 23:24:14 (3596): No heartbeat from core client for 30 sec - exiting 23:24:15 (3596): No heartbeat from core client for 30 sec - exiting 23:25:28 (2672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:25:46 (2672): No heartbeat from core client for 30 sec - exiting 23:25:47 (2672): No heartbeat from core client for 30 sec - exiting 23:25:48 (2672): No heartbeat from core client for 30 sec - exiting 23:25:49 (2672): No heartbeat from core client for 30 sec - exiting 23:25:50 (2672): No heartbeat from core client for 30 sec - exiting 23:25:51 (2672): No heartbeat from core client for 30 sec - exiting 23:25:52 (2672): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 23:27:47 (2000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 01:24:14 (6260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:24:15 (6260): No heartbeat from core client for 30 sec - exiting 01:24:16 (6260): No heartbeat from core client for 30 sec - exiting 01:24:17 (6260): No heartbeat from core client for 30 sec - exiting 01:24:18 (6260): No heartbeat from core client for 30 sec - exiting 01:24:19 (6260): No heartbeat from core client for 30 sec - exiting 01:24:20 (6260): No heartbeat from core client for 30 sec - exiting 01:24:21 (6260): No heartbeat from core client for 30 sec - exiting 01:24:22 (6260): No heartbeat from core client for 30 sec - exiting 01:24:23 (6260): No heartbeat from core client for 30 sec - exiting 01:24:24 (6260): No heartbeat from core client for 30 sec - exiting 01:25:56 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:25:59 (5900): No heartbeat from core client for 30 sec - exiting 01:26:00 (5900): No heartbeat from core client for 30 sec - exiting 01:26:01 (5900): No heartbeat from core client for 30 sec - exiting 01:26:02 (5900): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 01:27:31 (5084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4784, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4784, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4784, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4784, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4784, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4784, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish 03:26:33 (5912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:15:05 (3424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... 09:59:57 (5824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:21:42 (6468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:21:54 (6468): No heartbeat from core client for 30 sec - exiting 15:21:55 (6468): No heartbeat from core client for 30 sec - exiting 15:21:56 (6468): No heartbeat from core client for 30 sec - exiting 15:21:57 (6468): No heartbeat from core client for 30 sec - exiting 15:21:58 (6468): No heartbeat from core client for 30 sec - exiting 15:21:59 (6468): No heartbeat from core client for 30 sec - exiting 15:22:00 (6468): No heartbeat from core client for 30 sec - exiting 15:22:01 (6468): No heartbeat from core client for 30 sec - exiting 15:22:02 (6468): No heartbeat from core client for 30 sec - exiting 15:22:03 (6468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:59:02 (5424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:30:01 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:30:11 (4944): No heartbeat from core client for 30 sec - exiting 01:30:12 (4944): No heartbeat from core client for 30 sec - exiting 01:30:13 (4944): No heartbeat from core client for 30 sec - exiting 01:30:14 (4944): No heartbeat from core client for 30 sec - exiting 01:30:15 (4944): No heartbeat from core client for 30 sec - exiting 01:57:39 (6192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 02:25:20 (2724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:21 (2724): No heartbeat from core client for 30 sec - exiting 02:25:22 (2724): No heartbeat from core client for 30 sec - exiting 02:25:23 (2724): No heartbeat from core client for 30 sec - exiting 02:25:24 (2724): No heartbeat from core client for 30 sec - exiting 02:25:25 (2724): No heartbeat from core client for 30 sec - exiting 02:25:26 (2724): No heartbeat from core client for 30 sec - exiting 02:25:27 (2724): No heartbeat from core client for 30 sec - exiting 02:25:29 (2724): No heartbeat from core client for 30 sec - exiting 02:25:30 (2724): No heartbeat from core client for 30 sec - exiting 02:25:31 (2724): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Mar 2013 11:21:21	1232298	15648291	hadcm3n_4g6j_1940_40_008308973_1	129,600	149,591	1.1543
05 Mar 2013 22:38:18	1232298	15648291	hadcm3n_4g6j_1940_40_008308973_1	103,680	119,800	1.1555
05 Mar 2013 13:35:08	1232298	15648291	hadcm3n_4g6j_1940_40_008308973_1	77,760	90,037	1.1579
05 Mar 2013 02:34:08	1232298	15648291	hadcm3n_4g6j_1940_40_008308973_1	51,840	60,094	1.1592
04 Mar 2013 11:34:16	1232298	15648291	hadcm3n_4g6j_1940_40_008308973_1	25,920	30,184	1.1645