Task 16146290

Name	hadcm3n_7wp1_1980_40_008453656_1
Workunit	8604512
Created	17 Dec 2013, 16:31:36 UTC
Sent	17 Dec 2013, 16:31:54 UTC
Report deadline	18 Mar 2014, 23:59:05 UTC
Received	21 Dec 2013, 13:18:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1304476
Run time	3 days 15 hours 56 min 4 sec
CPU time	3 days 8 hours 11 min 21 sec
Validate state	Invalid
Credit	4,354.56
Device peak FLOPS	3.51 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> デバイスがコマンドを認識できません。 (0x16) - exit code 22 (0x16) </message> <stderr_txt> 12:09:07 (6968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:59:00 (8012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:16:34 (8024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:26:36 (3084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:26:38 (3084): No heartbeat from core client for 30 sec - exiting 20:01:46 (2288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 03:37:47 (2968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:41:21 (8224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 04:14:10 (8364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 04:24:11 (8888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:31:02 (8308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:03:57 (3276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:00 (3276): No heartbeat from core client for 30 sec - exiting 12:06:11 (8844): No heartbeat from core client for 30 sec - exiting 12:06:12 (8844): No heartbeat from core client for 30 sec - exiting 12:06:13 (8844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:14:38 (8980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:17:05 (936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:17:07 (936): No heartbeat from core client for 30 sec - exiting 12:30:15 (8640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 12:38:21 (8652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:41:46 (8892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:43:40 (8352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:01:42 (8812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:01:49 (8812): No heartbeat from core client for 30 sec - exiting 14:18:27 (4088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:22:08 (8344): No heartbeat from core client for 30 sec - exiting 14:22:19 (8344): No heartbeat from core client for 30 sec - exiting 14:22:22 (8344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:26:06 (8900): No heartbeat from core client for 30 sec - exiting 14:26:41 (8900): No heartbeat from core client for 30 sec - exiting 14:26:43 (8900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:37:44 (1772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 14:48:39 (7540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:16:49 (7952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:16:52 (7952): No heartbeat from core client for 30 sec - exiting 15:21:12 (8292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 15:22:02 (7768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 15:47:24 (6188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:50:05 (7760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:52:38 (4052): No heartbeat from core client for 30 sec - exiting 15:52:41 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:14 (4832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:14:02 (4260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:16:24 (2888): No heartbeat from core client for 30 sec - exiting 16:16:27 (2888): No heartbeat from core client for 30 sec - exiting 16:16:29 (2888): No heartbeat from core client for 30 sec - exiting 16:16:31 (2888): No heartbeat from core client for 30 sec - exiting 16:16:34 (2888): No heartbeat from core client for 30 sec - exiting 16:16:36 (2888): No heartbeat from core client for 30 sec - exiting 16:16:37 (2888): No heartbeat from core client for 30 sec - exiting 16:16:40 (2888): No heartbeat from core client for 30 sec - exiting 16:16:41 (2888): No heartbeat from core client for 30 sec - exiting 16:16:42 (2888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:18:46 (6748): No heartbeat from core client for 30 sec - exiting 16:18:56 (6748): No heartbeat from core client for 30 sec - exiting 16:18:57 (6748): No heartbeat from core client for 30 sec - exiting 16:18:58 (6748): No heartbeat from core client for 30 sec - exiting 16:18:59 (6748): No heartbeat from core client for 30 sec - exiting 16:19:03 (6748): No heartbeat from core client for 30 sec - exiting 16:19:08 (6748): No heartbeat from core client for 30 sec - exiting 16:19:09 (6748): No heartbeat from core client for 30 sec - exiting 16:19:12 (6748): No heartbeat from core client for 30 sec - exiting 16:19:13 (6748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:39:59 (7420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:16:59 (5784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:17:00 (5784): No heartbeat from core client for 30 sec - exiting 17:23:55 (8912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 17:37:01 (8648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:39:47 (5088): No heartbeat from core client for 30 sec - exiting 17:39:49 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:08:03 (2908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:56 (1384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:33 (9180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:42:58 (4644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:46 (8696): No heartbeat from core client for 30 sec - exiting 19:47:54 (8696): No heartbeat from core client for 30 sec - exiting 19:47:55 (8696): No heartbeat from core client for 30 sec - exiting 19:47:59 (8696): No heartbeat from core client for 30 sec - exiting 19:48:00 (8696): No heartbeat from core client for 30 sec - exiting 19:48:01 (8696): No heartbeat from core client for 30 sec - exiting 19:48:11 (8696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:27 (8400): No heartbeat from core client for 30 sec - exiting 19:51:33 (8400): No heartbeat from core client for 30 sec - exiting 19:51:39 (8400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:53:54 (7128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:06 (7464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:11 (7464): No heartbeat from core client for 30 sec - exiting 20:49:12 (6440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 20:53:16 (7140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:53:19 (7140): No heartbeat from core client for 30 sec - exiting 20:55:36 (8816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:57:26 (5988): No heartbeat from core client for 30 sec - exiting 20:57:30 (5988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 21:12:50 (8448): No heartbeat from core client for 30 sec - exiting 21:12:51 (8448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:15:09 (7316): No heartbeat from core client for 30 sec - exiting 21:15:13 (7316): No heartbeat from core client for 30 sec - exiting 21:15:16 (7316): No heartbeat from core client for 30 sec - exiting 21:15:20 (7316): No heartbeat from core client for 30 sec - exiting 21:15:21 (7316): No heartbeat from core client for 30 sec - exiting 21:15:23 (7316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:05 (9072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:14 (4752): No heartbeat from core client for 30 sec - exiting 21:33:16 (4752): No heartbeat from core client for 30 sec - exiting 21:33:17 (4752): No heartbeat from core client for 30 sec - exiting 21:33:18 (4752): No heartbeat from core client for 30 sec - exiting 21:33:26 (4752): No heartbeat from core client for 30 sec - exiting 21:33:27 (4752): No heartbeat from core client for 30 sec - exiting 21:33:35 (4752): No heartbeat from core client for 30 sec - exiting 21:33:36 (4752): No heartbeat from core client for 30 sec - exiting 21:33:37 (4752): No heartbeat from core client for 30 sec - exiting 21:33:45 (4752): No heartbeat from core client for 30 sec - exiting 21:33:46 (4752): No heartbeat from core client for 30 sec - exiting 21:33:53 (4752): No heartbeat from core client for 30 sec - exiting 21:33:54 (4752): No heartbeat from core client for 30 sec - exiting 21:33:58 (4752): No heartbeat from core client for 30 sec - exiting 21:34:03 (4752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:40:37 (8324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:40:45 (8324): No heartbeat from core client for 30 sec - exiting 21:43:15 (8036): No heartbeat from core client for 30 sec - exiting 21:43:16 (8036): No heartbeat from core client for 30 sec - exiting 21:43:21 (8036): No heartbeat from core client for 30 sec - exiting 21:43:22 (8036): No heartbeat from core client for 30 sec - exiting 21:43:23 (8036): No heartbeat from core client for 30 sec - exiting 21:43:26 (8036): No heartbeat from core client for 30 sec - exiting 21:43:27 (8036): No heartbeat from core client for 30 sec - exiting 21:43:33 (8036): No heartbeat from core client for 30 sec - exiting 21:43:34 (8036): No heartbeat from core client for 30 sec - exiting 21:43:35 (8036): No heartbeat from core client for 30 sec - exiting 21:43:36 (8036): No heartbeat from core client for 30 sec - exiting 21:43:39 (8036): No heartbeat from core client for 30 sec - exiting 21:43:40 (8036): No heartbeat from core client for 30 sec - exiting 21:43:41 (8036): No heartbeat from core client for 30 sec - exiting 21:43:43 (8036): No heartbeat from core client for 30 sec - exiting 21:43:44 (8036): No heartbeat from core client for 30 sec - exiting 21:43:52 (8036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:46:34 (6992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:46:39 (6992): No heartbeat from core client for 30 sec - exiting 21:48:33 (4012): No heartbeat from core client for 30 sec - exiting 21:48:35 (4012): No heartbeat from core client for 30 sec - exiting 21:48:37 (4012): No heartbeat from core client for 30 sec - exiting 21:48:40 (4012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:56:17 (7956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:59:19 (6380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:11:52 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9176, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9176, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9176, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9176, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9176, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9176, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Dec 2013 09:51:37	1304476	16146290	hadcm3n_7wp1_1980_40_008453656_1	362,880	282,811	0.7794
21 Dec 2013 01:14:30	1304476	16146290	hadcm3n_7wp1_1980_40_008453656_1	336,960	263,204	0.7811
20 Dec 2013 18:52:53	1304476	16146290	hadcm3n_7wp1_1980_40_008453656_1	311,040	243,051	0.7814
20 Dec 2013 13:01:56	1304476	16146290	hadcm3n_7wp1_1980_40_008453656_1	285,120	222,850	0.7816
20 Dec 2013 07:30:39	1304476	16146290	hadcm3n_7wp1_1980_40_008453656_1	259,200	202,483	0.7812
20 Dec 2013 00:43:20	1304476	16146290	hadcm3n_7wp1_1980_40_008453656_1	233,280	182,270	0.7813
19 Dec 2013 18:08:53	1304476	16146290	hadcm3n_7wp1_1980_40_008453656_1	207,360	162,106	0.7818
19 Dec 2013 13:04:37	1304476	16146290	hadcm3n_7wp1_1980_40_008453656_1	181,440	141,841	0.7818
19 Dec 2013 07:05:00	1304476	16146290	hadcm3n_7wp1_1980_40_008453656_1	155,520	121,798	0.7832
19 Dec 2013 00:42:53	1304476	16146290	hadcm3n_7wp1_1980_40_008453656_1	129,600	102,023	0.7872
18 Dec 2013 18:05:32	1304476	16146290	hadcm3n_7wp1_1980_40_008453656_1	103,680	81,607	0.7871
18 Dec 2013 12:53:17	1304476	16146290	hadcm3n_7wp1_1980_40_008453656_1	77,760	61,186	0.7869
18 Dec 2013 06:21:17	1304476	16146290	hadcm3n_7wp1_1980_40_008453656_1	51,840	40,581	0.7828
17 Dec 2013 23:18:46	1304476	16146290	hadcm3n_7wp1_1980_40_008453656_1	25,920	20,216	0.7799