Task 12992601

Name	hadcm3n_s7b9_1940_40_007300837_1
Workunit	7498261
Created	21 Jun 2011, 1:10:12 UTC
Sent	21 Jun 2011, 1:10:17 UTC
Report deadline	20 Sep 2011, 8:37:28 UTC
Received	30 Jun 2011, 17:23:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1035012
Run time	6 days 6 hours 25 min 11 sec
CPU time	5 days 15 hours 22 min 21 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	2.80 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> Il dispositivo non riconosce il comando. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 01:13:12 (5704): No heartbeat from core client for 30 sec - exiting 01:13:13 (5704): No heartbeat from core client for 30 sec - exiting 01:13:14 (5704): No heartbeat from core client for 30 sec - exiting 01:13:15 (5704): No heartbeat from core client for 30 sec - exiting 01:13:16 (5704): No heartbeat from core client for 30 sec - exiting 01:13:17 (5704): No heartbeat from core client for 30 sec - exiting 01:13:18 (5704): No heartbeat from core client for 30 sec - exiting 01:13:19 (5704): No heartbeat from core client for 30 sec - exiting 01:13:20 (5704): No heartbeat from core client for 30 sec - exiting 01:13:21 (5704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:21:26 (4820): No heartbeat from core client for 30 sec - exiting 06:21:27 (4820): No heartbeat from core client for 30 sec - exiting 06:21:28 (4820): No heartbeat from core client for 30 sec - exiting 06:21:29 (4820): No heartbeat from core client for 30 sec - exiting 06:21:30 (4820): No heartbeat from core client for 30 sec - exiting 06:21:31 (4820): No heartbeat from core client for 30 sec - exiting 06:21:32 (4820): No heartbeat from core client for 30 sec - exiting 06:21:33 (4820): No heartbeat from core client for 30 sec - exiting 06:21:34 (4820): No heartbeat from core client for 30 sec - exiting 06:21:35 (4820): No heartbeat from core client for 30 sec - exiting 06:21:36 (4820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:46:32 (5080): No heartbeat from core client for 30 sec - exiting 06:46:33 (5080): No heartbeat from core client for 30 sec - exiting 06:46:34 (5080): No heartbeat from core client for 30 sec - exiting 06:46:35 (5080): No heartbeat from core client for 30 sec - exiting 06:46:36 (5080): No heartbeat from core client for 30 sec - exiting 06:46:37 (5080): No heartbeat from core client for 30 sec - exiting 06:46:38 (5080): No heartbeat from core client for 30 sec - exiting 06:46:39 (5080): No heartbeat from core client for 30 sec - exiting 06:46:40 (5080): No heartbeat from core client for 30 sec - exiting 06:46:41 (5080): No heartbeat from core client for 30 sec - exiting 06:46:42 (5080): No heartbeat from core client for 30 sec - exiting 06:46:43 (5080): No heartbeat from core client for 30 sec - exiting 06:46:44 (5080): No heartbeat from core client for 30 sec - exiting 06:46:45 (5080): No heartbeat from core client for 30 sec - exiting 06:46:46 (5080): No heartbeat from core client for 30 sec - exiting 06:46:47 (5080): No heartbeat from core client for 30 sec - exiting 06:46:48 (5080): No heartbeat from core client for 30 sec - exiting 06:46:49 (5080): No heartbeat from core client for 30 sec - exiting 06:46:50 (5080): No heartbeat from core client for 30 sec - exiting 06:46:51 (5080): No heartbeat from core client for 30 sec - exiting 06:46:52 (5080): No heartbeat from core client for 30 sec - exiting 06:46:53 (5080): No heartbeat from core client for 30 sec - exiting 06:46:54 (5080): No heartbeat from core client for 30 sec - exiting 06:46:55 (5080): No heartbeat from core client for 30 sec - exiting 06:46:56 (5080): No heartbeat from core client for 30 sec - exiting 06:46:57 (5080): No heartbeat from core client for 30 sec - exiting 06:46:58 (5080): No heartbeat from core client for 30 sec - exiting 06:46:59 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:38:16 (5004): No heartbeat from core client for 30 sec - exiting 13:38:17 (5004): No heartbeat from core client for 30 sec - exiting 13:38:18 (5004): No heartbeat from core client for 30 sec - exiting 13:38:19 (5004): No heartbeat from core client for 30 sec - exiting 13:38:20 (5004): No heartbeat from core client for 30 sec - exiting 13:38:21 (5004): No heartbeat from core client for 30 sec - exiting 13:38:22 (5004): No heartbeat from core client for 30 sec - exiting 13:38:23 (5004): No heartbeat from core client for 30 sec - exiting 13:38:24 (5004): No heartbeat from core client for 30 sec - exiting 13:38:25 (5004): No heartbeat from core client for 30 sec - exiting 13:38:26 (5004): No heartbeat from core client for 30 sec - exiting 13:38:27 (5004): No heartbeat from core client for 30 sec - exiting 13:38:28 (5004): No heartbeat from core client for 30 sec - exiting 13:38:29 (5004): No heartbeat from core client for 30 sec - exiting 13:38:30 (5004): No heartbeat from core client for 30 sec - exiting 13:38:31 (5004): No heartbeat from core client for 30 sec - exiting 13:38:32 (5004): No heartbeat from core client for 30 sec - exiting 13:38:33 (5004): No heartbeat from core client for 30 sec - exiting 13:38:34 (5004): No heartbeat from core client for 30 sec - exiting 13:38:35 (5004): No heartbeat from core client for 30 sec - exiting 13:38:36 (5004): No heartbeat from core client for 30 sec - exiting 13:38:37 (5004): No heartbeat from core client for 30 sec - exiting 13:38:38 (5004): No heartbeat from core client for 30 sec - exiting 13:38:39 (5004): No heartbeat from core client for 30 sec - exiting 13:38:40 (5004): No heartbeat from core client for 30 sec - exiting 13:38:41 (5004): No heartbeat from core client for 30 sec - exiting 13:38:42 (5004): No heartbeat from core client for 30 sec - exiting 13:38:43 (5004): No heartbeat from core client for 30 sec - exiting 13:38:44 (5004): No heartbeat from core client for 30 sec - exiting 13:38:45 (5004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:28:12 (5028): No heartbeat from core client for 30 sec - exiting 02:28:13 (5028): No heartbeat from core client for 30 sec - exiting 02:28:14 (5028): No heartbeat from core client for 30 sec - exiting 02:28:15 (5028): No heartbeat from core client for 30 sec - exiting 02:28:16 (5028): No heartbeat from core client for 30 sec - exiting 02:28:17 (5028): No heartbeat from core client for 30 sec - exiting 02:28:18 (5028): No heartbeat from core client for 30 sec - exiting 02:28:19 (5028): No heartbeat from core client for 30 sec - exiting 02:28:20 (5028): No heartbeat from core client for 30 sec - exiting 02:28:21 (5028): No heartbeat from core client for 30 sec - exiting 02:28:22 (5028): No heartbeat from core client for 30 sec - exiting 02:28:23 (5028): No heartbeat from core client for 30 sec - exiting 02:28:24 (5028): No heartbeat from core client for 30 sec - exiting 02:28:25 (5028): No heartbeat from core client for 30 sec - exiting 02:28:26 (5028): No heartbeat from core client for 30 sec - exiting 02:28:27 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:40:35 (3472): No heartbeat from core client for 30 sec - exiting 06:40:36 (3472): No heartbeat from core client for 30 sec - exiting 06:40:37 (3472): No heartbeat from core client for 30 sec - exiting 06:40:38 (3472): No heartbeat from core client for 30 sec - exiting 06:40:39 (3472): No heartbeat from core client for 30 sec - exiting 06:40:40 (3472): No heartbeat from core client for 30 sec - exiting 06:40:41 (3472): No heartbeat from core client for 30 sec - exiting 06:40:42 (3472): No heartbeat from core client for 30 sec - exiting 06:40:43 (3472): No heartbeat from core client for 30 sec - exiting 06:40:44 (3472): No heartbeat from core client for 30 sec - exiting 06:40:45 (3472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:32:35 (3724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:18:12 (4748): No heartbeat from core client for 30 sec - exiting 07:18:13 (4748): No heartbeat from core client for 30 sec - exiting 07:18:14 (4748): No heartbeat from core client for 30 sec - exiting 07:18:15 (4748): No heartbeat from core client for 30 sec - exiting 07:18:16 (4748): No heartbeat from core client for 30 sec - exiting 07:18:17 (4748): No heartbeat from core client for 30 sec - exiting 07:18:18 (4748): No heartbeat from core client for 30 sec - exiting 07:18:19 (4748): No heartbeat from core client for 30 sec - exiting 07:18:20 (4748): No heartbeat from core client for 30 sec - exiting 07:18:21 (4748): No heartbeat from core client for 30 sec - exiting 07:18:22 (4748): No heartbeat from core client for 30 sec - exiting 07:18:23 (4748): No heartbeat from core client for 30 sec - exiting 07:18:24 (4748): No heartbeat from core client for 30 sec - exiting 07:18:25 (4748): No heartbeat from core client for 30 sec - exiting 07:18:26 (4748): No heartbeat from core client for 30 sec - exiting 07:18:27 (4748): No heartbeat from core client for 30 sec - exiting 07:18:28 (4748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:59:43 (4784): No heartbeat from core client for 30 sec - exiting 07:59:44 (4784): No heartbeat from core client for 30 sec - exiting 07:59:45 (4784): No heartbeat from core client for 30 sec - exiting 07:59:46 (4784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:53:27 (1284): No heartbeat from core client for 30 sec - exiting 06:53:28 (1284): No heartbeat from core client for 30 sec - exiting 06:53:29 (1284): No heartbeat from core client for 30 sec - exiting 06:53:30 (1284): No heartbeat from core client for 30 sec - exiting 06:53:31 (1284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:53:32 (1284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:16:18 (3160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5660, iMonCtr=1 Model crash detected, will try to restart... 01:45:26 (4864): No heartbeat from core client for 30 sec - exiting 01:45:27 (4864): No heartbeat from core client for 30 sec - exiting 01:45:28 (4864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:36:55 (6036): No heartbeat from core client for 30 sec - exiting 06:36:56 (6036): No heartbeat from core client for 30 sec - exiting 06:36:57 (6036): No heartbeat from core client for 30 sec - exiting 06:36:58 (6036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:40:52 (4072): No heartbeat from core client for 30 sec - exiting 07:40:53 (4072): No heartbeat from core client for 30 sec - exiting 07:40:54 (4072): No heartbeat from core client for 30 sec - exiting 07:40:55 (4072): No heartbeat from core client for 30 sec - exiting 07:40:56 (4072): No heartbeat from core client for 30 sec - exiting 07:40:57 (4072): No heartbeat from core client for 30 sec - exiting 07:40:58 (4072): No heartbeat from core client for 30 sec - exiting 07:40:59 (4072): No heartbeat from core client for 30 sec - exiting 07:41:00 (4072): No heartbeat from core client for 30 sec - exiting 07:41:01 (4072): No heartbeat from core client for 30 sec - exiting 07:41:02 (4072): No heartbeat from core client for 30 sec - exiting 07:41:03 (4072): No heartbeat from core client for 30 sec - exiting 07:41:04 (4072): No heartbeat from core client for 30 sec - exiting 07:41:05 (4072): No heartbeat from core client for 30 sec - exiting 07:41:06 (4072): No heartbeat from core client for 30 sec - exiting 07:41:07 (4072): No heartbeat from core client for 30 sec - exiting 07:41:08 (4072): No heartbeat from core client for 30 sec - exiting 07:41:09 (4072): No heartbeat from core client for 30 sec - exiting 07:41:10 (4072): No heartbeat from core client for 30 sec - exiting 07:41:11 (4072): No heartbeat from core client for 30 sec - exiting 07:41:12 (4072): No heartbeat from core client for 30 sec - exiting 07:41:13 (4072): No heartbeat from core client for 30 sec - exiting 07:41:14 (4072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:20:50 (5888): No heartbeat from core client for 30 sec - exiting 06:20:51 (5888): No heartbeat from core client for 30 sec - exiting 06:20:52 (5888): No heartbeat from core client for 30 sec - exiting 06:20:53 (5888): No heartbeat from core client for 30 sec - exiting 06:20:54 (5888): No heartbeat from core client for 30 sec - exiting 06:20:55 (5888): No heartbeat from core client for 30 sec - exiting 06:20:56 (5888): No heartbeat from core client for 30 sec - exiting 06:20:57 (5888): No heartbeat from core client for 30 sec - exiting 06:20:58 (5888): No heartbeat from core client for 30 sec - exiting 06:20:59 (5888): No heartbeat from core client for 30 sec - exiting 06:21:00 (5888): No heartbeat from core client for 30 sec - exiting 06:21:01 (5888): No heartbeat from core client for 30 sec - exiting 06:21:02 (5888): No heartbeat from core client for 30 sec - exiting 06:21:03 (5888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:37:01 (4848): No heartbeat from core client for 30 sec - exiting 17:37:02 (4848): No heartbeat from core client for 30 sec - exiting 17:37:03 (4848): No heartbeat from core client for 30 sec - exiting 17:37:04 (4848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:32 (3960): No heartbeat from core client for 30 sec - exiting 01:11:33 (3960): No heartbeat from core client for 30 sec - exiting 01:11:34 (3960): No heartbeat from core client for 30 sec - exiting 01:11:35 (3960): No heartbeat from core client for 30 sec - exiting 01:11:36 (3960): No heartbeat from core client for 30 sec - exiting 01:11:37 (3960): No heartbeat from core client for 30 sec - exiting 01:11:38 (3960): No heartbeat from core client for 30 sec - exiting 01:11:39 (3960): No heartbeat from core client for 30 sec - exiting 01:11:40 (3960): No heartbeat from core client for 30 sec - exiting 01:11:41 (3960): No heartbeat from core client for 30 sec - exiting 01:11:42 (3960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:57 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Jun 2011 15:29:47	1035012	12992601	hadcm3n_s7b9_1940_40_007300837_1	233,280	526,512	2.2570
29 Jun 2011 17:37:27	1035012	12992601	hadcm3n_s7b9_1940_40_007300837_1	207,360	469,092	2.2622
28 Jun 2011 17:17:03	1035012	12992601	hadcm3n_s7b9_1940_40_007300837_1	181,440	411,508	2.2680
27 Jun 2011 08:48:51	1035012	12992601	hadcm3n_s7b9_1940_40_007300837_1	155,520	352,368	2.2657
26 Jun 2011 07:03:58	1035012	12992601	hadcm3n_s7b9_1940_40_007300837_1	129,600	293,683	2.2661
25 Jun 2011 06:21:36	1035012	12992601	hadcm3n_s7b9_1940_40_007300837_1	103,680	233,332	2.2505
23 Jun 2011 20:28:19	1035012	12992601	hadcm3n_s7b9_1940_40_007300837_1	77,760	177,098	2.2775
22 Jun 2011 19:01:31	1035012	12992601	hadcm3n_s7b9_1940_40_007300837_1	51,840	117,943	2.2751
21 Jun 2011 20:55:54	1035012	12992601	hadcm3n_s7b9_1940_40_007300837_1	25,920	58,957	2.2746