Task 15619118

Name	hadcm3n_zb76_1880_40_008251747_3
Workunit	8406871
Created	22 Feb 2013, 2:39:35 UTC
Sent	22 Feb 2013, 2:39:47 UTC
Report deadline	24 May 2013, 10:06:58 UTC
Received	27 Feb 2013, 3:03:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1259079
Run time	3 days 19 hours 36 min 22 sec
CPU time	3 days 10 hours 27 min 41 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.64 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 22:29:39 (6560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:40 (6560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 03:03:15 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:04:47 (7300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:05:48 (380): No heartbeat from core client for 30 sec - exiting 03:05:49 (380): No heartbeat from core client for 30 sec - exiting 03:05:50 (380): No heartbeat from core client for 30 sec - exiting 03:05:51 (380): No heartbeat from core client for 30 sec - exiting 03:05:52 (380): No heartbeat from core client for 30 sec - exiting 03:05:53 (380): No heartbeat from core client for 30 sec - exiting 03:05:54 (380): No heartbeat from core client for 30 sec - exiting 03:05:55 (380): No heartbeat from core client for 30 sec - exiting 03:05:56 (380): No heartbeat from core client for 30 sec - exiting 03:05:57 (380): No heartbeat from core client for 30 sec - exiting 03:05:58 (380): No heartbeat from core client for 30 sec - exiting 03:05:59 (380): No heartbeat from core client for 30 sec - exiting 03:06:00 (380): No heartbeat from core client for 30 sec - exiting 03:06:01 (380): No heartbeat from core client for 30 sec - exiting 03:06:02 (380): No heartbeat from core client for 30 sec - exiting 03:06:03 (380): No heartbeat from core client for 30 sec - exiting 03:06:04 (380): No heartbeat from core client for 30 sec - exiting 03:06:05 (380): No heartbeat from core client for 30 sec - exiting 03:06:06 (380): No heartbeat from core client for 30 sec - exiting 03:06:07 (380): No heartbeat from core client for 30 sec - exiting 03:06:08 (380): No heartbeat from core client for 30 sec - exiting 03:06:09 (380): No heartbeat from core client for 30 sec - exiting 03:06:10 (380): No heartbeat from core client for 30 sec - exiting 03:06:11 (380): No heartbeat from core client for 30 sec - exiting 03:06:12 (380): No heartbeat from core client for 30 sec - exiting 03:06:13 (380): No heartbeat from core client for 30 sec - exiting 03:06:14 (380): No heartbeat from core client for 30 sec - exiting 03:06:15 (380): No heartbeat from core client for 30 sec - exiting 03:06:16 (380): No heartbeat from core client for 30 sec - exiting 03:06:17 (380): No heartbeat from core client for 30 sec - exiting 03:06:18 (380): No heartbeat from core client for 30 sec - exiting 03:06:19 (380): No heartbeat from core client for 30 sec - exiting 03:06:20 (380): No heartbeat from core client for 30 sec - exiting 03:06:21 (380): No heartbeat from core client for 30 sec - exiting 03:06:22 (380): No heartbeat from core client for 30 sec - exiting 03:06:23 (380): No heartbeat from core client for 30 sec - exiting 03:06:24 (380): No heartbeat from core client for 30 sec - exiting 03:06:25 (380): No heartbeat from core client for 30 sec - exiting 03:06:26 (380): No heartbeat from core client for 30 sec - exiting 03:06:27 (380): No heartbeat from core client for 30 sec - exiting 03:06:28 (380): No heartbeat from core client for 30 sec - exiting 03:06:29 (380): No heartbeat from core client for 30 sec - exiting 03:06:30 (380): No heartbeat from core client for 30 sec - exiting 03:06:31 (380): No heartbeat from core client for 30 sec - exiting 03:06:32 (380): No heartbeat from core client for 30 sec - exiting 03:06:33 (380): No heartbeat from core client for 30 sec - exiting 03:06:34 (380): No heartbeat from core client for 30 sec - exiting 03:06:35 (380): No heartbeat from core client for 30 sec - exiting 03:06:36 (380): No heartbeat from core client for 30 sec - exiting 03:06:37 (380): No heartbeat from core client for 30 sec - exiting 03:06:38 (380): No heartbeat from core client for 30 sec - exiting 03:06:39 (380): No heartbeat from core client for 30 sec - exiting 03:06:40 (380): No heartbeat from core client for 30 sec - exiting 03:06:41 (380): No heartbeat from core client for 30 sec - exiting 03:06:42 (380): No heartbeat from core client for 30 sec - exiting 03:06:43 (380): No heartbeat from core client for 30 sec - exiting 03:06:44 (380): No heartbeat from core client for 30 sec - exiting 03:06:45 (380): No heartbeat from core client for 30 sec - exiting 03:06:46 (380): No heartbeat from core client for 30 sec - exiting 03:06:47 (380): No heartbeat from core client for 30 sec - exiting 03:06:48 (380): No heartbeat from core client for 30 sec - exiting 03:06:49 (380): No heartbeat from core client for 30 sec - exiting 03:06:50 (380): No heartbeat from core client for 30 sec - exiting 03:06:51 (380): No heartbeat from core client for 30 sec - exiting 03:06:52 (380): No heartbeat from core client for 30 sec - exiting 03:06:53 (380): No heartbeat from core client for 30 sec - exiting 03:06:54 (380): No heartbeat from core client for 30 sec - exiting 03:06:55 (380): No heartbeat from core client for 30 sec - exiting 03:06:56 (380): No heartbeat from core client for 30 sec - exiting 03:06:57 (380): No heartbeat from core client for 30 sec - exiting 03:06:58 (380): No heartbeat from core client for 30 sec - exiting 03:06:59 (380): No heartbeat from core client for 30 sec - exiting 03:07:00 (380): No heartbeat from core client for 30 sec - exiting 03:07:01 (380): No heartbeat from core client for 30 sec - exiting 03:07:02 (380): No heartbeat from core client for 30 sec - exiting 03:07:03 (380): No heartbeat from core client for 30 sec - exiting 03:07:04 (380): No heartbeat from core client for 30 sec - exiting 03:07:05 (380): No heartbeat from core client for 30 sec - exiting 03:07:06 (380): No heartbeat from core client for 30 sec - exiting 03:07:07 (380): No heartbeat from core client for 30 sec - exiting 03:07:08 (380): No heartbeat from core client for 30 sec - exiting 03:07:09 (380): No heartbeat from core client for 30 sec - exiting 03:07:10 (380): No heartbeat from core client for 30 sec - exiting 03:07:11 (380): No heartbeat from core client for 30 sec - exiting 03:07:12 (380): No heartbeat from core client for 30 sec - exiting 03:07:13 (380): No heartbeat from core client for 30 sec - exiting 03:07:14 (380): No heartbeat from core client for 30 sec - exiting 03:07:15 (380): No heartbeat from core client for 30 sec - exiting 03:07:16 (380): No heartbeat from core client for 30 sec - exiting 03:07:17 (380): No heartbeat from core client for 30 sec - exiting 03:07:18 (380): No heartbeat from core client for 30 sec - exiting 03:07:19 (380): No heartbeat from core client for 30 sec - exiting 03:07:20 (380): No heartbeat from core client for 30 sec - exiting 03:07:21 (380): No heartbeat from core client for 30 sec - exiting 03:07:22 (380): No heartbeat from core client for 30 sec - exiting 03:07:23 (380): No heartbeat from core client for 30 sec - exiting 03:07:24 (380): No heartbeat from core client for 30 sec - exiting 03:07:25 (380): No heartbeat from core client for 30 sec - exiting 03:07:26 (380): No heartbeat from core client for 30 sec - exiting 03:07:27 (380): No heartbeat from core client for 30 sec - exiting 03:07:28 (380): No heartbeat from core client for 30 sec - exiting 03:07:29 (380): No heartbeat from core client for 30 sec - exiting 03:07:30 (380): No heartbeat from core client for 30 sec - exiting 03:07:31 (380): No heartbeat from core client for 30 sec - exiting 03:07:32 (380): No heartbeat from core client for 30 sec - exiting 03:07:33 (380): No heartbeat from core client for 30 sec - exiting 03:07:34 (380): No heartbeat from core client for 30 sec - exiting 03:07:35 (380): No heartbeat from core client for 30 sec - exiting 03:07:36 (380): No heartbeat from core client for 30 sec - exiting 03:07:37 (380): No heartbeat from core client for 30 sec - exiting 03:07:38 (380): No heartbeat from core client for 30 sec - exiting 03:07:39 (380): No heartbeat from core client for 30 sec - exiting 03:07:40 (380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:41 (380): No heartbeat from core client for 30 sec - exiting 03:09:20 (7132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:12:09 (3744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:13:20 (3508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:17:10 (7404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:17:11 (7404): No heartbeat from core client for 30 sec - exiting 16:17:12 (7404): No heartbeat from core client for 30 sec - exiting 16:17:13 (7404): No heartbeat from core client for 30 sec - exiting 16:17:14 (7404): No heartbeat from core client for 30 sec - exiting 16:17:15 (7404): No heartbeat from core client for 30 sec - exiting 16:17:16 (7404): No heartbeat from core client for 30 sec - exiting 16:17:17 (7404): No heartbeat from core client for 30 sec - exiting 16:17:18 (7404): No heartbeat from core client for 30 sec - exiting 16:17:19 (7404): No heartbeat from core client for 30 sec - exiting 16:17:20 (7404): No heartbeat from core client for 30 sec - exiting 16:19:19 (7616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:20:39 (7808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:20:40 (7808): No heartbeat from core client for 30 sec - exiting 17:20:41 (7808): No heartbeat from core client for 30 sec - exiting 17:21:44 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:18:12 (7916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:31:43 (9080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:45:17 (8588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:21:58 (5724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:27:52 (3812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:32:21 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:46:01 (9120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:05:09 (5376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:08:50 (9356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:28:37 (6416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:30:19 (9704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:25:43 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:50:29 (9832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:31:42 (3372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:31:44 (3372): No heartbeat from core client for 30 sec - exiting 10:31:45 (3372): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:48:19 (9348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:57:01 (5496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:57:42 (7088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:47:47 (9280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:59:43 (7788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:31:27 (9364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:42 (2528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:27:46 (9288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:28:39 (8544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77BF3AB3 read attempt to address 0x40EEA678 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77BF3AB3 read attempt to address 0x40EEA678 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\Program Files\Common Files\Services\Grid\Data/projects/climateprediction.net/hadcm3n_zb76_1880_40_008251747/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Feb 2013 06:24:35	1259079	15619118	hadcm3n_zb76_1880_40_008251747_3	259,200	293,584	1.1327
25 Feb 2013 13:31:23	1259079	15619118	hadcm3n_zb76_1880_40_008251747_3	233,280	264,788	1.1351
25 Feb 2013 05:33:39	1259079	15619118	hadcm3n_zb76_1880_40_008251747_3	207,360	236,906	1.1425
24 Feb 2013 21:23:42	1259079	15619118	hadcm3n_zb76_1880_40_008251747_3	181,440	208,314	1.1481
24 Feb 2013 13:30:25	1259079	15619118	hadcm3n_zb76_1880_40_008251747_3	155,520	178,896	1.1503
24 Feb 2013 03:33:18	1259079	15619118	hadcm3n_zb76_1880_40_008251747_3	129,600	148,816	1.1483
23 Feb 2013 18:17:02	1259079	15619118	hadcm3n_zb76_1880_40_008251747_3	103,680	120,140	1.1588
23 Feb 2013 08:57:09	1259079	15619118	hadcm3n_zb76_1880_40_008251747_3	77,760	91,497	1.1767
22 Feb 2013 23:35:05	1259079	15619118	hadcm3n_zb76_1880_40_008251747_3	51,840	62,393	1.2036
22 Feb 2013 13:15:10	1259079	15619118	hadcm3n_zb76_1880_40_008251747_3	25,920	31,394	1.2112