Task 15820451

Name	hadcm3n_o794_1980_40_008385228_0
Workunit	8536087
Created	3 Jun 2013, 2:28:58 UTC
Sent	11 Jun 2013, 18:11:29 UTC
Report deadline	11 Sep 2013, 1:38:40 UTC
Received	18 Jul 2013, 12:00:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1186467
Run time	6 days 15 hours 46 min 22 sec
CPU time	5 days 12 hours 43 min 16 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.93 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.1.17</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:59:00 (36904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:29:00 (7424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:13:27 (8708): No heartbeat from core client for 30 sec - exiting 02:13:28 (8708): No heartbeat from core client for 30 sec - exiting 02:13:29 (8708): No heartbeat from core client for 30 sec - exiting 02:13:30 (8708): No heartbeat from core client for 30 sec - exiting 02:13:31 (8708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:12:31 (4796): No heartbeat from core client for 30 sec - exiting 15:12:32 (4796): No heartbeat from core client for 30 sec - exiting 15:12:33 (4796): No heartbeat from core client for 30 sec - exiting 15:12:34 (4796): No heartbeat from core client for 30 sec - exiting 15:12:35 (4796): No heartbeat from core client for 30 sec - exiting 15:12:36 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:38:49 (7184): No heartbeat from core client for 30 sec - exiting 02:38:50 (7184): No heartbeat from core client for 30 sec - exiting 02:38:51 (7184): No heartbeat from core client for 30 sec - exiting 02:38:52 (7184): No heartbeat from core client for 30 sec - exiting 02:38:53 (7184): No heartbeat from core client for 30 sec - exiting 02:38:54 (7184): No heartbeat from core client for 30 sec - exiting 02:38:55 (7184): No heartbeat from core client for 30 sec - exiting 02:38:56 (7184): No heartbeat from core client for 30 sec - exiting 02:38:57 (7184): No heartbeat from core client for 30 sec - exiting 02:38:58 (7184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:38:59 (7184): No heartbeat from core client for 30 sec - exiting 02:39:00 (7184): No heartbeat from core client for 30 sec - exiting 02:39:01 (7184): No heartbeat from core client for 30 sec - exiting 02:39:02 (7184): No heartbeat from core client for 30 sec - exiting 02:39:03 (7184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:28:56 (17532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:36 (35168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=48052, iMonCtr=1 Model crash detected, will try to restart... 17:08:43 (4664): No heartbeat from core client for 30 sec - exiting 17:08:44 (4664): No heartbeat from core client for 30 sec - exiting 17:08:45 (4664): No heartbeat from core client for 30 sec - exiting 17:08:46 (4664): No heartbeat from core client for 30 sec - exiting 17:08:47 (4664): No heartbeat from core client for 30 sec - exiting 17:08:48 (4664): No heartbeat from core client for 30 sec - exiting 17:08:49 (4664): No heartbeat from core client for 30 sec - exiting 17:08:50 (4664): No heartbeat from core client for 30 sec - exiting 17:08:51 (4664): No heartbeat from core client for 30 sec - exiting 17:08:52 (4664): No heartbeat from core client for 30 sec - exiting 17:08:53 (4664): No heartbeat from core client for 30 sec - exiting 17:08:54 (4664): No heartbeat from core client for 30 sec - exiting 17:08:55 (4664): No heartbeat from core client for 30 sec - exiting 17:08:56 (4664): No heartbeat from core client for 30 sec - exiting 17:08:57 (4664): No heartbeat from core client for 30 sec - exiting 17:08:58 (4664): No heartbeat from core client for 30 sec - exiting 17:08:59 (4664): No heartbeat from core client for 30 sec - exiting 17:09:00 (4664): No heartbeat from core client for 30 sec - exiting 17:09:01 (4664): No heartbeat from core client for 30 sec - exiting 17:09:02 (4664): No heartbeat from core client for 30 sec - exiting 17:09:03 (4664): No heartbeat from core client for 30 sec - exiting 17:09:04 (4664): No heartbeat from core client for 30 sec - exiting 17:09:05 (4664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10156, iMonCtr=1 Model crash detected, will try to restart... 23:48:09 (5724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:23:40 (7988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:46:28 (7584): No heartbeat from core client for 30 sec - exiting 12:46:29 (7584): No heartbeat from core client for 30 sec - exiting 12:46:30 (7584): No heartbeat from core client for 30 sec - exiting 12:46:31 (7584): No heartbeat from core client for 30 sec - exiting 12:46:32 (7584): No heartbeat from core client for 30 sec - exiting 12:46:33 (7584): No heartbeat from core client for 30 sec - exiting 12:46:34 (7584): No heartbeat from core client for 30 sec - exiting 12:46:35 (7584): No heartbeat from core client for 30 sec - exiting 12:46:36 (7584): No heartbeat from core client for 30 sec - exiting 12:46:37 (7584): No heartbeat from core client for 30 sec - exiting 12:46:38 (7584): No heartbeat from core client for 30 sec - exiting 12:46:39 (7584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:46:40 (7584): No heartbeat from core client for 30 sec - exiting 12:46:41 (7584): No heartbeat from core client for 30 sec - exiting 13:13:58 (6076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25956, iMonCtr=1 Model crash detected, will try to restart... 21:39:31 (6336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:11:25 (35312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:34:07 (37476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:21 (34412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:33:51 (7144): No heartbeat from core client for 30 sec - exiting 21:33:52 (7144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:43:48 (4244): No heartbeat from core client for 30 sec - exiting 12:43:49 (4244): No heartbeat from core client for 30 sec - exiting 12:43:50 (4244): No heartbeat from core client for 30 sec - exiting 12:43:51 (4244): No heartbeat from core client for 30 sec - exiting 12:43:52 (4244): No heartbeat from core client for 30 sec - exiting 12:43:53 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:24:21 (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:46:53 (7644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:46:54 (7644): No heartbeat from core client for 30 sec - exiting 04:46:55 (7644): No heartbeat from core client for 30 sec - exiting 04:46:56 (7644): No heartbeat from core client for 30 sec - exiting 04:46:57 (7644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 10:15:19 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:42:58 (9272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:01:30 (6236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:21:31 (7224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:22:40 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:40:50 (6880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:23:37 (1144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:46:01 (12656): No heartbeat from core client for 30 sec - exiting 07:46:02 (12656): No heartbeat from core client for 30 sec - exiting 07:46:03 (12656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:44:10 (11464): No heartbeat from core client for 30 sec - exiting 14:44:11 (11464): No heartbeat from core client for 30 sec - exiting 14:44:12 (11464): No heartbeat from core client for 30 sec - exiting 14:44:13 (11464): No heartbeat from core client for 30 sec - exiting 14:44:14 (11464): No heartbeat from core client for 30 sec - exiting 14:44:15 (11464): No heartbeat from core client for 30 sec - exiting 14:44:16 (11464): No heartbeat from core client for 30 sec - exiting 14:44:17 (11464): No heartbeat from core client for 30 sec - exiting 14:44:18 (11464): No heartbeat from core client for 30 sec - exiting 14:44:19 (11464): No heartbeat from core client for 30 sec - exiting 14:44:20 (11464): No heartbeat from core client for 30 sec - exiting 14:44:21 (11464): No heartbeat from core client for 30 sec - exiting 14:44:22 (11464): No heartbeat from core client for 30 sec - exiting 14:44:23 (11464): No heartbeat from core client for 30 sec - exiting 14:44:24 (11464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77EBFF2B write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 15:30:33	1186467	15820451	hadcm3n_o794_1980_40_008385228_0	259,200	477,783	1.8433
23 Jul 2013 15:30:32	1186467	15820451	hadcm3n_o794_1980_40_008385228_0	233,280	429,475	1.8410
11 Jul 2013 10:46:40	1186467	15820451	hadcm3n_o794_1980_40_008385228_0	207,360	381,647	1.8405
08 Jul 2013 08:32:15	1186467	15820451	hadcm3n_o794_1980_40_008385228_0	181,440	335,458	1.8489
06 Jul 2013 04:24:41	1186467	15820451	hadcm3n_o794_1980_40_008385228_0	155,520	284,903	1.8319
02 Jul 2013 10:16:55	1186467	15820451	hadcm3n_o794_1980_40_008385228_0	129,600	234,916	1.8126
25 Jun 2013 20:20:14	1186467	15820451	hadcm3n_o794_1980_40_008385228_0	103,680	184,698	1.7814
22 Jun 2013 16:25:06	1186467	15820451	hadcm3n_o794_1980_40_008385228_0	77,760	137,345	1.7663
20 Jun 2013 15:26:04	1186467	15820451	hadcm3n_o794_1980_40_008385228_0	51,840	91,773	1.7703
17 Jun 2013 19:03:46	1186467	15820451	hadcm3n_o794_1980_40_008385228_0	25,920	45,562	1.7578