Task 13678201

Name	hadcm3n_yhi6_1940_40_007548385_0
Workunit	7745617
Created	30 Nov 2011, 21:43:31 UTC
Sent	1 Dec 2011, 7:28:13 UTC
Report deadline	1 Mar 2012, 14:55:24 UTC
Received	14 Jan 2012, 12:43:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1098144
Run time	17 days 23 hours 6 min 57 sec
CPU time	17 days 8 hours 45 min 54 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.58 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:58:52 (1648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:36:48 (4136): No heartbeat from core client for 30 sec - exiting 17:36:49 (4136): No heartbeat from core client for 30 sec - exiting 17:36:50 (4136): No heartbeat from core client for 30 sec - exiting 17:36:51 (4136): No heartbeat from core client for 30 sec - exiting 17:36:52 (4136): No heartbeat from core client for 30 sec - exiting 17:36:53 (4136): No heartbeat from core client for 30 sec - exiting 17:36:54 (4136): No heartbeat from core client for 30 sec - exiting 17:36:55 (4136): No heartbeat from core client for 30 sec - exiting 17:36:56 (4136): No heartbeat from core client for 30 sec - exiting 17:36:57 (4136): No heartbeat from core client for 30 sec - exiting 17:36:58 (4136): No heartbeat from core client for 30 sec - exiting 17:36:59 (4136): No heartbeat from core client for 30 sec - exiting 17:37:00 (4136): No heartbeat from core client for 30 sec - exiting 17:37:01 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:37:02 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:40:59 (4624): No heartbeat from core client for 30 sec - exiting 22:41:00 (4624): No heartbeat from core client for 30 sec - exiting 22:41:01 (4624): No heartbeat from core client for 30 sec - exiting 22:41:02 (4624): No heartbeat from core client for 30 sec - exiting 22:41:03 (4624): No heartbeat from core client for 30 sec - exiting 22:41:04 (4624): No heartbeat from core client for 30 sec - exiting 22:41:05 (4624): No heartbeat from core client for 30 sec - exiting 22:41:06 (4624): No heartbeat from core client for 30 sec - exiting 22:41:07 (4624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1516, iMonCtr=1 Model crash detected, will try to restart... 20:16:55 (4772): No heartbeat from core client for 30 sec - exiting 20:16:56 (4772): No heartbeat from core client for 30 sec - exiting 20:16:57 (4772): No heartbeat from core client for 30 sec - exiting 20:16:58 (4772): No heartbeat from core client for 30 sec - exiting 20:16:59 (4772): No heartbeat from core client for 30 sec - exiting 20:17:00 (4772): No heartbeat from core client for 30 sec - exiting 20:17:01 (4772): No heartbeat from core client for 30 sec - exiting 20:17:02 (4772): No heartbeat from core client for 30 sec - exiting 20:17:03 (4772): No heartbeat from core client for 30 sec - exiting 20:17:04 (4772): No heartbeat from core client for 30 sec - exiting 20:17:05 (4772): No heartbeat from core client for 30 sec - exiting 20:17:06 (4772): No heartbeat from core client for 30 sec - exiting 20:17:07 (4772): No heartbeat from core client for 30 sec - exiting 20:17:08 (4772): No heartbeat from core client for 30 sec - exiting 20:17:09 (4772): No heartbeat from core client for 30 sec - exiting 20:17:10 (4772): No heartbeat from core client for 30 sec - exiting 20:17:11 (4772): No heartbeat from core client for 30 sec - exiting 20:17:12 (4772): No heartbeat from core client for 30 sec - exiting 20:17:13 (4772): No heartbeat from core client for 30 sec - exiting 20:17:14 (4772): No heartbeat from core client for 30 sec - exiting 20:17:15 (4772): No heartbeat from core client for 30 sec - exiting 20:17:16 (4772): No heartbeat from core client for 30 sec - exiting 20:17:17 (4772): No heartbeat from core client for 30 sec - exiting 20:17:18 (4772): No heartbeat from core client for 30 sec - exiting 20:17:19 (4772): No heartbeat from core client for 30 sec - exiting 20:17:20 (4772): No heartbeat from core client for 30 sec - exiting 20:17:21 (4772): No heartbeat from core client for 30 sec - exiting 20:17:22 (4772): No heartbeat from core client for 30 sec - exiting 20:17:23 (4772): No heartbeat from core client for 30 sec - exiting 20:17:24 (4772): No heartbeat from core client for 30 sec - exiting 20:17:25 (4772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:28 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:41:53 (6172): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 15:07:28 (6788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:07:29 (6788): No heartbeat from core client for 30 sec - exiting 15:07:30 (6788): No heartbeat from core client for 30 sec - exiting 15:07:31 (6788): No heartbeat from core client for 30 sec - exiting 15:07:32 (6788): No heartbeat from core client for 30 sec - exiting 15:07:33 (6788): No heartbeat from core client for 30 sec - exiting 15:07:34 (6788): No heartbeat from core client for 30 sec - exiting 15:07:35 (6788): No heartbeat from core client for 30 sec - exiting 15:07:36 (6788): No heartbeat from core client for 30 sec - exiting 15:07:37 (6788): No heartbeat from core client for 30 sec - exiting 15:07:38 (6788): No heartbeat from core client for 30 sec - exiting 15:07:39 (6788): No heartbeat from core client for 30 sec - exiting 15:07:40 (6788): No heartbeat from core client for 30 sec - exiting 15:07:41 (6788): No heartbeat from core client for 30 sec - exiting 15:07:42 (6788): No heartbeat from core client for 30 sec - exiting 15:07:43 (6788): No heartbeat from core client for 30 sec - exiting 15:07:44 (6788): No heartbeat from core client for 30 sec - exiting 15:07:45 (6788): No heartbeat from core client for 30 sec - exiting 15:07:46 (6788): No heartbeat from core client for 30 sec - exiting 15:07:47 (6788): No heartbeat from core client for 30 sec - exiting 15:07:48 (6788): No heartbeat from core client for 30 sec - exiting 15:07:49 (6788): No heartbeat from core client for 30 sec - exiting 15:07:50 (6788): No heartbeat from core client for 30 sec - exiting 15:07:51 (6788): No heartbeat from core client for 30 sec - exiting 15:07:52 (6788): No heartbeat from core client for 30 sec - exiting 15:07:53 (6788): No heartbeat from core client for 30 sec - exiting 15:07:54 (6788): No heartbeat from core client for 30 sec - exiting 15:07:55 (6788): No heartbeat from core client for 30 sec - exiting 15:07:56 (6788): No heartbeat from core client for 30 sec - exiting 15:07:57 (6788): No heartbeat from core client for 30 sec - exiting 15:07:58 (6788): No heartbeat from core client for 30 sec - exiting 15:07:59 (6788): No heartbeat from core client for 30 sec - exiting 15:08:00 (6788): No heartbeat from core client for 30 sec - exiting 15:08:01 (6788): No heartbeat from core client for 30 sec - exiting 15:08:02 (6788): No heartbeat from core client for 30 sec - exiting 15:08:03 (6788): No heartbeat from core client for 30 sec - exiting 15:08:04 (6788): No heartbeat from core client for 30 sec - exiting 15:08:05 (6788): No heartbeat from core client for 30 sec - exiting 15:08:06 (6788): No heartbeat from core client for 30 sec - exiting 15:08:07 (6788): No heartbeat from core client for 30 sec - exiting 15:08:08 (6788): No heartbeat from core client for 30 sec - exiting 15:08:09 (6788): No heartbeat from core client for 30 sec - exiting 15:08:10 (6788): No heartbeat from core client for 30 sec - exiting 15:08:11 (6788): No heartbeat from core client for 30 sec - exiting 15:08:12 (6788): No heartbeat from core client for 30 sec - exiting 15:08:13 (6788): No heartbeat from core client for 30 sec - exiting 15:08:14 (6788): No heartbeat from core client for 30 sec - exiting 15:08:15 (6788): No heartbeat from core client for 30 sec - exiting 15:08:16 (6788): No heartbeat from core client for 30 sec - exiting 15:08:17 (6788): No heartbeat from core client for 30 sec - exiting 15:08:18 (6788): No heartbeat from core client for 30 sec - exiting 15:08:19 (6788): No heartbeat from core client for 30 sec - exiting 15:08:20 (6788): No heartbeat from core client for 30 sec - exiting 15:08:21 (6788): No heartbeat from core client for 30 sec - exiting 15:08:22 (6788): No heartbeat from core client for 30 sec - exiting 15:08:23 (6788): No heartbeat from core client for 30 sec - exiting 15:08:24 (6788): No heartbeat from core client for 30 sec - exiting 15:08:25 (6788): No heartbeat from core client for 30 sec - exiting 15:08:26 (6788): No heartbeat from core client for 30 sec - exiting 15:08:27 (6788): No heartbeat from core client for 30 sec - exiting 15:08:28 (6788): No heartbeat from core client for 30 sec - exiting 15:08:29 (6788): No heartbeat from core client for 30 sec - exiting 15:08:30 (6788): No heartbeat from core client for 30 sec - exiting 15:08:31 (6788): No heartbeat from core client for 30 sec - exiting 15:08:32 (6788): No heartbeat from core client for 30 sec - exiting 15:08:33 (6788): No heartbeat from core client for 30 sec - exiting 15:08:34 (6788): No heartbeat from core client for 30 sec - exiting 15:08:35 (6788): No heartbeat from core client for 30 sec - exiting 15:08:36 (6788): No heartbeat from core client for 30 sec - exiting 15:08:37 (6788): No heartbeat from core client for 30 sec - exiting 15:08:38 (6788): No heartbeat from core client for 30 sec - exiting 15:08:39 (6788): No heartbeat from core client for 30 sec - exiting 15:08:40 (6788): No heartbeat from core client for 30 sec - exiting 15:08:41 (6788): No heartbeat from core client for 30 sec - exiting 15:08:42 (6788): No heartbeat from core client for 30 sec - exiting 15:08:43 (6788): No heartbeat from core client for 30 sec - exiting 15:08:44 (6788): No heartbeat from core client for 30 sec - exiting 15:08:45 (6788): No heartbeat from core client for 30 sec - exiting 15:08:46 (6788): No heartbeat from core client for 30 sec - exiting 15:08:47 (6788): No heartbeat from core client for 30 sec - exiting 15:08:48 (6788): No heartbeat from core client for 30 sec - exiting 15:08:49 (6788): No heartbeat from core client for 30 sec - exiting 15:08:50 (6788): No heartbeat from core client for 30 sec - exiting 15:08:51 (6788): No heartbeat from core client for 30 sec - exiting 15:08:52 (6788): No heartbeat from core client for 30 sec - exiting 15:08:53 (6788): No heartbeat from core client for 30 sec - exiting 15:08:54 (6788): No heartbeat from core client for 30 sec - exiting 15:08:55 (6788): No heartbeat from core client for 30 sec - exiting 15:08:56 (6788): No heartbeat from core client for 30 sec - exiting 15:08:57 (6788): No heartbeat from core client for 30 sec - exiting 15:08:58 (6788): No heartbeat from core client for 30 sec - exiting 15:08:59 (6788): No heartbeat from core client for 30 sec - exiting 15:09:00 (6788): No heartbeat from core client for 30 sec - exiting 15:09:01 (6788): No heartbeat from core client for 30 sec - exiting 15:09:02 (6788): No heartbeat from core client for 30 sec - exiting 15:09:03 (6788): No heartbeat from core client for 30 sec - exiting 15:09:04 (6788): No heartbeat from core client for 30 sec - exiting 15:09:05 (6788): No heartbeat from core client for 30 sec - exiting 15:09:06 (6788): No heartbeat from core client for 30 sec - exiting 15:09:07 (6788): No heartbeat from core client for 30 sec - exiting 15:09:08 (6788): No heartbeat from core client for 30 sec - exiting 15:09:09 (6788): No heartbeat from core client for 30 sec - exiting 15:09:10 (6788): No heartbeat from core client for 30 sec - exiting 15:09:11 (6788): No heartbeat from core client for 30 sec - exiting 15:09:12 (6788): No heartbeat from core client for 30 sec - exiting 15:09:13 (6788): No heartbeat from core client for 30 sec - exiting 15:09:14 (6788): No heartbeat from core client for 30 sec - exiting 15:09:15 (6788): No heartbeat from core client for 30 sec - exiting 15:09:16 (6788): No heartbeat from core client for 30 sec - exiting 15:09:17 (6788): No heartbeat from core client for 30 sec - exiting 15:09:18 (6788): No heartbeat from core client for 30 sec - exiting 15:09:19 (6788): No heartbeat from core client for 30 sec - exiting 15:09:20 (6788): No heartbeat from core client for 30 sec - exiting 15:09:21 (6788): No heartbeat from core client for 30 sec - exiting 15:09:22 (6788): No heartbeat from core client for 30 sec - exiting 15:09:23 (6788): No heartbeat from core client for 30 sec - exiting 15:09:24 (6788): No heartbeat from core client for 30 sec - exiting 15:09:25 (6788): No heartbeat from core client for 30 sec - exiting 15:09:26 (6788): No heartbeat from core client for 30 sec - exiting 15:09:27 (6788): No heartbeat from core client for 30 sec - exiting 15:09:28 (6788): No heartbeat from core client for 30 sec - exiting 15:09:29 (6788): No heartbeat from core client for 30 sec - exiting 15:09:30 (6788): No heartbeat from core client for 30 sec - exiting 15:09:31 (6788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 20:27:58 (4604): No heartbeat from core client for 30 sec - exiting 20:28:00 (4604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:32:53 (7292):No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1484, selfPID=1484, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C53740 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C53A93 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Jan 2012 12:48:00	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	1,036,800	1,500,403	1.4471
14 Jan 2012 12:48:00	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	1,010,880	1,464,730	1.4490
14 Jan 2012 12:48:00	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	984,960	1,428,451	1.4503
09 Jan 2012 01:56:39	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	959,040	1,389,218	1.4486
08 Jan 2012 13:30:58	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	933,120	1,348,933	1.4456
08 Jan 2012 10:30:14	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	907,200	1,312,363	1.4466
08 Jan 2012 10:30:14	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	881,280	1,276,387	1.4483
01 Jan 2012 23:57:45	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	855,360	1,239,356	1.4489
01 Jan 2012 13:28:26	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	829,440	1,202,470	1.4497
01 Jan 2012 02:56:10	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	803,520	1,165,573	1.4506
31 Dec 2011 12:52:22	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	777,600	1,128,571	1.4514
31 Dec 2011 02:14:45	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	751,680	1,091,266	1.4518
30 Dec 2011 06:24:22	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	725,760	1,054,057	1.4523
27 Dec 2011 12:43:24	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	699,840	1,016,837	1.4530
27 Dec 2011 02:00:53	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	673,920	979,406	1.4533
26 Dec 2011 15:26:24	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	648,000	942,130	1.4539
26 Dec 2011 03:34:11	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	622,080	903,768	1.4528
25 Dec 2011 16:40:31	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	596,160	865,522	1.4518
25 Dec 2011 05:48:13	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	570,240	827,077	1.4504
24 Dec 2011 19:08:34	1098144	13678201	hadcm3n_yhi6_1940_40_007548385_0	544,320	788,983	1.4495