Task 13148113

Name	hadcm3n_t2ao_1940_40_007314582_2
Workunit	7512012
Created	20 Jul 2011, 14:01:50 UTC
Sent	20 Jul 2011, 14:09:19 UTC
Report deadline	19 Oct 2011, 21:36:30 UTC
Received	20 Sep 2011, 12:23:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1159034
Run time	15 days 8 hours 28 min 39 sec
CPU time	14 days 23 hours 48 min 27 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.53 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> 23:30:30 (5796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:32:44 (3564): No heartbeat from core client for 30 sec - exiting 09:32:45 (3564): No heartbeat from core client for 30 sec - exiting 09:32:46 (3564): No heartbeat from core client for 30 sec - exiting 09:32:47 (3564): No heartbeat from core client for 30 sec - exiting 09:32:48 (3564): No heartbeat from core client for 30 sec - exiting 09:32:49 (3564): No heartbeat from core client for 30 sec - exiting 09:32:50 (3564): No heartbeat from core client for 30 sec - exiting 09:32:51 (3564): No heartbeat from core client for 30 sec - exiting 09:32:52 (3564): No heartbeat from core client for 30 sec - exiting 09:32:53 (3564): No heartbeat from core client for 30 sec - exiting 09:32:54 (3564): No heartbeat from core client for 30 sec - exiting 09:32:55 (3564): No heartbeat from core client for 30 sec - exiting 09:32:56 (3564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1516, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3852, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5420, iMonCtr=1 Model crash detected, will try to restart... 11:37:14 (3420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:18:53 (10256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3668, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76FE7353 read attempt to address 0x3D6AD728 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Sep 2011 12:20:29	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	518,400	1,295,293	2.4986
12 Sep 2011 09:01:08	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	492,480	1,229,520	2.4966
10 Sep 2011 18:03:31	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	466,560	1,161,185	2.4888
08 Sep 2011 14:14:57	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	440,640	1,093,465	2.4815
05 Sep 2011 18:25:09	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	414,720	1,027,367	2.4773
04 Sep 2011 13:36:01	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	388,800	957,962	2.4639
25 Aug 2011 21:17:13	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	362,880	891,622	2.4571
17 Aug 2011 09:08:03	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	336,960	820,860	2.4361
12 Aug 2011 21:26:03	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	311,040	752,603	2.4196
10 Aug 2011 18:52:26	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	285,120	687,286	2.4105
09 Aug 2011 17:48:24	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	259,200	627,966	2.4227
07 Aug 2011 20:51:31	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	233,280	562,783	2.4125
04 Aug 2011 07:12:30	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	207,360	497,189	2.3977
02 Aug 2011 12:08:42	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	181,440	426,944	2.3531
31 Jul 2011 15:55:30	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	155,520	361,235	2.3228
30 Jul 2011 10:43:50	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	129,600	296,311	2.2864
28 Jul 2011 19:02:18	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	103,680	230,198	2.2203
26 Jul 2011 07:21:21	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	77,760	166,095	2.1360
25 Jul 2011 21:59:37	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	51,840	103,746	2.0013
25 Jul 2011 20:46:18	1159034	13148113	hadcm3n_t2ao_1940_40_007314582_2	25,920	48,134	1.8570