Task 16067258

Name	hadcm3n_831h_1980_40_008461880_3
Workunit	8612736
Created	14 Oct 2013, 0:53:32 UTC
Sent	14 Oct 2013, 0:53:49 UTC
Report deadline	13 Jan 2014, 8:21:00 UTC
Received	13 Dec 2013, 4:25:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1122348
Run time	12 days 8 hours 28 min 1 sec
CPU time	12 days 7 hours 21 min 5 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5552, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5916, iMonCtr=1 Model crash detected, will try to restart... 03:38:42 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5716, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6468, iMonCtr=1 Model crash detected, will try to restart... 09:04:53 (5552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:32:36 (4916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6468, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 00:37:40 (6568): No heartbeat from core client for 30 sec - exiting 00:37:41 (6568): No heartbeat from core client for 30 sec - exiting 00:37:42 (6568): No heartbeat from core client for 30 sec - exiting 00:37:43 (6568): No heartbeat from core client for 30 sec - exiting 00:37:44 (6568): No heartbeat from core client for 30 sec - exiting 00:37:45 (6568): No heartbeat from core client for 30 sec - exiting 00:37:46 (6568): No heartbeat from core client for 30 sec - exiting 00:37:47 (6568): No heartbeat from core client for 30 sec - exiting 00:37:48 (6568): No heartbeat from core client for 30 sec - exiting 00:37:49 (6568): No heartbeat from core client for 30 sec - exiting 00:37:50 (6568): No heartbeat from core client for 30 sec - exiting 00:37:51 (6568): No heartbeat from core client for 30 sec - exiting 00:37:52 (6568): No heartbeat from core client for 30 sec - exiting 00:37:53 (6568): No heartbeat from core client for 30 sec - exiting 00:37:54 (6568): No heartbeat from core client for 30 sec - exiting 00:37:55 (6568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:37:56 (6568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:02:09 (3984): No heartbeat from core client for 30 sec - exiting 04:02:10 (3984): No heartbeat from core client for 30 sec - exiting 04:02:11 (3984): No heartbeat from core client for 30 sec - exiting 04:02:12 (3984): No heartbeat from core client for 30 sec - exiting 04:02:13 (3984): No heartbeat from core client for 30 sec - exiting 04:02:14 (3984): No heartbeat from core client for 30 sec - exiting 04:02:15 (3984): No heartbeat from core client for 30 sec - exiting 04:02:16 (3984): No heartbeat from core client for 30 sec - exiting 04:02:17 (3984): No heartbeat from core client for 30 sec - exiting 04:02:18 (3984): No heartbeat from core client for 30 sec - exiting 04:02:19 (3984): No heartbeat from core client for 30 sec - exiting 04:02:20 (3984): No heartbeat from core client for 30 sec - exiting 04:02:21 (3984): No heartbeat from core client for 30 sec - exiting 04:02:22 (3984): No heartbeat from core client for 30 sec - exiting 04:02:23 (3984): No heartbeat from core client for 30 sec - exiting 04:02:24 (3984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:10:32 (5688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:12:24 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:14:17 (7188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:35:26 (7260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:37:14 (6440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:38:57 (6600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:37 (7252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:18 (6688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:47 (5540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6960, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6552, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7404, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6148, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6048, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5148, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5148, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5824, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5824, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76F78118 read attempt to address 0x40BE6CD7 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77543AC3 read attempt to address 0x40BE6CD3 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Dec 2013 03:59:05	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	518,400	1,051,522	2.0284
10 Dec 2013 04:20:05	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	492,480	996,126	2.0227
04 Dec 2013 04:28:45	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	466,560	940,519	2.0159
28 Nov 2013 19:41:17	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	440,640	884,840	2.0081
26 Nov 2013 03:49:02	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	414,720	830,619	2.0028
22 Nov 2013 01:03:10	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	388,800	778,935	2.0034
19 Nov 2013 02:22:44	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	362,880	728,202	2.0067
16 Nov 2013 14:07:00	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	336,960	678,102	2.0124
15 Nov 2013 00:59:09	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	311,040	625,880	2.0122
10 Nov 2013 21:23:48	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	285,120	578,873	2.0303
10 Nov 2013 06:02:15	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	259,200	531,584	2.0509
04 Nov 2013 00:16:18	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	233,280	483,145	2.0711
02 Nov 2013 12:54:41	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	207,360	433,220	2.0892
27 Oct 2013 16:49:58	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	181,440	378,301	2.0850
26 Oct 2013 20:58:39	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	155,520	323,775	2.0819
26 Oct 2013 06:51:10	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	129,600	273,143	2.1076
22 Oct 2013 22:26:52	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	103,680	222,634	2.1473
19 Oct 2013 07:14:57	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	77,760	167,358	2.1522
18 Oct 2013 02:38:08	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	51,840	111,907	2.1587
15 Oct 2013 12:53:28	1122348	16067258	hadcm3n_831h_1980_40_008461880_3	25,920	56,166	2.1669