Task 16100383

Name	hadcm3n_o7bh_2020_40_008375220_2
Workunit	8526079
Created	29 Nov 2013, 20:26:28 UTC
Sent	29 Nov 2013, 20:26:42 UTC
Report deadline	1 Mar 2014, 3:53:53 UTC
Received	4 Jan 2014, 15:35:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1302571
Run time	14 days 19 hours 43 min 23 sec
CPU time	13 days 10 hours 9 min 34 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.16 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 21:43:03 (2888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:43:04 (2888): No heartbeat from core client for 30 sec - exiting 21:43:05 (2888): No heartbeat from core client for 30 sec - exiting 21:43:06 (2888): No heartbeat from core client for 30 sec - exiting 21:43:07 (2888): No heartbeat from core client for 30 sec - exiting 21:43:08 (2888): No heartbeat from core client for 30 sec - exiting 21:43:09 (2888): No heartbeat from core client for 30 sec - exiting 21:43:10 (2888): No heartbeat from core client for 30 sec - exiting 21:43:11 (2888): No heartbeat from core client for 30 sec - exiting 21:43:12 (2888): No heartbeat from core client for 30 sec - exiting 21:43:13 (2888): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7672, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6076, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8436, selfPID=8436, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6216, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6216, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7768, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6476, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6476, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6892, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6892, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6892, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6892, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6892, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7304, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6184, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6184, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8000, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7184, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6832, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7652, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6416, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6896, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6896, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6960, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6960, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6660, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6660, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7636, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7760, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6840, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6840, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6840, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7316, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7388, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7684, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7912, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77087383 read attempt to address 0x403747E9 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77083AC3 read attempt to address 0x403747F1 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Jan 2014 09:15:12	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	777,600	1,155,052	1.4854
02 Jan 2014 20:27:38	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	751,680	1,116,329	1.4851
01 Jan 2014 16:59:59	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	725,760	1,077,583	1.4848
31 Dec 2013 19:56:05	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	699,840	1,040,048	1.4861
30 Dec 2013 16:34:43	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	673,920	1,001,785	1.4865
29 Dec 2013 12:37:56	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	648,000	962,951	1.4860
28 Dec 2013 15:28:50	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	622,080	924,539	1.4862
27 Dec 2013 07:41:14	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	596,160	885,439	1.4852
26 Dec 2013 11:24:24	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	570,240	846,371	1.4842
25 Dec 2013 14:52:41	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	544,320	806,178	1.4811
24 Dec 2013 19:57:13	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	518,400	767,107	1.4798
23 Dec 2013 15:50:31	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	492,480	729,253	1.4808
22 Dec 2013 13:10:34	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	466,560	690,610	1.4802
21 Dec 2013 09:56:38	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	440,640	652,841	1.4816
19 Dec 2013 20:30:15	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	414,720	612,892	1.4778
18 Dec 2013 16:43:35	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	388,800	573,730	1.4756
16 Dec 2013 21:07:25	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	362,880	535,164	1.4748
15 Dec 2013 09:46:43	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	336,960	496,874	1.4746
13 Dec 2013 16:08:26	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	311,040	458,544	1.4742
11 Dec 2013 21:34:11	1302571	16100383	hadcm3n_o7bh_2020_40_008375220_2	285,120	419,976	1.4730