Task 16167875

Name	hadcm3n_odw4_1900_40_008473127_1
Workunit	8623966
Created	29 Dec 2013, 15:24:15 UTC
Sent	29 Dec 2013, 15:24:23 UTC
Report deadline	30 Mar 2014, 22:51:34 UTC
Received	22 Feb 2014, 14:37:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1308421
Run time	13 days 5 hours 40 min 24 sec
CPU time	12 days 14 hours 23 min 44 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.74 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=400, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1176, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5528, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5392, iMonCtr=1 Model crash detected, will try to restart... 15:50:19 (4680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:50:20 (4680): No heartbeat from core client for 30 sec - exiting 15:50:21 (4680): No heartbeat from core client for 30 sec - exiting 15:50:22 (4680): No heartbeat from core client for 30 sec - exiting 15:50:23 (4680): No heartbeat from core client for 30 sec - exiting 15:50:24 (4680): No heartbeat from core client for 30 sec - exiting 15:50:25 (4680): No heartbeat from core client for 30 sec - exiting 15:50:26 (4680): No heartbeat from core client for 30 sec - exiting 15:50:27 (4680): No heartbeat from core client for 30 sec - exiting 15:50:28 (4680): No heartbeat from core client for 30 sec - exiting 15:50:29 (4680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:32:50 (2664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:32:51 (2664): No heartbeat from core client for 30 sec - exiting 21:32:52 (2664): No heartbeat from core client for 30 sec - exiting 21:32:53 (2664): No heartbeat from core client for 30 sec - exiting 21:32:54 (2664): No heartbeat from core client for 30 sec - exiting 21:32:55 (2664): No heartbeat from core client for 30 sec - exiting 21:32:56 (2664): No heartbeat from core client for 30 sec - exiting 21:32:57 (2664): No heartbeat from core client for 30 sec - exiting 21:32:58 (2664): No heartbeat from core client for 30 sec - exiting 21:32:59 (2664): No heartbeat from core client for 30 sec - exiting 21:33:00 (2664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:44:07 (1104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5392, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4896, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:37:36 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:37:37 (3776): No heartbeat from core client for 30 sec - exiting 00:37:38 (3776): No heartbeat from core client for 30 sec - exiting 00:37:39 (3776): No heartbeat from core client for 30 sec - exiting 00:37:40 (3776): No heartbeat from core client for 30 sec - exiting 00:37:41 (3776): No heartbeat from core client for 30 sec - exiting 00:37:42 (3776): No heartbeat from core client for 30 sec - exiting 00:37:43 (3776): No heartbeat from core client for 30 sec - exiting 00:37:44 (3776): No heartbeat from core client for 30 sec - exiting 00:37:45 (3776): No heartbeat from core client for 30 sec - exiting 00:37:46 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:06:11 (984): No heartbeat from core client for 30 sec - exiting 19:06:12 (984): No heartbeat from core client for 30 sec - exiting 19:06:13 (984): No heartbeat from core client for 30 sec - exiting 19:06:14 (984): No heartbeat from core client for 30 sec - exiting 19:06:15 (984): No heartbeat from core client for 30 sec - exiting 19:06:16 (984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77533AB3 read attempt to address 0x4066665B Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Feb 2014 14:40:11	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	777,600	1,088,617	1.4000
20 Feb 2014 11:37:02	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	751,680	1,052,370	1.4000
16 Feb 2014 13:09:14	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	725,760	1,014,773	1.3982
15 Feb 2014 14:02:40	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	699,840	976,963	1.3960
13 Feb 2014 12:43:04	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	673,920	939,578	1.3942
10 Feb 2014 07:31:57	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	648,000	901,064	1.3905
09 Feb 2014 10:05:53	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	622,080	862,000	1.3857
08 Feb 2014 14:47:32	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	596,160	823,230	1.3809
06 Feb 2014 12:06:05	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	570,240	786,777	1.3797
05 Feb 2014 08:05:49	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	544,320	751,095	1.3799
01 Feb 2014 17:05:11	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	518,400	715,633	1.3805
30 Jan 2014 16:42:22	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	492,480	678,834	1.3784
26 Jan 2014 13:12:45	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	466,560	641,607	1.3752
25 Jan 2014 14:18:24	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	440,640	604,430	1.3717
24 Jan 2014 16:58:11	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	414,720	567,976	1.3695
22 Jan 2014 20:42:49	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	388,800	531,780	1.3677
20 Jan 2014 16:09:28	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	362,880	495,629	1.3658
19 Jan 2014 03:24:01	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	336,960	458,803	1.3616
18 Jan 2014 08:06:53	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	311,040	422,380	1.3580
17 Jan 2014 11:22:45	1308421	16167875	hadcm3n_odw4_1900_40_008473127_1	285,120	386,146	1.3543