Task 15878156

Name	hadcm3n_o5qh_1980_40_008385257_4
Workunit	8536116
Created	3 Jul 2013, 1:03:11 UTC
Sent	3 Jul 2013, 1:10:50 UTC
Report deadline	2 Oct 2013, 8:38:01 UTC
Received	20 Aug 2013, 16:35:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1191411
Run time	20 days 9 hours 14 min 41 sec
CPU time	17 days 22 hours 18 min 52 sec
Validate state	Invalid
Credit	12,130.56
Device peak FLOPS	3.15 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6372, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6992, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6912, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4196, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7204, iMonCtr=1 Model crash detected, will try to restart... 12:54:30 (7092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8004, iMonCtr=1 Model crash detected, will try to restart... 17:04:03 (8496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7876, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7564, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o5qhko.pjk5c10 Error converting file to netcdf: dataout/o5qhko.pik5c10 Error converting file to netcdf: dataout/o5qhko.pfk5c10 Error converting file to netcdf: dataout/o5qhka.phk5c10 Error converting file to netcdf: dataout/o5qhka.pgk5c10 Error converting file to netcdf: dataout/o5qhka.pek5c10 Error converting file to netcdf: dataout/o5qhka.pdk5c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7844, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7728, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7068, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7436, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7204, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7560, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7600, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6636, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7656, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7292, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7740, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6980, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7676, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77327383 read attempt to address 0x40377608 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77323AC3 read attempt to address 0x40377610 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Aug 2013 21:07:11	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	1,010,880	1,510,273	1.4940
17 Aug 2013 11:55:12	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	984,960	1,472,507	1.4950
16 Aug 2013 15:35:56	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	959,040	1,434,503	1.4958
15 Aug 2013 07:10:06	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	933,120	1,395,988	1.4960
14 Aug 2013 18:21:39	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	907,200	1,357,165	1.4960
14 Aug 2013 18:21:39	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	881,280	1,317,804	1.4953
14 Aug 2013 18:21:39	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	855,360	1,278,714	1.4949
14 Aug 2013 18:21:39	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	829,440	1,239,901	1.4949
14 Aug 2013 18:21:39	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	803,520	1,201,069	1.4948
14 Aug 2013 18:21:39	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	777,600	1,161,866	1.4942
14 Aug 2013 18:21:39	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	751,680	1,121,207	1.4916
14 Aug 2013 18:21:39	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	725,760	1,083,066	1.4923
14 Aug 2013 18:21:39	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	699,840	1,044,653	1.4927
14 Aug 2013 18:21:39	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	673,920	1,005,945	1.4927
14 Aug 2013 18:21:39	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	648,000	967,719	1.4934
29 Jul 2013 13:55:38	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	622,080	929,823	1.4947
29 Jul 2013 13:55:38	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	596,160	891,837	1.4960
25 Jul 2013 22:23:00	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	570,240	853,547	1.4968
24 Jul 2013 19:21:14	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	544,320	815,252	1.4977
23 Jul 2013 22:13:16	1191411	15878156	hadcm3n_o5qh_1980_40_008385257_4	518,400	777,405	1.4996