Task 15416790

Name	hadcm3n_z93f_1880_40_008241934_1
Workunit	8397058
Created	29 Oct 2012, 16:42:55 UTC
Sent	29 Oct 2012, 16:42:59 UTC
Report deadline	29 Jan 2013, 0:10:10 UTC
Received	13 Dec 2012, 19:54:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	508054
Run time	8 days 16 hours 4 min 36 sec
CPU time	8 days 13 hours 27 min 43 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.47 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5324, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5048, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3564, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3648, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:04:50 (4432): No heartbeat from core client for 30 sec - exiting 13:04:52 (4432): No heartbeat from core client for 30 sec - exiting 13:04:53 (4432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:40:39 (4308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/z93fko.pj89c10 Error converting file to netcdf: dataout/z93fko.pi89c10 Error converting file to netcdf: dataout/z93fko.pf89c10 Error converting file to netcdf: dataout/z93fka.ph89c10 Error converting file to netcdf: dataout/z93fka.pg89c10 Error converting file to netcdf: dataout/z93fka.pe89c10 Error converting file to netcdf: dataout/z93fka.pd89c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1 Model crash detected, will try to restart... 14:09:34 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1268, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4924, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:55:44 (4364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:48:40 (4748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4792, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4120, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3592, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1144, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1340, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77123AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77653AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Dec 2012 19:59:31	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	518,400	734,202	1.4163
07 Dec 2012 22:13:54	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	492,480	697,056	1.4154
07 Dec 2012 06:16:33	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	466,560	660,649	1.4160
06 Dec 2012 17:25:53	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	440,640	624,245	1.4167
05 Dec 2012 12:00:07	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	414,720	587,395	1.4164
30 Nov 2012 19:31:24	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	388,800	550,789	1.4166
29 Nov 2012 22:49:31	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	362,880	514,361	1.4174
29 Nov 2012 13:08:32	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	336,960	477,360	1.4167
24 Nov 2012 08:58:27	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	311,040	440,538	1.4163
22 Nov 2012 18:15:31	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	285,120	403,582	1.4155
20 Nov 2012 21:16:46	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	259,200	366,592	1.4143
16 Nov 2012 22:28:47	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	233,280	329,852	1.4140
14 Nov 2012 06:48:49	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	207,360	293,316	1.4145
13 Nov 2012 21:12:02	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	181,440	256,707	1.4148
09 Nov 2012 06:05:07	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	155,520	219,940	1.4142
08 Nov 2012 11:50:00	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	129,600	183,494	1.4158
06 Nov 2012 16:26:44	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	103,680	146,738	1.4153
03 Nov 2012 07:29:35	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	77,760	110,401	1.4198
02 Nov 2012 11:50:22	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	51,840	73,939	1.4263
31 Oct 2012 13:09:49	508054	15416790	hadcm3n_z93f_1880_40_008241934_1	25,920	37,061	1.4298