Task 15478725

Name	hadcm3n_zgco_1920_40_008255338_2
Workunit	8410462
Created	14 Dec 2012, 19:30:02 UTC
Sent	14 Dec 2012, 19:31:21 UTC
Report deadline	16 Mar 2013, 2:58:32 UTC
Received	22 Mar 2013, 15:50:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1400002
Run time	22 days 19 hours 36 min 57 sec
CPU time	22 days 0 hours 3 min 45 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	1.73 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4012, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4248, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:07:22 (1092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6700, iMonCtr=1 Model crash detected, will try to restart... Ocean Restart file copy failed on zgcoko.daf5560 Ocean Restart file copy failed on zgcoko.daf56o0 Ocean Restart file copy failed on zgcoko.daf6220 Ocean Restart file copy failed on zgcoko.daf62r0 Ocean Restart file copy failed on zgcoko.daf62t0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on zgcoko.daf6590 Ocean Restart file copy failed on zgcoko.daf69t0 Ocean Restart file copy failed on zgcoko.daf6b20 Ocean Restart file copy failed on zgcoko.daf6bi0 CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on zgcoko.daf76e0 Ocean Restart file copy failed on zgcoko.daf77d0 CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on zgcoko.daf79n0 Ocean Restart file copy failed on zgcoko.daf7a70 Atmos Hold Restart file rename failed on atmos_restart.hold Ocean Restart file copy failed on zgcoko.daf7cn0 Ocean Restart file copy failed on zgcoko.daf82q0 CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on zgcoko.daf88m0 Ocean Restart file copy failed on zgcoko.daf8a20 Ocean Restart file copy failed on zgcoko.daf8ck0 Atmos Hold Restart file rename failed on atmos_restart.hold Ocean Restart file copy failed on zgcoko.daf9560 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Ocean Restart file copy failed on zgcoko.daf96h0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77923AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Mar 2013 14:50:21	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	1,036,800	1,901,010	1.8335
21 Mar 2013 15:50:37	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	1,010,880	1,855,192	1.8352
20 Mar 2013 14:25:17	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	984,960	1,810,249	1.8379
19 Mar 2013 16:07:50	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	959,040	1,765,050	1.8404
18 Mar 2013 18:39:37	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	933,120	1,726,150	1.8499
16 Mar 2013 01:45:51	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	907,200	1,696,736	1.8703
15 Mar 2013 14:25:19	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	881,280	1,657,688	1.8810
15 Mar 2013 08:33:25	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	855,360	1,622,830	1.8972
14 Mar 2013 19:57:25	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	829,440	1,591,957	1.9193
14 Mar 2013 08:59:54	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	803,520	1,551,114	1.9304
14 Mar 2013 08:59:54	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	777,600	1,525,956	1.9624
13 Mar 2013 14:50:24	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	751,680	1,488,790	1.9806
13 Mar 2013 08:04:42	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	725,760	1,454,744	2.0044
12 Mar 2013 20:39:47	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	699,840	1,426,461	2.0383
12 Mar 2013 10:37:02	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	673,920	1,389,373	2.0616
12 Mar 2013 08:31:28	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	648,000	1,361,723	2.1014
11 Mar 2013 16:45:55	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	622,080	1,326,077	2.1317
09 Mar 2013 14:55:19	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	596,160	1,283,704	2.1533
09 Mar 2013 08:47:17	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	570,240	1,249,663	2.1915
08 Mar 2013 21:39:00	1176386	15478725	hadcm3n_zgco_1920_40_008255338_2	544,320	1,221,451	2.2440