Task 13305405

Name	hadcm3n_y9ox_1940_40_007426854_0
Workunit	7624357
Created	27 Aug 2011, 7:07:55 UTC
Sent	27 Aug 2011, 7:25:24 UTC
Report deadline	26 Nov 2011, 14:52:35 UTC
Received	8 Nov 2011, 10:42:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1165323
Run time	9 days 2 hours 52 min 29 sec
CPU time	8 days 19 hours 41 min 8 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.69 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:09:34 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:54:23 (5096): No heartbeat from core client for 30 sec - exiting 09:54:24 (5096): No heartbeat from core client for 30 sec - exiting 09:54:25 (5096): No heartbeat from core client for 30 sec - exiting 09:54:27 (5096): No heartbeat from core client for 30 sec - exiting 09:54:28 (5096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:55:04 (5112): No heartbeat from core client for 30 sec - exiting 09:55:06 (5112): No heartbeat from core client for 30 sec - exiting 09:55:07 (5112): No heartbeat from core client for 30 sec - exiting 09:55:08 (5112): No heartbeat from core client for 30 sec - exiting 09:55:09 (5112): No heartbeat from core client for 30 sec - exiting 09:55:10 (5112): No heartbeat from core client for 30 sec - exiting 09:55:11 (5112): No heartbeat from core client for 30 sec - exiting 09:55:12 (5112): No heartbeat from core client for 30 sec - exiting 09:55:13 (5112): No heartbeat from core client for 30 sec - exiting 09:55:14 (5112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:55:15 (5112): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:19:48 (6056): No heartbeat from core client for 30 sec - exiting 21:19:51 (6056): No heartbeat from core client for 30 sec - exiting 21:19:52 (6056): No heartbeat from core client for 30 sec - exiting 21:19:53 (6056): No heartbeat from core client for 30 sec - exiting 21:19:54 (6056): No heartbeat from core client for 30 sec - exiting 21:19:55 (6056): No heartbeat from core client for 30 sec - exiting 21:19:56 (6056): No heartbeat from core client for 30 sec - exiting 21:19:57 (6056): No heartbeat from core client for 30 sec - exiting 21:19:58 (6056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:18:34 (4660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:18:35 (4660): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 11:39:48 (1228): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:09:36 (5964): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 13:04:08 (7024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:04:10 (7024): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 13:04:52 (7344): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:30:53 (4404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:40:43 (4744): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:40:46 (4744): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:59:54 (4648): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:59:55 (4648): No heartbeat from core client for 30 sec - exiting 10:59:57 (4648): No heartbeat from core client for 30 sec - exiting 10:59:58 (4648): No heartbeat from core client for 30 sec - exiting 10:59:59 (4648): No heartbeat from core client for 30 sec - exiting 11:00:00 (4648): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 09:06:23 (4232): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:06:24 (4232): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:22:54 (5124): No heartbeat from core client for 30 sec - exiting 10:22:56 (5124): No heartbeat from core client for 30 sec - exiting 10:22:57 (5124): No heartbeat from core client for 30 sec - exiting 10:22:58 (5124): No heartbeat from core client for 30 sec - exiting 10:22:59 (5124): No heartbeat from core client for 30 sec - exiting 10:23:00 (5124): No heartbeat from core client for 30 sec - exiting 10:23:01 (5124): No heartbeat from core client for 30 sec - exiting 10:23:02 (5124): No heartbeat from core client for 30 sec - exiting 10:23:03 (5124): No heartbeat from core client for 30 sec - exiting 10:23:04 (5124): No heartbeat from core client for 30 sec - exiting 10:23:05 (5124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:55:06 (4436): No heartbeat from core client for 30 sec - exiting 09:55:07 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:55:51 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:32 (376): No heartbeat from core client for 30 sec - exiting 08:11:33 (376): No heartbeat from core client for 30 sec - exiting 08:11:34 (376): No heartbeat from core client for 30 sec - exiting 08:11:36 (376): No heartbeat from core client for 30 sec - exiting 08:11:37 (376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: C I/O Error feof - Unit 62 - Return code = 16 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/y9oxko.pjf0c10 Error converting file to netcdf: dataout/y9oxko.pif0c10 Error converting file to netcdf: dataout/y9oxko.pff0c10 Error converting file to netcdf: dataout/y9oxko.pcf0c10 Error converting file to netcdf: dataout/y9oxko.pbf0c10 Error converting file to netcdf: dataout/y9oxko.paf0c10 Error converting file to netcdf: dataout/y9oxka.phf0c10 Error converting file to netcdf: dataout/y9oxka.pgf0c10 Error converting file to netcdf: dataout/y9oxka.pef0c10 Error converting file to netcdf: dataout/y9oxka.pdf0c10 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77523A93 read attempt to address 0x4088C13C Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77CC3A93 read attempt to address 0x4088C13C Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Nov 2011 09:43:15	1165323	13305405	hadcm3n_y9ox_1940_40_007426854_0	259,200	761,791	2.9390
06 Nov 2011 03:09:37	1165323	13305405	hadcm3n_y9ox_1940_40_007426854_0	233,280	686,292	2.9419
04 Nov 2011 13:21:57	1165323	13305405	hadcm3n_y9ox_1940_40_007426854_0	207,360	610,751	2.9454
03 Nov 2011 12:27:52	1165323	13305405	hadcm3n_y9ox_1940_40_007426854_0	181,440	534,533	2.9461
02 Nov 2011 12:59:24	1165323	13305405	hadcm3n_y9ox_1940_40_007426854_0	155,520	458,423	2.9477
10 Oct 2011 21:27:50	1165323	13305405	hadcm3n_y9ox_1940_40_007426854_0	129,600	382,155	2.9487
09 Oct 2011 11:03:40	1165323	13305405	hadcm3n_y9ox_1940_40_007426854_0	103,680	306,205	2.9534
27 Sep 2011 00:52:47	1165323	13305405	hadcm3n_y9ox_1940_40_007426854_0	77,760	229,790	2.9551
31 Aug 2011 16:25:53	1165323	13305405	hadcm3n_y9ox_1940_40_007426854_0	51,840	152,994	2.9513
29 Aug 2011 05:46:28	1165323	13305405	hadcm3n_y9ox_1940_40_007426854_0	25,920	76,258	2.9421