Task 14797148

Name	hadcm3n_o0od_1940_40_007833986_3
Workunit	7989098
Created	19 Jun 2012, 7:53:10 UTC
Sent	19 Jun 2012, 7:53:17 UTC
Report deadline	18 Sep 2012, 15:20:28 UTC
Received	25 Jul 2012, 22:30:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1193311
Run time	9 days 20 hours 43 min 7 sec
CPU time	9 days 1 hours 40 min 47 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.64 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:48:11 (4564): No heartbeat from core client for 30 sec - exiting 19:48:13 (4564): No heartbeat from core client for 30 sec - exiting 19:48:14 (4564): No heartbeat from core client for 30 sec - exiting 19:48:15 (4564): No heartbeat from core client for 30 sec - exiting 19:48:16 (4564): No heartbeat from core client for 30 sec - exiting 19:48:17 (4564): No heartbeat from core client for 30 sec - exiting 19:48:18 (4564): No heartbeat from core client for 30 sec - exiting 19:48:19 (4564): No heartbeat from core client for 30 sec - exiting 19:48:20 (4564): No heartbeat from core client for 30 sec - exiting 19:48:21 (4564): No heartbeat from core client for 30 sec - exiting 19:48:22 (4564): No heartbeat from core client for 30 sec - exiting 19:48:23 (4564): No heartbeat from core client for 30 sec - exiting 19:48:24 (4564): No heartbeat from core client for 30 sec - exiting 19:48:25 (4564): No heartbeat from core client for 30 sec - exiting 19:48:26 (4564): No heartbeat from core client for 30 sec - exiting 19:48:27 (4564): No heartbeat from core client for 30 sec - exiting 19:48:28 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:15:51 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o0odko.pje6c10 Error converting file to netcdf: dataout/o0odko.pie6c10 Error converting file to netcdf: dataout/o0odko.pfe6c10 Error converting file to netcdf: dataout/o0odka.phe6c10 Error converting file to netcdf: dataout/o0odka.pge6c10 Error converting file to netcdf: dataout/o0odka.pee6c10 Error converting file to netcdf: dataout/o0odka.pde6c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:43:59 (4004): No heartbeat from core client for 30 sec - exiting 07:44:00 (4004): No heartbeat from core client for 30 sec - exiting 07:44:01 (4004): No heartbeat from core client for 30 sec - exiting 07:44:02 (4004): No heartbeat from core client for 30 sec - exiting 07:44:03 (4004): No heartbeat from core client for 30 sec - exiting 07:44:04 (4004): No heartbeat from core client for 30 sec - exiting 07:44:05 (4004): No heartbeat from core client for 30 sec - exiting 07:44:06 (4004): No heartbeat from core client for 30 sec - exiting 07:44:07 (4004): No heartbeat from core client for 30 sec - exiting 07:44:08 (4004): No heartbeat from core client for 30 sec - exiting 07:44:09 (4004): No heartbeat from core client for 30 sec - exiting 07:44:10 (4004): No heartbeat from core client for 30 sec - exiting 07:44:11 (4004): No heartbeat from core client for 30 sec - exiting 07:44:12 (4004): No heartbeat from core client for 30 sec - exiting 07:44:13 (4004): No heartbeat from core client for 30 sec - exiting 07:44:14 (4004): No heartbeat from core client for 30 sec - exiting 07:44:15 (4004): No heartbeat from core client for 30 sec - exiting 07:44:16 (4004): No heartbeat from core client for 30 sec - exiting 07:44:17 (4004): No heartbeat from core client for 30 sec - exiting 07:44:18 (4004): No heartbeat from core client for 30 sec - exiting 07:44:19 (4004): No heartbeat from core client for 30 sec - exiting 07:44:20 (4004): No heartbeat from core client for 30 sec - exiting 07:44:21 (4004): No heartbeat from core client for 30 sec - exiting 07:44:22 (4004): No heartbeat from core client for 30 sec - exiting 07:44:23 (4004): No heartbeat from core client for 30 sec - exiting 07:44:24 (4004): No heartbeat from core client for 30 sec - exiting 07:44:25 (4004): No heartbeat from core client for 30 sec - exiting 07:44:26 (4004): No heartbeat from core client for 30 sec - exiting 07:44:27 (4004): No heartbeat from core client for 30 sec - exiting 07:44:28 (4004): No heartbeat from core client for 30 sec - exiting 07:44:29 (4004): No heartbeat from core client for 30 sec - exiting 07:44:30 (4004): No heartbeat from core client for 30 sec - exiting 07:44:31 (4004): No heartbeat from core client for 30 sec - exiting 07:44:32 (4004): No heartbeat from core client for 30 sec - exiting 07:44:33 (4004): No heartbeat from core client for 30 sec - exiting 07:44:34 (4004): No heartbeat from core client for 30 sec - exiting 07:44:35 (4004): No heartbeat from core client for 30 sec - exiting 07:44:36 (4004): No heartbeat from core client for 30 sec - exiting 07:44:37 (4004): No heartbeat from core client for 30 sec - exiting 07:44:38 (4004): No heartbeat from core client for 30 sec - exiting 07:44:39 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:44:40 (4004): No heartbeat from core client for 30 sec - exiting 07:44:41 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77EA3AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77EA71F3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2012 15:28:39	1193311	14797148	hadcm3n_o0od_1940_40_007833986_3	259,200	783,544	3.0229
23 Jul 2012 08:47:41	1193311	14797148	hadcm3n_o0od_1940_40_007833986_3	233,280	707,968	3.0348
21 Jul 2012 09:01:21	1193311	14797148	hadcm3n_o0od_1940_40_007833986_3	207,360	634,664	3.0607
13 Jul 2012 23:43:13	1193311	14797148	hadcm3n_o0od_1940_40_007833986_3	181,440	561,267	3.0934
11 Jul 2012 08:43:39	1193311	14797148	hadcm3n_o0od_1940_40_007833986_3	155,520	481,386	3.0953
06 Jul 2012 01:07:49	1193311	14797148	hadcm3n_o0od_1940_40_007833986_3	129,600	399,173	3.0800
03 Jul 2012 05:37:32	1193311	14797148	hadcm3n_o0od_1940_40_007833986_3	103,680	318,527	3.0722
25 Jun 2012 05:11:10	1193311	14797148	hadcm3n_o0od_1940_40_007833986_3	77,760	234,838	3.0200
23 Jun 2012 02:21:19	1193311	14797148	hadcm3n_o0od_1940_40_007833986_3	51,840	157,921	3.0463
21 Jun 2012 04:26:32	1193311	14797148	hadcm3n_o0od_1940_40_007833986_3	25,920	76,983	2.9700