Task 15635456

Name	hadcm3n_3d0k_1980_40_008320630_0
Workunit	8471765
Created	24 Feb 2013, 15:06:53 UTC
Sent	24 Feb 2013, 15:11:54 UTC
Report deadline	26 May 2013, 22:39:05 UTC
Received	12 May 2013, 7:45:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1187187
Run time	8 days 7 hours 39 min 58 sec
CPU time	6 days 14 hours 45 min 58 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.74 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:25:51 (1476): No heartbeat from core client for 30 sec - exiting 18:25:52 (1476): No heartbeat from core client for 30 sec - exiting 18:25:53 (1476): No heartbeat from core client for 30 sec - exiting 18:25:55 (1476): No heartbeat from core client for 30 sec - exiting 18:25:56 (1476): No heartbeat from core client for 30 sec - exiting 18:25:57 (1476): No heartbeat from core client for 30 sec - exiting 18:25:58 (1476): No heartbeat from core client for 30 sec - exiting 18:25:59 (1476): No heartbeat from core client for 30 sec - exiting 18:26:00 (1476): No heartbeat from core client for 30 sec - exiting 18:26:01 (1476): No heartbeat from core client for 30 sec - exiting 18:26:02 (1476): No heartbeat from core client for 30 sec - exiting 18:26:03 (1476): No heartbeat from core client for 30 sec - exiting 18:26:04 (1476): No heartbeat from core client for 30 sec - exiting 18:26:06 (1476): No heartbeat from core client for 30 sec - exiting 18:26:07 (1476): No heartbeat from core client for 30 sec - exiting 18:26:08 (1476): No heartbeat from core client for 30 sec - exiting 18:26:09 (1476): No heartbeat from core client for 30 sec - exiting 18:26:10 (1476): No heartbeat from core client for 30 sec - exiting 18:26:11 (1476): No heartbeat from core client for 30 sec - exiting 18:26:12 (1476): No heartbeat from core client for 30 sec - exiting 18:26:13 (1476): No heartbeat from core client for 30 sec - exiting 18:26:14 (1476): No heartbeat from core client for 30 sec - exiting 18:26:15 (1476): No heartbeat from core client for 30 sec - exiting 18:26:17 (1476): No heartbeat from core client for 30 sec - exiting 18:26:18 (1476): No heartbeat from core client for 30 sec - exiting 18:26:19 (1476): No heartbeat from core client for 30 sec - exiting 18:26:20 (1476): No heartbeat from core client for 30 sec - exiting 18:26:21 (1476): No heartbeat from core client for 30 sec - exiting 18:26:22 (1476): No heartbeat from core client for 30 sec - exiting 18:26:23 (1476): No heartbeat from core client for 30 sec - exiting 18:26:24 (1476): No heartbeat from core client for 30 sec - exiting 18:26:25 (1476): No heartbeat from core client for 30 sec - exiting 18:26:27 (1476): No heartbeat from core client for 30 sec - exiting 18:26:28 (1476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/3d0kko.pji7c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:23:12 (7932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:23:13 (7932): No heartbeat from core client for 30 sec - exiting 14:23:14 (7932): No heartbeat from core client for 30 sec - exiting 14:23:15 (7932): No heartbeat from core client for 30 sec - exiting 14:23:16 (7932): No heartbeat from core client for 30 sec - exiting 14:23:17 (7932): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/3d0kko.pji9c10 Error converting file to netcdf: dataout/3d0kko.pii9c10 Error converting file to netcdf: dataout/3d0kko.pfi9c10 Error converting file to netcdf: dataout/3d0kka.phi9c10 Error converting file to netcdf: dataout/3d0kka.pgi9c10 Error converting file to netcdf: dataout/3d0kka.pei9c10 Error converting file to netcdf: dataout/3d0kka.pdi9c10 11:27:41 (5304): No heartbeat from core client for 30 sec - exiting 11:27:42 (5304): No heartbeat from core client for 30 sec - exiting 11:27:43 (5304): No heartbeat from core client for 30 sec - exiting 11:27:44 (5304): No heartbeat from core client for 30 sec - exiting 11:27:45 (5304): No heartbeat from core client for 30 sec - exiting 11:27:46 (5304): No heartbeat from core client for 30 sec - exiting 11:27:47 (5304): No heartbeat from core client for 30 sec - exiting 11:27:48 (5304): No heartbeat from core client for 30 sec - exiting 11:27:50 (5304): No heartbeat from core client for 30 sec - exiting 11:27:51 (5304): No heartbeat from core client for 30 sec - exiting 11:27:52 (5304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/3d0kko.pji9c10 Error converting file to netcdf: dataout/3d0kko.pii9c10 Error converting file to netcdf: dataout/3d0kko.pfi9c10 Error converting file to netcdf: dataout/3d0kka.phi9c10 Error converting file to netcdf: dataout/3d0kka.pgi9c10 Error converting file to netcdf: dataout/3d0kka.pei9c10 Error converting file to netcdf: dataout/3d0kka.pdi9c10 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C25EAB read attempt to address 0x40FA7256 Engaging BOINC Windows Runtime Debugger... Signal 11 received, exiting... Called boinc_finish ERROR: Invalid parameter detected in function (null). File: (null) Line: 0 ERROR: Expression: (null) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 May 2013 16:16:18	1187187	15635456	hadcm3n_3d0k_1980_40_008320630_0	259,200	561,297	2.1655
09 May 2013 09:36:16	1187187	15635456	hadcm3n_3d0k_1980_40_008320630_0	233,280	504,502	2.1626
21 Apr 2013 19:52:47	1187187	15635456	hadcm3n_3d0k_1980_40_008320630_0	207,360	448,274	2.1618
20 Apr 2013 19:15:08	1187187	15635456	hadcm3n_3d0k_1980_40_008320630_0	181,440	393,773	2.1703
06 Apr 2013 14:30:28	1187187	15635456	hadcm3n_3d0k_1980_40_008320630_0	155,520	336,958	2.1667
31 Mar 2013 18:46:47	1187187	15635456	hadcm3n_3d0k_1980_40_008320630_0	129,600	281,357	2.1710
30 Mar 2013 10:45:00	1187187	15635456	hadcm3n_3d0k_1980_40_008320630_0	103,680	224,708	2.1673
26 Mar 2013 17:52:17	1187187	15635456	hadcm3n_3d0k_1980_40_008320630_0	77,760	167,934	2.1596
16 Mar 2013 17:41:25	1187187	15635456	hadcm3n_3d0k_1980_40_008320630_0	51,840	112,909	2.1780
09 Mar 2013 12:28:06	1187187	15635456	hadcm3n_3d0k_1980_40_008320630_0	25,920	61,503	2.3728