Task 15585351

Name	hadcm3n_o6uq_2140_40_008269630_4
Workunit	8424754
Created	6 Feb 2013, 1:38:25 UTC
Sent	6 Feb 2013, 1:38:36 UTC
Report deadline	8 May 2013, 9:05:47 UTC
Received	1 Apr 2013, 0:28:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1096292
Run time	11 days 0 hours 52 min 15 sec
CPU time	9 days 5 hours 10 min 19 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.87 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:17:05 (3048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o6uqko.pjy1c10 Error converting file to netcdf: dataout/o6uqko.piy1c10 Error converting file to netcdf: dataout/o6uqko.pfy1c10 Error converting file to netcdf: dataout/o6uqka.phy1c10 Error converting file to netcdf: dataout/o6uqka.pgy1c10 Error converting file to netcdf: dataout/o6uqka.pey1c10 Error converting file to netcdf: dataout/o6uqka.pdy1c10 CPDN Monitor - Quit request from BOINC... 08:19:18 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:23:39 (2940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:23:09 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:09:11 (2848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:09:12 (2848): No heartbeat from core client for 30 sec - exiting 10:09:13 (2848): No heartbeat from core client for 30 sec - exiting 10:09:14 (2848): No heartbeat from core client for 30 sec - exiting 10:09:15 (2848): No heartbeat from core client for 30 sec - exiting 10:09:16 (2848): No heartbeat from core client for 30 sec - exiting 10:09:17 (2848): No heartbeat from core client for 30 sec - exiting 10:09:19 (2848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 13:13:04 (2928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:01:21 (3012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:01:22 (3012): No heartbeat from core client for 30 sec - exiting 16:01:23 (3012): No heartbeat from core client for 30 sec - exiting 16:01:24 (3012): No heartbeat from core client for 30 sec - exiting 16:01:25 (3012): No heartbeat from core client for 30 sec - exiting 16:01:26 (3012): No heartbeat from core client for 30 sec - exiting 16:01:28 (3012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:48:56 (3076): No heartbeat from core client for 30 sec - exiting 13:48:57 (3076): No heartbeat from core client for 30 sec - exiting 13:48:58 (3076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:56:23 (2944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:14:51 (2912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:54:39 (2896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:32:50 (3004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:29:15 (3016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:41 (2380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:15:08 (2956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:33:35 (3000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:40:50 (3108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:42:58 (3028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:29:52 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:29:53 (3228): No heartbeat from core client for 30 sec - exiting 09:29:54 (3228): No heartbeat from core client for 30 sec - exiting 09:29:56 (3228): No heartbeat from core client for 30 sec - exiting 09:29:57 (3228): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2480, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:54:18 (2376): No heartbeat from core client for 30 sec - exiting 12:54:19 (2376): No heartbeat from core client for 30 sec - exiting 12:54:20 (2376): No heartbeat from core client for 30 sec - exiting 12:54:22 (2376): No heartbeat from core client for 30 sec - exiting 12:54:23 (2376): No heartbeat from core client for 30 sec - exiting 12:54:24 (2376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:25 (2376): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2560, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:56:44 (3012): No heartbeat from core client for 30 sec - exiting 12:56:45 (3012): No heartbeat from core client for 30 sec - exiting 12:56:46 (3012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:42:19 (3080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:07:46 (3092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:25:52 (4056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:25:53 (4056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 14:06:49 (664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:06:50 (664): No heartbeat from core client for 30 sec - exiting 14:06:51 (664): No heartbeat from core client for 30 sec - exiting 14:06:52 (664): No heartbeat from core client for 30 sec - exiting 14:06:54 (664): No heartbeat from core client for 30 sec - exiting 14:06:55 (664): No heartbeat from core client for 30 sec - exiting 14:06:56 (664): No heartbeat from core client for 30 sec - exiting 14:06:57 (664): No heartbeat from core client for 30 sec - exiting 14:06:58 (664): No heartbeat from core client for 30 sec - exiting 14:06:59 (664): No heartbeat from core client for 30 sec - exiting 14:07:00 (664): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C931780 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Mar 2013 07:08:54	1096292	15585351	hadcm3n_o6uq_2140_40_008269630_4	259,200	796,201	3.0718
26 Mar 2013 01:38:22	1096292	15585351	hadcm3n_o6uq_2140_40_008269630_4	233,280	712,984	3.0563
20 Mar 2013 05:11:10	1096292	15585351	hadcm3n_o6uq_2140_40_008269630_4	207,360	635,116	3.0629
14 Mar 2013 06:44:16	1096292	15585351	hadcm3n_o6uq_2140_40_008269630_4	181,440	566,234	3.1208
10 Mar 2013 07:31:08	1096292	15585351	hadcm3n_o6uq_2140_40_008269630_4	155,520	484,944	3.1182
05 Mar 2013 02:24:05	1096292	15585351	hadcm3n_o6uq_2140_40_008269630_4	129,600	403,254	3.1115
28 Feb 2013 01:35:50	1096292	15585351	hadcm3n_o6uq_2140_40_008269630_4	103,680	321,203	3.0980
24 Feb 2013 01:37:31	1096292	15585351	hadcm3n_o6uq_2140_40_008269630_4	77,760	240,083	3.0875
18 Feb 2013 05:52:42	1096292	15585351	hadcm3n_o6uq_2140_40_008269630_4	51,840	158,927	3.0657
10 Feb 2013 07:21:36	1096292	15585351	hadcm3n_o6uq_2140_40_008269630_4	25,920	78,818	3.0408