Task 15698389

Name	hadcm3n_3iz9_1980_40_008333173_1
Workunit	8484034
Created	1 Apr 2013, 7:45:20 UTC
Sent	1 Apr 2013, 7:45:30 UTC
Report deadline	1 Jul 2013, 15:12:41 UTC
Received	28 May 2013, 15:46:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1181784
Run time	6 days 17 hours 11 min 58 sec
CPU time	6 days 13 hours 13 min 25 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.24 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:16:36 (6128): No heartbeat from core client for 30 sec - exiting 17:16:37 (6128): No heartbeat from core client for 30 sec - exiting 17:16:38 (6128): No heartbeat from core client for 30 sec - exiting 17:16:39 (6128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:16:40 (6128): No heartbeat from core client for 30 sec - exiting 17:16:41 (6128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:40:39 (4088): No heartbeat from core client for 30 sec - exiting 18:40:40 (4088): No heartbeat from core client for 30 sec - exiting 18:40:41 (4088): No heartbeat from core client for 30 sec - exiting 18:40:42 (4088): No heartbeat from core client for 30 sec - exiting 18:40:43 (4088): No heartbeat from core client for 30 sec - exiting 18:40:44 (4088): No heartbeat from core client for 30 sec - exiting 18:40:45 (4088): No heartbeat from core client for 30 sec - exiting 18:40:46 (4088): No heartbeat from core client for 30 sec - exiting 18:40:47 (4088): No heartbeat from core client for 30 sec - exiting 18:40:48 (4088): No heartbeat from core client for 30 sec - exiting 18:40:49 (4088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:53:57 (1544): No heartbeat from core client for 30 sec - exiting 18:53:58 (1544): No heartbeat from core client for 30 sec - exiting 18:53:59 (1544): No heartbeat from core client for 30 sec - exiting 18:54:00 (1544): No heartbeat from core client for 30 sec - exiting 18:54:01 (1544): No heartbeat from core client for 30 sec - exiting 18:54:02 (1544): No heartbeat from core client for 30 sec - exiting 18:54:03 (1544): No heartbeat from core client for 30 sec - exiting 18:54:04 (1544): No heartbeat from core client for 30 sec - exiting 18:54:05 (1544): No heartbeat from core client for 30 sec - exiting 18:54:06 (1544): No heartbeat from core client for 30 sec - exiting 18:54:07 (1544): No heartbeat from core client for 30 sec - exiting 18:54:08 (1544): No heartbeat from core client for 30 sec - exiting 18:54:09 (1544): No heartbeat from core client for 30 sec - exiting 18:54:10 (1544): No heartbeat from core client for 30 sec - exiting 18:54:11 (1544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:54:12 (1544): No heartbeat from core client for 30 sec - exiting 18:54:13 (1544): No heartbeat from core client for 30 sec - exiting 18:54:14 (1544): No heartbeat from core client for 30 sec - exiting 18:54:15 (1544): No heartbeat from core client for 30 sec - exiting 18:54:16 (1544): No heartbeat from core client for 30 sec - exiting 18:54:17 (1544): No heartbeat from core client for 30 sec - exiting 18:54:18 (1544): No heartbeat from core client for 30 sec - exiting 18:54:19 (1544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4796, iMonCtr=1 Model crash detected, will try to restart... 19:10:58 (3288): No heartbeat from core client for 30 sec - exiting 19:10:59 (3288): No heartbeat from core client for 30 sec - exiting 19:11:00 (3288): No heartbeat from core client for 30 sec - exiting 19:11:01 (3288): No heartbeat from core client for 30 sec - exiting 19:11:02 (3288): No heartbeat from core client for 30 sec - exiting 19:11:03 (3288): No heartbeat from core client for 30 sec - exiting 19:11:04 (3288): No heartbeat from core client for 30 sec - exiting 19:11:05 (3288): No heartbeat from core client for 30 sec - exiting 19:11:06 (3288): No heartbeat from core client for 30 sec - exiting 19:11:07 (3288): No heartbeat from core client for 30 sec - exiting 19:11:08 (3288): No heartbeat from core client for 30 sec - exiting 19:11:09 (3288): No heartbeat from core client for 30 sec - exiting 19:11:10 (3288): No heartbeat from core client for 30 sec - exiting 19:11:11 (3288): No heartbeat from core client for 30 sec - exiting 19:11:12 (3288): No heartbeat from core client for 30 sec - exiting 19:11:13 (3288): No heartbeat from core client for 30 sec - exiting 19:11:14 (3288): No heartbeat from core client for 30 sec - exiting 19:11:15 (3288): No heartbeat from core client for 30 sec - exiting 19:11:16 (3288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:11:17 (3288): No heartbeat from core client for 30 sec - exiting 19:11:18 (3288): No heartbeat from core client for 30 sec - exiting 19:11:19 (3288): No heartbeat from core client for 30 sec - exiting 19:11:20 (3288): No heartbeat from core client for 30 sec - exiting 19:11:21 (3288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:57:29 (3300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:45:22 (3236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77573AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4676, selfPID=4676, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77573AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 May 2013 17:07:19	1181784	15698389	hadcm3n_3iz9_1980_40_008333173_1	259,200	560,950	2.1642
27 May 2013 01:51:32	1181784	15698389	hadcm3n_3iz9_1980_40_008333173_1	233,280	507,723	2.1765
26 May 2013 03:28:35	1181784	15698389	hadcm3n_3iz9_1980_40_008333173_1	207,360	453,917	2.1890
07 Apr 2013 08:07:40	1181784	15698389	hadcm3n_3iz9_1980_40_008333173_1	181,440	398,967	2.1989
06 Apr 2013 07:48:15	1181784	15698389	hadcm3n_3iz9_1980_40_008333173_1	155,520	341,853	2.1981
05 Apr 2013 05:23:16	1181784	15698389	hadcm3n_3iz9_1980_40_008333173_1	129,600	282,015	2.1760
04 Apr 2013 05:04:14	1181784	15698389	hadcm3n_3iz9_1980_40_008333173_1	103,680	225,640	2.1763
03 Apr 2013 08:10:15	1181784	15698389	hadcm3n_3iz9_1980_40_008333173_1	77,760	167,832	2.1583
02 Apr 2013 15:45:53	1181784	15698389	hadcm3n_3iz9_1980_40_008333173_1	51,840	110,817	2.1377
01 Apr 2013 23:25:02	1181784	15698389	hadcm3n_3iz9_1980_40_008333173_1	25,920	54,333	2.0962