Task 16489162

Name	hadcm3n_o83x_1900_40_008465632_2
Workunit	8616471
Created	10 Apr 2014, 9:16:45 UTC
Sent	10 Apr 2014, 9:18:22 UTC
Report deadline	10 Jul 2014, 16:45:33 UTC
Received	4 May 2014, 18:20:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1322841
Run time	6 days 12 hours 52 min 14 sec
CPU time	6 days 5 hours 10 min 43 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.77 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.3.11</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9188, iMonCtr=1 Model crash detected, will try to restart... 12:30:27 (6456): No heartbeat from core client for 30 sec - exiting 12:30:28 (6456): No heartbeat from core client for 30 sec - exiting 12:30:29 (6456): No heartbeat from core client for 30 sec - exiting 12:30:30 (6456): No heartbeat from core client for 30 sec - exiting 12:30:31 (6456): No heartbeat from core client for 30 sec - exiting 12:30:32 (6456): No heartbeat from core client for 30 sec - exiting 12:30:33 (6456): No heartbeat from core client for 30 sec - exiting 12:30:34 (6456): No heartbeat from core client for 30 sec - exiting 12:30:35 (6456): No heartbeat from core client for 30 sec - exiting 12:30:36 (6456): No heartbeat from core client for 30 sec - exiting 12:30:38 (6456): No heartbeat from core client for 30 sec - exiting 12:30:39 (6456): No heartbeat from core client for 30 sec - exiting 12:30:40 (6456): No heartbeat from core client for 30 sec - exiting 12:30:41 (6456): No heartbeat from core client for 30 sec - exiting 12:30:42 (6456): No heartbeat from core client for 30 sec - exiting 12:30:43 (6456): No heartbeat from core client for 30 sec - exiting 12:30:44 (6456): No heartbeat from core client for 30 sec - exiting 12:30:45 (6456): No heartbeat from core client for 30 sec - exiting 12:30:46 (6456): No heartbeat from core client for 30 sec - exiting 12:30:47 (6456): No heartbeat from core client for 30 sec - exiting 12:30:48 (6456): No heartbeat from core client for 30 sec - exiting 12:30:50 (6456): No heartbeat from core client for 30 sec - exiting 12:30:51 (6456): No heartbeat from core client for 30 sec - exiting 12:30:52 (6456): No heartbeat from core client for 30 sec - exiting 12:30:53 (6456): No heartbeat from core client for 30 sec - exiting 12:30:54 (6456): No heartbeat from core client for 30 sec - exiting 12:30:55 (6456): No heartbeat from core client for 30 sec - exiting 12:30:56 (6456): No heartbeat from core client for 30 sec - exiting 12:30:57 (6456): No heartbeat from core client for 30 sec - exiting 12:30:58 (6456): No heartbeat from core client for 30 sec - exiting 12:30:59 (6456): No heartbeat from core client for 30 sec - exiting 12:31:00 (6456): No heartbeat from core client for 30 sec - exiting 12:31:02 (6456): No heartbeat from core client for 30 sec - exiting 12:31:03 (6456): No heartbeat from core client for 30 sec - exiting 12:31:04 (6456): No heartbeat from core client for 30 sec - exiting 12:31:05 (6456): No heartbeat from core client for 30 sec - exiting 12:31:06 (6456): No heartbeat from core client for 30 sec - exiting 12:31:07 (6456): No heartbeat from core client for 30 sec - exiting 12:31:08 (6456): No heartbeat from core client for 30 sec - exiting 12:31:09 (6456): No heartbeat from core client for 30 sec - exiting 12:31:10 (6456): No heartbeat from core client for 30 sec - exiting 12:31:11 (6456): No heartbeat from core client for 30 sec - exiting 12:31:12 (6456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:31:14 (6456): No heartbeat from core client for 30 sec - exiting 12:31:15 (6456): No heartbeat from core client for 30 sec - exiting 12:31:16 (6456): No heartbeat from core client for 30 sec - exiting 12:31:17 (6456): No heartbeat from core client for 30 sec - exiting 12:31:18 (6456): No heartbeat from core client for 30 sec - exiting 12:31:19 (6456): No heartbeat from core client for 30 sec - exiting 12:31:20 (6456): No heartbeat from core client for 30 sec - exiting 12:31:21 (6456): No heartbeat from core client for 30 sec - exiting 12:31:22 (6456): No heartbeat from core client for 30 sec - exiting 12:31:23 (6456): No heartbeat from core client for 30 sec - exiting 12:33:12 (7144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:35:04 (7040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:15:51 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:15:53 (5900): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10924, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=372, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8140, iMonCtr=1 Model crash detected, will try to restart... 09:55:44 (5076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:26:08 (4756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:49:31 (1824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5556, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5896, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3476, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 15:30:03 (8568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8608, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:01:18 (10472): No heartbeat from core client for 30 sec - exiting 22:01:19 (10472): No heartbeat from core client for 30 sec - exiting 22:01:20 (10472): No heartbeat from core client for 30 sec - exiting 22:01:21 (10472): No heartbeat from core client for 30 sec - exiting 22:01:22 (10472): No heartbeat from core client for 30 sec - exiting 22:01:23 (10472): No heartbeat from core client for 30 sec - exiting 22:01:24 (10472): No heartbeat from core client for 30 sec - exiting 22:01:25 (10472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:43:00 (4612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:27:01 (5500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8748, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:12:24 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:15:06 (7120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3392, iMonCtr=1 Model crash detected, will try to restart... 10:06:14 (5356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77573AC3 read attempt to address 0x40BD7D71 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77173AC3 read attempt to address 0x40BD7D71 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 May 2014 15:20:06	1322841	16489162	hadcm3n_o83x_1900_40_008465632_2	259,200	531,987	2.0524
01 May 2014 13:34:22	1322841	16489162	hadcm3n_o83x_1900_40_008465632_2	233,280	477,230	2.0457
29 Apr 2014 22:30:47	1322841	16489162	hadcm3n_o83x_1900_40_008465632_2	207,360	422,528	2.0377
28 Apr 2014 13:22:50	1322841	16489162	hadcm3n_o83x_1900_40_008465632_2	181,440	367,006	2.0227
26 Apr 2014 13:50:33	1322841	16489162	hadcm3n_o83x_1900_40_008465632_2	155,520	311,843	2.0052
25 Apr 2014 12:47:03	1322841	16489162	hadcm3n_o83x_1900_40_008465632_2	129,600	265,905	2.0517
22 Apr 2014 20:08:01	1322841	16489162	hadcm3n_o83x_1900_40_008465632_2	103,680	212,953	2.0539
17 Apr 2014 18:02:12	1322841	16489162	hadcm3n_o83x_1900_40_008465632_2	77,760	159,794	2.0550
16 Apr 2014 16:39:50	1322841	16489162	hadcm3n_o83x_1900_40_008465632_2	51,840	105,912	2.0431
14 Apr 2014 22:05:27	1322841	16489162	hadcm3n_o83x_1900_40_008465632_2	25,920	53,222	2.0533