Task 14019595

Name	hadcm3n_ykfx_1980_40_007742252_3
Workunit	7897360
Created	27 Jan 2012, 17:15:53 UTC
Sent	27 Jan 2012, 17:19:55 UTC
Report deadline	28 Apr 2012, 0:47:06 UTC
Received	9 Apr 2012, 1:28:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1173669
Run time	3 days 1 hours 22 min 21 sec
CPU time	2 days 22 hours 5 min 19 sec
Validate state	Invalid
Credit	1,555.20
Device peak FLOPS	2.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> 09:59:23 (4456): No heartbeat from core client for 30 sec - exiting 09:59:24 (4456): No heartbeat from core client for 30 sec - exiting 09:59:25 (4456): No heartbeat from core client for 30 sec - exiting 09:59:26 (4456): No heartbeat from core client for 30 sec - exiting 09:59:27 (4456): No heartbeat from core client for 30 sec - exiting 09:59:28 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3684, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 09:20:20 (1668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:21 (1660): No heartbeat from core client for 30 sec - exiting 13:34:22 (1660): No heartbeat from core client for 30 sec - exiting 13:34:23 (1660): No heartbeat from core client for 30 sec - exiting 13:34:24 (1660): No heartbeat from core client for 30 sec - exiting 13:34:25 (1660): No heartbeat from core client for 30 sec - exiting 13:34:26 (1660): No heartbeat from core client for 30 sec - exiting 13:34:27 (1660): No heartbeat from core client for 30 sec - exiting 13:34:28 (1660): No heartbeat from core client for 30 sec - exiting 13:34:29 (1660): No heartbeat from core client for 30 sec - exiting 13:34:30 (1660): No heartbeat from core client for 30 sec - exiting 13:34:31 (1660): No heartbeat from core client for 30 sec - exiting 13:34:32 (1660): No heartbeat from core client for 30 sec - exiting 13:34:33 (1660): No heartbeat from core client for 30 sec - exiting 13:34:34 (1660): No heartbeat from core client for 30 sec - exiting 13:34:35 (1660): No heartbeat from core client for 30 sec - exiting 13:34:36 (1660): No heartbeat from core client for 30 sec - exiting 13:34:37 (1660): No heartbeat from core client for 30 sec - exiting 13:34:38 (1660): No heartbeat from core client for 30 sec - exiting 13:34:39 (1660): No heartbeat from core client for 30 sec - exiting 13:34:40 (1660): No heartbeat from core client for 30 sec - exiting 13:34:41 (1660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:42 (1660): No heartbeat from core client for 30 sec - exiting 13:34:43 (1660): No heartbeat from core client for 30 sec - exiting 13:34:44 (1660): No heartbeat from core client for 30 sec - exiting 13:34:45 (1660): No heartbeat from core client for 30 sec - exiting 13:34:46 (1660): No heartbeat from core client for 30 sec - exiting 13:34:47 (1660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 10:39:00 (4140): No heartbeat from core client for 30 sec - exiting 10:39:01 (4140): No heartbeat from core client for 30 sec - exiting 10:39:02 (4140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:39:03 (4140): No heartbeat from core client for 30 sec - exiting 10:39:04 (4140): No heartbeat from core client for 30 sec - exiting 10:39:05 (4140): No heartbeat from core client for 30 sec - exiting 10:39:06 (4140): No heartbeat from core client for 30 sec - exiting 10:39:07 (4140): No heartbeat from core client for 30 sec - exiting 10:30:17 (5424): No heartbeat from core client for 30 sec - exiting 10:30:18 (5424): No heartbeat from core client for 30 sec - exiting 10:30:19 (5424): No heartbeat from core client for 30 sec - exiting 10:30:20 (5424): No heartbeat from core client for 30 sec - exiting 10:30:21 (5424): No heartbeat from core client for 30 sec - exiting 10:30:22 (5424): No heartbeat from core client for 30 sec - exiting 10:30:23 (5424): No heartbeat from core client for 30 sec - exiting 10:30:24 (5424): No heartbeat from core client for 30 sec - exiting 10:30:25 (5424): No heartbeat from core client for 30 sec - exiting 10:30:26 (5424): No heartbeat from core client for 30 sec - exiting 10:30:27 (5424): No heartbeat from core client for 30 sec - exiting 10:30:28 (5424): No heartbeat from core client for 30 sec - exiting 10:30:29 (5424): No heartbeat from core client for 30 sec - exiting 10:30:30 (5424): No heartbeat from core client for 30 sec - exiting 10:30:31 (5424): No heartbeat from core client for 30 sec - exiting 10:30:32 (5424): No heartbeat from core client for 30 sec - exiting 10:30:34 (5424): No heartbeat from core client for 30 sec - exiting 10:30:35 (5424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:43:05 (7296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:43:40 (3288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:23:17 (5804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:31:53 (5736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:18 (4912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:40:42 (8756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4216, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Apr 2012 23:41:17	1173669	14019595	hadcm3n_ykfx_1980_40_007742252_3	129,600	241,740	1.8653
29 Mar 2012 19:08:13	1173669	14019595	hadcm3n_ykfx_1980_40_007742252_3	103,680	189,749	1.8301
07 Mar 2012 15:01:50	1173669	14019595	hadcm3n_ykfx_1980_40_007742252_3	77,760	138,869	1.7859
16 Feb 2012 17:31:55	1173669	14019595	hadcm3n_ykfx_1980_40_007742252_3	51,840	91,744	1.7698
30 Jan 2012 16:29:09	1173669	14019595	hadcm3n_ykfx_1980_40_007742252_3	25,920	46,100	1.7785