Task 13649767

Name	hadcm3n_ydtn_1900_40_007518387_2
Workunit	7715862
Created	21 Nov 2011, 0:18:20 UTC
Sent	21 Nov 2011, 0:26:44 UTC
Report deadline	20 Feb 2012, 7:53:55 UTC
Received	8 Dec 2011, 14:39:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1112451
Run time	4 days 14 hours 30 min 2 sec
CPU time	4 days 0 hours 52 min 46 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.80 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4660, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4848, iMonCtr=1 Model crash detected, will try to restart... 07:21:42 (4788): No heartbeat from core client for 30 sec - exiting 07:21:43 (4788): No heartbeat from core client for 30 sec - exiting 07:21:44 (4788): No heartbeat from core client for 30 sec - exiting 07:21:45 (4788): No heartbeat from core client for 30 sec - exiting 07:21:46 (4788): No heartbeat from core client for 30 sec - exiting 07:21:47 (4788): No heartbeat from core client for 30 sec - exiting 07:21:48 (4788): No heartbeat from core client for 30 sec - exiting 07:21:49 (4788): No heartbeat from core client for 30 sec - exiting 07:21:50 (4788): No heartbeat from core client for 30 sec - exiting 07:21:51 (4788): No heartbeat from core client for 30 sec - exiting 07:21:52 (4788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:21:54 (4788): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4348, iMonCtr=1 Model crash detected, will try to restart... 17:25:10 (1996): No heartbeat from core client for 30 sec - exiting 17:25:11 (1996): No heartbeat from core client for 30 sec - exiting 17:25:13 (1996): No heartbeat from core client for 30 sec - exiting 17:25:14 (1996): No heartbeat from core client for 30 sec - exiting 17:25:15 (1996): No heartbeat from core client for 30 sec - exiting 17:25:16 (1996): No heartbeat from core client for 30 sec - exiting 17:25:17 (1996): No heartbeat from core client for 30 sec - exiting 17:25:18 (1996): No heartbeat from core client for 30 sec - exiting 17:25:19 (1996): No heartbeat from core client for 30 sec - exiting 17:25:20 (1996): No heartbeat from core client for 30 sec - exiting 17:25:21 (1996): No heartbeat from core client for 30 sec - exiting 17:25:22 (1996): No heartbeat from core client for 30 sec - exiting 17:25:23 (1996): No heartbeat from core client for 30 sec - exiting 17:25:25 (1996): No heartbeat from core client for 30 sec - exiting 17:25:26 (1996): No heartbeat from core client for 30 sec - exiting 17:25:27 (1996): No heartbeat from core client for 30 sec - exiting 17:25:28 (1996): No heartbeat from core client for 30 sec - exiting 17:25:29 (1996): No heartbeat from core client for 30 sec - exiting 17:25:30 (1996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3332, iMonCtr=1 Model crash detected, will try to restart... 17:33:34 (3516): No heartbeat from core client for 30 sec - exiting 17:33:35 (3516): No heartbeat from core client for 30 sec - exiting 17:33:36 (3516): No heartbeat from core client for 30 sec - exiting 17:33:37 (3516): No heartbeat from core client for 30 sec - exiting 17:33:38 (3516): No heartbeat from core client for 30 sec - exiting 17:33:39 (3516): No heartbeat from core client for 30 sec - exiting 17:33:40 (3516): No heartbeat from core client for 30 sec - exiting 17:33:41 (3516): No heartbeat from core client for 30 sec - exiting 17:33:42 (3516): No heartbeat from core client for 30 sec - exiting 17:33:43 (3516): No heartbeat from core client for 30 sec - exiting 17:33:44 (3516): No heartbeat from core client for 30 sec - exiting 17:33:45 (3516): No heartbeat from core client for 30 sec - exiting 17:33:46 (3516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1900, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4752, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3892, iMonCtr=1 Model crash detected, will try to restart... 07:12:05 (2948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C17:08:24 (2728): No heartbeat from core client for 30 sec - exiting 17:08:25 (2728): No heartbeat from core client for 30 sec - exiting 17:08:26 (2728): No heartbeat from core client for 30 sec - exiting 17:08:27 (2728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4304, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1900, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x774B3A93 read attempt to address 0x406F5568 Engaging BOINC Windows Runtime Debugger... Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77133772 read attempt to address 0x406F5568 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Dec 2011 14:44:39	1112451	13649767	hadcm3n_ydtn_1900_40_007518387_2	259,200	337,959	1.3039
05 Dec 2011 00:38:58	1112451	13649767	hadcm3n_ydtn_1900_40_007518387_2	233,280	303,434	1.3007
03 Dec 2011 21:31:54	1112451	13649767	hadcm3n_ydtn_1900_40_007518387_2	207,360	269,597	1.3001
02 Dec 2011 15:08:38	1112451	13649767	hadcm3n_ydtn_1900_40_007518387_2	181,440	236,184	1.3017
02 Dec 2011 15:08:38	1112451	13649767	hadcm3n_ydtn_1900_40_007518387_2	155,520	202,770	1.3038
02 Dec 2011 15:08:38	1112451	13649767	hadcm3n_ydtn_1900_40_007518387_2	129,600	168,939	1.3035
27 Nov 2011 15:07:22	1112451	13649767	hadcm3n_ydtn_1900_40_007518387_2	103,680	134,485	1.2971
26 Nov 2011 23:48:00	1112451	13649767	hadcm3n_ydtn_1900_40_007518387_2	77,760	100,500	1.2924
26 Nov 2011 23:48:00	1112451	13649767	hadcm3n_ydtn_1900_40_007518387_2	51,840	66,816	1.2889
25 Nov 2011 02:49:27	1112451	13649767	hadcm3n_ydtn_1900_40_007518387_2	25,920	33,201	1.2809