Task 13375499

Name	hadcm3n_yg7x_1940_40_007452883_2
Workunit	7650386
Created	11 Sep 2011, 17:57:59 UTC
Sent	11 Sep 2011, 18:02:30 UTC
Report deadline	12 Dec 2011, 1:29:41 UTC
Received	9 Dec 2011, 18:18:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1168763
Run time	6 days 1 hours 38 min 26 sec
CPU time	5 days 15 hours 4 min 28 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.41 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5856, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:33:48 (2264): No heartbeat from core client for 30 sec - exiting 22:33:49 (2264): No heartbeat from core client for 30 sec - exiting 22:33:50 (2264): No heartbeat from core client for 30 sec - exiting 22:33:51 (2264): No heartbeat from core client for 30 sec - exiting 22:33:52 (2264): No heartbeat from core client for 30 sec - exiting 22:33:53 (2264): No heartbeat from core client for 30 sec - exiting 22:33:54 (2264): No heartbeat from core client for 30 sec - exiting 22:33:55 (2264): No heartbeat from core client for 30 sec - exiting 22:33:56 (2264): No heartbeat from core client for 30 sec - exiting 22:33:57 (2264): No heartbeat from core client for 30 sec - exiting 22:33:58 (2264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:33:59 (2264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:28:01 (4720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:23:47 (2936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:38:34 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:39:17 (2864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:38:23 (5720): No heartbeat from core client for 30 sec - exiting 15:38:24 (5720): No heartbeat from core client for 30 sec - exiting 15:38:25 (5720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:22:56 (4364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3584, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:10:07 (5940): No heartbeat from core client for 30 sec - exiting 21:10:08 (5940): No heartbeat from core client for 30 sec - exiting 21:10:09 (5940): No heartbeat from core client for 30 sec - exiting 21:10:10 (5940): No heartbeat from core client for 30 sec - exiting 21:10:11 (5940): No heartbeat from core client for 30 sec - exiting 21:10:12 (5940): No heartbeat from core client for 30 sec - exiting 21:10:13 (5940): No heartbeat from core client for 30 sec - exiting 21:10:14 (5940): No heartbeat from core client for 30 sec - exiting 21:10:15 (5940): No heartbeat from core client for 30 sec - exiting 21:10:16 (5940): No heartbeat from core client for 30 sec - exiting 21:10:17 (5940): No heartbeat from core client for 30 sec - exiting 21:10:18 (5940): No heartbeat from core client for 30 sec - exiting 21:10:19 (5940): No heartbeat from core client for 30 sec - exiting 21:10:20 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:10:21 (5940): No heartbeat from core client for 30 sec - exiting 21:21:23 (2428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5020, iMonCtr=1 Model crash detected, will try to restart... 21:01:09 (4180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:18:59 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:45:50 (3768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4036, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2784, iMonCtr=1 Model crash detected, will try to restart... 14:05:56 (3388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:12:07 (5616): No heartbeat from core client for 30 sec - exiting 18:12:08 (5616): No heartbeat from core client for 30 sec - exiting 18:12:09 (5616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:37:53 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:56:50 (4016): No heartbeat from core client for 30 sec - exiting 02:56:51 (4016): No heartbeat from core client for 30 sec - exiting 02:56:52 (4016): No heartbeat from core client for 30 sec - exiting 02:56:53 (4016): No heartbeat from core client for 30 sec - exiting 02:56:54 (4016): No heartbeat from core client for 30 sec - exiting 02:56:56 (4016): No heartbeat from core client for 30 sec - exiting 02:56:57 (4016): No heartbeat from core client for 30 sec - exiting 02:56:58 (4016): No heartbeat from core client for 30 sec - exiting 02:56:59 (4016): No heartbeat from core client for 30 sec - exiting 02:57:00 (4016): No heartbeat from core client for 30 sec - exiting 02:57:01 (4016): No heartbeat from core client for 30 sec - exiting 02:57:02 (4016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:57:38 (2624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5220, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 12:30:22 (800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:36:23 (3484): No heartbeat from core client for 30 sec - exiting 00:36:24 (3484): No heartbeat from core client for 30 sec - exiting 00:36:25 (3484): No heartbeat from core client for 30 sec - exiting 00:36:26 (3484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3792, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 19:59:26 (4928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=144, iMonCtr=1 Model crash detected, will try to restart... 13:47:20 (2548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:43:34 (5540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:59:10 (4092): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x773B3A93 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4572, selfPID=4572, iMonCtr=1 Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x778C3772 read attempt to address 0x40A92020 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Dec 2011 17:30:22	1168763	13375499	hadcm3n_yg7x_1940_40_007452883_2	259,200	475,339	1.8339
28 Nov 2011 20:11:12	1168763	13375499	hadcm3n_yg7x_1940_40_007452883_2	233,280	429,444	1.8409
22 Nov 2011 22:09:44	1168763	13375499	hadcm3n_yg7x_1940_40_007452883_2	207,360	382,880	1.8465
07 Nov 2011 19:41:34	1168763	13375499	hadcm3n_yg7x_1940_40_007452883_2	181,440	341,990	1.8849
31 Oct 2011 17:09:16	1168763	13375499	hadcm3n_yg7x_1940_40_007452883_2	155,520	291,820	1.8764
31 Oct 2011 15:15:10	1168763	13375499	hadcm3n_yg7x_1940_40_007452883_2	129,600	237,200	1.8302
18 Oct 2011 00:26:55	1168763	13375499	hadcm3n_yg7x_1940_40_007452883_2	103,680	191,147	1.8436
03 Oct 2011 20:24:15	1168763	13375499	hadcm3n_yg7x_1940_40_007452883_2	77,760	143,253	1.8422
25 Sep 2011 16:20:22	1168763	13375499	hadcm3n_yg7x_1940_40_007452883_2	51,840	93,849	1.8104
18 Sep 2011 16:30:09	1168763	13375499	hadcm3n_yg7x_1940_40_007452883_2	25,920	47,949	1.8499