Task 15492261

Name	hadcm3n_3bvm_1940_40_008263496_0
Workunit	8418620
Created	21 Dec 2012, 5:31:18 UTC
Sent	23 Dec 2012, 10:51:32 UTC
Report deadline	24 Mar 2013, 18:18:43 UTC
Received	15 Mar 2013, 14:31:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1232750
Run time	8 days 0 hours 21 min 18 sec
CPU time	7 days 15 hours 32 min 8 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.31 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4932, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1512, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3620, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=920, iMonCtr=1 Model crash detected, will try to restart... 22:47:15 (3688): No heartbeat from core client for 30 sec - exiting 22:47:16 (3688): No heartbeat from core client for 30 sec - exiting 22:47:17 (3688): No heartbeat from core client for 30 sec - exiting 22:47:18 (3688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3696, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3232, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3928, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3640, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 16:53:56 (4264): No heartbeat from core client for 30 sec - exiting 16:53:57 (4264): No heartbeat from core client for 30 sec - exiting 16:53:58 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4912, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4912, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:03:36 (2836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4028, iMonCtr=1 Model crash detected, will try to restart... 19:44:00 (2928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D73760 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Mar 2013 14:35:21	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	518,400	660,723	1.2745
29 Jan 2013 18:21:02	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	492,480	629,220	1.2777
08 Jan 2013 22:57:53	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	466,560	598,062	1.2819
07 Jan 2013 20:17:45	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	440,640	566,834	1.2864
06 Jan 2013 13:32:05	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	414,720	534,696	1.2893
05 Jan 2013 12:45:12	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	388,800	502,733	1.2930
04 Jan 2013 17:05:08	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	362,880	471,422	1.2991
04 Jan 2013 07:55:05	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	336,960	440,295	1.3067
03 Jan 2013 10:51:23	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	311,040	406,830	1.3080
02 Jan 2013 14:31:21	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	285,120	372,901	1.3079
01 Jan 2013 16:11:05	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	259,200	338,657	1.3065
31 Dec 2012 11:23:58	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	233,280	304,332	1.3046
29 Dec 2012 22:21:45	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	207,360	271,024	1.3070
29 Dec 2012 10:55:49	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	181,440	236,913	1.3057
28 Dec 2012 12:00:05	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	155,520	203,222	1.3067
27 Dec 2012 16:31:07	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	129,600	169,153	1.3052
26 Dec 2012 21:15:41	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	103,680	135,357	1.3055
26 Dec 2012 12:04:39	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	77,760	101,569	1.3062
25 Dec 2012 12:45:15	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	51,840	67,422	1.3006
24 Dec 2012 10:48:21	1232750	15492261	hadcm3n_3bvm_1940_40_008263496_0	25,920	33,580	1.2955