Task 14106041

Name	hadcm3n_yfdu_1940_40_007752530_2
Workunit	7907639
Created	17 Feb 2012, 20:04:21 UTC
Sent	17 Feb 2012, 20:04:28 UTC
Report deadline	19 May 2012, 3:31:39 UTC
Received	18 Mar 2012, 15:05:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-529697949 (0xE06D7363) Unknown error code
Computer ID	1186649
Run time	6 days 14 hours 18 min 38 sec
CPU time	6 days 8 hours 2 min 37 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.24 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -529697949 (0xe06d7363) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:40:16 (8588): No heartbeat from core client for 30 sec - exiting 03:40:18 (8588): No heartbeat from core client for 30 sec - exiting 03:40:19 (8588): No heartbeat from core client for 30 sec - exiting 03:40:20 (8588): No heartbeat from core client for 30 sec - exiting 03:40:21 (8588): No heartbeat from core client for 30 sec - exiting 03:40:22 (8588): No heartbeat from core client for 30 sec - exiting 03:40:23 (8588): No heartbeat from core client for 30 sec - exiting 03:40:24 (8588): No heartbeat from core client for 30 sec - exiting 03:40:25 (8588): No heartbeat from core client for 30 sec - exiting 03:40:26 (8588): No heartbeat from core client for 30 sec - exiting 03:40:27 (8588): No heartbeat from core client for 30 sec - exiting 03:40:28 (8588): No heartbeat from core client for 30 sec - exiting 03:40:29 (8588): No heartbeat from core client for 30 sec - exiting 03:40:30 (8588): No heartbeat from core client for 30 sec - exiting 03:40:31 (8588): No heartbeat from core client for 30 sec - exiting 03:40:32 (8588): No heartbeat from core client for 30 sec - exiting 03:40:33 (8588): No heartbeat from core client for 30 sec - exiting 03:40:34 (8588): No heartbeat from core client for 30 sec - exiting 03:40:35 (8588): No heartbeat from core client for 30 sec - exiting 03:40:36 (8588): No heartbeat from core client for 30 sec - exiting 03:40:37 (8588): No heartbeat from core client for 30 sec - exiting 03:40:38 (8588): No heartbeat from core client for 30 sec - exiting 03:40:39 (8588): No heartbeat from core client for 30 sec - exiting 03:40:40 (8588): No heartbeat from core client for 30 sec - exiting 03:40:41 (8588): No heartbeat from core client for 30 sec - exiting 03:40:42 (8588): No heartbeat from core client for 30 sec - exiting 03:40:43 (8588): No heartbeat from core client for 30 sec - exiting 03:40:44 (8588): No heartbeat from core client for 30 sec - exiting 03:40:45 (8588): No heartbeat from core client for 30 sec - exiting 03:40:46 (8588): No heartbeat from core client for 30 sec - exiting 03:40:47 (8588): No heartbeat from core client for 30 sec - exiting 03:40:48 (8588): No heartbeat from core client for 30 sec - exiting 03:40:49 (8588): No heartbeat from core client for 30 sec - exiting 03:40:50 (8588): No heartbeat from core client for 30 sec - exiting 03:40:51 (8588): No heartbeat from core client for 30 sec - exiting 03:40:52 (8588): No heartbeat from core client for 30 sec - exiting 03:40:53 (8588): No heartbeat from core client for 30 sec - exiting 03:40:54 (8588): No heartbeat from core client for 30 sec - exiting 03:40:55 (8588): No heartbeat from core client for 30 sec - exiting 03:40:56 (8588): No heartbeat from core client for 30 sec - exiting 03:40:57 (8588): No heartbeat from core client for 30 sec - exiting 03:40:58 (8588): No heartbeat from core client for 30 sec - exiting 03:40:59 (8588): No heartbeat from core client for 30 sec - exiting 03:41:00 (8588): No heartbeat from core client for 30 sec - exiting 03:41:01 (8588): No heartbeat from core client for 30 sec - exiting 03:41:02 (8588): No heartbeat from core client for 30 sec - exiting 03:41:03 (8588): No heartbeat from core client for 30 sec - exiting 03:41:04 (8588): No heartbeat from core client for 30 sec - exiting 03:41:05 (8588): No heartbeat from core client for 30 sec - exiting 03:41:06 (8588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7272, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:06:11 (7188): No heartbeat from core client for 30 sec - exiting 16:06:12 (7188): No heartbeat from core client for 30 sec - exiting 16:06:14 (7188): No heartbeat from core client for 30 sec - exiting 16:06:15 (7188): No heartbeat from core client for 30 sec - exiting 16:06:16 (7188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x773C3F99 read attempt to address 0x3E2C2353 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9500, selfPID=9500, iMonCtr=1 Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x773C3760 read attempt to address 0x3E2C2353 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Mar 2012 09:11:49	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	518,400	546,107	1.0534
17 Mar 2012 16:17:31	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	492,480	515,784	1.0473
17 Mar 2012 05:46:02	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	466,560	485,738	1.0411
16 Mar 2012 14:31:34	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	440,640	455,661	1.0341
16 Mar 2012 05:26:15	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	414,720	425,525	1.0261
15 Mar 2012 11:13:47	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	388,800	394,965	1.0159
14 Mar 2012 12:03:06	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	362,880	364,586	1.0047
13 Mar 2012 22:43:03	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	336,960	334,090	0.9915
11 Mar 2012 22:49:52	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	311,040	303,130	0.9746
09 Mar 2012 11:03:50	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	259,200	243,801	0.9406
08 Mar 2012 15:14:44	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	233,280	219,810	0.9423
03 Mar 2012 14:31:03	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	207,360	196,184	0.9461
03 Mar 2012 06:21:17	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	181,440	171,986	0.9479
02 Mar 2012 23:33:48	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	155,520	147,816	0.9505
02 Mar 2012 10:39:31	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	129,600	123,628	0.9539
02 Mar 2012 03:36:01	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	103,680	99,538	0.9601
01 Mar 2012 05:57:54	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	77,760	75,660	0.9730
29 Feb 2012 23:18:49	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	51,840	51,666	0.9966
29 Feb 2012 09:36:12	1186649	14106041	hadcm3n_yfdu_1940_40_007752530_2	25,920	27,322	1.0541