Task 12753794

Name	hadcm3n_o6gj_1900_40_007203702_2
Workunit	7401982
Created	29 Mar 2011, 3:50:25 UTC
Sent	29 Mar 2011, 3:56:04 UTC
Report deadline	28 Jun 2011, 11:23:15 UTC
Received	3 May 2011, 21:19:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1 (0xFFFFFFFF) Unknown error code
Computer ID	1045750
Run time	23 days 1 hours 24 min 22 sec
CPU time	20 days 6 hours 9 min 30 sec
Validate state	Invalid
Credit	9,953.28
Device peak FLOPS	2.14 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> - exit code -1 (0xffffffff) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3664, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The requested operation cannot be performed on a file with a user-mapped section open. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4244, iMonCtr=1 Model crash detected, will try to restart... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4152, selfPID=4152, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:31:19 (4596): No heartbeat from core client for 30 sec - exiting 01:31:20 (4596): No heartbeat from core client for 30 sec - exiting 01:31:21 (4596): No heartbeat from core client for 30 sec - exiting 01:31:22 (4596): No heartbeat from core client for 30 sec - exiting 01:31:23 (4596): No heartbeat from core client for 30 sec - exiting 01:31:24 (4596): No heartbeat from core client for 30 sec - exiting 01:31:25 (4596): No heartbeat from core client for 30 sec - exiting 01:31:26 (4596): No heartbeat from core client for 30 sec - exiting 01:31:27 (4596): No heartbeat from core client for 30 sec - exiting 01:31:28 (4596): No heartbeat from core client for 30 sec - exiting 01:31:29 (4596): No heartbeat from core client for 30 sec - exiting 01:31:30 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:31 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:31:13 (4460): No heartbeat from core client for 30 sec - exiting 15:31:14 (4460): No heartbeat from core client for 30 sec - exiting 15:31:15 (4460): No heartbeat from core client for 30 sec - exiting 15:31:16 (4460): No heartbeat from core client for 30 sec - exiting 15:31:17 (4460): No heartbeat from core client for 30 sec - exiting 15:31:19 (4460): No heartbeat from core client for 30 sec - exiting 15:31:20 (4460): No heartbeat from core client for 30 sec - exiting 15:31:21 (4460): No heartbeat from core client for 30 sec - exiting 15:31:22 (4460): No heartbeat from core client for 30 sec - exiting 15:31:23 (4460): No heartbeat from core client for 30 sec - exiting 15:31:24 (4460): No heartbeat from core client for 30 sec - exiting 15:31:25 (4460): No heartbeat from core client for 30 sec - exiting 15:31:26 (4460): No heartbeat from core client for 30 sec - exiting 15:31:27 (4460): No heartbeat from core client for 30 sec - exiting 15:31:28 (4460): No heartbeat from core client for 30 sec - exiting 15:31:29 (4460): No heartbeat from core client for 30 sec - exiting 15:31:31 (4460): No heartbeat from core client for 30 sec - exiting 15:31:32 (4460): No heartbeat from core client for 30 sec - exiting 15:31:33 (4460): No heartbeat from core client for 30 sec - exiting 15:31:34 (4460): No heartbeat from core client for 30 sec - exiting 15:31:35 (4460): No heartbeat from core client for 30 sec - exiting 15:31:36 (4460): No heartbeat from core client for 30 sec - exiting 15:31:37 (4460): No heartbeat from core client for 30 sec - exiting 15:31:38 (4460): No heartbeat from core client for 30 sec - exiting 15:31:39 (4460): No heartbeat from core client for 30 sec - exiting 15:31:40 (4460): No heartbeat from core client for 30 sec - exiting 15:31:42 (4460): No heartbeat from core client for 30 sec - exiting 15:31:43 (4460): No heartbeat from core client for 30 sec - exiting 15:31:44 (4460): No heartbeat from core client for 30 sec - exiting 15:31:45 (4460): No heartbeat from core client for 30 sec - exiting 15:31:46 (4460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:31:47 (4460): No heartbeat from core client for 30 sec - exiting 15:31:48 (4460): No heartbeat from core client for 30 sec - exiting 15:31:49 (4460): No heartbeat from core client for 30 sec - exiting 15:31:50 (4460): No heartbeat from core client for 30 sec - exiting 15:31:51 (4460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:52:41 (540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:31:40 (5232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 May 2011 09:44:59	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	829,440	1,742,443	2.1007
02 May 2011 02:39:45	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	803,520	1,689,052	2.1021
30 Apr 2011 13:17:47	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	777,600	1,635,769	2.1036
29 Apr 2011 20:42:44	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	751,680	1,581,466	2.1039
27 Apr 2011 17:17:38	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	725,760	1,526,667	2.1035
25 Apr 2011 18:52:44	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	699,840	1,472,429	2.1040
25 Apr 2011 03:01:52	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	673,920	1,418,284	2.1045
24 Apr 2011 08:13:04	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	648,000	1,363,633	2.1044
23 Apr 2011 12:10:34	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	622,080	1,309,718	2.1054
22 Apr 2011 18:54:24	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	596,160	1,256,612	2.1078
22 Apr 2011 02:19:05	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	570,240	1,199,479	2.1035
21 Apr 2011 08:52:16	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	544,320	1,139,249	2.0930
21 Apr 2011 08:52:16	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	518,400	1,085,140	2.0932
21 Apr 2011 08:52:16	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	492,480	1,030,985	2.0935
21 Apr 2011 08:52:16	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	466,560	976,251	2.0924
12 Apr 2011 13:44:27	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	440,640	922,206	2.0929
12 Apr 2011 09:06:16	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	414,720	869,994	2.0978
12 Apr 2011 09:05:11	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	388,800	815,960	2.0987
12 Apr 2011 09:04:20	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	362,880	759,565	2.0932
12 Apr 2011 09:03:42	1045750	12753794	hadcm3n_o6gj_1900_40_007203702_2	336,960	701,420	2.0816