Task 14370387

Name	hadcm3n_u6sg_1980_40_007858908_2
Workunit	8014020
Created	6 Apr 2012, 11:18:49 UTC
Sent	6 Apr 2012, 11:19:07 UTC
Report deadline	6 Jul 2012, 18:46:18 UTC
Received	29 Dec 2012, 8:56:49 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	1 (0x00000001) Unknown error code
Computer ID	1165352
Run time	22 hours 0 min 10 sec
CPU time	16 hours 8 min 12 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	2.57 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> Incorrect function. (0x1) - exit code 1 (0x1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 19:05:04 (6972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:39:55 (7704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:08:27 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:12:34 (9104): No heartbeat from core client for 30 sec - exiting 00:12:35 (9104): No heartbeat from core client for 30 sec - exiting 00:12:36 (9104): No heartbeat from core client for 30 sec - exiting 00:12:37 (9104): No heartbeat from core client for 30 sec - exiting 00:12:38 (9104): No heartbeat from core client for 30 sec - exiting 00:12:39 (9104): No heartbeat from core client for 30 sec - exiting 00:12:40 (9104): No heartbeat from core client for 30 sec - exiting 00:12:41 (9104): No heartbeat from core client for 30 sec - exiting 00:12:42 (9104): No heartbeat from core client for 30 sec - exiting 00:12:43 (9104): No heartbeat from core client for 30 sec - exiting 00:12:44 (9104): No heartbeat from core client for 30 sec - exiting 00:12:45 (9104): No heartbeat from core client for 30 sec - exiting 00:12:46 (9104): No heartbeat from core client for 30 sec - exiting 00:12:47 (9104): No heartbeat from core client for 30 sec - exiting 00:12:48 (9104): No heartbeat from core client for 30 sec - exiting 00:12:49 (9104): No heartbeat from core client for 30 sec - exiting 00:12:50 (9104): No heartbeat from core client for 30 sec - exiting 00:12:51 (9104): No heartbeat from core client for 30 sec - exiting 00:12:52 (9104): No heartbeat from core client for 30 sec - exiting 00:13:29 (9104): No heartbeat from core client for 30 sec - exiting 00:13:30 (9104): No heartbeat from core client for 30 sec - exiting 00:13:31 (9104): No heartbeat from core client for 30 sec - exiting 00:13:32 (9104): No heartbeat from core client for 30 sec - exiting 00:13:33 (9104): No heartbeat from core client for 30 sec - exiting 00:13:34 (9104): No heartbeat from core client for 30 sec - exiting 00:13:35 (9104): No heartbeat from core client for 30 sec - exiting 00:13:36 (9104): No heartbeat from core client for 30 sec - exiting 00:13:37 (9104): No heartbeat from core client for 30 sec - exiting 00:13:38 (9104): No heartbeat from core client for 30 sec - exiting 00:13:39 (9104): No heartbeat from core client for 30 sec - exiting 00:13:40 (9104): No heartbeat from core client for 30 sec - exiting 00:13:41 (9104): No heartbeat from core client for 30 sec - exiting 00:13:42 (9104): No heartbeat from core client for 30 sec - exiting 00:13:43 (9104): No heartbeat from core client for 30 sec - exiting 00:13:44 (9104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:43:19 (6780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:27:47 (8548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:32:21 (6704): No heartbeat from core client for 30 sec - exiting 08:32:22 (6704): No heartbeat from core client for 30 sec - exiting 08:32:23 (6704): No heartbeat from core client for 30 sec - exiting 08:32:24 (6704): No heartbeat from core client for 30 sec - exiting 08:32:25 (6704): No heartbeat from core client for 30 sec - exiting 08:32:26 (6704): No heartbeat from core client for 30 sec - exiting 08:32:27 (6704): No heartbeat from core client for 30 sec - exiting 08:32:28 (6704): No heartbeat from core client for 30 sec - exiting 08:32:29 (6704): No heartbeat from core client for 30 sec - exiting 08:32:30 (6704): No heartbeat from core client for 30 sec - exiting 08:32:31 (6704): No heartbeat from core client for 30 sec - exiting 08:32:32 (6704): No heartbeat from core client for 30 sec - exiting 08:32:33 (6704): No heartbeat from core client for 30 sec - exiting 08:32:34 (6704): No heartbeat from core client for 30 sec - exiting 08:32:35 (6704): No heartbeat from core client for 30 sec - exiting 08:32:36 (6704): No heartbeat from core client for 30 sec - exiting 08:32:37 (6704): No heartbeat from core client for 30 sec - exiting 08:32:38 (6704): No heartbeat from core client for 30 sec - exiting 08:32:39 (6704): No heartbeat from core client for 30 sec - exiting 08:32:40 (6704): No heartbeat from core client for 30 sec - exiting 08:32:41 (6704): No heartbeat from core client for 30 sec - exiting 08:32:42 (6704): No heartbeat from core client for 30 sec - exiting 08:32:43 (6704): No heartbeat from core client for 30 sec - exiting 08:32:44 (6704): No heartbeat from core client for 30 sec - exiting 08:32:45 (6704): No heartbeat from core client for 30 sec - exiting 08:32:46 (6704): No heartbeat from core client for 30 sec - exiting 08:32:47 (6704): No heartbeat from core client for 30 sec - exiting 08:32:48 (6704): No heartbeat from core client for 30 sec - exiting 08:32:49 (6704): No heartbeat from core client for 30 sec - exiting 08:32:50 (6704): No heartbeat from core client for 30 sec - exiting 08:32:51 (6704): No heartbeat from core client for 30 sec - exiting 08:32:52 (6704): No heartbeat from core client for 30 sec - exiting 08:32:53 (6704): No heartbeat from core client for 30 sec - exiting 08:32:54 (6704): No heartbeat from core client for 30 sec - exiting 08:32:55 (6704): No heartbeat from core client for 30 sec - exiting 08:32:56 (6704): No heartbeat from core client for 30 sec - exiting 08:32:57 (6704): No heartbeat from core client for 30 sec - exiting 08:32:58 (6704): No heartbeat from core client for 30 sec - exiting 08:32:59 (6704): No heartbeat from core client for 30 sec - exiting 08:33:00 (6704): No heartbeat from core client for 30 sec - exiting 08:33:01 (6704): No heartbeat from core client for 30 sec - exiting 08:33:02 (6704): No heartbeat from core client for 30 sec - exiting 08:33:03 (6704): No heartbeat from core client for 30 sec - exiting 08:33:04 (6704): No heartbeat from core client for 30 sec - exiting 08:33:05 (6704): No heartbeat from core client for 30 sec - exiting 08:33:06 (6704): No heartbeat from core client for 30 sec - exiting 08:33:07 (6704): No heartbeat from core client for 30 sec - exiting 08:33:08 (6704): No heartbeat from core client for 30 sec - exiting 08:33:09 (6704): No heartbeat from core client for 30 sec - exiting 08:33:10 (6704): No heartbeat from core client for 30 sec - exiting 08:33:11 (6704): No heartbeat from core client for 30 sec - exiting 08:33:12 (6704): No heartbeat from core client for 30 sec - exiting 08:33:13 (6704): No heartbeat from core client for 30 sec - exiting 08:33:14 (6704): No heartbeat from core client for 30 sec - exiting 08:33:15 (6704): No heartbeat from core client for 30 sec - exiting 08:33:16 (6704): No heartbeat from core client for 30 sec - exiting 08:33:17 (6704): No heartbeat from core client for 30 sec - exiting 08:33:18 (6704): No heartbeat from core client for 30 sec - exiting 08:33:19 (6704): No heartbeat from core client for 30 sec - exiting 08:33:20 (6704): No heartbeat from core client for 30 sec - exiting 08:33:21 (6704): No heartbeat from core client for 30 sec - exiting 08:33:22 (6704): No heartbeat from core client for 30 sec - exiting 08:33:23 (6704): No heartbeat from core client for 30 sec - exiting 08:33:24 (6704): No heartbeat from core client for 30 sec - exiting 08:33:25 (6704): No heartbeat from core client for 30 sec - exiting 08:33:26 (6704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:33:27 (6704): No heartbeat from core client for 30 sec - exiting 08:33:28 (6704): No heartbeat from core client for 30 sec - exiting 08:33:29 (6704): No heartbeat from core client for 30 sec - exiting 08:33:30 (6704): No heartbeat from core client for 30 sec - exiting 08:33:31 (6704): No heartbeat from core client for 30 sec - exiting 08:33:32 (6704): No heartbeat from core client for 30 sec - exiting 08:33:33 (6704): No heartbeat from core client for 30 sec - exiting 08:47:34 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:35 (5028): No heartbeat from core client for 30 sec - exiting 08:47:36 (5028): No heartbeat from core client for 30 sec - exiting 08:47:37 (5028): No heartbeat from core client for 30 sec - exiting 08:47:38 (5028): No heartbeat from core client for 30 sec - exiting 08:47:39 (5028): No heartbeat from core client for 30 sec - exiting 08:47:40 (5028): No heartbeat from core client for 30 sec - exiting 08:47:41 (5028): No heartbeat from core client for 30 sec - exiting 08:47:42 (5028): No heartbeat from core client for 30 sec - exiting 08:47:43 (5028): No heartbeat from core client for 30 sec - exiting 08:47:44 (5028): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:11:56 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:58 (5872): No heartbeat from core client for 30 sec - exiting 12:11:59 (5872): No heartbeat from core client for 30 sec - exiting 12:12:00 (5872): No heartbeat from core client for 30 sec - exiting 12:12:01 (5872): No heartbeat from core client for 30 sec - exiting 12:12:02 (5872): No heartbeat from core client for 30 sec - exiting 12:12:04 (5872): No heartbeat from core client for 30 sec - exiting 12:12:05 (5872): No heartbeat from core client for 30 sec - exiting 12:12:06 (5872): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8024, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8024, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8024, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8024, iMonCtr=1 Model crash detected, will try to restart... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Dec 2012 16:46:15	1165352	14370387	hadcm3n_u6sg_1980_40_007858908_2	25,920	48,235	1.8609