Task 14263235

Name	hadam3p_eu_9nsc_1979_1_007766796_1
Workunit	7921905
Created	14 Mar 2012, 12:39:16 UTC
Sent	14 Mar 2012, 13:08:05 UTC
Report deadline	24 Feb 2013, 18:28:05 UTC
Received	21 Mar 2012, 7:04:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1122757
Run time	18 hours 44 min 24 sec
CPU time	17 hours 9 min 43 sec
Validate state	Invalid
Credit	200.38
Device peak FLOPS	1.69 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> 01:48:23 (4840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:48:24 (4840): No heartbeat from core client for 30 sec - exiting 01:48:25 (4840): No heartbeat from core client for 30 sec - exiting 01:48:26 (4840): No heartbeat from core client for 30 sec - exiting 01:48:27 (4840): No heartbeat from core client for 30 sec - exiting 01:48:29 (4840): No heartbeat from core client for 30 sec - exiting 01:48:30 (4840): No heartbeat from core client for 30 sec - exiting 01:48:31 (4840): No heartbeat from core client for 30 sec - exiting 01:48:32 (4840): No heartbeat from core client for 30 sec - exiting 01:48:33 (4840): No heartbeat from core client for 30 sec - exiting 01:48:35 (4840): No heartbeat from core client for 30 sec - exiting 01:48:36 (4840): No heartbeat from core client for 30 sec - exiting 01:48:37 (4840): No heartbeat from core client for 30 sec - exiting 01:48:38 (4840): No heartbeat from core client for 30 sec - exiting 01:48:39 (4840): No heartbeat from core client for 30 sec - exiting 01:48:40 (4840): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 03:48:15 (7464): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 03:48:17 (7464): No heartbeat from core client for 30 sec - exiting 03:48:18 (7464): No heartbeat from core client for 30 sec - exiting 03:48:19 (7464): No heartbeat from core client for 30 sec - exiting 03:48:20 (7464): No heartbeat from core client for 30 sec - exiting 03:48:21 (7464): No heartbeat from core client for 30 sec - exiting 03:48:23 (7464): No heartbeat from core client for 30 sec - exiting 03:48:24 (7464): No heartbeat from core client for 30 sec - exiting 03:48:25 (7464): No heartbeat from core client for 30 sec - exiting 03:48:26 (7464): No heartbeat from core client for 30 sec - exiting 03:48:27 (7464): No heartbeat from core client for 30 sec - exiting 03:48:28 (7464): No heartbeat from core client for 30 sec - exiting 03:48:29 (7464): No heartbeat from core client for 30 sec - exiting 03:48:30 (7464): No heartbeat from core client for 30 sec - exiting 03:48:31 (7464): No heartbeat from core client for 30 sec - exiting 03:48:32 (7464): No heartbeat from core client for 30 sec - exiting 03:48:33 (7464): No heartbeat from core client for 30 sec - exiting 03:48:35 (7464): No heartbeat from core client for 30 sec - exiting 03:48:36 (7464): No heartbeat from core client for 30 sec - exiting 03:48:37 (7464): No heartbeat from core client for 30 sec - exiting 03:48:38 (7464): No heartbeat from core client for 30 sec - exiting 03:48:39 (7464): No heartbeat from core client for 30 sec - exiting 04:27:00 (7752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:30:17 (7896): No heartbeat from core client for 30 sec - exiting 04:30:18 (7896): No heartbeat from core client for 30 sec - exiting 04:30:19 (7896): No heartbeat from core client for 30 sec - exiting 04:30:21 (7896): No heartbeat from core client for 30 sec - exiting 04:30:22 (7896): No heartbeat from core client for 30 sec - exiting 04:30:23 (7896): No heartbeat from core client for 30 sec - exiting 04:30:24 (7896): No heartbeat from core client for 30 sec - exiting 04:30:25 (7896): No heartbeat from core client for 30 sec - exiting 04:30:26 (7896): No heartbeat from core client for 30 sec - exiting 04:30:27 (7896): No heartbeat from core client for 30 sec - exiting 04:30:28 (7896): No heartbeat from core client for 30 sec - exiting 04:30:29 (7896): No heartbeat from core client for 30 sec - exiting 04:30:30 (7896): No heartbeat from core client for 30 sec - exiting 04:30:31 (7896): No heartbeat from core client for 30 sec - exiting 04:30:33 (7896): No heartbeat from core client for 30 sec - exiting 04:30:34 (7896): No heartbeat from core client for 30 sec - exiting 04:30:35 (7896): No heartbeat from core client for 30 sec - exiting 04:30:36 (7896): No heartbeat from core client for 30 sec - exiting 04:30:37 (7896): No heartbeat from core client for 30 sec - exiting 04:31:12 (7896): No heartbeat from core client for 30 sec - exiting 04:31:13 (7896): No heartbeat from core client for 30 sec - exiting 04:31:14 (7896): No heartbeat from core client for 30 sec - exiting 04:31:15 (7896): No heartbeat from core client for 30 sec - exiting 04:31:16 (7896): No heartbeat from core client for 30 sec - exiting 04:31:17 (7896): No heartbeat from core client for 30 sec - exiting 04:31:18 (7896): No heartbeat from core client for 30 sec - exiting 04:31:20 (7896): No heartbeat from core client for 30 sec - exiting 04:31:21 (7896): No heartbeat from core client for 30 sec - exiting 04:31:22 (7896): No heartbeat from core client for 30 sec - exiting 04:31:23 (7896): No heartbeat from core client for 30 sec - exiting 04:31:24 (7896): No heartbeat from core client for 30 sec - exiting 04:31:25 (7896): No heartbeat from core client for 30 sec - exiting 04:31:26 (7896): No heartbeat from core client for 30 sec - exiting 04:31:27 (7896): No heartbeat from core client for 30 sec - exiting 04:31:28 (7896): No heartbeat from core client for 30 sec - exiting 04:31:29 (7896): No heartbeat from core client for 30 sec - exiting 04:31:30 (7896): No heartbeat from core client for 30 sec - exiting 04:31:32 (7896): No heartbeat from core client for 30 sec - exiting 04:31:33 (7896): No heartbeat from core client for 30 sec - exiting 04:31:34 (7896): No heartbeat from core client for 30 sec - exiting 04:31:35 (7896): No heartbeat from core client for 30 sec - exiting 04:31:36 (7896): No heartbeat from core client for 30 sec - exiting 04:31:37 (7896): No heartbeat from core client for 30 sec - exiting 04:31:38 (7896): No heartbeat from core client for 30 sec - exiting 04:31:39 (7896): No heartbeat from core client for 30 sec - exiting 04:31:40 (7896): No heartbeat from core client for 30 sec - exiting 04:31:41 (7896): No heartbeat from core client for 30 sec - exiting 04:31:42 (7896): No heartbeat from core client for 30 sec - exiting 04:31:44 (7896): No heartbeat from core client for 30 sec - exiting 04:31:45 (7896): No heartbeat from core client for 30 sec - exiting 04:31:46 (7896): No heartbeat from core client for 30 sec - exiting 04:31:47 (7896): No heartbeat from core client for 30 sec - exiting 04:31:48 (7896): No heartbeat from core client for 30 sec - exiting 04:31:49 (7896): No heartbeat from core client for 30 sec - exiting 04:31:50 (7896): No heartbeat from core client for 30 sec - exiting 04:31:51 (7896): No heartbeat from core client for 30 sec - exiting 04:31:52 (7896): No heartbeat from core client for 30 sec - exiting 04:31:53 (7896): No heartbeat from core client for 30 sec - exiting 04:31:54 (7896): No heartbeat from core client for 30 sec - exiting 04:31:56 (7896): No heartbeat from core client for 30 sec - exiting 04:31:57 (7896): No heartbeat from core client for 30 sec - exiting 04:31:58 (7896): No heartbeat from core client for 30 sec - exiting 04:31:59 (7896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:25:30 (916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:09:20 (3212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:09:30 (3212): No heartbeat from core client for 30 sec - exiting 10:09:31 (3212): No heartbeat from core client for 30 sec - exiting 10:10:39 (5788): No heartbeat from core client for 30 sec - exiting 10:10:40 (5788): No heartbeat from core client for 30 sec - exiting 10:10:41 (5788): No heartbeat from core client for 30 sec - exiting 10:10:42 (5788): No heartbeat from core client for 30 sec - exiting 10:10:43 (5788): No heartbeat from core client for 30 sec - exiting 10:10:45 (5788): No heartbeat from core client for 30 sec - exiting 10:10:46 (5788): No heartbeat from core client for 30 sec - exiting 10:10:47 (5788): No heartbeat from core client for 30 sec - exiting 10:10:48 (5788): No heartbeat from core client for 30 sec - exiting 10:10:49 (5788): No heartbeat from core client for 30 sec - exiting 10:10:50 (5788): No heartbeat from core client for 30 sec - exiting 10:10:51 (5788): No heartbeat from core client for 30 sec - exiting 10:10:52 (5788): No heartbeat from core client for 30 sec - exiting 10:10:53 (5788): No heartbeat from core client for 30 sec - exiting 10:10:54 (5788): No heartbeat from core client for 30 sec - exiting 10:10:55 (5788): No heartbeat from core client for 30 sec - exiting 10:10:57 (5788): No heartbeat from core client for 30 sec - exiting 10:10:58 (5788): No heartbeat from core client for 30 sec - exiting 10:10:59 (5788): No heartbeat from core client for 30 sec - exiting 10:11:00 (5788): No heartbeat from core client for 30 sec - exiting 10:11:01 (5788): No heartbeat from core client for 30 sec - exiting 10:11:02 (5788): No heartbeat from core client for 30 sec - exiting 10:11:03 (5788): No heartbeat from core client for 30 sec - exiting 10:11:04 (5788): No heartbeat from core client for 30 sec - exiting 10:11:05 (5788): No heartbeat from core client for 30 sec - exiting 10:11:06 (5788): No heartbeat from core client for 30 sec - exiting 10:11:07 (5788): No heartbeat from core client for 30 sec - exiting 10:11:09 (5788): No heartbeat from core client for 30 sec - exiting 10:11:10 (5788): No heartbeat from core client for 30 sec - exiting 10:11:11 (5788): No heartbeat from core client for 30 sec - exiting 10:11:12 (5788): No heartbeat from core client for 30 sec - exiting 10:11:13 (5788): No heartbeat from core client for 30 sec - exiting 10:11:14 (5788): No heartbeat from core client for 30 sec - exiting 10:12:00 (5788): No heartbeat from core client for 30 sec - exiting 10:12:01 (5788): No heartbeat from core client for 30 sec - exiting 10:12:02 (5788): No heartbeat from core client for 30 sec - exiting 10:12:03 (5788): No heartbeat from core client for 30 sec - exiting 10:12:04 (5788): No heartbeat from core client for 30 sec - exiting 10:12:05 (5788): No heartbeat from core client for 30 sec - exiting 10:12:06 (5788): No heartbeat from core client for 30 sec - exiting 10:12:08 (5788): No heartbeat from core client for 30 sec - exiting 10:12:09 (5788): No heartbeat from core client for 30 sec - exiting 10:12:10 (5788): No heartbeat from core client for 30 sec - exiting 10:12:11 (5788): No heartbeat from core client for 30 sec - exiting 10:12:12 (5788): No heartbeat from core client for 30 sec - exiting 10:12:13 (5788): No heartbeat from core client for 30 sec - exiting 10:12:14 (5788): No heartbeat from core client for 30 sec - exiting 10:12:15 (5788): No heartbeat from core client for 30 sec - exiting 10:12:16 (5788): No heartbeat from core client for 30 sec - exiting 10:12:17 (5788): No heartbeat from core client for 30 sec - exiting 10:12:18 (5788): No heartbeat from core client for 30 sec - exiting 10:12:20 (5788): No heartbeat from core client for 30 sec - exiting 10:12:21 (5788): No heartbeat from core client for 30 sec - exiting 10:12:22 (5788): No heartbeat from core client for 30 sec - exiting 10:12:23 (5788): No heartbeat from core client for 30 sec - exiting 10:12:24 (5788): No heartbeat from core client for 30 sec - exiting 10:12:25 (5788): No heartbeat from core client for 30 sec - exiting 10:12:26 (5788): No heartbeat from core client for 30 sec - exiting 10:12:27 (5788): No heartbeat from core client for 30 sec - exiting 10:12:28 (5788): No heartbeat from core client for 30 sec - exiting 10:12:29 (5788): No heartbeat from core client for 30 sec - exiting 10:12:30 (5788): No heartbeat from core client for 30 sec - exiting 10:12:32 (5788): No heartbeat from core client for 30 sec - exiting 10:18:05 (5788): No heartbeat from core client for 30 sec - exiting 10:18:06 (5788): No heartbeat from core client for 30 sec - exiting 10:18:07 (5788): No heartbeat from core client for 30 sec - exiting 10:18:08 (5788): No heartbeat from core client for 30 sec - exiting 10:18:09 (5788): No heartbeat from core client for 30 sec - exiting 10:18:10 (5788): No heartbeat from core client for 30 sec - exiting 10:18:11 (5788): No heartbeat from core client for 30 sec - exiting 10:18:12 (5788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:20:35 (2844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:21:18 (5124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:29:24 (564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:31:28 (7324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:44:37 (6944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:25:21 (3160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:33:48 (4828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:36 (6156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:09 (5112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:18:43 (4024): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 02:19:00 (4024): No heartbeat from core client for 30 sec - exiting 02:19:01 (4024): No heartbeat from core client for 30 sec - exiting 02:19:02 (4024): No heartbeat from core client for 30 sec - exiting 02:19:03 (4024): No heartbeat from core client for 30 sec - exiting 02:19:04 (4024): No heartbeat from core client for 30 sec - exiting 02:19:05 (4024): No heartbeat from core client for 30 sec - exiting 02:19:06 (4024): No heartbeat from core client for 30 sec - exiting 02:19:07 (4024): No heartbeat from core client for 30 sec - exiting 02:19:09 (4024): No heartbeat from core client for 30 sec - exiting 02:19:10 (4024): No heartbeat from core client for 30 sec - exiting 02:19:11 (4024): No heartbeat from core client for 30 sec - exiting 02:19:12 (4024): No heartbeat from core client for 30 sec - exiting 02:20:23 (4024): No heartbeat from core client for 30 sec - exiting 02:20:24 (4024): No heartbeat from core client for 30 sec - exiting 02:20:25 (4024): No heartbeat from core client for 30 sec - exiting 02:20:26 (4024): No heartbeat from core client for 30 sec - exiting 02:20:27 (4024): No heartbeat from core client for 30 sec - exiting 02:20:28 (4024): No heartbeat from core client for 30 sec - exiting 02:20:29 (4024): No heartbeat from core client for 30 sec - exiting 02:20:30 (4024): No heartbeat from core client for 30 sec - exiting 02:20:32 (4024): No heartbeat from core client for 30 sec - exiting 02:20:33 (4024): No heartbeat from core client for 30 sec - exiting 02:20:34 (4024): No heartbeat from core client for 30 sec - exiting 02:20:35 (4024): No heartbeat from core client for 30 sec - exiting 02:20:36 (4024): No heartbeat from core client for 30 sec - exiting 02:20:37 (4024): No heartbeat from core client for 30 sec - exiting 02:20:38 (4024): No heartbeat from core client for 30 sec - exiting 02:20:39 (4024): No heartbeat from core client for 30 sec - exiting 02:20:40 (4024): No heartbeat from core client for 30 sec - exiting 02:20:41 (4024): No heartbeat from core client for 30 sec - exiting 02:20:42 (4024): No heartbeat from core client for 30 sec - exiting 02:20:44 (4024): No heartbeat from core client for 30 sec - exiting 02:20:45 (4024): No heartbeat from core client for 30 sec - exiting 18:12:45 (6148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:48 (6148): No heartbeat from core client for 30 sec - exiting 18:12:49 (6148): No heartbeat from core client for 30 sec - exiting 18:12:51 (6148): No heartbeat from core client for 30 sec - exiting 18:12:52 (6148): No heartbeat from core client for 30 sec - exiting 18:12:53 (6148): No heartbeat from core client for 30 sec - exiting 18:12:54 (6148): No heartbeat from core client for 30 sec - exiting 18:12:55 (6148): No heartbeat from core client for 30 sec - exiting 18:12:56 (6148): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 20:44:18 (3348): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:44:26 (3348): No heartbeat from core client for 30 sec - exiting 20:44:29 (3348): No heartbeat from core client for 30 sec - exiting 20:44:30 (3348): No heartbeat from core client for 30 sec - exiting 20:44:31 (3348): No heartbeat from core client for 30 sec - exiting 20:44:32 (3348): No heartbeat from core client for 30 sec - exiting 20:44:33 (3348): No heartbeat from core client for 30 sec - exiting 20:44:34 (3348): No heartbeat from core client for 30 sec - exiting 20:44:35 (3348): No heartbeat from core client for 30 sec - exiting 20:44:36 (3348): No heartbeat from core client for 30 sec - exiting 20:44:37 (3348): No heartbeat from core client for 30 sec - exiting 20:44:38 (3348): No heartbeat from core client for 30 sec - exiting 20:44:39 (3348): No heartbeat from core client for 30 sec - exiting 20:44:40 (3348): No heartbeat from core client for 30 sec - exiting 20:44:42 (3348): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=2040, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4960, selfPID=6640, iMonCtr=1 Model crash detected, will try to restart... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4960, selfPID=4960, iMonCtr=2 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_9nsc_1979_1_007766796_1_2.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9nsc_1979_1_007766796_1_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9nsc_1979_1_007766796_1_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9nsc_1979_1_007766796_1_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9nsc_1979_1_007766796_1_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9nsc_1979_1_007766796_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9nsc_1979_1_007766796_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9nsc_1979_1_007766796_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9nsc_1979_1_007766796_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9nsc_1979_1_007766796_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_9nsc_1979_1_007766796_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Mar 2012 08:53:34	1122757	14263235	hadam3p_eu_9nsc_1979_1_007766796_1	11,616	49,099	4.2268