Task 15223130

Name	hadam3p_eu_wc2i_2001_1_006820594_1
Workunit	7023910
Created	1 Sep 2012, 17:29:54 UTC
Sent	19 Sep 2012, 1:14:59 UTC
Report deadline	1 Sep 2013, 6:34:59 UTC
Received	28 Sep 2012, 13:27:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1237933
Run time	4 days 12 hours 1 min 24 sec
CPU time	1 min 43 sec
Validate state	Invalid
Credit	1,790.21
Device peak FLOPS	2.15 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> 03:26:17 (1840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:26:18 (1840): No heartbeat from core client for 30 sec - exiting 03:26:19 (1840): No heartbeat from core client for 30 sec - exiting 03:26:20 (1840): No heartbeat from core client for 30 sec - exiting 03:26:21 (1840): No heartbeat from core client for 30 sec - exiting 03:26:22 (1840): No heartbeat from core client for 30 sec - exiting 03:26:23 (1840): No heartbeat from core client for 30 sec - exiting 03:26:24 (1840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:44:58 (6620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:44:59 (6620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3228, selfPID=3228, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:05:53 (4308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6240, selfPID=6240, iMonCtr=2 13:22:18 (4940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:01:50 (2500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:01:57 (2500): No heartbeat from core client for 30 sec - exiting 03:02:50 (6500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6652, selfPID=6024, iMonCtr=1 Model crash detected, will try to restart... 13:51:32 (3652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5808, selfPID=5808, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3552, selfPID=2616, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 07:11:15 (4588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:11:39 (4588): No heartbeat from core client for 30 sec - exiting 07:15:01 (6036): No heartbeat from core client for 30 sec - exiting 07:15:22 (6036): No heartbeat from core client for 30 sec - exiting 07:15:24 (6036): No heartbeat from core client for 30 sec - exiting 07:15:25 (6036): No heartbeat from core client for 30 sec - exiting 07:15:26 (6036): No heartbeat from core client for 30 sec - exiting 07:15:27 (6036): No heartbeat from core client for 30 sec - exiting 07:15:28 (6036): No heartbeat from core client for 30 sec - exiting 07:15:29 (6036): No heartbeat from core client for 30 sec - exiting 07:15:30 (6036): No heartbeat from core client for 30 sec - exiting 07:15:31 (6036): No heartbeat from core client for 30 sec - exiting 07:15:32 (6036): No heartbeat from core client for 30 sec - exiting 07:15:33 (6036): No heartbeat from core client for 30 sec - exiting 07:15:34 (6036): No heartbeat from core client for 30 sec - exiting 07:15:36 (6036): No heartbeat from core client for 30 sec - exiting 07:15:37 (6036): No heartbeat from core client for 30 sec - exiting 07:15:38 (6036): No heartbeat from core client for 30 sec - exiting 07:15:39 (6036): No heartbeat from core client for 30 sec - exiting 07:15:40 (6036): No heartbeat from core client for 30 sec - exiting 07:15:41 (6036): No heartbeat from core client for 30 sec - exiting 07:15:42 (6036): No heartbeat from core client for 30 sec - exiting 07:15:43 (6036): No heartbeat from core client for 30 sec - exiting 07:15:44 (6036): No heartbeat from core client for 30 sec - exiting 07:15:45 (6036): No heartbeat from core client for 30 sec - exiting 07:15:47 (6036): No heartbeat from core client for 30 sec - exiting 07:15:48 (6036): No heartbeat from core client for 30 sec - exiting 07:15:49 (6036): No heartbeat from core client for 30 sec - exiting 07:15:50 (6036): No heartbeat from core client for 30 sec - exiting 07:15:51 (6036): No heartbeat from core client for 30 sec - exiting 07:15:52 (6036): No heartbeat from core client for 30 sec - exiting 07:15:53 (6036): No heartbeat from core client for 30 sec - exiting 07:15:54 (6036): No heartbeat from core client for 30 sec - exiting 07:15:55 (6036): No heartbeat from core client for 30 sec - exiting 07:15:56 (6036): No heartbeat from core client for 30 sec - exiting 07:15:57 (6036): No heartbeat from core client for 30 sec - exiting 07:16:04 (6036): No heartbeat from core client for 30 sec - exiting 07:16:05 (6036): No heartbeat from core client for 30 sec - exiting 07:16:06 (6036): No heartbeat from core client for 30 sec - exiting 07:16:07 (6036): No heartbeat from core client for 30 sec - exiting 07:16:08 (6036): No heartbeat from core client for 30 sec - exiting 07:16:09 (6036): No heartbeat from core client for 30 sec - exiting 07:16:10 (6036): No heartbeat from core client for 30 sec - exiting 07:16:11 (6036): No heartbeat from core client for 30 sec - exiting 07:16:12 (6036): No heartbeat from core client for 30 sec - exiting 07:16:13 (6036): No heartbeat from core client for 30 sec - exiting 07:16:15 (6036): No heartbeat from core client for 30 sec - exiting 07:16:16 (6036): No heartbeat from core client for 30 sec - exiting 07:16:17 (6036): No heartbeat from core client for 30 sec - exiting 07:16:18 (6036): No heartbeat from core client for 30 sec - exiting 07:16:19 (6036): No heartbeat from core client for 30 sec - exiting 07:16:20 (6036): No heartbeat from core client for 30 sec - exiting 07:16:21 (6036): No heartbeat from core client for 30 sec - exiting 07:16:22 (6036): No heartbeat from core client for 30 sec - exiting 07:16:23 (6036): No heartbeat from core client for 30 sec - exiting 07:16:24 (6036): No heartbeat from core client for 30 sec - exiting 07:16:25 (6036): No heartbeat from core client for 30 sec - exiting 07:16:27 (6036): No heartbeat from core client for 30 sec - exiting 07:16:28 (6036): No heartbeat from core client for 30 sec - exiting 07:16:29 (6036): No heartbeat from core client for 30 sec - exiting 07:16:30 (6036): No heartbeat from core client for 30 sec - exiting 07:16:31 (6036): No heartbeat from core client for 30 sec - exiting 07:16:32 (6036): No heartbeat from core client for 30 sec - exiting 07:16:33 (6036): No heartbeat from core client for 30 sec - exiting 07:16:34 (6036): No heartbeat from core client for 30 sec - exiting 07:16:35 (6036): No heartbeat from core client for 30 sec - exiting 07:16:36 (6036): No heartbeat from core client for 30 sec - exiting 07:16:37 (6036): No heartbeat from core client for 30 sec - exiting 07:16:39 (6036): No heartbeat from core client for 30 sec - exiting 07:16:40 (6036): No heartbeat from core client for 30 sec - exiting 07:16:41 (6036): No heartbeat from core client for 30 sec - exiting 07:16:42 (6036): No heartbeat from core client for 30 sec - exiting 07:16:43 (6036): No heartbeat from core client for 30 sec - exiting 07:16:44 (6036): No heartbeat from core client for 30 sec - exiting 07:16:45 (6036): No heartbeat from core client for 30 sec - exiting 07:16:46 (6036): No heartbeat from core client for 30 sec - exiting 07:16:47 (6036): No heartbeat from core client for 30 sec - exiting 07:16:48 (6036): No heartbeat from core client for 30 sec - exiting 07:16:50 (6036): No heartbeat from core client for 30 sec - exiting 07:16:51 (6036): No heartbeat from core client for 30 sec - exiting 07:16:52 (6036): No heartbeat from core client for 30 sec - exiting 07:16:53 (6036): No heartbeat from core client for 30 sec - exiting 07:16:54 (6036): No heartbeat from core client for 30 sec - exiting 07:16:55 (6036): No heartbeat from core client for 30 sec - exiting 07:16:56 (6036): No heartbeat from core client for 30 sec - exiting 07:16:57 (6036): No heartbeat from core client for 30 sec - exiting 07:17:17 (6036): No heartbeat from core client for 30 sec - exiting 07:17:18 (6036): No heartbeat from core client for 30 sec - exiting 07:17:19 (6036): No heartbeat from core client for 30 sec - exiting 07:17:20 (6036): No heartbeat from core client for 30 sec - exiting 07:17:21 (6036): No heartbeat from core client for 30 sec - exiting 07:17:22 (6036): No heartbeat from core client for 30 sec - exiting 07:17:23 (6036): No heartbeat from core client for 30 sec - exiting 07:17:24 (6036): No heartbeat from core client for 30 sec - exiting 07:17:25 (6036): No heartbeat from core client for 30 sec - exiting 07:17:26 (6036): No heartbeat from core client for 30 sec - exiting 07:17:28 (6036): No heartbeat from core client for 30 sec - exiting 07:18:01 (6036): No heartbeat from core client for 30 sec - exiting 07:18:03 (6036): No heartbeat from core client for 30 sec - exiting 07:18:04 (6036): No heartbeat from core client for 30 sec - exiting 07:18:05 (6036): No heartbeat from core client for 30 sec - exiting 07:18:06 (6036): No heartbeat from core client for 30 sec - exiting 07:18:07 (6036): No heartbeat from core client for 30 sec - exiting 07:18:08 (6036): No heartbeat from core client for 30 sec - exiting 07:18:09 (6036): No heartbeat from core client for 30 sec - exiting 07:18:10 (6036): No heartbeat from core client for 30 sec - exiting 07:18:11 (6036): No heartbeat from core client for 30 sec - exiting 07:18:12 (6036): No heartbeat from core client for 30 sec - exiting 07:18:13 (6036): No heartbeat from core client for 30 sec - exiting 07:18:15 (6036): No heartbeat from core client for 30 sec - exiting 07:18:16 (6036): No heartbeat from core client for 30 sec - exiting 07:18:17 (6036): No heartbeat from core client for 30 sec - exiting 07:18:18 (6036): No heartbeat from core client for 30 sec - exiting 07:18:19 (6036): No heartbeat from core client for 30 sec - exiting 07:18:20 (6036): No heartbeat from core client for 30 sec - exiting 07:18:21 (6036): No heartbeat from core client for 30 sec - exiting 07:18:22 (6036): No heartbeat from core client for 30 sec - exiting 07:18:23 (6036): No heartbeat from core client for 30 sec - exiting 07:18:24 (6036): No heartbeat from core client for 30 sec - exiting 07:18:26 (6036): No heartbeat from core client for 30 sec - exiting 07:18:27 (6036): No heartbeat from core client for 30 sec - exiting 07:18:28 (6036): No heartbeat from core client for 30 sec - exiting 07:18:29 (6036): No heartbeat from core client for 30 sec - exiting 07:18:30 (6036): No heartbeat from core client for 30 sec - exiting 07:18:31 (6036): No heartbeat from core client for 30 sec - exiting 07:18:32 (6036): No heartbeat from core client for 30 sec - exiting 07:18:33 (6036): No heartbeat from core client for 30 sec - exiting 07:18:34 (6036): No heartbeat from core client for 30 sec - exiting 07:18:35 (6036): No heartbeat from core client for 30 sec - exiting 07:18:36 (6036): No heartbeat from core client for 30 sec - exiting 07:18:38 (6036): No heartbeat from core client for 30 sec - exiting 07:18:39 (6036): No heartbeat from core client for 30 sec - exiting 07:18:40 (6036): No heartbeat from core client for 30 sec - exiting 07:18:41 (6036): No heartbeat from core client for 30 sec - exiting 07:18:42 (6036): No heartbeat from core client for 30 sec - exiting 07:18:43 (6036): No heartbeat from core client for 30 sec - exiting 07:18:44 (6036): No heartbeat from core client for 30 sec - exiting 07:18:45 (6036): No heartbeat from core client for 30 sec - exiting 07:18:46 (6036): No heartbeat from core client for 30 sec - exiting 07:18:47 (6036): No heartbeat from core client for 30 sec - exiting 07:18:48 (6036): No heartbeat from core client for 30 sec - exiting 07:18:50 (6036): No heartbeat from core client for 30 sec - exiting 07:18:51 (6036): No heartbeat from core client for 30 sec - exiting 07:18:52 (6036): No heartbeat from core client for 30 sec - exiting 07:18:53 (6036): No heartbeat from core client for 30 sec - exiting 07:18:54 (6036): No heartbeat from core client for 30 sec - exiting 07:18:55 (6036): No heartbeat from core client for 30 sec - exiting 07:18:56 (6036): No heartbeat from core client for 30 sec - exiting 07:18:57 (6036): No heartbeat from core client for 30 sec - exiting 07:18:58 (6036): No heartbeat from core client for 30 sec - exiting 07:18:59 (6036): No heartbeat from core client for 30 sec - exiting 07:19:01 (6036): No heartbeat from core client for 30 sec - exiting 07:19:02 (6036): No heartbeat from core client for 30 sec - exiting 07:19:03 (6036): No heartbeat from core client for 30 sec - exiting 07:19:04 (6036): No heartbeat from core client for 30 sec - exiting 07:19:05 (6036): No heartbeat from core client for 30 sec - exiting 07:19:06 (6036): No heartbeat from core client for 30 sec - exiting 07:19:07 (6036): No heartbeat from core client for 30 sec - exiting 07:19:08 (6036): No heartbeat from core client for 30 sec - exiting 07:19:09 (6036): No heartbeat from core client for 30 sec - exiting 07:19:10 (6036): No heartbeat from core client for 30 sec - exiting 07:19:11 (6036): No heartbeat from core client for 30 sec - exiting 07:19:13 (6036): No heartbeat from core client for 30 sec - exiting 07:19:14 (6036): No heartbeat from core client for 30 sec - exiting 07:19:15 (6036): No heartbeat from core client for 30 sec - exiting 07:19:16 (6036): No heartbeat from core client for 30 sec - exiting 07:19:17 (6036): No heartbeat from core client for 30 sec - exiting 07:19:18 (6036): No heartbeat from core client for 30 sec - exiting 07:19:19 (6036): No heartbeat from core client for 30 sec - exiting 07:19:20 (6036): No heartbeat from core client for 30 sec - exiting 07:19:21 (6036): No heartbeat from core client for 30 sec - exiting 07:19:22 (6036): No heartbeat from core client for 30 sec - exiting 07:19:23 (6036): No heartbeat from core client for 30 sec - exiting 07:19:25 (6036): No heartbeat from core client for 30 sec - exiting 07:19:26 (6036): No heartbeat from core client for 30 sec - exiting 07:19:27 (6036): No heartbeat from core client for 30 sec - exiting 07:19:28 (6036): No heartbeat from core client for 30 sec - exiting 07:19:29 (6036): No heartbeat from core client for 30 sec - exiting 07:19:30 (6036): No heartbeat from core client for 30 sec - exiting 07:19:31 (6036): No heartbeat from core client for 30 sec - exiting 07:19:32 (6036): No heartbeat from core client for 30 sec - exiting 07:19:33 (6036): No heartbeat from core client for 30 sec - exiting 07:19:34 (6036): No heartbeat from core client for 30 sec - exiting 07:19:36 (6036): No heartbeat from core client for 30 sec - exiting 07:19:37 (6036): No heartbeat from core client for 30 sec - exiting 07:19:38 (6036): No heartbeat from core client for 30 sec - exiting 07:19:39 (6036): No heartbeat from core client for 30 sec - exiting 07:19:40 (6036): No heartbeat from core client for 30 sec - exiting 07:19:41 (6036): No heartbeat from core client for 30 sec - exiting 07:19:42 (6036): No heartbeat from core client for 30 sec - exiting 07:19:43 (6036): No heartbeat from core client for 30 sec - exiting 07:19:44 (6036): No heartbeat from core client for 30 sec - exiting 07:19:45 (6036): No heartbeat from core client for 30 sec - exiting 07:19:46 (6036): No heartbeat from core client for 30 sec - exiting 07:19:48 (6036): No heartbeat from core client for 30 sec - exiting 07:19:49 (6036): No heartbeat from core client for 30 sec - exiting 07:19:50 (6036): No heartbeat from core client for 30 sec - exiting 07:19:51 (6036): No heartbeat from core client for 30 sec - exiting 07:19:52 (6036): No heartbeat from core client for 30 sec - exiting 07:19:53 (6036): No heartbeat from core client for 30 sec - exiting 07:19:54 (6036): No heartbeat from core client for 30 sec - exiting 07:19:55 (6036): No heartbeat from core client for 30 sec - exiting 07:19:56 (6036): No heartbeat from core client for 30 sec - exiting 07:19:57 (6036): No heartbeat from core client for 30 sec - exiting 07:19:58 (6036): No heartbeat from core client for 30 sec - exiting 07:20:00 (6036): No heartbeat from core client for 30 sec - exiting 07:20:01 (6036): No heartbeat from core client for 30 sec - exiting 07:20:02 (6036): No heartbeat from core client for 30 sec - exiting 07:20:03 (6036): No heartbeat from core client for 30 sec - exiting 07:20:04 (6036): No heartbeat from core client for 30 sec - exiting 07:20:05 (6036): No heartbeat from core client for 30 sec - exiting 07:20:06 (6036): No heartbeat from core client for 30 sec - exiting 07:20:07 (6036): No heartbeat from core client for 30 sec - exiting 07:20:08 (6036): No heartbeat from core client for 30 sec - exiting 07:20:09 (6036): No heartbeat from core client for 30 sec - exiting 07:20:11 (6036): No heartbeat from core client for 30 sec - exiting 07:20:12 (6036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:23:05 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:24:47 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:31:14 (5712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4252, selfPID=4252, iMonCtr=2 07:32:34 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:34:39 (2720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4256, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5420, selfPID=5432, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4820, selfPID=4820, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4820, selfPID=3876, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1032, selfPID=1032, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1032, selfPID=4260, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_wc2i_2001_1_006820594_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wc2i_2001_1_006820594_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wc2i_2001_1_006820594_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Sep 2012 21:24:35	1237933	15223130	hadam3p_eu_wc2i_2001_1_006820594_1	103,776	330,994	3.1895
26 Sep 2012 08:32:35	1237933	15223130	hadam3p_eu_wc2i_2001_1_006820594_1	92,256	293,566	3.1821
25 Sep 2012 09:23:06	1237933	15223130	hadam3p_eu_wc2i_2001_1_006820594_1	80,736	256,937	3.1824
24 Sep 2012 22:05:24	1237933	15223130	hadam3p_eu_wc2i_2001_1_006820594_1	69,216	220,595	3.1871
23 Sep 2012 00:29:08	1237933	15223130	hadam3p_eu_wc2i_2001_1_006820594_1	57,696	183,526	3.1809
22 Sep 2012 04:01:58	1237933	15223130	hadam3p_eu_wc2i_2001_1_006820594_1	46,176	147,914	3.2033
21 Sep 2012 14:09:04	1237933	15223130	hadam3p_eu_wc2i_2001_1_006820594_1	34,656	111,714	3.2235
20 Sep 2012 17:47:05	1237933	15223130	hadam3p_eu_wc2i_2001_1_006820594_1	23,136	75,279	3.2538
19 Sep 2012 13:49:19	1237933	15223130	hadam3p_eu_wc2i_2001_1_006820594_1	11,616	37,894	3.2622