Task 15344958

Name	hadam3p_eu_6d3d_2008_1_008219919_1
Workunit	8375043
Created	6 Oct 2012, 16:51:40 UTC
Sent	7 Oct 2012, 11:02:13 UTC
Report deadline	19 Sep 2013, 16:22:13 UTC
Received	8 Nov 2012, 11:04:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1216099
Run time	3 days 11 hours 25 min 35 sec
CPU time	3 days 0 hours 28 min 31 sec
Validate state	Invalid
Credit	1,591.48
Device peak FLOPS	2.55 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3128, selfPID=3128, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4396, selfPID=4396, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:49:46 (3428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPCPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4780, selfPID=4780, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4928, selfPID=4928, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... NCPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2536, selfPID=2536, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:13:50 (3612): No heartbeat from core client for 30 sec - exiting 12:13:52 (3612): No heartbeat from core client for 30 sec - exiting 12:13:53 (3612): No heartbeat from core client for 30 sec - exiting 12:13:54 (3612): No heartbeat from core client for 30 sec - exiting 12:13:55 (3612): No heartbeat from core client for 30 sec - exiting 12:13:56 (3612): No heartbeat from core client for 30 sec - exiting 12:13:57 (3612): No heartbeat from core client for 30 sec - exiting 12:13:58 (3612): No heartbeat from core client for 30 sec - exiting 12:13:59 (3612): No heartbeat from core client for 30 sec - exiting 12:14:00 (3612): No heartbeat from core client for 30 sec - exiting 12:14:01 (3612): No heartbeat from core client for 30 sec - exiting 12:14:02 (3612): No heartbeat from core client for 30 sec - exiting 12:14:03 (3612): No heartbeat from core client for 30 sec - exiting 12:14:04 (3612): No heartbeat from core client for 30 sec - exiting 12:14:05 (3612): No heartbeat from core client for 30 sec - exiting 12:14:06 (3612): No heartbeat from core client for 30 sec - exiting 12:14:07 (3612): No heartbeat from core client for 30 sec - exiting 12:14:08 (3612): No heartbeat from core client for 30 sec - exiting 12:14:09 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4772, selfPID=4772, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:48:33 (3756): No heartbeat from core client for 30 sec - exiting 09:48:34 (3756): No heartbeat from core client for 30 sec - exiting 09:48:35 (3756): No heartbeat from core client for 30 sec - exiting 09:48:36 (3756): No heartbeat from core client for 30 sec - exiting 09:48:37 (3756): No heartbeat from core client for 30 sec - exiting 09:48:38 (3756): No heartbeat from core client for 30 sec - exiting 09:48:39 (3756): No heartbeat from core client for 30 sec - exiting 09:48:40 (3756): No heartbeat from core client for 30 sec - exiting 09:48:41 (3756): No heartbeat from core client for 30 sec - exiting 09:48:42 (3756): No heartbeat from core client for 30 sec - exiting 09:48:43 (3756): No heartbeat from core client for 30 sec - exiting 09:48:44 (3756): No heartbeat from core client for 30 sec - exiting 09:48:45 (3756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1856, selfPID=1856, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No PrCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4452, selfPID=4452, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4776, selfPID=4776, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:48:13 (3936): No heartbeat from core client for 30 sec - exiting 13:48:14 (3936): No heartbeat from core client for 30 sec - exiting 13:48:15 (3936): No heartbeat from core client for 30 sec - exiting 13:48:16 (3936): No heartbeat from core client for 30 sec - exiting 13:48:17 (3936): No heartbeat from core client for 30 sec - exiting 13:48:18 (3936): No heartbeat from core client for 30 sec - exiting 13:48:19 (3936): No heartbeat from core client for 30 sec - exiting 13:48:20 (3936): No heartbeat from core client for 30 sec - exiting 13:48:21 (3936): No heartbeat from core client for 30 sec - exiting 13:48:22 (3936): No heartbeat from core client for 30 sec - exiting 13:48:23 (3936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:48:24 (3936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4068, selfPID=4068, iMonCtr=2 08:49:49 (804): No heartbeat from core client for 30 sec - exiting 08:49:50 (804): No heartbeat from core client for 30 sec - exiting 08:49:51 (804): No heartbeat from core client for 30 sec - exiting 08:49:52 (804): No heartbeat from core client for 30 sec - exiting 08:49:53 (804): No heartbeat from core client for 30 sec - exiting 08:49:54 (804): No heartbeat from core client for 30 sec - exiting 08:49:55 (804): No heartbeat from core client for 30 sec - exiting 08:49:56 (804): No heartbeat from core client for 30 sec - exiting 08:49:57 (804): No heartbeat from core client for 30 sec - exiting 08:49:58 (804): No heartbeat from core client for 30 sec - exiting 08:49:59 (804): No heartbeat from core client for 30 sec - exiting 08:50:00 (804): No heartbeat from core client for 30 sec - exiting 08:50:01 (804): No heartbeat from core client for 30 sec - exiting 08:50:02 (804): No heartbeat from core client for 30 sec - exiting 08:50:03 (804): No heartbeat from core client for 30 sec - exiting 08:50:04 (804): No heartbeat from core client for 30 sec - exiting 08:50:05 (804): No heartbeat from core client for 30 sec - exiting 08:50:06 (804): No heartbeat from core client for 30 sec - exiting 08:50:07 (804): No heartbeat from core client for 30 sec - exiting 08:50:08 (804): No heartbeat from core client for 30 sec - exiting 08:50:09 (804): No heartbeat from core client for 30 sec - exiting 08:50:10 (804): No heartbeat from core client for 30 sec - exiting 08:50:11 (804): No heartbeat from core client for 30 sec - exiting 08:50:12 (804): No heartbeat from core client for 30 sec - exiting 08:50:13 (804): No heartbeat from core client for 30 sec - exiting 08:50:14 (804): No heartbeat from core client for 30 sec - exiting 08:50:15 (804): No heartbeat from core client for 30 sec - exiting 08:50:16 (804): No heartbeat from core client for 30 sec - exiting 08:50:17 (804): No heartbeat from core client for 30 sec - exiting 08:50:18 (804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4248, selfPID=4248, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4504, selfPID=4504, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1484, selfPID=1484, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:20:01 (3028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=4628, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4328, selfPID=4328, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4328, selfPID=2352, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 11:47:08 (2352): No heartbeat from core client for 30 sec - exiting 11:47:09 (2352): No heartbeat from core client for 30 sec - exiting 11:47:10 (2352): No heartbeat from core client for 30 sec - exiting 11:47:11 (2352): No heartbeat from core client for 30 sec - exiting 11:47:12 (2352): No heartbeat from core client for 30 sec - exiting 11:47:13 (2352): No heartbeat from core client for 30 sec - exiting 11:47:14 (2352): No heartbeat from core client for 30 sec - exiting Called boinc_finish 11:47:16 (2352): No heartbeat from core client for 30 sec - exiting 11:47:17 (2352): No heartbeat from core client for 30 sec - exiting </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_6d3d_2008_1_008219919_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_6d3d_2008_1_008219919_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_6d3d_2008_1_008219919_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_6d3d_2008_1_008219919_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Nov 2012 18:23:17	1216099	15344958	hadam3p_eu_6d3d_2008_1_008219919_1	92,256	232,231	2.5172
30 Oct 2012 16:02:22	1216099	15344958	hadam3p_eu_6d3d_2008_1_008219919_1	80,736	203,211	2.5170
26 Oct 2012 11:23:22	1216099	15344958	hadam3p_eu_6d3d_2008_1_008219919_1	69,216	174,448	2.5203
24 Oct 2012 08:41:43	1216099	15344958	hadam3p_eu_6d3d_2008_1_008219919_1	57,696	144,744	2.5087
20 Oct 2012 09:26:35	1216099	15344958	hadam3p_eu_6d3d_2008_1_008219919_1	46,176	115,895	2.5099
18 Oct 2012 09:22:08	1216099	15344958	hadam3p_eu_6d3d_2008_1_008219919_1	34,656	87,065	2.5123
15 Oct 2012 18:13:00	1216099	15344958	hadam3p_eu_6d3d_2008_1_008219919_1	23,136	58,070	2.5099
14 Oct 2012 19:11:35	1216099	15344958	hadam3p_eu_6d3d_2008_1_008219919_1	11,618	29,597	2.5475
14 Oct 2012 18:15:14	1216099	15344958	hadam3p_eu_6d3d_2008_1_008219919_1	11,616	29,219	2.5154