Task 13197462

Name	hadam3p_eu_2ssw_1986_1_007381854_1
Workunit	7579284
Created	3 Aug 2011, 17:58:51 UTC
Sent	3 Aug 2011, 18:13:38 UTC
Report deadline	15 Jul 2012, 23:33:38 UTC
Received	22 Jan 2012, 15:18:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1038022
Run time	3 days 0 hours 53 min 2 sec
CPU time	2 days 21 hours 50 min 51 sec
Validate state	Invalid
Credit	1,591.48
Device peak FLOPS	2.14 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4784, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=2 Model crash detected, will try to restart... 10:10:06 (4628): No heartbeat from core client for 30 sec - exiting 10:10:07 (4628): No heartbeat from core client for 30 sec - exiting 10:10:08 (4628): No heartbeat from core client for 30 sec - exiting 10:10:09 (4628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:18:48 (5828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:23:00 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:23:04 (5708): No heartbeat from core client for 30 sec - exiting 10:23:06 (5708): No heartbeat from core client for 30 sec - exiting 10:23:07 (5708): No heartbeat from core client for 30 sec - exiting 10:23:08 (5708): No heartbeat from core client for 30 sec - exiting 10:23:09 (5708): No heartbeat from core client for 30 sec - exiting 10:23:10 (5708): No heartbeat from core client for 30 sec - exiting 10:23:12 (5708): No heartbeat from core client for 30 sec - exiting 10:23:13 (5708): No heartbeat from core client for 30 sec - exiting 10:23:14 (5708): No heartbeat from core client for 30 sec - exiting 10:23:15 (5708): No heartbeat from core client for 30 sec - exiting 10:23:16 (5708): No heartbeat from core client for 30 sec - exiting 10:23:17 (5708): No heartbeat from core client for 30 sec - exiting 10:23:18 (5708): No heartbeat from core client for 30 sec - exiting 10:23:19 (5708): No heartbeat from core client for 30 sec - exiting 10:23:20 (5708): No heartbeat from core client for 30 sec - exiting 10:23:22 (5708): No heartbeat from core client for 30 sec - exiting 10:32:14 (5740): No heartbeat from core client for 30 sec - exiting 10:32:15 (5740): No heartbeat from core client for 30 sec - exiting 10:32:16 (5740): No heartbeat from core client for 30 sec - exiting 10:32:17 (5740): No heartbeat from core client for 30 sec - exiting 10:32:18 (5740): No heartbeat from core client for 30 sec - exiting 10:32:20 (5740): No heartbeat from core client for 30 sec - exiting 10:32:21 (5740): No heartbeat from core client for 30 sec - exiting 10:32:22 (5740): No heartbeat from core client for 30 sec - exiting 10:32:23 (5740): No heartbeat from core client for 30 sec - exiting 10:32:24 (5740): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=4680, iMonCtr=1 CPDN Monitor - No 'heartbeat' from BOINC... 10:36:04 (3572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:48:40 (5344): No heartbeat from core client for 30 sec - exiting 15:48:41 (5344): No heartbeat from core client for 30 sec - exiting 15:48:42 (5344): No heartbeat from core client for 30 sec - exiting 15:48:43 (5344): No heartbeat from core client for 30 sec - exiting 15:48:44 (5344): No heartbeat from core client for 30 sec - exiting 15:48:45 (5344): No heartbeat from core client for 30 sec - exiting 15:48:47 (5344): No heartbeat from core client for 30 sec - exiting 15:48:48 (5344): No heartbeat from core client for 30 sec - exiting 15:48:49 (5344): No heartbeat from core client for 30 sec - exiting 15:48:50 (5344): No heartbeat from core client for 30 sec - exiting 15:48:51 (5344): No heartbeat from core client for 30 sec - exiting 15:48:52 (5344): No heartbeat from core client for 30 sec - exiting 15:48:53 (5344): No heartbeat from core client for 30 sec - exiting 15:48:54 (5344): No heartbeat from core client for 30 sec - exiting 15:48:55 (5344): No heartbeat from core client for 30 sec - exiting 15:48:56 (5344): No heartbeat from core client for 30 sec - exiting 15:48:57 (5344): No heartbeat from core client for 30 sec - exiting 15:48:58 (5344): No heartbeat from core client for 30 sec - exiting 15:49:00 (5344): No heartbeat from core client for 30 sec - exiting 15:49:01 (5344): No heartbeat from core client for 30 sec - exiting 15:49:02 (5344): No heartbeat from core client for 30 sec - exiting 15:49:03 (5344): No heartbeat from core client for 30 sec - exiting 15:49:04 (5344): No heartbeat from core client for 30 sec - exiting 15:49:05 (5344): No heartbeat from core client for 30 sec - exiting 15:49:06 (5344): No heartbeat from core client for 30 sec - exiting 15:49:07 (5344): No heartbeat from core client for 30 sec - exiting 15:49:08 (5344): No heartbeat from core client for 30 sec - exiting 15:49:09 (5344): No heartbeat from core client for 30 sec - exiting 15:49:10 (5344): No heartbeat from core client for 30 sec - exiting 15:49:12 (5344): No heartbeat from core client for 30 sec - exiting 15:49:13 (5344): No heartbeat from core client for 30 sec - exiting 15:49:14 (5344): No heartbeat from core client for 30 sec - exiting 15:49:15 (5344): No heartbeat from core client for 30 sec - exiting 15:49:16 (5344): No heartbeat from core client for 30 sec - exiting 15:49:17 (5344): No heartbeat from core client for 30 sec - exiting 15:49:18 (5344): No heartbeat from core client for 30 sec - exiting 15:49:19 (5344): No heartbeat from core client for 30 sec - exiting 15:49:20 (5344): No heartbeat from core client for 30 sec - exiting 15:49:21 (5344): No heartbeat from core client for 30 sec - exiting 15:49:22 (5344): No heartbeat from core client for 30 sec - exiting 15:49:23 (5344): No heartbeat from core client for 30 sec - exiting 15:49:24 (5344): No heartbeat from core client for 30 sec - exiting 15:49:25 (5344): No heartbeat from core client for 30 sec - exiting 15:49:26 (5344): No heartbeat from core client for 30 sec - exiting 15:49:27 (5344): No heartbeat from core client for 30 sec - exiting 15:49:29 (5344): No heartbeat from core client for 30 sec - exiting 15:49:30 (5344): No heartbeat from core client for 30 sec - exiting 15:49:31 (5344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:49:32 (5344): No heartbeat from core client for 30 sec - exiting 15:49:33 (5344): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:10:55 (4740): No heartbeat from core client for 30 sec - exiting 10:10:56 (4740): No heartbeat from core client for 30 sec - exiting 10:10:57 (4740): No heartbeat from core client for 30 sec - exiting 10:10:58 (4740): No heartbeat from core client for 30 sec - exiting 10:10:59 (4740): No heartbeat from core client for 30 sec - exiting 10:11:01 (4740): No heartbeat from core client for 30 sec - exiting 10:11:02 (4740): No heartbeat from core client for 30 sec - exiting 10:11:03 (4740): No heartbeat from core client for 30 sec - exiting 10:11:04 (4740): No heartbeat from core client for 30 sec - exiting 10:11:05 (4740): No heartbeat from core client for 30 sec - exiting 10:11:06 (4740): No heartbeat from core client for 30 sec - exiting 10:11:07 (4740): No heartbeat from core client for 30 sec - exiting 10:11:08 (4740): No heartbeat from core client for 30 sec - exiting 10:11:09 (4740): No heartbeat from core client for 30 sec - exiting 10:11:10 (4740): No heartbeat from core client for 30 sec - exiting 10:11:11 (4740): No heartbeat from core client for 30 sec - exiting 10:11:13 (4740): No heartbeat from core client for 30 sec - exiting 10:11:14 (4740): No heartbeat from core client for 30 sec - exiting 10:11:15 (4740): No heartbeat from core client for 30 sec - exiting 10:11:16 (4740): No heartbeat from core client for 30 sec - exiting 10:11:17 (4740): No heartbeat from core client for 30 sec - exiting 10:11:18 (4740): No heartbeat from core client for 30 sec - exiting 10:11:19 (4740): No heartbeat from core client for 30 sec - exiting 10:11:20 (4740): No heartbeat from core client for 30 sec - exiting 10:11:21 (4740): No heartbeat from core client for 30 sec - exiting 10:11:22 (4740): No heartbeat from core client for 30 sec - exiting 10:11:23 (4740): No heartbeat from core client for 30 sec - exiting 10:11:25 (4740): No heartbeat from core client for 30 sec - exiting 10:11:26 (4740): No heartbeat from core client for 30 sec - exiting 10:11:27 (4740): No heartbeat from core client for 30 sec - exiting 10:11:28 (4740): No heartbeat from core client for 30 sec - exiting 10:11:29 (4740): No heartbeat from core client for 30 sec - exiting 10:11:30 (4740): No heartbeat from core client for 30 sec - exiting 10:11:31 (4740): No heartbeat from core client for 30 sec - exiting 10:11:32 (4740): No heartbeat from core client for 30 sec - exiting 10:11:33 (4740): No heartbeat from core client for 30 sec - exiting 10:11:34 (4740): No heartbeat from core client for 30 sec - exiting 10:11:35 (4740): No heartbeat from core client for 30 sec - exiting 10:11:37 (4740): No heartbeat from core client for 30 sec - exiting 10:11:38 (4740): No heartbeat from core client for 30 sec - exiting 10:11:39 (4740): No heartbeat from core client for 30 sec - exiting 10:11:40 (4740): No heartbeat from core client for 30 sec - exiting 10:11:41 (4740): No heartbeat from core client for 30 sec - exiting 10:11:42 (4740): No heartbeat from core client for 30 sec - exiting 10:11:43 (4740): No heartbeat from core client for 30 sec - exiting 10:11:44 (4740): No heartbeat from core client for 30 sec - exiting 10:11:45 (4740): No heartbeat from core client for 30 sec - exiting 10:11:46 (4740): No heartbeat from core client for 30 sec - exiting 10:11:47 (4740): No heartbeat from core client for 30 sec - exiting 10:11:49 (4740): No heartbeat from core client for 30 sec - exiting 10:11:50 (4740): No heartbeat from core client for 30 sec - exiting 10:11:51 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=5996, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5664, selfPID=5812, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_2ssw_1986_1_007381854_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2ssw_1986_1_007381854_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2ssw_1986_1_007381854_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2ssw_1986_1_007381854_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Jan 2012 02:44:55	1038022	13197462	hadam3p_eu_2ssw_1986_1_007381854_1	92,256	235,684	2.5547
21 Jan 2012 09:30:55	1038022	13197462	hadam3p_eu_2ssw_1986_1_007381854_1	80,736	206,902	2.5627
20 Jan 2012 00:48:00	1038022	13197462	hadam3p_eu_2ssw_1986_1_007381854_1	69,216	177,869	2.5698
12 Dec 2011 15:35:42	1038022	13197462	hadam3p_eu_2ssw_1986_1_007381854_1	57,696	148,108	2.5670
12 Dec 2011 15:35:42	1038022	13197462	hadam3p_eu_2ssw_1986_1_007381854_1	46,176	118,257	2.5610
26 Aug 2011 18:25:40	1038022	13197462	hadam3p_eu_2ssw_1986_1_007381854_1	34,656	88,315	2.5483
24 Aug 2011 02:53:24	1038022	13197462	hadam3p_eu_2ssw_1986_1_007381854_1	23,136	59,405	2.5676
22 Aug 2011 17:27:04	1038022	13197462	hadam3p_eu_2ssw_1986_1_007381854_1	11,616	30,203	2.6001