Task 16115732

Name	hadam3p_eu_ixkk_1991_1_008488697_0
Workunit	8639510
Created	3 Dec 2013, 20:46:39 UTC
Sent	5 Dec 2013, 4:01:19 UTC
Report deadline	17 Nov 2014, 9:21:19 UTC
Received	11 Dec 2013, 4:26:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1264979
Run time	1 days 16 hours 0 min 45 sec
CPU time	1 days 12 hours 15 min 24 sec
Validate state	Invalid
Credit	995.30
Device peak FLOPS	2.76 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4404, selfPID=4404, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6460, selfPID=13116, iMonCtr=1 Model crash detected, will try to restart... 17:38:46 (6680): No heartbeat from core client for 30 sec - exiting 17:38:47 (6680): No heartbeat from core client for 30 sec - exiting 17:38:48 (6680): No heartbeat from core client for 30 sec - exiting 17:38:49 (6680): No heartbeat from core client for 30 sec - exiting 17:38:50 (6680): No heartbeat from core client for 30 sec - exiting 17:38:51 (6680): No heartbeat from core client for 30 sec - exiting 17:38:52 (6680): No heartbeat from core client for 30 sec - exiting 17:38:53 (6680): No heartbeat from core client for 30 sec - exiting 17:38:54 (6680): No heartbeat from core client for 30 sec - exiting 17:38:55 (6680): No heartbeat from core client for 30 sec - exiting 17:38:56 (6680): No heartbeat from core client for 30 sec - exiting 17:38:57 (6680): No heartbeat from core client for 30 sec - exiting 17:38:58 (6680): No heartbeat from core client for 30 sec - exiting 17:38:59 (6680): No heartbeat from core client for 30 sec - exiting 17:39:00 (6680): No heartbeat from core client for 30 sec - exiting 17:39:01 (6680): No heartbeat from core client for 30 sec - exiting 17:39:02 (6680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6068, selfPID=6068, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:15:00 (5924): No heartbeat from core client for 30 sec - exiting 17:15:01 (5924): No heartbeat from core client for 30 sec - exiting 17:15:02 (5924): No heartbeat from core client for 30 sec - exiting 17:15:03 (5924): No heartbeat from core client for 30 sec - exiting 17:15:04 (5924): No heartbeat from core client for 30 sec - exiting 17:15:05 (5924): No heartbeat from core client for 30 sec - exiting 17:15:06 (5924): No heartbeat from core client for 30 sec - exiting 17:15:07 (5924): No heartbeat from core client for 30 sec - exiting 17:15:08 (5924): No heartbeat from core client for 30 sec - exiting 17:15:09 (5924): No heartbeat from core client for 30 sec - exiting 17:15:10 (5924): No heartbeat from core client for 30 sec - exiting 17:15:11 (5924): No heartbeat from core client for 30 sec - exiting 17:15:12 (5924): No heartbeat from core client for 30 sec - exiting 17:15:13 (5924): No heartbeat from core client for 30 sec - exiting 17:15:14 (5924): No heartbeat from core client for 30 sec - exiting 17:15:15 (5924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_ixkk_1991_1_008488697_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_ixkk_1991_1_008488697_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_ixkk_1991_1_008488697_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_ixkk_1991_1_008488697_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_ixkk_1991_1_008488697_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_ixkk_1991_1_008488697_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_ixkk_1991_1_008488697_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Dec 2013 10:32:08	1264979	16115732	hadam3p_eu_ixkk_1991_1_008488697_0	57,696	118,642	2.0563
09 Dec 2013 10:19:48	1264979	16115732	hadam3p_eu_ixkk_1991_1_008488697_0	46,176	94,884	2.0548
08 Dec 2013 08:39:45	1264979	16115732	hadam3p_eu_ixkk_1991_1_008488697_0	34,656	70,950	2.0473
07 Dec 2013 12:27:43	1264979	16115732	hadam3p_eu_ixkk_1991_1_008488697_0	23,136	47,293	2.0441
06 Dec 2013 04:10:50	1264979	16115732	hadam3p_eu_ixkk_1991_1_008488697_0	11,616	23,439	2.0178