Task 17668951

Name	hadam3p_pnw_f4a5_2011_1_009353175_0
Workunit	9437208
Created	7 Jan 2015, 10:22:54 UTC
Sent	15 Jan 2015, 16:17:32 UTC
Report deadline	28 Dec 2015, 21:37:32 UTC
Received	20 Jan 2015, 1:11:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1346591
Run time	21 hours 50 min 32 sec
CPU time	18 hours 2 min 23 sec
Validate state	Invalid
Credit	507.13
Device peak FLOPS	3.23 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v7.22 windows_intelx86
Stderr	<core_client_version>6.8.44</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=153408, iMonCtr=1 Regional Worker:: CPDN process is not running, exitCng, bRetValntroller:: CPDN process is not r = ing, exiti1g, bRetkVal = 51,8 checkPID=155114,8,MonClfPID =151472, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:02:40 (192572): No heartbeat from client for 30 sec - exiting 15:02:40 (192572): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:03:18 (181592): No heartbeat from client for 30 sec - exiting 15:03:18 (181592): timer handler: client dead, exiting 15:03:19 (181592): No heartbeat from client for 30 sec - exiting 15:03:19 (181592): timer handler: client dead, exiting 15:03:20 (181592): No heartbeat from client for 30 sec - exiting 15:03:20 (181592): timer handler: client dead, exiting 15:03:21 (181592): No heartbeat from client for 30 sec - exiting 15:03:21 (181592): timer handler: client dead, exiting 15:03:22 (181592): No heartbeat from client for 30 sec - exiting 15:03:22 (181592): timer handler: client dead, exiting 15:03:23 (181592): No heartbeat from client for 30 sec - exiting 15:03:23 (181592): timer handler: client dead, exiting 15:03:24 (181592): No heartbeat from client for 30 sec - exiting 15:03:24 (181592): timer handler: client dead, exiting 15:03:25 (181592): No heartbeat from client for 30 sec - exiting 15:03:25 (181592): timer handler: client dead, exiting 15:03:26 (181592): No heartbeat from client for 30 sec - exiting 15:03:26 (181592): timer handler: client dead, exiting 15:03:27 (181592): No heartbeat from client for 30 sec - exiting 15:03:27 (181592): timer handler: client dead, exiting 15:03:28 (181592): No heartbeat from client for 30 sec - exiting 15:03:28 (181592): timer handler: client dead, exiting 15:03:29 (181592): No heartbeat from client for 30 sec - exiting 15:03:29 (181592): timer handler: client dead, exiting 15:03:30 (181592): No heartbeat from client for 30 sec - exiting 15:03:30 (181592): timer handler: client dead, exiting 15:03:31 (181592): No heartbeat from client for 30 sec - exiting 15:03:31 (181592): timer handler: client dead, exiting 15:03:32 (181592): No heartbeat from client for 30 sec - exiting 15:03:32 (181592): timer handler: client dead, exiting 15:03:33 (181592): No heartbeat from client for 30 sec - exiting 15:03:33 (181592): timer handler: client dead, exiting 15:03:34 (181592): No heartbeat from client for 30 sec - exiting 15:03:34 (181592): timer handler: client dead, exiting 15:03:35 (181592): No heartbeat from client for 30 sec - exiting 15:03:35 (181592): timer handler: client dead, exiting 15:03:36 (181592): No heartbeat from client for 30 sec - exiting 15:03:36 (181592): timer handler: client dead, exiting 15:03:37 (181592): No heartbeat from client for 30 sec - exiting 15:03:37 (181592): timer handler: client dead, exiting 15:03:38 (181592): No heartbeat from client for 30 sec - exiting 15:03:38 (181592): timer handler: client dead, exiting 15:03:39 (181592): No heartbeat from client for 30 sec - exiting 15:03:39 (181592): timer handler: client dead, exiting 15:03:40 (181592): No heartbeat from client for 30 sec - exiting 15:03:40 (181592): timer handler: client dead, exiting 15:03:41 (181592): No heartbeat from client for 30 sec - exiting 15:03:41 (181592): timer handler: client dead, exiting 15:03:42 (181592): No heartbeat from client for 30 sec - exiting 15:03:42 (181592): timer handler: client dead, exiting 15:03:43 (181592): No heartbeat from client for 30 sec - exiting 15:03:43 (181592): timer handler: client dead, exiting 15:03:44 (181592): No heartbeat from client for 30 sec - exiting 15:03:44 (181592): timer handler: client dead, exiting 15:03:45 (181592): No heartbeat from client for 30 sec - exiting 15:03:45 (181592): timer handler: client dead, exiting 15:03:46 (181592): No heartbeat from client for 30 sec - exiting 15:03:46 (181592): timer handler: client dead, exiting 15:03:47 (181592): No heartbeat from client for 30 sec - exiting 15:03:47 (181592): timer handler: client dead, exiting 15:03:48 (181592): No heartbeat from client for 30 sec - exiting 15:03:48 (181592): timer handler: client dead, exiting 15:03:49 (181592): No heartbeat from client for 30 sec - exiting 15:03:49 (181592): timer handler: client dead, exiting 15:03:50 (181592): No heartbeat from client for 30 sec - exiting 15:03:50 (181592): timer handler: client dead, exiting 15:03:51 (181592): No heartbeat from client for 30 sec - exiting 15:03:51 (181592): timer handler: client dead, exiting 15:03:52 (181592): No heartbeat from client for 30 sec - exiting 15:03:52 (181592): timer handler: client dead, exiting 15:03:53 (181592): No heartbeat from client for 30 sec - exiting 15:03:53 (181592): timer handler: client dead, exiting 15:03:54 (181592): No heartbeat from client for 30 sec - exiting 15:03:54 (181592): timer handler: client dead, exiting 15:03:55 (181592): No heartbeat from client for 30 sec - exiting 15:03:55 (181592): timer handler: client dead, exiting 15:03:56 (181592): No heartbeat from client for 30 sec - exiting 15:03:56 (181592): timer handler: client dead, exiting 15:03:57 (181592): No heartbeat from client for 30 sec - exiting 15:03:57 (181592): timer handler: client dead, exiting 15:03:58 (181592): No heartbeat from client for 30 sec - exiting 15:03:58 (181592): timer handler: client dead, exiting 15:03:59 (181592): No heartbeat from client for 30 sec - exiting 15:03:59 (181592): timer handler: client dead, exiting 15:04:00 (181592): No heartbeat from client for 30 sec - exiting 15:04:00 (181592): timer handler: client dead, exiting 15:04:01 (181592): No heartbeat from client for 30 sec - exiting 15:04:01 (181592): timer handler: client dead, exiting 15:04:02 (181592): No heartbeat from client for 30 sec - exiting 15:04:02 (181592): timer handler: client dead, exiting 15:04:03 (181592): No heartbeat from client for 30 sec - exiting 15:04:03 (181592): timer handler: client dead, exiting 15:04:04 (181592): No heartbeat from client for 30 sec - exiting 15:04:04 (181592): timer handler: client dead, exiting 15:04:05 (181592): No heartbeat from client for 30 sec - exiting 15:04:05 (181592): timer handler: client dead, exiting 15:04:06 (181592): No heartbeat from client for 30 sec - exiting 15:04:06 (181592): timer handler: client dead, exiting 15:04:07 (181592): No heartbeat from client for 30 sec - exiting 15:04:07 (181592): timer handler: client dead, exiting 15:04:08 (181592): No heartbeat from client for 30 sec - exiting 15:04:08 (181592): timer handler: client dead, exiting 15:04:09 (181592): No heartbeat from client for 30 sec - exiting 15:04:09 (181592): timer handler: client dead, exiting 15:04:10 (181592): No heartbeat from client for 30 sec - exiting 15:04:10 (181592): timer handler: client dead, exiting 15:04:11 (181592): No heartbeat from client for 30 sec - exiting 15:04:11 (181592): timer handler: client dead, exiting 15:04:12 (181592): No heartbeat from client for 30 sec - exiting 15:04:12 (181592): timer handler: client dead, exiting 15:04:13 (181592): No heartbeat from client for 30 sec - exiting 15:04:13 (181592): timer handler: client dead, exiting 15:04:14 (181592): No heartbeat from client for 30 sec - exiting 15:04:14 (181592): timer handler: client dead, exiting 15:04:15 (181592): No heartbeat from client for 30 sec - exiting 15:04:15 (181592): timer handler: client dead, exiting 15:04:16 (181592): No heartbeat from client for 30 sec - exiting 15:04:16 (181592): timer handler: client dead, exiting 15:04:17 (181592): No heartbeat from client for 30 sec - exiting 15:04:17 (181592): timer handler: client dead, exiting 15:04:18 (181592): No heartbeat from client for 30 sec - exiting 15:04:18 (181592): timer handler: client dead, exiting 15:04:19 (181592): No heartbeat from client for 30 sec - exiting 15:04:19 (181592): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:56:01 (100996): No heartbeat from client for 30 sec - exiting 07:56:02 (100996): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is notCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=123472, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=125264, selfPID=125264, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=125264, selfPID=127484, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 17:45:33 (127484): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_f4a5_2011_1_009353175_0_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_f4a5_2011_1_009353175_0_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_f4a5_2011_1_009353175_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_f4a5_2011_1_009353175_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_f4a5_2011_1_009353175_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_f4a5_2011_1_009353175_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_f4a5_2011_1_009353175_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_f4a5_2011_1_009353175_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_f4a5_2011_1_009353175_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_f4a5_2011_1_009353175_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Jan 2015 14:54:06	1346591	17668951	hadam3p_pnw_f4a5_2011_1_009353175_0	23,339	44,781	1.9187
18 Jan 2015 05:22:39	1346591	17668951	hadam3p_pnw_f4a5_2011_1_009353175_0	11,819	22,673	1.9184