Task 15368687

Name	hadam3p_pnw_736w_2003_1_008215238_1
Workunit	8370362
Created	19 Oct 2012, 9:30:23 UTC
Sent	19 Oct 2012, 9:31:07 UTC
Report deadline	1 Oct 2013, 14:51:07 UTC
Received	8 Nov 2012, 11:04:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1216099
Run time	1 days 9 hours 3 min 25 sec
CPU time	1 days 4 hours 3 min 54 sec
Validate state	Invalid
Credit	502.72
Device peak FLOPS	2.56 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4244, selfPID=4244, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1148, selfPID=1148, iMonCtr=2 09:48:36 (3784): No heartbeat from core client for 30 sec - exiting 09:48:37 (3784): No heartbeat from core client for 30 sec - exiting 09:48:38 (3784): No heartbeat from core client for 30 sec - exiting 09:48:39 (3784): No heartbeat from core client for 30 sec - exiting 09:48:40 (3784): No heartbeat from core client for 30 sec - exiting 09:48:41 (3784): No heartbeat from core client for 30 sec - exiting 09:48:42 (3784): No heartbeat from core client for 30 sec - exiting 09:48:43 (3784): No heartbeat from core client for 30 sec - exiting 09:48:44 (3784): No heartbeat from core client for 30 sec - exiting 09:48:45 (3784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2284, selfPID=2284, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:48:13 (3216): No heartbeat from core client for 30 sec - exiting 13:48:15 (3216): No heartbeat from core client for 30 sec - exiting 13:48:16 (3216): No heartbeat from core client for 30 sec - exiting 13:48:17 (3216): No heartbeat from core client for 30 sec - exiting 13:48:18 (3216): No heartbeat from core client for 30 sec - exiting 13:48:19 (3216): No heartbeat from core client for 30 sec - exiting 13:48:20 (3216): No heartbeat from core client for 30 sec - exiting 13:48:21 (3216): No heartbeat from core client for 30 sec - exiting 13:48:22 (3216): No heartbeat from core client for 30 sec - exiting 13:48:23 (3216): No heartbeat from core client for 30 sec - exiting 13:48:24 (3216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:49:49 (460): No heartbeat from core client for 30 sec - exiting 08:49:50 (460): No heartbeat from core client for 30 sec - exiting 08:49:51 (460): No heartbeat from core client for 30 sec - exiting 08:49:52 (460): No heartbeat from core client for 30 sec - exiting 08:49:53 (460): No heartbeat from core client for 30 sec - exiting 08:49:54 (460): No heartbeat from core client for 30 sec - exiting 08:49:55 (460): No heartbeat from core client for 30 sec - exiting 08:49:56 (460): No heartbeat from core client for 30 sec - exiting 08:49:57 (460): No heartbeat from core client for 30 sec - exiting 08:49:58 (460): No heartbeat from core client for 30 sec - exiting 08:49:59 (460): No heartbeat from core client for 30 sec - exiting 08:50:00 (460): No heartbeat from core client for 30 sec - exiting 08:50:01 (460): No heartbeat from core client for 30 sec - exiting 08:50:02 (460): No heartbeat from core client for 30 sec - exiting 08:50:03 (460): No heartbeat from core client for 30 sec - exiting 08:50:04 (460): No heartbeat from core client for 30 sec - exiting 08:50:05 (460): No heartbeat from core client for 30 sec - exiting 08:50:06 (460): No heartbeat from core client for 30 sec - exiting 08:50:07 (460): No heartbeat from core client for 30 sec - exiting 08:50:08 (460): No heartbeat from core client for 30 sec - exiting 08:50:09 (460): No heartbeat from core client for 30 sec - exiting 08:50:10 (460): No heartbeat from core client for 30 sec - exiting 08:50:11 (460): No heartbeat from core client for 30 sec - exiting 08:50:12 (460): No heartbeat from core client for 30 sec - exiting 08:50:13 (460): No heartbeat from core client for 30 sec - exiting 08:50:14 (460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:15 (460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3920, selfPID=3920, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1228, selfPID=1228, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=4360, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2436, selfPID=2436, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2436, selfPID=4640, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 11:47:24 (4640): No heartbeat from core client for 30 sec - exiting 11:47:25 (4640): No heartbeat from core client for 30 sec - exiting 11:47:26 (4640): No heartbeat from core client for 30 sec - exiting 11:47:27 (4640): No heartbeat from core client for 30 sec - exiting 11:47:28 (4640): No heartbeat from core client for 30 sec - exiting 11:47:29 (4640): No heartbeat from core client for 30 sec - exiting 11:47:30 (4640): No heartbeat from core client for 30 sec - exiting Called boinc_finish 11:47:31 (4640): No heartbeat from core client for 30 sec - exiting 11:47:32 (4640): No heartbeat from core client for 30 sec - exiting </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_736w_2003_1_008215238_1_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_736w_2003_1_008215238_1_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_736w_2003_1_008215238_1_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_736w_2003_1_008215238_1_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_736w_2003_1_008215238_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_736w_2003_1_008215238_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_736w_2003_1_008215238_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_736w_2003_1_008215238_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_736w_2003_1_008215238_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_736w_2003_1_008215238_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Nov 2012 16:21:39	1216099	15368687	hadam3p_pnw_736w_2003_1_008215238_1	23,136	70,127	3.0311
26 Oct 2012 18:14:34	1216099	15368687	hadam3p_pnw_736w_2003_1_008215238_1	11,620	35,496	3.0547
26 Oct 2012 17:09:17	1216099	15368687	hadam3p_pnw_736w_2003_1_008215238_1	11,617	35,175	3.0279
26 Oct 2012 15:18:54	1216099	15368687	hadam3p_pnw_736w_2003_1_008215238_1	11,616	34,838	2.9991