Task 14809907

Name	hadam3p_pnw_bmc8_1992_1_008009353_0
Workunit	8164467
Created	21 Jun 2012, 8:10:23 UTC
Sent	21 Jun 2012, 8:11:25 UTC
Report deadline	3 Jun 2013, 13:31:25 UTC
Received	31 Jul 2012, 5:43:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1193311
Run time	4 days 23 hours 1 min 1 sec
CPU time	4 days 14 hours 23 min 20 sec
Validate state	Invalid
Credit	1,503.98
Device peak FLOPS	2.64 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1920, selfPID=732, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:15:52 (7324): No heartbeat from core client for 30 sec - exiting 01:15:53 (7324): No heartbeat from core client for 30 sec - exiting 01:15:54 (7324): No heartbeat from core client for 30 sec - exiting 01:15:55 (7324): No heartbeat from core client for 30 sec - exiting 01:15:56 (7324): No heartbeat from core client for 30 sec - exiting 01:15:57 (7324): No heartbeat from core client for 30 sec - exiting 01:15:58 (7324): No heartbeat from core client for 30 sec - exiting 01:15:59 (7324): No heartbeat from core client for 30 sec - exiting 01:16:00 (7324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5988, selfPID=5988, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:43:59 (4848): No heartbeat from core client for 30 sec - exiting 07:44:00 (4848): No heartbeat from core client for 30 sec - exiting 07:44:01 (4848): No heartbeat from core client for 30 sec - exiting 07:44:02 (4848): No heartbeat from core client for 30 sec - exiting 07:44:03 (4848): No heartbeat from core client for 30 sec - exiting 07:44:04 (4848): No heartbeat from core client for 30 sec - exiting 07:44:05 (4848): No heartbeat from core client for 30 sec - exiting 07:44:06 (4848): No heartbeat from core client for 30 sec - exiting 07:44:07 (4848): No heartbeat from core client for 30 sec - exiting 07:44:08 (4848): No heartbeat from core client for 30 sec - exiting 07:44:09 (4848): No heartbeat from core client for 30 sec - exiting 07:44:10 (4848): No heartbeat from core client for 30 sec - exiting 07:44:11 (4848): No heartbeat from core client for 30 sec - exiting 07:44:12 (4848): No heartbeat from core client for 30 sec - exiting 07:44:13 (4848): No heartbeat from core client for 30 sec - exiting 07:44:14 (4848): No heartbeat from core client for 30 sec - exiting 07:44:15 (4848): No heartbeat from core client for 30 sec - exiting 07:44:16 (4848): No heartbeat from core client for 30 sec - exiting 07:44:17 (4848): No heartbeat from core client for 30 sec - exiting 07:44:18 (4848): No heartbeat from core client for 30 sec - exiting 07:44:19 (4848): No heartbeat from core client for 30 sec - exiting 07:44:20 (4848): No heartbeat from core client for 30 sec - exiting 07:44:21 (4848): No heartbeat from core client for 30 sec - exiting 07:44:22 (4848): No heartbeat from core client for 30 sec - exiting 07:44:23 (4848): No heartbeat from core client for 30 sec - exiting 07:44:24 (4848): No heartbeat from core client for 30 sec - exiting 07:44:25 (4848): No heartbeat from core client for 30 sec - exiting 07:44:26 (4848): No heartbeat from core client for 30 sec - exiting 07:44:27 (4848): No heartbeat from core client for 30 sec - exiting 07:44:28 (4848): No heartbeat from core client for 30 sec - exiting 07:44:29 (4848): No heartbeat from core client for 30 sec - exiting 07:44:30 (4848): No heartbeat from core client for 30 sec - exiting 07:44:31 (4848): No heartbeat from core client for 30 sec - exiting 07:44:32 (4848): No heartbeat from core client for 30 sec - exiting 07:44:33 (4848): No heartbeat from core client for 30 sec - exiting 07:44:34 (4848): No heartbeat from core client for 30 sec - exiting 07:44:35 (4848): No heartbeat from core client for 30 sec - exiting 07:44:36 (4848): No heartbeat from core client for 30 sec - exiting 07:44:37 (4848): No heartbeat from core client for 30 sec - exiting 07:44:38 (4848): No heartbeat from core client for 30 sec - exiting 07:44:39 (4848): No heartbeat from core client for 30 sec - exiting 07:44:40 (4848): No heartbeat from core client for 30 sec - exiting 07:44:41 (4848): No heartbeat from core client for 30 sec - exiting 07:44:42 (4848): No heartbeat from core client for 30 sec - exiting 07:44:43 (4848): No heartbeat from core client for 30 sec - exiting 07:44:44 (4848): No heartbeat from core client for 30 sec - exiting 07:44:45 (4848): No heartbeat from core client for 30 sec - exiting 07:44:46 (4848): No heartbeat from core client for 30 sec - exiting 07:44:47 (4848): No heartbeat from core client for 30 sec - exiting 07:44:48 (4848): No heartbeat from core client for 30 sec - exiting 07:44:49 (4848): No heartbeat from core client for 30 sec - exiting 07:44:50 (4848): No heartbeat from core client for 30 sec - exiting 07:44:51 (4848): No heartbeat from core client for 30 sec - exiting 07:44:52 (4848): No heartbeat from core client for 30 sec - exiting 07:44:53 (4848): No heartbeat from core client for 30 sec - exiting 07:44:54 (4848): No heartbeat from core client for 30 sec - exiting 07:44:55 (4848): No heartbeat from core client for 30 sec - exiting 07:44:56 (4848): No heartbeat from core client for 30 sec - exiting 07:44:57 (4848): No heartbeat from core client for 30 sec - exiting 07:44:58 (4848): No heartbeat from core client for 30 sec - exiting 07:44:59 (4848): No heartbeat from core client for 30 sec - exiting 07:45:00 (4848): No heartbeat from core client for 30 sec - exiting 07:45:01 (4848): No heartbeat from core client for 30 sec - exiting 07:45:02 (4848): No heartbeat from core client for 30 sec - exiting 07:45:03 (4848): No heartbeat from core client for 30 sec - exiting 07:45:04 (4848): No heartbeat from core client for 30 sec - exiting 07:45:05 (4848): No heartbeat from core client for 30 sec - exiting 07:45:06 (4848): No heartbeat from core client for 30 sec - exiting 07:45:07 (4848): No heartbeat from core client for 30 sec - exiting 07:45:08 (4848): No heartbeat from core client for 30 sec - exiting 07:45:09 (4848): No heartbeat from core client for 30 sec - exiting 07:45:10 (4848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2536, selfPID=2536, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6480, selfPID=6480, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3368, selfPID=4120, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_bmc8_1992_1_008009353_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bmc8_1992_1_008009353_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bmc8_1992_1_008009353_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bmc8_1992_1_008009353_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bmc8_1992_1_008009353_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bmc8_1992_1_008009353_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2012 08:02:04	1193311	14809907	hadam3p_pnw_bmc8_1992_1_008009353_0	69,216	359,299	5.1910
23 Jul 2012 04:36:49	1193311	14809907	hadam3p_pnw_bmc8_1992_1_008009353_0	57,696	302,319	5.2399
21 Jul 2012 11:11:45	1193311	14809907	hadam3p_pnw_bmc8_1992_1_008009353_0	46,176	246,481	5.3379
14 Jul 2012 02:33:49	1193311	14809907	hadam3p_pnw_bmc8_1992_1_008009353_0	34,656	190,640	5.5009
12 Jul 2012 07:56:42	1193311	14809907	hadam3p_pnw_bmc8_1992_1_008009353_0	23,136	128,981	5.5749
06 Jul 2012 01:07:49	1193311	14809907	hadam3p_pnw_bmc8_1992_1_008009353_0	11,618	62,567	5.3854
06 Jul 2012 00:02:38	1193311	14809907	hadam3p_pnw_bmc8_1992_1_008009353_0	11,616	62,050	5.3418