Task 15200750

Name	hadam3p_pnw_34q3_1976_1_008169584_0
Workunit	8324708
Created	29 Aug 2012, 17:20:33 UTC
Sent	29 Aug 2012, 17:34:37 UTC
Report deadline	11 Aug 2013, 22:54:37 UTC
Received	27 Sep 2012, 13:22:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1089092
Run time	4 days 6 hours 54 min 35 sec
CPU time	3 days 12 hours 4 min 57 sec
Validate state	Invalid
Credit	1,003.35
Device peak FLOPS	1.67 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6828, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8824, selfPID=8824, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:23:38 (3372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4884, selfPID=4884, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5488, selfPID=7036, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7420, selfPID=7420, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:53:04 (4464): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5828, selfPID=5828, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6584, selfPID=6584, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:43:51 (9536): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:55:16 (3836): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4292, selfPID=4292, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4272, selfPID=4272, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2184, selfPID=3600, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5116, selfPID=5336, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2992, selfPID=2992, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2200, selfPID=2200, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4216, selfPID=4216, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3776, selfPID=3776, iMonCtr=2 13:58:04 (1664): No heartbeat from core client for 30 sec - exiting 13:58:05 (1664): No heartbeat from core client for 30 sec - exiting 13:58:07 (1664): No heartbeat from core client for 30 sec - exiting 13:58:08 (1664): No heartbeat from core client for 30 sec - exiting 13:58:09 (1664): No heartbeat from core client for 30 sec - exiting 13:58:10 (1664): No heartbeat from core client for 30 sec - exiting 13:58:11 (1664): No heartbeat from core client for 30 sec - exiting 13:58:12 (1664): No heartbeat from core client for 30 sec - exiting 13:58:13 (1664): No heartbeat from core client for 30 sec - exiting 13:58:14 (1664): No heartbeat from core client for 30 sec - exiting 13:58:15 (1664): No heartbeat from core client for 30 sec - exiting 13:58:16 (1664): No heartbeat from core client for 30 sec - exiting 13:58:17 (1664): No heartbeat from core client for 30 sec - exiting 13:58:19 (1664): No heartbeat from core client for 30 sec - exiting 13:58:20 (1664): No heartbeat from core client for 30 sec - exiting 13:58:21 (1664): No heartbeat from core client for 30 sec - exiting 13:58:22 (1664): No heartbeat from core client for 30 sec - exiting 13:58:23 (1664): No heartbeat from core client for 30 sec - exiting 13:58:24 (1664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:58:25 (1664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1352, selfPID=1352, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2456, selfPID=2456, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 06:50:47 (4120): No heartbeat from core client for 30 sec - exiting 06:50:48 (4120): No heartbeat from core client for 30 sec - exiting 06:50:49 (4120): No heartbeat from core client for 30 sec - exiting 06:50:50 (4120): No heartbeat from core client for 30 sec - exiting 06:50:51 (4120): No heartbeat from core client for 30 sec - exiting 06:50:52 (4120): No heartbeat from core client for 30 sec - exiting 06:50:53 (4120): No heartbeat from core client for 30 sec - exiting 06:50:54 (4120): No heartbeat from core client for 30 sec - exiting 06:50:55 (4120): No heartbeat from core client for 30 sec - exiting 06:50:56 (4120): No heartbeat from core client for 30 sec - exiting 06:50:57 (4120): No heartbeat from core client for 30 sec - exiting 06:50:59 (4120): No heartbeat from core client for 30 sec - exiting 06:51:00 (4120): No heartbeat from core client for 30 sec - exiting 06:51:01 (4120): No heartbeat from core client for 30 sec - exiting 06:51:02 (4120): No heartbeat from core client for 30 sec - exiting 06:51:03 (4120): No heartbeat from core client for 30 sec - exiting 06:51:04 (4120): No heartbeat from core client for 30 sec - exiting 06:51:05 (4120): No heartbeat from core client for 30 sec - exiting 06:51:06 (4120): No heartbeat from core client for 30 sec - exiting 06:51:07 (4120): No heartbeat from core client for 30 sec - exiting 06:51:08 (4120): No heartbeat from core client for 30 sec - exiting 06:51:09 (4120): No heartbeat from core client for 30 sec - exiting 06:51:11 (4120): No heartbeat from core client for 30 sec - exiting 06:51:12 (4120): No heartbeat from core client for 30 sec - exiting 06:51:13 (4120): No heartbeat from core client for 30 sec - exiting 06:51:14 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6048, selfPID=6048, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4812, selfPID=2728, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_34q3_1976_1_008169584_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_34q3_1976_1_008169584_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_34q3_1976_1_008169584_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_34q3_1976_1_008169584_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_34q3_1976_1_008169584_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_34q3_1976_1_008169584_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_34q3_1976_1_008169584_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_34q3_1976_1_008169584_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Sep 2012 21:39:20	1089092	15200750	hadam3p_pnw_34q3_1976_1_008169584_0	46,176	266,778	5.7774
18 Sep 2012 01:13:48	1089092	15200750	hadam3p_pnw_34q3_1976_1_008169584_0	34,656	203,084	5.8600
15 Sep 2012 20:15:32	1089092	15200750	hadam3p_pnw_34q3_1976_1_008169584_0	23,136	135,617	5.8617
06 Sep 2012 16:36:55	1089092	15200750	hadam3p_pnw_34q3_1976_1_008169584_0	11,617	72,832	6.2694
06 Sep 2012 15:35:00	1089092	15200750	hadam3p_pnw_34q3_1976_1_008169584_0	11,616	72,127	6.2093