Task 14060381

Name	hadam3p_pnw_72yd_2003_1_007748648_0
Workunit	7903757
Created	4 Feb 2012, 22:06:42 UTC
Sent	4 Feb 2012, 22:24:38 UTC
Report deadline	17 Jan 2013, 3:44:38 UTC
Received	17 Feb 2012, 22:11:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1056228
Run time	4 days 18 hours 11 min 35 sec
CPU time	3 days 8 hours 40 min 57 sec
Validate state	Invalid
Credit	2,004.61
Device peak FLOPS	2.27 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4584, selfPID=4584, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6020, selfPID=6020, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3768, selfPID=3768, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3452, selfPID=3452, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:20:45 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3956, selfPID=3956, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3012, selfPID=3012, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5108, selfPID=5108, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5032, selfPID=5032, iMonCtr=2 06:00:33 (3764): No heartbeat from core client for 30 sec - exiting 06:00:35 (3764): No heartbeat from core client for 30 sec - exiting 06:00:36 (3764): No heartbeat from core client for 30 sec - exiting 06:00:37 (3764): No heartbeat from core client for 30 sec - exiting 06:00:38 (3764): No heartbeat from core client for 30 sec - exiting 06:00:39 (3764): No heartbeat from core client for 30 sec - exiting 06:00:40 (3764): No heartbeat from core client for 30 sec - exiting 06:00:41 (3764): No heartbeat from core client for 30 sec - exiting 06:00:43 (3764): No heartbeat from core client for 30 sec - exiting 06:00:44 (3764): No heartbeat from core client for 30 sec - exiting 06:00:45 (3764): No heartbeat from core client for 30 sec - exiting 06:00:47 (3764): No heartbeat from core client for 30 sec - exiting 06:00:48 (3764): No heartbeat from core client for 30 sec - exiting 06:00:49 (3764): No heartbeat from core client for 30 sec - exiting 06:00:50 (3764): No heartbeat from core client for 30 sec - exiting 06:00:51 (3764): No heartbeat from core client for 30 sec - exiting 06:00:52 (3764): No heartbeat from core client for 30 sec - exiting 06:00:53 (3764): No heartbeat from core client for 30 sec - exiting 06:00:54 (3764): No heartbeat from core client for 30 sec - exiting 06:00:55 (3764): No heartbeat from core client for 30 sec - exiting 06:00:56 (3764): No heartbeat from core client for 30 sec - exiting 06:00:57 (3764): No heartbeat from core client for 30 sec - exiting 06:00:59 (3764): No heartbeat from core client for 30 sec - exiting 06:01:00 (3764): No heartbeat from core client for 30 sec - exiting 06:01:01 (3764): No heartbeat from core client for 30 sec - exiting 06:01:02 (3764): No heartbeat from core client for 30 sec - exiting 06:01:03 (3764): No heartbeat from core client for 30 sec - exiting 06:01:04 (3764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:58:25 (5536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4576, selfPID=4576, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2924, selfPID=2924, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5032, selfPID=5032, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3600, selfPID=3600, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:40:50 (3432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:40:52 (3432): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3940, selfPID=3940, iMonCtr=2 11:02:30 (5548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:02:31 (5548): No heartbeat from core client for 30 sec - exiting 11:02:32 (5548): No heartbeat from core client for 30 sec - exiting 11:02:33 (5548): No heartbeat from core client for 30 sec - exiting 11:02:34 (5548): No heartbeat from core client for 30 sec - exiting 11:02:35 (5548): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4140, selfPID=4140, iMonCtr=2 11:02:36 (5548): No heartbeat from core client for 30 sec - exiting 11:02:37 (5548): No heartbeat from core client for 30 sec - exiting 11:02:38 (5548): No heartbeat from core client for 30 sec - exiting 11:02:39 (5548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2212, selfPID=2212, iMonCtr=2 15:55:53 (2116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:54 (2116): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1164, selfPID=5540, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2772, selfPID=2772, iMonCtr=2 08:32:39 (2720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:31:36 (4404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3356, selfPID=3356, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:30:34 (4864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:58:48 (1084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:57:45 (2884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_pnw_72yd_2003_1_007748648/dataout/atmos_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 8 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_72yd_2003_1_007748648_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_72yd_2003_1_007748648_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_72yd_2003_1_007748648_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_72yd_2003_1_007748648_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Feb 2012 02:49:04	1056228	14060381	hadam3p_pnw_72yd_2003_1_007748648_0	92,256	289,697	3.1401
16 Feb 2012 10:00:22	1056228	14060381	hadam3p_pnw_72yd_2003_1_007748648_0	80,736	254,317	3.1500
15 Feb 2012 18:12:25	1056228	14060381	hadam3p_pnw_72yd_2003_1_007748648_0	69,216	219,025	3.1644
14 Feb 2012 11:34:30	1056228	14060381	hadam3p_pnw_72yd_2003_1_007748648_0	57,696	182,559	3.1642
13 Feb 2012 14:35:53	1056228	14060381	hadam3p_pnw_72yd_2003_1_007748648_0	46,176	145,674	3.1548
08 Feb 2012 15:56:05	1056228	14060381	hadam3p_pnw_72yd_2003_1_007748648_0	34,656	109,001	3.1452
07 Feb 2012 13:41:32	1056228	14060381	hadam3p_pnw_72yd_2003_1_007748648_0	23,136	72,088	3.1158
06 Feb 2012 13:52:11	1056228	14060381	hadam3p_pnw_72yd_2003_1_007748648_0	11,616	36,866	3.1737