Task 12614971

Name	hadam3p_pnw_2wk5_1984_1_007175693_0
Workunit	7373975
Created	22 Feb 2011, 11:24:43 UTC
Sent	10 Mar 2011, 18:16:35 UTC
Report deadline	20 Feb 2012, 23:36:35 UTC
Received	4 Apr 2011, 8:07:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1084764
Run time	2 days 17 hours 12 min 12 sec
CPU time	2 days 16 hours 33 min 47 sec
Validate state	Invalid
Credit	1,503.98
Device peak FLOPS	2.79 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.08 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2464, selfPID=2464, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2116, selfPID=2116, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 10:21:58 (3696): No heartbeat from core client for 30 sec - exiting 10:21:59 (3696): No heartbeat from core client for 30 sec - exiting 10:22:00 (3696): No heartbeat from core client for 30 sec - exiting 10:22:01 (3696): No heartbeat from core client for 30 sec - exiting 10:22:02 (3696): No heartbeat from core client for 30 sec - exiting 10:22:03 (3696): No heartbeat from core client for 30 sec - exiting 10:22:04 (3696): No heartbeat from core client for 30 sec - exiting 10:22:05 (3696): No heartbeat from core client for 30 sec - exiting 10:22:06 (3696): No heartbeat from core client for 30 sec - exiting 10:22:08 (3696): No heartbeat from core client for 30 sec - exiting 10:22:09 (3696): No heartbeat from core client for 30 sec - exiting 10:22:10 (3696): No heartbeat from core client for 30 sec - exiting 10:22:11 (3696): No heartbeat from core client for 30 sec - exiting 10:22:12 (3696): No heartbeat from core client for 30 sec - exiting 10:22:13 (3696): No heartbeat from core client for 30 sec - exiting 10:22:14 (3696): No heartbeat from core client for 30 sec - exiting 10:22:15 (3696): No heartbeat from core client for 30 sec - exiting 10:22:16 (3696): No heartbeat from core client for 30 sec - exiting 10:22:17 (3696): No heartbeat from core client for 30 sec - exiting 10:22:18 (3696): No heartbeat from core client for 30 sec - exiting 10:22:20 (3696): No heartbeat from core client for 30 sec - exiting 10:22:21 (3696): No heartbeat from core client for 30 sec - exiting 10:22:22 (3696): No heartbeat from core client for 30 sec - exiting 10:22:23 (3696): No heartbeat from core client for 30 sec - exiting 10:22:24 (3696): No heartbeat from core client for 30 sec - exiting 10:22:25 (3696): No heartbeat from core client for 30 sec - exiting 10:22:26 (3696): No heartbeat from core client for 30 sec - exiting 10:22:27 (3696): No heartbeat from core client for 30 sec - exiting 10:22:28 (3696): No heartbeat from core client for 30 sec - exiting 10:22:29 (3696): No heartbeat from core client for 30 sec - exiting 10:22:31 (3696): No heartbeat from core client for 30 sec - exiting 10:22:32 (3696): No heartbeat from core client for 30 sec - exiting 10:22:33 (3696): No heartbeat from core client for 30 sec - exiting 10:22:34 (3696): No heartbeat from core client for 30 sec - exiting 10:22:35 (3696): No heartbeat from core client for 30 sec - exiting 10:22:36 (3696): No heartbeat from core client for 30 sec - exiting 10:22:37 (3696): No heartbeat from core client for 30 sec - exiting 10:22:38 (3696): No heartbeat from core client for 30 sec - exiting 10:22:39 (3696): No heartbeat from core client for 30 sec - exiting 10:22:40 (3696): No heartbeat from core client for 30 sec - exiting 10:22:41 (3696): No heartbeat from core client for 30 sec - exiting 10:22:43 (3696): No heartbeat from core client for 30 sec - exiting 10:22:44 (3696): No heartbeat from core client for 30 sec - exiting 10:22:45 (3696): No heartbeat from core client for 30 sec - exiting 10:22:46 (3696): No heartbeat from core client for 30 sec - exiting 10:22:47 (3696): No heartbeat from core client for 30 sec - exiting 10:22:48 (3696): No heartbeat from core client for 30 sec - exiting 10:22:49 (3696): No heartbeat from core client for 30 sec - exiting 10:22:50 (3696): No heartbeat from core client for 30 sec - exiting 10:22:51 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:22:52 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3436, selfPID=3436, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1540, selfPID=820, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3680, selfPID=3680, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:25:56 (4040): No heartbeat from core client for 30 sec - exiting 10:25:57 (4040): No heartbeat from core client for 30 sec - exiting 10:25:59 (4040): No heartbeat from core client for 30 sec - exiting 10:26:00 (4040): No heartbeat from core client for 30 sec - exiting 10:26:01 (4040): No heartbeat from core client for 30 sec - exiting 10:26:02 (4040): No heartbeat from core client for 30 sec - exiting 10:26:03 (4040): No heartbeat from core client for 30 sec - exiting 10:26:04 (4040): No heartbeat from core client for 30 sec - exiting 10:26:05 (4040): No heartbeat from core client for 30 sec - exiting 10:26:06 (4040): No heartbeat from core client for 30 sec - exiting 10:26:07 (4040): No heartbeat from core client for 30 sec - exiting 10:26:08 (4040): No heartbeat from core client for 30 sec - exiting 10:26:09 (4040): No heartbeat from core client for 30 sec - exiting 10:26:11 (4040): No heartbeat from core client for 30 sec - exiting 10:26:12 (4040): No heartbeat from core client for 30 sec - exiting 10:26:13 (4040): No heartbeat from core client for 30 sec - exiting 10:26:14 (4040): No heartbeat from core client for 30 sec - exiting 10:26:15 (4040): No heartbeat from core client for 30 sec - exiting 10:26:16 (4040): No heartbeat from core client for 30 sec - exiting 10:26:17 (4040): No heartbeat from core client for 30 sec - exiting 10:26:18 (4040): No heartbeat from core client for 30 sec - exiting 10:26:19 (4040): No heartbeat from core client for 30 sec - exiting 10:26:20 (4040): No heartbeat from core client for 30 sec - exiting 10:26:21 (4040): No heartbeat from core client for 30 sec - exiting 10:26:23 (4040): No heartbeat from core client for 30 sec - exiting 10:26:24 (4040): No heartbeat from core client for 30 sec - exiting 10:26:25 (4040): No heartbeat from core client for 30 sec - exiting 10:26:26 (4040): No heartbeat from core client for 30 sec - exiting 10:26:27 (4040): No heartbeat from core client for 30 sec - exiting 10:26:28 (4040): No heartbeat from core client for 30 sec - exiting 10:26:29 (4040): No heartbeat from core client for 30 sec - exiting 10:26:30 (4040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4048, selfPID=4048, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3352, selfPID=3352, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:50:13 (3720): No heartbeat from core client for 30 sec - exiting 18:50:14 (3720): No heartbeat from core client for 30 sec - exiting 18:50:15 (3720): No heartbeat from core client for 30 sec - exiting 18:50:16 (3720): No heartbeat from core client for 30 sec - exiting 18:50:17 (3720): No heartbeat from core client for 30 sec - exiting 18:50:19 (3720): No heartbeat from core client for 30 sec - exiting 18:50:20 (3720): No heartbeat from core client for 30 sec - exiting 18:50:21 (3720): No heartbeat from core client for 30 sec - exiting 18:50:22 (3720): No heartbeat from core client for 30 sec - exiting 18:50:23 (3720): No heartbeat from core client for 30 sec - exiting 18:50:24 (3720): No heartbeat from core client for 30 sec - exiting 18:50:25 (3720): No heartbeat from core client for 30 sec - exiting 18:50:26 (3720): No heartbeat from core client for 30 sec - exiting 18:50:27 (3720): No heartbeat from core client for 30 sec - exiting 18:50:28 (3720): No heartbeat from core client for 30 sec - exiting 18:50:30 (3720): No heartbeat from core client for 30 sec - exiting 18:50:31 (3720): No heartbeat from core client for 30 sec - exiting 18:50:32 (3720): No heartbeat from core client for 30 sec - exiting 18:50:33 (3720): No heartbeat from core client for 30 sec - exiting 18:50:34 (3720): No heartbeat from core client for 30 sec - exiting 18:50:35 (3720): No heartbeat from core client for 30 sec - exiting 18:50:36 (3720): No heartbeat from core client for 30 sec - exiting 18:50:37 (3720): No heartbeat from core client for 30 sec - exiting 18:50:38 (3720): No heartbeat from core client for 30 sec - exiting 18:50:39 (3720): No heartbeat from core client for 30 sec - exiting 18:50:40 (3720): No heartbeat from core client for 30 sec - exiting 18:50:42 (3720): No heartbeat from core client for 30 sec - exiting 18:50:43 (3720): No heartbeat from core client for 30 sec - exiting 18:50:44 (3720): No heartbeat from core client for 30 sec - exiting 18:50:45 (3720): No heartbeat from core client for 30 sec - exiting 18:50:46 (3720): No heartbeat from core client for 30 sec - exiting 18:50:47 (3720): No heartbeat from core client for 30 sec - exiting 18:50:48 (3720): No heartbeat from core client for 30 sec - exiting 18:50:49 (3720): No heartbeat from core client for 30 sec - exiting 18:50:50 (3720): No heartbeat from core client for 30 sec - exiting 18:50:51 (3720): No heartbeat from core client for 30 sec - exiting 18:50:52 (3720): No heartbeat from core client for 30 sec - exiting 18:50:54 (3720): No heartbeat from core client for 30 sec - exiting 18:50:55 (3720): No heartbeat from core client for 30 sec - exiting 18:50:56 (3720): No heartbeat from core client for 30 sec - exiting 18:50:57 (3720): No heartbeat from core client for 30 sec - exiting 18:50:58 (3720): No heartbeat from core client for 30 sec - exiting 18:50:59 (3720): No heartbeat from core client for 30 sec - exiting 18:51:00 (3720): No heartbeat from core client for 30 sec - exiting 18:51:01 (3720): No heartbeat from core client for 30 sec - exiting 18:51:02 (3720): No heartbeat from core client for 30 sec - exiting 18:51:03 (3720): No heartbeat from core client for 30 sec - exiting 18:51:04 (3720): No heartbeat from core client for 30 sec - exiting 18:51:06 (3720): No heartbeat from core client for 30 sec - exiting 18:51:07 (3720): No heartbeat from core client for 30 sec - exiting 18:51:08 (3720): No heartbeat from core client for 30 sec - exiting 18:51:09 (3720): No heartbeat from core client for 30 sec - exiting 18:51:10 (3720): No heartbeat from core client for 30 sec - exiting 18:51:11 (3720): No heartbeat from core client for 30 sec - exiting 18:51:12 (3720): No heartbeat from core client for 30 sec - exiting 18:51:13 (3720): No heartbeat from core client for 30 sec - exiting 18:51:14 (3720): No heartbeat from core client for 30 sec - exiting 18:51:15 (3720): No heartbeat from core client for 30 sec - exiting 18:51:16 (3720): No heartbeat from core client for 30 sec - exiting 18:51:18 (3720): No heartbeat from core client for 30 sec - exiting 18:51:19 (3720): No heartbeat from core client for 30 sec - exiting 18:51:20 (3720): No heartbeat from core client for 30 sec - exiting 18:51:21 (3720): No heartbeat from core client for 30 sec - exiting 18:51:22 (3720): No heartbeat from core client for 30 sec - exiting 18:51:23 (3720): No heartbeat from core client for 30 sec - exiting 18:51:24 (3720): No heartbeat from core client for 30 sec - exiting 18:51:25 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:29:26 (3724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:04:56 (3400): No heartbeat from core client for 30 sec - exiting 12:04:58 (3400): No heartbeat from core client for 30 sec - exiting 12:04:59 (3400): No heartbeat from core client for 30 sec - exiting 12:05:00 (3400): No heartbeat from core client for 30 sec - exiting 12:05:01 (3400): No heartbeat from core client for 30 sec - exiting 12:05:02 (3400): No heartbeat from core client for 30 sec - exiting 12:05:03 (3400): No heartbeat from core client for 30 sec - exiting 12:05:04 (3400): No heartbeat from core client for 30 sec - exiting 12:05:05 (3400): No heartbeat from core client for 30 sec - exiting 12:05:07 (3400): No heartbeat from core client for 30 sec - exiting 12:05:08 (3400): No heartbeat from core client for 30 sec - exiting 12:05:09 (3400): No heartbeat from core client for 30 sec - exiting 12:05:10 (3400): No heartbeat from core client for 30 sec - exiting 12:05:11 (3400): No heartbeat from core client for 30 sec - exiting 12:05:12 (3400): No heartbeat from core client for 30 sec - exiting 12:05:13 (3400): No heartbeat from core client for 30 sec - exiting 12:05:14 (3400): No heartbeat from core client for 30 sec - exiting 12:05:15 (3400): No heartbeat from core client for 30 sec - exiting 12:05:16 (3400): No heartbeat from core client for 30 sec - exiting 12:05:17 (3400): No heartbeat from core client for 30 sec - exiting 12:05:19 (3400): No heartbeat from core client for 30 sec - exiting 12:05:20 (3400): No heartbeat from core client for 30 sec - exiting 12:05:21 (3400): No heartbeat from core client for 30 sec - exiting 12:05:22 (3400): No heartbeat from core client for 30 sec - exiting 12:05:23 (3400): No heartbeat from core client for 30 sec - exiting 12:05:24 (3400): No heartbeat from core client for 30 sec - exiting 12:05:25 (3400): No heartbeat from core client for 30 sec - exiting 12:05:26 (3400): No heartbeat from core client for 30 sec - exiting 12:05:27 (3400): No heartbeat from core client for 30 sec - exiting 12:05:28 (3400): No heartbeat from core client for 30 sec - exiting 12:05:29 (3400): No heartbeat from core client for 30 sec - exiting 12:05:31 (3400): No heartbeat from core client for 30 sec - exiting 12:05:32 (3400): No heartbeat from core client for 30 sec - exiting 12:05:33 (3400): No heartbeat from core client for 30 sec - exiting 12:05:34 (3400): No heartbeat from core client for 30 sec - exiting 12:05:35 (3400): No heartbeat from core client for 30 sec - exiting 12:05:36 (3400): No heartbeat from core client for 30 sec - exiting 12:05:37 (3400): No heartbeat from core client for 30 sec - exiting 12:05:38 (3400): No heartbeat from core client for 30 sec - exiting 12:05:39 (3400): No heartbeat from core client for 30 sec - exiting 12:05:40 (3400): No heartbeat from core client for 30 sec - exiting 12:05:41 (3400): No heartbeat from core client for 30 sec - exiting 12:05:43 (3400): No heartbeat from core client for 30 sec - exiting 12:05:44 (3400): No heartbeat from core client for 30 sec - exiting 12:05:45 (3400): No heartbeat from core client for 30 sec - exiting 12:05:46 (3400): No heartbeat from core client for 30 sec - exiting 12:05:47 (3400): No heartbeat from core client for 30 sec - exiting 12:05:48 (3400): No heartbeat from core client for 30 sec - exiting 12:05:49 (3400): No heartbeat from core client for 30 sec - exiting 12:05:50 (3400): No heartbeat from core client for 30 sec - exiting 12:05:51 (3400): No heartbeat from core client for 30 sec - exiting 12:05:52 (3400): No heartbeat from core client for 30 sec - exiting 12:05:53 (3400): No heartbeat from core client for 30 sec - exiting 12:05:55 (3400): No heartbeat from core client for 30 sec - exiting 12:05:56 (3400): No heartbeat from core client for 30 sec - exiting 12:05:57 (3400): No heartbeat from core client for 30 sec - exiting 12:05:58 (3400): No heartbeat from core client for 30 sec - exiting 12:05:59 (3400): No heartbeat from core client for 30 sec - exiting 12:06:00 (3400): No heartbeat from core client for 30 sec - exiting 12:06:01 (3400): No heartbeat from core client for 30 sec - exiting 12:06:02 (3400): No heartbeat from core client for 30 sec - exiting 12:06:03 (3400): No heartbeat from core client for 30 sec - exiting 12:06:04 (3400): No heartbeat from core client for 30 sec - exiting 12:06:05 (3400): No heartbeat from core client for 30 sec - exiting 12:06:07 (3400): No heartbeat from core client for 30 sec - exiting 12:06:08 (3400): No heartbeat from core client for 30 sec - exiting 12:06:09 (3400): No heartbeat from core client for 30 sec - exiting 12:06:10 (3400): No heartbeat from core client for 30 sec - exiting 12:06:11 (3400): No heartbeat from core client for 30 sec - exiting 12:06:12 (3400): No heartbeat from core client for 30 sec - exiting 12:06:13 (3400): No heartbeat from core client for 30 sec - exiting 12:06:14 (3400): No heartbeat from core client for 30 sec - exiting 12:06:15 (3400): No heartbeat from core client for 30 sec - exiting 12:06:16 (3400): No heartbeat from core client for 30 sec - exiting 12:06:17 (3400): No heartbeat from core client for 30 sec - exiting 12:06:19 (3400): No heartbeat from core client for 30 sec - exiting 12:06:20 (3400): No heartbeat from core client for 30 sec - exiting 12:06:21 (3400): No heartbeat from core client for 30 sec - exiting 12:06:22 (3400): No heartbeat from core client for 30 sec - exiting 12:06:23 (3400): No heartbeat from core client for 30 sec - exiting 12:06:24 (3400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:37:04 (3704): No heartbeat from core client for 30 sec - exiting 18:37:05 (3704): No heartbeat from core client for 30 sec - exiting 18:37:07 (3704): No heartbeat from core client for 30 sec - exiting 18:37:08 (3704): No heartbeat from core client for 30 sec - exiting 18:37:09 (3704): No heartbeat from core client for 30 sec - exiting 18:37:10 (3704): No heartbeat from core client for 30 sec - exiting 18:37:11 (3704): No heartbeat from core client for 30 sec - exiting 18:37:12 (3704): No heartbeat from core client for 30 sec - exiting 18:37:13 (3704): No heartbeat from core client for 30 sec - exiting 18:37:14 (3704): No heartbeat from core client for 30 sec - exiting 18:37:15 (3704): No heartbeat from core client for 30 sec - exiting 18:37:16 (3704): No heartbeat from core client for 30 sec - exiting 18:37:17 (3704): No heartbeat from core client for 30 sec - exiting 18:37:19 (3704): No heartbeat from core client for 30 sec - exiting 18:37:20 (3704): No heartbeat from core client for 30 sec - exiting 18:37:21 (3704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:37:22 (3704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=3536, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1200, selfPID=4068, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 21:24:48 (4068): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_2wk5_1984_1_007175693_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2wk5_1984_1_007175693_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2wk5_1984_1_007175693_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2wk5_1984_1_007175693_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2wk5_1984_1_007175693_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2wk5_1984_1_007175693_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Apr 2011 11:41:24	1084764	12614971	hadam3p_pnw_2wk5_1984_1_007175693_0	69,216	226,566	3.2733
02 Apr 2011 10:09:33	1084764	12614971	hadam3p_pnw_2wk5_1984_1_007175693_0	57,696	188,451	3.2663
01 Apr 2011 16:03:41	1084764	12614971	hadam3p_pnw_2wk5_1984_1_007175693_0	46,176	150,357	3.2562
31 Mar 2011 19:13:33	1084764	12614971	hadam3p_pnw_2wk5_1984_1_007175693_0	34,656	112,938	3.2588
30 Mar 2011 21:24:50	1084764	12614971	hadam3p_pnw_2wk5_1984_1_007175693_0	23,137	75,718	3.2726
30 Mar 2011 20:58:35	1084764	12614971	hadam3p_pnw_2wk5_1984_1_007175693_0	23,136	75,362	3.2573
29 Mar 2011 18:41:27	1084764	12614971	hadam3p_pnw_2wk5_1984_1_007175693_0	11,616	37,994	3.2708