Task 17562254

Name	hadam3p_pnw_vjc5_2004_1_009230033_2
Workunit	9343144
Created	9 Dec 2014, 19:44:40 UTC
Sent	9 Dec 2014, 20:15:35 UTC
Report deadline	22 Nov 2015, 1:35:35 UTC
Received	14 Dec 2014, 20:04:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1346591
Run time	2 days 3 hours 8 min 13 sec
CPU time	1 days 22 hours 47 min 33 sec
Validate state	Invalid
Credit	2,009.02
Device peak FLOPS	3.40 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v7.22 windows_intelx86
Stderr	<core_client_version>6.8.44</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 14:36:14 (364088): No heartbeat from client for 30 sec - exiting 14:36:14 (364088): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:39:40 (363920): No heartbeat from client for 30 sec - exiting 15:39:40 (363920): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:15:12 (102300): No heartbeat from client for 30 sec - exiting 18:15:20 (102300): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:43:18 (6456): No heartbeat from client for 30 sec - exiting 07:43:18 (6456): timer handler: client dead, exiting 07:43:19 (6456): No heartbeat from client for 30 sec - exiting 07:43:19 (6456): timer handler: client dead, exiting 07:43:20 (6456): No heartbeat from client for 30 sec - exiting 07:43:20 (6456): timer handler: client dead, exiting 07:43:21 (6456): No heartbeat from client for 30 sec - exiting 07:43:21 (6456): timer handler: client dead, exiting 07:43:22 (6456): No heartbeat from client for 30 sec - exiting 07:43:22 (6456): timer handler: client dead, exiting 07:43:23 (6456): No heartbeat from client for 30 sec - exiting 07:43:23 (6456): timer handler: client dead, exiting 07:43:24 (6456): No heartbeat from client for 30 sec - exiting 07:43:24 (6456): timer handler: client dead, exiting 07:43:25 (6456): No heartbeat from client for 30 sec - exiting 07:43:25 (6456): timer handler: client dead, exiting 07:43:26 (6456): No heartbeat from client for 30 sec - exiting 07:43:26 (6456): timer handler: client dead, exiting 07:43:27 (6456): No heartbeat from client for 30 sec - exiting 07:43:27 (6456): timer handler: client dead, exiting 07:43:28 (6456): No heartbeat from client for 30 sec - exiting 07:43:28 (6456): timer handler: client dead, exiting 07:43:29 (6456): No heartbeat from client for 30 sec - exiting 07:43:29 (6456): timer handler: client dead, exiting 07:43:30 (6456): No heartbeat from client for 30 sec - exiting 07:43:30 (6456): timer handler: client dead, exiting 07:43:31 (6456): No heartbeat from client for 30 sec - exiting 07:43:31 (6456): timer handler: client dead, exiting 07:43:32 (6456): No heartbeat from client for 30 sec - exiting 07:43:32 (6456): timer handler: client dead, exiting 07:43:33 (6456): No heartbeat from client for 30 sec - exiting 07:43:33 (6456): timer handler: client dead, exiting 07:43:34 (6456): No heartbeat from client for 30 sec - exiting 07:43:34 (6456): timer handler: client dead, exiting 07:43:35 (6456): No heartbeat from client for 30 sec - exiting 07:43:35 (6456): timer handler: client dead, exiting 07:43:36 (6456): No heartbeat from client for 30 sec - exiting 07:43:36 (6456): timer handler: client dead, exiting 07:43:37 (6456): No heartbeat from client for 30 sec - exiting 07:43:37 (6456): timer handler: client dead, exiting 07:43:38 (6456): No heartbeat from client for 30 sec - exiting 07:43:38 (6456): timer handler: client dead, exiting 07:43:39 (6456): No heartbeat from client for 30 sec - exiting 07:43:39 (6456): timer handler: client dead, exiting 07:43:40 (6456): No heartbeat from client for 30 sec - exiting 07:43:40 (6456): timer handler: client dead, exiting 07:43:41 (6456): No heartbeat from client for 30 sec - exiting 07:43:41 (6456): timer handler: client dead, exiting 07:43:42 (6456): No heartbeat from client for 30 sec - exiting 07:43:42 (6456): timer handler: client dead, exiting 07:43:43 (6456): No heartbeat from client for 30 sec - exiting 07:43:43 (6456): timer handler: client dead, exiting 07:43:44 (6456): No heartbeat from client for 30 sec - exiting 07:43:44 (6456): timer handler: client dead, exiting 07:43:45 (6456): No heartbeat from client for 30 sec - exiting 07:43:45 (6456): timer handler: client dead, exiting 07:43:46 (6456): No heartbeat from client for 30 sec - exiting 07:43:46 (6456): timer handler: client dead, exiting 07:43:47 (6456): No heartbeat from client for 30 sec - exiting 07:43:47 (6456): timer handler: client dead, exiting 07:43:48 (6456): No heartbeat from client for 30 sec - exiting 07:43:48 (6456): timer handler: client dead, exiting 07:43:49 (6456): No heartbeat from client for 30 sec - exiting 07:43:49 (6456): timer handler: client dead, exiting 07:43:50 (6456): No heartbeat from client for 30 sec - exiting 07:43:50 (6456): timer handler: client dead, exiting 07:43:51 (6456): No heartbeat from client for 30 sec - exiting 07:43:51 (6456): timer handler: client dead, exiting 07:43:52 (6456): No heartbeat from client for 30 sec - exiting 07:43:52 (6456): timer handler: client dead, exiting 07:43:53 (6456): No heartbeat from client for 30 sec - exiting 07:43:53 (6456): timer handler: client dead, exiting 07:43:54 (6456): No heartbeat from client for 30 sec - exiting 07:43:54 (6456): timer handler: client dead, exiting 07:43:55 (6456): No heartbeat from client for 30 sec - exiting 07:43:55 (6456): timer handler: client dead, exiting 07:43:56 (6456): No heartbeat from client for 30 sec - exiting 07:43:56 (6456): timer handler: client dead, exiting 07:43:57 (6456): No heartbeat from client for 30 sec - exiting 07:43:57 (6456): timer handler: client dead, exiting 07:43:58 (6456): No heartbeat from client for 30 sec - exiting 07:43:58 (6456): timer handler: client dead, exiting 07:43:59 (6456): No heartbeat from client for 30 sec - exiting 07:43:59 (6456): timer handler: client dead, exiting 07:44:00 (6456): No heartbeat from client for 30 sec - exiting 07:44:00 (6456): timer handler: client dead, exiting 07:44:01 (6456): No heartbeat from client for 30 sec - exiting 07:44:01 (6456): timer handler: client dead, exiting 07:44:02 (6456): No heartbeat from client for 30 sec - exiting 07:44:02 (6456): timer handler: client dead, exiting 07:44:03 (6456): No heartbeat from client for 30 sec - exiting 07:44:03 (6456): timer handler: client dead, exiting 07:44:04 (6456): No heartbeat from client for 30 sec - exiting 07:44:04 (6456): timer handler: client dead, exiting 07:44:05 (6456): No heartbeat from client for 30 sec - exiting 07:44:05 (6456): timer handler: client dead, exiting 07:44:06 (6456): No heartbeat from client for 30 sec - exiting 07:44:06 (6456): timer handler: client dead, exiting 07:44:07 (6456): No heartbeat from client for 30 sec - exiting 07:44:07 (6456): timer handler: client dead, exiting 07:44:08 (6456): No heartbeat from client for 30 sec - exiting 07:44:08 (6456): timer handler: client dead, exiting 07:44:09 (6456): No heartbeat from client for 30 sec - exiting 07:44:09 (6456): timer handler: client dead, exiting 07:44:10 (6456): No heartbeat from client for 30 sec - exiting 07:44:10 (6456): timer handler: client dead, exiting 07:44:11 (6456): No heartbeat from client for 30 sec - exiting 07:44:11 (6456): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:45:09 (2528): No heartbeat from client for 30 sec - exiting 07:45:09 (2528): timer handler: client dead, exiting 07:45:10 (2528): No heartbeat from client for 30 sec - exiting 07:45:10 (2528): timer handler: client dead, exiting 07:45:11 (2528): No heartbeat from client for 30 sec - exiting 07:45:11 (2528): timer handler: client dead, exiting 07:45:12 (2528): No heartbeat from client for 30 sec - exiting 07:45:12 (2528): timer handler: client dead, exiting 07:45:13 (2528): No heartbeat from client for 30 sec - exiting 07:45:13 (2528): timer handler: client dead, exiting 07:45:14 (2528): No heartbeat from client for 30 sec - exiting 07:45:14 (2528): timer handler: client dead, exiting 07:45:15 (2528): No heartbeat from client for 30 sec - exiting 07:45:15 (2528): timer handler: client dead, exiting 07:45:16 (2528): No heartbeat from client for 30 sec - exiting 07:45:16 (2528): timer handler: client dead, exiting 07:45:17 (2528): No heartbeat from client for 30 sec - exiting 07:45:17 (2528): timer handler: client dead, exiting 07:45:18 (2528): No heartbeat from client for 30 sec - exiting 07:45:18 (2528): timer handler: client dead, exiting 07:45:19 (2528): No heartbeat from client for 30 sec - exiting 07:45:19 (2528): timer handler: client dead, exiting 07:45:20 (2528): No heartbeat from client for 30 sec - exiting 07:45:20 (2528): timer handler: client dead, exiting 07:45:21 (2528): No heartbeat from client for 30 sec - exiting 07:45:21 (2528): timer handler: client dead, exiting 07:45:22 (2528): No heartbeat from client for 30 sec - exiting 07:45:22 (2528): timer handler: client dead, exiting 07:45:23 (2528): No heartbeat from client for 30 sec - exiting 07:45:23 (2528): timer handler: client dead, exiting 07:45:24 (2528): No heartbeat from client for 30 sec - exiting 07:45:24 (2528): timer handler: client dead, exiting 07:45:25 (2528): No heartbeat from client for 30 sec - exiting 07:45:25 (2528): timer handler: client dead, exiting 07:45:26 (2528): No heartbeat from client for 30 sec - exiting 07:45:26 (2528): timer handler: client dead, exiting 07:45:27 (2528): No heartbeat from client for 30 sec - exiting 07:45:27 (2528): timer handler: client dead, exiting 07:45:28 (2528): No heartbeat from client for 30 sec - exiting 07:45:28 (2528): timer handler: client dead, exiting 07:45:29 (2528): No heartbeat from client for 30 sec - exiting 07:45:29 (2528): timer handler: client dead, exiting 07:45:30 (2528): No heartbeat from client for 30 sec - exiting 07:45:30 (2528): timer handler: client dead, exiting 07:45:31 (2528): No heartbeat from client for 30 sec - exiting 07:45:31 (2528): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:09:25 (9928): No heartbeat from client for 30 sec - exiting 08:09:25 (9928): timer handler: client dead, exiting 08:09:26 (9928): No heartbeat from client for 30 sec - exiting 08:09:26 (9928): timer handler: client dead, exiting 08:09:27 (9928): No heartbeat from client for 30 sec - exiting 08:09:27 (9928): timer handler: client dead, exiting 08:09:28 (9928): No heartbeat from client for 30 sec - exiting 08:09:28 (9928): timer handler: client dead, exiting 08:09:29 (9928): No heartbeat from client for 30 sec - exiting 08:09:29 (9928): timer handler: client dead, exiting 08:09:30 (9928): No heartbeat from client for 30 sec - exiting 08:09:30 (9928): timer handler: client dead, exiting 08:09:31 (9928): No heartbeat from client for 30 sec - exiting 08:09:31 (9928): timer handler: client dead, exiting 08:09:32 (9928): No heartbeat from client for 30 sec - exiting 08:09:32 (9928): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=6996, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4292, selfPID=4292, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4292, selfPID=4032, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 08:10:16 (4032): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_vjc5_2004_1_009230033_2_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_vjc5_2004_1_009230033_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_vjc5_2004_1_009230033_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_vjc5_2004_1_009230033_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Dec 2014 13:35:31	1346591	17562254	hadam3p_pnw_vjc5_2004_1_009230033_2	92,459	166,339	1.7991
14 Dec 2014 06:24:20	1346591	17562254	hadam3p_pnw_vjc5_2004_1_009230033_2	80,939	146,384	1.8086
13 Dec 2014 16:04:11	1346591	17562254	hadam3p_pnw_vjc5_2004_1_009230033_2	69,419	126,091	1.8164
13 Dec 2014 13:58:53	1346591	17562254	hadam3p_pnw_vjc5_2004_1_009230033_2	57,899	103,789	1.7926
12 Dec 2014 19:36:40	1346591	17562254	hadam3p_pnw_vjc5_2004_1_009230033_2	46,379	83,405	1.7983
12 Dec 2014 06:37:55	1346591	17562254	hadam3p_pnw_vjc5_2004_1_009230033_2	34,859	61,967	1.7776
11 Dec 2014 20:30:01	1346591	17562254	hadam3p_pnw_vjc5_2004_1_009230033_2	23,339	41,261	1.7679
10 Dec 2014 05:42:02	1346591	17562254	hadam3p_pnw_vjc5_2004_1_009230033_2	11,819	20,912	1.7694