Task 17532626

Name	hadam3p_anz_f93u_2012_1_009268161_0
Workunit	9361077
Created	1 Dec 2014, 16:15:14 UTC
Sent	2 Dec 2014, 10:58:14 UTC
Report deadline	14 Nov 2015, 16:18:14 UTC
Received	21 Dec 2014, 22:30:55 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1292523
Run time	8 days 23 hours 23 min 21 sec
CPU time	7 days 22 hours 33 min 37 sec
Validate state	Invalid
Credit	4,484.28
Device peak FLOPS	2.75 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.27</core_client_version> <![CDATA[ <stderr_txt> Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4912, selfPID=4912, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4916, selfPID=4856, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=324, selfPID=324, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=324, selfPID=212, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9516, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2000, selfPID=2000, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=28748, selfPID=48072, iMonCtr=1 Model crash detected, will try to restart... 09:12:04 (4760): No heartbeat from core client for 30 sec - exiting 09:12:05 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:03:36 (5256): No heartbeat from core client for 30 sec - exiting 09:03:37 (5256): No heartbeat from core client for 30 sec - exiting 09:03:38 (5256): No heartbeat from core client for 30 sec - exiting 09:03:39 (5256): No heartbeat from core client for 30 sec - exiting 09:03:40 (5256): No heartbeat from core client for 30 sec - exiting 09:03:41 (5256): No heartbeat from core client for 30 sec - exiting 09:03:42 (5256): No heartbeat from core client for 30 sec - exiting 09:03:43 (5256): No heartbeat from core client for 30 sec - exiting 09:03:44 (5256): No heartbeat from core client for 30 sec - exiting 09:03:45 (5256): No heartbeat from core client for 30 sec - exiting 09:03:47 (5256): No heartbeat from core client for 30 sec - exiting 09:03:48 (5256): No heartbeat from core client for 30 sec - exiting 09:03:49 (5256): No heartbeat from core client for 30 sec - exiting 09:03:50 (5256): No heartbeat from core client for 30 sec - exiting 09:03:51 (5256): No heartbeat from core client for 30 sec - exiting 09:03:52 (5256): No heartbeat from core client for 30 sec - exiting 09:03:53 (5256): No heartbeat from core client for 30 sec - exiting 09:03:54 (5256): No heartbeat from core client for 30 sec - exiting 09:03:55 (5256): No heartbeat from core client for 30 sec - exiting 09:03:56 (5256): No heartbeat from core client for 30 sec - exiting 09:03:58 (5256): No heartbeat from core client for 30 sec - exiting 09:03:59 (5256): No heartbeat from core client for 30 sec - exiting 09:04:00 (5256): No heartbeat from core client for 30 sec - exiting 09:04:01 (5256): No heartbeat from core client for 30 sec - exiting 09:04:02 (5256): No heartbeat from core client for 30 sec - exiting 09:04:03 (5256): No heartbeat from core client for 30 sec - exiting 09:04:04 (5256): No heartbeat from core client for 30 sec - exiting 09:04:05 (5256): No heartbeat from core client for 30 sec - exiting 09:04:06 (5256): No heartbeat from core client for 30 sec - exiting 09:04:07 (5256): No heartbeat from core client for 30 sec - exiting 09:04:08 (5256): No heartbeat from core client for 30 sec - exiting 09:04:10 (5256): No heartbeat from core client for 30 sec - exiting 09:04:11 (5256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4844, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2576, iMonCtr=2 Model crash detected, will try to restart... 07:45:13 (2984): No heartbeat from core client for 30 sec - exiting 07:45:14 (2984): No heartbeat from core client for 30 sec - exiting 07:45:15 (2984): No heartbeat from core client for 30 sec - exiting 07:45:16 (2984): No heartbeat from core client for 30 sec - exiting 07:45:18 (2984): No heartbeat from core client for 30 sec - exiting 07:45:19 (2984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:26:54 (5972): No heartbeat from core client for 30 sec - exiting 07:26:55 (5972): No heartbeat from core client for 30 sec - exiting 07:26:56 (5972): No heartbeat from core client for 30 sec - exiting 07:26:57 (5972): No heartbeat from core client for 30 sec - exiting 07:26:59 (5972): No heartbeat from core client for 30 sec - exiting 07:27:00 (5972): No heartbeat from core client for 30 sec - exiting 07:27:01 (5972): No heartbeat from core client for 30 sec - exiting 07:27:02 (5972): No heartbeat from core client for 30 sec - exiting 07:27:03 (5972): No heartbeat from core client for 30 sec - exiting 07:27:04 (5972): No heartbeat from core client for 30 sec - exiting 07:27:05 (5972): No heartbeat from core client for 30 sec - exiting 07:27:06 (5972): No heartbeat from core client for 30 sec - exiting 07:27:07 (5972): No heartbeat from core client for 30 sec - exiting 07:27:08 (5972): No heartbeat from core client for 30 sec - exiting 07:27:09 (5972): No heartbeat from core client for 30 sec - exiting 07:27:11 (5972): No heartbeat from core client for 30 sec - exiting 07:27:12 (5972): No heartbeat from core client for 30 sec - exiting 07:27:13 (5972): No heartbeat from core client for 30 sec - exiting 07:27:14 (5972): No heartbeat from core client for 30 sec - exiting 07:27:15 (5972): No heartbeat from core client for 30 sec - exiting 07:27:16 (5972): No heartbeat from core client for 30 sec - exiting 07:27:17 (5972): No heartbeat from core client for 30 sec - exiting 07:27:18 (5972): No heartbeat from core client for 30 sec - exiting 07:27:19 (5972): No heartbeat from core client for 30 sec - exiting 07:27:20 (5972): No heartbeat from core client for 30 sec - exiting 07:27:21 (5972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4132, selfPID=2836, iMonCtr=1 Model crash detected, will try to restart... 10:28:42 (5580): No heartbeat from core client for 30 sec - exiting 10:28:43 (5580): No heartbeat from core client for 30 sec - exiting 10:28:44 (5580): No heartbeat from core client for 30 sec - exiting 10:28:45 (5580): No heartbeat from core client for 30 sec - exiting 10:28:46 (5580): No heartbeat from core client for 30 sec - exiting 10:28:47 (5580): No heartbeat from core client for 30 sec - exiting 10:28:48 (5580): No heartbeat from core client for 30 sec - exiting 10:28:49 (5580): No heartbeat from core client for 30 sec - exiting 10:28:50 (5580): No heartbeat from core client for 30 sec - exiting 10:28:51 (5580): No heartbeat from core client for 30 sec - exiting 10:28:53 (5580): No heartbeat from core client for 30 sec - exiting 10:28:54 (5580): No heartbeat from core client for 30 sec - exiting 10:28:55 (5580): No heartbeat from core client for 30 sec - exiting 10:28:56 (5580): No heartbeat from core client for 30 sec - exiting 10:28:57 (5580): No heartbeat from core client for 30 sec - exiting 10:28:58 (5580): No heartbeat from core client for 30 sec - exiting 10:28:59 (5580): No heartbeat from core client for 30 sec - exiting 10:29:00 (5580): No heartbeat from core client for 30 sec - exiting 10:29:01 (5580): No heartbeat from core client for 30 sec - exiting 10:29:02 (5580): No heartbeat from core client for 30 sec - exiting 10:29:03 (5580): No heartbeat from core client for 30 sec - exiting 10:29:05 (5580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4348, selfPID=4348, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 07:32:34 (5312): No heartbeat from core client for 30 sec - exiting 07:32:35 (5312): No heartbeat from core client for 30 sec - exiting 07:32:36 (5312): No heartbeat from core client for 30 sec - exiting 07:32:37 (5312): No heartbeat from core client for 30 sec - exiting 07:32:38 (5312): No heartbeat from core client for 30 sec - exiting 07:32:39 (5312): No heartbeat from core client for 30 sec - exiting 07:32:40 (5312): No heartbeat from core client for 30 sec - exiting 07:32:41 (5312): No heartbeat from core client for 30 sec - exiting 07:32:42 (5312): No heartbeat from core client for 30 sec - exiting 07:32:43 (5312): No heartbeat from core client for 30 sec - exiting 07:32:44 (5312): No heartbeat from core client for 30 sec - exiting 07:32:46 (5312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:10:28 (896): No heartbeat from core client for 30 sec - exiting 10:10:29 (896): No heartbeat from core client for 30 sec - exiting 10:10:30 (896): No heartbeat from core client for 30 sec - exiting 10:10:32 (896): No heartbeat from core client for 30 sec - exiting 10:10:33 (896): No heartbeat from core client for 30 sec - exiting 10:10:34 (896): No heartbeat from core client for 30 sec - exiting 10:10:35 (896): No heartbeat from core client for 30 sec - exiting 10:10:36 (896): No heartbeat from core client for 30 sec - exiting 10:10:37 (896): No heartbeat from core client for 30 sec - exiting 10:10:38 (896): No heartbeat from core client for 30 sec - exiting 10:10:39 (896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3624, selfPID=3624, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=49116, selfPID=49116, iMonCtr=1 CPDN Monitor - Quit request from BOINC... 13:59:17 (204): No heartbeat from core client for 30 sec - exiting 13:59:18 (204): No heartbeat from core client for 30 sec - exiting 13:59:19 (204): No heartbeat from core client for 30 sec - exiting 13:59:20 (204): No heartbeat from core client for 30 sec - exiting 13:59:21 (204): No heartbeat from core client for 30 sec - exiting 13:59:22 (204): No heartbeat from core client for 30 sec - exiting 13:59:23 (204): No heartbeat from core client for 30 sec - exiting 13:59:24 (204): No heartbeat from core client for 30 sec - exiting 13:59:25 (204): No heartbeat from core client for 30 sec - exiting 13:59:27 (204): No heartbeat from core client for 30 sec - exiting 13:59:28 (204): No heartbeat from core client for 30 sec - exiting 13:59:29 (204): No heartbeat from core client for 30 sec - exiting 13:59:30 (204): No heartbeat from core client for 30 sec - exiting 13:59:31 (204): No heartbeat from core client for 30 sec - exiting 13:59:32 (204): No heartbeat from core client for 30 sec - exiting 13:59:33 (204): No heartbeat from core client for 30 sec - exiting 13:59:34 (204): No heartbeat from core client for 30 sec - exiting 13:59:35 (204): No heartbeat from core client for 30 sec - exiting 13:59:36 (204): No heartbeat from core client for 30 sec - exiting 13:59:37 (204): No heartbeat from core client for 30 sec - exiting 13:59:39 (204): No heartbeat from core client for 30 sec - exiting 13:59:40 (204): No heartbeat from core client for 30 sec - exiting 13:59:41 (204): No heartbeat from core client for 30 sec - exiting 13:59:42 (204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:55:16 (3596): No heartbeat from core client for 30 sec - exiting 07:55:17 (3596): No heartbeat from core client for 30 sec - exiting 07:55:18 (3596): No heartbeat from core client for 30 sec - exiting 07:55:19 (3596): No heartbeat from core client for 30 sec - exiting 07:55:20 (3596): No heartbeat from core client for 30 sec - exiting 07:55:22 (3596): No heartbeat from core client for 30 sec - exiting 07:55:23 (3596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=47872, selfPID=47872, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24152, selfPID=24152, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=4916, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10572, selfPID=10572, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10572, selfPID=6976, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_f93u_2012_1_009268161_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f93u_2012_1_009268161_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f93u_2012_1_009268161_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Dec 2014 09:01:22	1292523	17532626	hadam3p_anz_f93u_2012_1_009268161_0	103,979	665,432	6.3997
15 Dec 2014 14:45:33	1292523	17532626	hadam3p_anz_f93u_2012_1_009268161_0	92,459	598,173	6.4696
13 Dec 2014 08:33:00	1292523	17532626	hadam3p_anz_f93u_2012_1_009268161_0	80,939	522,599	6.4567
11 Dec 2014 11:09:38	1292523	17532626	hadam3p_anz_f93u_2012_1_009268161_0	69,419	444,116	6.3976
09 Dec 2014 16:27:07	1292523	17532626	hadam3p_anz_f93u_2012_1_009268161_0	57,899	366,085	6.3228
08 Dec 2014 08:04:46	1292523	17532626	hadam3p_anz_f93u_2012_1_009268161_0	46,379	288,920	6.2295
06 Dec 2014 13:46:48	1292523	17532626	hadam3p_anz_f93u_2012_1_009268161_0	34,859	212,523	6.0966
05 Dec 2014 08:03:40	1292523	17532626	hadam3p_anz_f93u_2012_1_009268161_0	23,339	139,307	5.9689
03 Dec 2014 17:14:29	1292523	17532626	hadam3p_anz_f93u_2012_1_009268161_0	11,819	71,425	6.0432