Task 18280600

Name	hadam3p_anz_d8kg_2013_1_009725737_0
Workunit	9799034
Created	8 Apr 2015, 18:27:52 UTC
Sent	17 Apr 2015, 14:42:14 UTC
Report deadline	29 Mar 2016, 20:02:14 UTC
Received	2 May 2015, 20:53:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1172715
Run time	7 days 11 hours 31 min 2 sec
CPU time	6 days 10 hours 47 min 21 sec
Validate state	Invalid
Credit	3,987.46
Device peak FLOPS	2.77 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> 14:00:47 (2568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:11 (8088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5756, selfPID=5756, iMonCtr=2 02:11:39 (7556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:14:22 (10356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:15 (5468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:21:13 (8212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting00:47:25 (6384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:26:35 (5128): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:19:16 (8104): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:19:17 (8104): No heartbeat from core client for 30 sec - exiting 17:19:19 (8104): No heartbeat from core client for 30 sec - exiting 04:22:10 (12548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:42:13 (12708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:52:37 (12164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:52:39 (12164): No heartbeat from core client for 30 sec - exiting 05:53:23 (9468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:11:35 (8932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:19:03 (6256): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:04:09 (6384): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 06:04:10 (6384): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:42:20 (3672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:45:40 (5720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:26:53 (10148): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 07:26:54 (10148): No heartbeat from core client for 30 sec - exiting 07:26:55 (10148): No heartbeat from core client for 30 sec - exiting 16:54:16 (7560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:54:17 (7560): No heartbeat from core client for 30 sec - exiting 16:54:18 (7560): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12012, selfPID=12012, iMonCtr=2 17:10:07 (13240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:10:08 (13240): No heartbeat from core client for 30 sec - exiting 17:10:09 (13240): No heartbeat from core client for 30 sec - exiting 17:10:10 (13240): No heartbeat from core client for 30 sec - exiting 17:10:11 (13240): No heartbeat from core client for 30 sec - exiting 17:10:12 (13240): No heartbeat from core client for 30 sec - exiting 17:28:52 (11248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:28:53 (11248): No heartbeat from core client for 30 sec - exiting 17:28:54 (11248): No heartbeat from core client for 30 sec - exiting 17:28:55 (11248): No heartbeat from core client for 30 sec - exiting 17:28:56 (11248): No heartbeat from core client for 30 sec - exiting 17:30:47 (11620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:30:48 (11620): No heartbeat from core client for 30 sec - exiting 17:30:49 (11620): No heartbeat from core client for 30 sec - exiting 17:30:50 (11620): No heartbeat from core client for 30 sec - exiting 17:30:51 (11620): No heartbeat from core client for 30 sec - exiting 17:30:52 (11620): No heartbeat from core client for 30 sec - exiting 17:30:53 (11620): No heartbeat from core client for 30 sec - exiting 17:30:55 (11620): No heartbeat from core client for 30 sec - exiting 17:30:56 (11620): No heartbeat from core client for 30 sec - exiting 17:32:04 (10824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12680, selfPID=12680, iMonCtr=2 17:48:14 (6220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11492, selfPID=11492, iMonCtr=2 17:48:15 (6220): No heartbeat from core client for 30 sec - exiting 17:48:16 (6220): No heartbeat from core client for 30 sec - exiting 20:02:55 (11972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:02:56 (11972): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 01:23:36 (1892): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 01:23:37 (1892): No heartbeat from core client for 30 sec - exiting 01:23:38 (1892): No heartbeat from core client for 30 sec - exiting 01:23:39 (1892): No heartbeat from core client for 30 sec - exiting 01:23:40 (1892): No heartbeat from core client for 30 sec - exiting 13:13:02 (796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:13:03 (796): No heartbeat from core client for 30 sec - exiting 13:13:04 (796): No heartbeat from core client for 30 sec - exiting 13:13:05 (796): No heartbeat from core client for 30 sec - exiting 13:13:06 (796): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:00:11 (8304): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:00:12 (8304): No heartbeat from core client for 30 sec - exiting 17:00:13 (8304): No heartbeat from core client for 30 sec - exiting 17:00:14 (8304): No heartbeat from core client for 30 sec - exiting 05:49:35 (728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:36 (728): No heartbeat from core client for 30 sec - exiting 05:50:59 (7560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:40:07 (10276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:40:08 (10276): No heartbeat from core client for 30 sec - exiting 18:40:09 (10276): No heartbeat from core client for 30 sec - exiting 18:40:25 (8168): Can't acquire lockfile (32) - waiting 35s 18:43:19 (8168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:43:20 (8168): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13184, selfPID=13184, iMonCtr=2 19:31:33 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:11 (6776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:12 (6776): No heartbeat from core client for 30 sec - exiting 19:51:13 (6776): No heartbeat from core client for 30 sec - exiting 19:51:14 (6776): No heartbeat from core client for 30 sec - exiting 19:51:15 (6776): No heartbeat from core client for 30 sec - exiting 19:51:16 (6776): No heartbeat from core client for 30 sec - exiting 19:53:37 (6152): No heartbeat from core client for 30 sec - exiting 19:53:38 (6152): No heartbeat from core client for 30 sec - exiting 19:53:39 (6152): No heartbeat from core client for 30 sec - exiting 19:53:40 (6152): No heartbeat from core client for 30 sec - exiting 19:53:41 (6152): No heartbeat from core client for 30 sec - exiting 19:53:42 (6152): No heartbeat from core client for 30 sec - exiting 19:53:43 (6152): No heartbeat from core client for 30 sec - exiting 19:53:44 (6152): No heartbeat from core client for 30 sec - exiting 19:53:45 (6152): No heartbeat from core client for 30 sec - exiting 19:53:47 (6152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:18 (11792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:52 (2232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:53 (2232): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=4812, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7928, selfPID=7928, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7928, selfPID=4340, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_d8kg_2013_1_009725737_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d8kg_2013_1_009725737_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d8kg_2013_1_009725737_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d8kg_2013_1_009725737_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Apr 2015 18:52:11	1172715	18280600	hadam3p_anz_d8kg_2013_1_009725737_0	92,459	524,927	5.6774
25 Apr 2015 09:40:59	1172715	18280600	hadam3p_anz_d8kg_2013_1_009725737_0	80,939	461,097	5.6968
24 Apr 2015 12:52:18	1172715	18280600	hadam3p_anz_d8kg_2013_1_009725737_0	69,419	396,098	5.7059
23 Apr 2015 16:28:35	1172715	18280600	hadam3p_anz_d8kg_2013_1_009725737_0	57,899	331,532	5.7260
22 Apr 2015 15:06:31	1172715	18280600	hadam3p_anz_d8kg_2013_1_009725737_0	46,379	268,011	5.7787
20 Apr 2015 14:16:58	1172715	18280600	hadam3p_anz_d8kg_2013_1_009725737_0	34,859	202,131	5.7985
19 Apr 2015 13:49:37	1172715	18280600	hadam3p_anz_d8kg_2013_1_009725737_0	23,339	135,481	5.8049
18 Apr 2015 15:35:45	1172715	18280600	hadam3p_anz_d8kg_2013_1_009725737_0	11,819	68,425	5.7894