Task 18282229

Name	hadam3p_anz_f1sg_2013_1_009728710_0
Workunit	9800555
Created	8 Apr 2015, 19:40:43 UTC
Sent	10 Apr 2015, 13:38:30 UTC
Report deadline	22 Mar 2016, 18:58:30 UTC
Received	24 Apr 2015, 13:50:27 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1041693
Run time	12 days 20 hours 31 min 59 sec
CPU time	11 days 7 hours 19 min 11 sec
Validate state	Invalid
Credit	4,484.28
Device peak FLOPS	2.51 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4604, selfPID=5640, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6116, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4700, selfPID=1804, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 04:14:38 (3472): No heartbeat from core client for 30 sec - exiting 04:14:39 (3472): No heartbeat from core client for 30 sec - exiting 04:14:40 (3472): No heartbeat from core client for 30 sec - exiting 04:14:41 (3472): No heartbeat from core client for 30 sec - exiting 04:14:42 (3472): No heartbeat from core client for 30 sec - exiting 04:14:43 (3472): No heartbeat from core client for 30 sec - exiting 04:14:44 (3472): No heartbeat from core client for 30 sec - exiting 04:14:45 (3472): No heartbeat from core client for 30 sec - exiting 04:14:46 (3472): No heartbeat from core client for 30 sec - exiting 04:14:47 (3472): No heartbeat from core client for 30 sec - exiting 04:14:48 (3472): No heartbeat from core client for 30 sec - exiting 04:14:49 (3472): No heartbeat from core client for 30 sec - exiting 04:14:50 (3472): No heartbeat from core client for 30 sec - exiting 04:14:51 (3472): No heartbeat from core client for 30 sec - exiting 04:14:52 (3472): No heartbeat from core client for 30 sec - exiting 04:14:53 (3472): No heartbeat from core client for 30 sec - exiting 04:14:54 (3472): No heartbeat from core client for 30 sec - exiting 04:14:55 (3472): No heartbeat from core client for 30 sec - exiting 04:14:56 (3472): No heartbeat from core client for 30 sec - exiting 04:14:57 (3472): No heartbeat from core client for 30 sec - exiting 04:14:58 (3472): No heartbeat from core client for 30 sec - exiting 04:14:59 (3472): No heartbeat from core client for 30 sec - exiting 04:15:00 (3472): No heartbeat from core client for 30 sec - exiting 04:15:01 (3472): No heartbeat from core client for 30 sec - exiting 04:15:02 (3472): No heartbeat from core client for 30 sec - exiting 04:15:03 (3472): No heartbeat from core client for 30 sec - exiting 04:15:04 (3472): No heartbeat from core client for 30 sec - exiting 04:15:05 (3472): No heartbeat from core client for 30 sec - exiting 04:15:06 (3472): No heartbeat from core client for 30 sec - exiting 04:15:07 (3472): No heartbeat from core client for 30 sec - exiting 04:15:08 (3472): No heartbeat from core client for 30 sec - exiting 04:15:09 (3472): No heartbeat from core client for 30 sec - exiting 04:15:10 (3472): No heartbeat from core client for 30 sec - exiting 04:15:11 (3472): No heartbeat from core client for 30 sec - exiting 04:15:12 (3472): No heartbeat from core client for 30 sec - exiting 04:15:13 (3472): No heartbeat from core client for 30 sec - exiting 04:15:14 (3472): No heartbeat from core client for 30 sec - exiting 04:15:15 (3472): No heartbeat from core client for 30 sec - exiting 04:15:16 (3472): No heartbeat from core client for 30 sec - exiting 04:15:17 (3472): No heartbeat from core client for 30 sec - exiting 04:15:18 (3472): No heartbeat from core client for 30 sec - exiting 04:15:19 (3472): No heartbeat from core client for 30 sec - exiting 04:15:20 (3472): No heartbeat from core client for 30 sec - exiting 04:15:21 (3472): No heartbeat from core client for 30 sec - exiting 04:15:22 (3472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4356, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 11:32:21 (5244): No heartbeat from core client for 30 sec - exiting 11:32:22 (5244): No heartbeat from core client for 30 sec - exiting 11:32:23 (5244): No heartbeat from core client for 30 sec - exiting 11:32:24 (5244): No heartbeat from core client for 30 sec - exiting 11:32:25 (5244): No heartbeat from core client for 30 sec - exiting 11:32:26 (5244): No heartbeat from core client for 30 sec - exiting 11:32:27 (5244): No heartbeat from core client for 30 sec - exiting 11:32:28 (5244): No heartbeat from core client for 30 sec - exiting 11:32:29 (5244): No heartbeat from core client for 30 sec - exiting 11:32:30 (5244): No heartbeat from core client for 30 sec - exiting 11:32:31 (5244): No heartbeat from core client for 30 sec - exiting 11:32:32 (5244): No heartbeat from core client for 30 sec - exiting 11:32:33 (5244): No heartbeat from core client for 30 sec - exiting 11:32:34 (5244): No heartbeat from core client for 30 sec - exiting 11:32:35 (5244): No heartbeat from core client for 30 sec - exiting 11:32:36 (5244): No heartbeat from core client for 30 sec - exiting 11:32:37 (5244): No heartbeat from core client for 30 sec - exiting 11:32:38 (5244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:59:15 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:58:06 (544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... GCM : BUFFIN: C I/O Error feof - Unit 35 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 35 - Return code = 16 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_f1sg_2013_1_009728710_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f1sg_2013_1_009728710_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f1sg_2013_1_009728710_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Apr 2015 04:11:22	1041693	18282229	hadam3p_anz_f1sg_2013_1_009728710_0	103,979	946,852	9.1062
22 Apr 2015 14:24:27	1041693	18282229	hadam3p_anz_f1sg_2013_1_009728710_0	92,459	836,597	9.0483
21 Apr 2015 03:21:43	1041693	18282229	hadam3p_anz_f1sg_2013_1_009728710_0	80,939	725,663	8.9656
19 Apr 2015 17:38:02	1041693	18282229	hadam3p_anz_f1sg_2013_1_009728710_0	69,419	614,949	8.8585
18 Apr 2015 11:01:37	1041693	18282229	hadam3p_anz_f1sg_2013_1_009728710_0	57,899	507,119	8.7587
17 Apr 2015 04:16:58	1041693	18282229	hadam3p_anz_f1sg_2013_1_009728710_0	46,379	401,478	8.6565
15 Apr 2015 15:50:24	1041693	18282229	hadam3p_anz_f1sg_2013_1_009728710_0	34,859	298,627	8.5667
14 Apr 2015 06:18:30	1041693	18282229	hadam3p_anz_f1sg_2013_1_009728710_0	23,339	198,077	8.4870
12 Apr 2015 21:14:32	1041693	18282229	hadam3p_anz_f1sg_2013_1_009728710_0	11,819	98,112	8.3012