Task 18332255

Name	hadam3p_anz_e1fg_2013_1_009758584_0
Workunit	9829622
Created	20 Apr 2015, 18:58:04 UTC
Sent	20 Apr 2015, 19:06:06 UTC
Report deadline	2 Apr 2016, 0:26:06 UTC
Received	28 Apr 2015, 9:43:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1321309
Run time	5 days 18 hours 58 min 24 sec
CPU time	5 days 8 hours 5 min 39 sec
Validate state	Invalid
Credit	4,981.10
Device peak FLOPS	4.06 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:25:02 (2256): No heartbeat from core client for 30 sec - exiting 20:25:03 (2256): No heartbeat from core client for 30 sec - exiting 20:25:04 (2256): No heartbeat from core client for 30 sec - exiting 20:25:05 (2256): No heartbeat from core client for 30 sec - exiting 20:25:06 (2256): No heartbeat from core client for 30 sec - exiting 20:25:07 (2256): No heartbeat from core client for 30 sec - exiting 20:25:08 (2256): No heartbeat from core client for 30 sec - exiting 20:25:09 (2256): No heartbeat from core client for 30 sec - exiting 20:25:10 (2256): No heartbeat from core client for 30 sec - exiting 20:25:11 (2256): No heartbeat from core client for 30 sec - exiting 20:25:12 (2256): No heartbeat from core client for 30 sec - exiting 20:25:13 (2256): No heartbeat from core client for 30 sec - exiting 20:25:14 (2256): No heartbeat from core client for 30 sec - exiting 20:25:15 (2256): No heartbeat from core client for 30 sec - exiting 20:25:16 (2256): No heartbeat from core client for 30 sec - exiting 20:25:17 (2256): No heartbeat from core client for 30 sec - exiting 20:25:18 (2256): No heartbeat from core client for 30 sec - exiting 20:25:19 (2256): No heartbeat from core client for 30 sec - exiting 20:25:20 (2256): No heartbeat from core client for 30 sec - exiting 20:25:21 (2256): No heartbeat from core client for 30 sec - exiting 20:25:22 (2256): No heartbeat from core client for 30 sec - exiting 20:25:23 (2256): No heartbeat from core client for 30 sec - exiting 20:25:24 (2256): No heartbeat from core client for 30 sec - exiting 20:25:25 (2256): No heartbeat from core client for 30 sec - exiting 20:25:26 (2256): No heartbeat from core client for 30 sec - exiting 20:25:27 (2256): No heartbeat from core client for 30 sec - exiting 20:25:28 (2256): No heartbeat from core client for 30 sec - exiting 20:25:29 (2256): No heartbeat from core client for 30 sec - exiting 20:25:30 (2256): No heartbeat from core client for 30 sec - exiting 20:25:31 (2256): No heartbeat from core client for 30 sec - exiting 20:25:32 (2256): No heartbeat from core client for 30 sec - exiting 20:25:33 (2256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:49:24 (7492): No heartbeat from core client for 30 sec - exiting 18:49:25 (7492): No heartbeat from core client for 30 sec - exiting 18:49:26 (7492): No heartbeat from core client for 30 sec - exiting 18:49:27 (7492): No heartbeat from core client for 30 sec - exiting 18:49:28 (7492): No heartbeat from core client for 30 sec - exiting 18:49:29 (7492): No heartbeat from core client for 30 sec - exiting 18:49:30 (7492): No heartbeat from core client for 30 sec - exiting 18:49:31 (7492): No heartbeat from core client for 30 sec - exiting 18:49:32 (7492): No heartbeat from core client for 30 sec - exiting 18:49:33 (7492): No heartbeat from core client for 30 sec - exiting 18:49:34 (7492): No heartbeat from core client for 30 sec - exiting 18:49:35 (7492): No heartbeat from core client for 30 sec - exiting 18:49:36 (7492): No heartbeat from core client for 30 sec - exiting 18:49:37 (7492): No heartbeat from core client for 30 sec - exiting 18:49:38 (7492): No heartbeat from core client for 30 sec - exiting 18:49:39 (7492): No heartbeat from core client for 30 sec - exiting 18:49:40 (7492): No heartbeat from core client for 30 sec - exiting 18:49:41 (7492): No heartbeat from core client for 30 sec - exiting 18:49:42 (7492): No heartbeat from core client for 30 sec - exiting 18:49:43 (7492): No heartbeat from core client for 30 sec - exiting 18:49:44 (7492): No heartbeat from core client for 30 sec - exiting 18:49:45 (7492): No heartbeat from core client for 30 sec - exiting 18:49:46 (7492): No heartbeat from core client for 30 sec - exiting 18:49:47 (7492): No heartbeat from core client for 30 sec - exiting 18:49:48 (7492): No heartbeat from core client for 30 sec - exiting 18:49:49 (7492): No heartbeat from core client for 30 sec - exiting 18:49:50 (7492): No heartbeat from core client for 30 sec - exiting 18:49:51 (7492): No heartbeat from core client for 30 sec - exiting 18:49:52 (7492): No heartbeat from core client for 30 sec - exiting 18:49:53 (7492): No heartbeat from core client for 30 sec - exiting 18:49:54 (7492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:57:27 (7700): No heartbeat from core client for 30 sec - exiting 13:57:28 (7700): No heartbeat from core client for 30 sec - exiting 13:57:29 (7700): No heartbeat from core client for 30 sec - exiting 13:57:30 (7700): No heartbeat from core client for 30 sec - exiting 13:57:31 (7700): No heartbeat from core client for 30 sec - exiting 13:57:32 (7700): No heartbeat from core client for 30 sec - exiting 13:57:33 (7700): No heartbeat from core client for 30 sec - exiting 13:57:34 (7700): No heartbeat from core client for 30 sec - exiting 13:57:35 (7700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8640, selfPID=8640, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8640, selfPID=8932, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_e1fg_2013_1_009758584_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e1fg_2013_1_009758584_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Apr 2015 12:32:36	1321309	18332255	hadam3p_anz_e1fg_2013_1_009758584_0	115,499	429,729	3.7206
26 Apr 2015 22:19:56	1321309	18332255	hadam3p_anz_e1fg_2013_1_009758584_0	103,979	386,331	3.7155
26 Apr 2015 08:18:25	1321309	18332255	hadam3p_anz_e1fg_2013_1_009758584_0	92,459	343,880	3.7193
25 Apr 2015 18:24:53	1321309	18332255	hadam3p_anz_e1fg_2013_1_009758584_0	80,939	301,667	3.7271
25 Apr 2015 05:30:22	1321309	18332255	hadam3p_anz_e1fg_2013_1_009758584_0	69,419	258,932	3.7300
24 Apr 2015 15:41:32	1321309	18332255	hadam3p_anz_e1fg_2013_1_009758584_0	57,899	216,164	3.7335
24 Apr 2015 00:45:56	1321309	18332255	hadam3p_anz_e1fg_2013_1_009758584_0	46,379	173,617	3.7434
23 Apr 2015 10:24:26	1321309	18332255	hadam3p_anz_e1fg_2013_1_009758584_0	34,859	131,052	3.7595
22 Apr 2015 10:48:14	1321309	18332255	hadam3p_anz_e1fg_2013_1_009758584_0	23,339	88,487	3.7914
21 Apr 2015 09:16:11	1321309	18332255	hadam3p_anz_e1fg_2013_1_009758584_0	11,819	45,644	3.8619