Task 18333133

Name	hadam3p_anz_e2c4_2013_1_009759384_0
Workunit	9830422
Created	20 Apr 2015, 20:13:54 UTC
Sent	24 Apr 2015, 6:22:44 UTC
Report deadline	5 Apr 2016, 11:42:44 UTC
Received	25 Jun 2015, 8:51:38 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1060531
Run time	7 days 2 hours 52 min 12 sec
CPU time	6 days 18 hours 8 min 28 sec
Validate state	Invalid
Credit	4,981.10
Device peak FLOPS	3.34 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:34:31 (6096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:38:54 (178392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:33:57 (190132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:55:59 (192292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=202152, selfPID=201324, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=61208, selfPID=61208, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 12:26:36 (7064): No heartbeat from core client for 30 sec - exiting 12:26:37 (7064): No heartbeat from core client for 30 sec - exiting 12:26:38 (7064): No heartbeat from core client for 30 sec - exiting 12:26:39 (7064): No heartbeat from core client for 30 sec - exiting 12:26:41 (7064): No heartbeat from core client for 30 sec - exiting 12:26:42 (7064): No heartbeat from core client for 30 sec - exiting 12:26:43 (7064): No heartbeat from core client for 30 sec - exiting 12:26:44 (7064): No heartbeat from core client for 30 sec - exiting 12:26:45 (7064): No heartbeat from core client for 30 sec - exiting 12:26:46 (7064): No heartbeat from core client for 30 sec - exiting 12:26:47 (7064): No heartbeat from core client for 30 sec - exiting 12:26:48 (7064): No heartbeat from core client for 30 sec - exiting 12:26:49 (7064): No heartbeat from core client for 30 sec - exiting 12:26:50 (7064): No heartbeat from core client for 30 sec - exiting 12:26:51 (7064): No heartbeat from core client for 30 sec - exiting 12:26:53 (7064): No heartbeat from core client for 30 sec - exiting 12:26:54 (7064): No heartbeat from core client for 30 sec - exiting 12:26:55 (7064): No heartbeat from core client for 30 sec - exiting 12:26:56 (7064): No heartbeat from core client for 30 sec - exiting 12:26:57 (7064): No heartbeat from core client for 30 sec - exiting 12:26:58 (7064): No heartbeat from core client for 30 sec - exiting 12:26:59 (7064): No heartbeat from core client for 30 sec - exiting 12:27:00 (7064): No heartbeat from core client for 30 sec - exiting 12:27:01 (7064): No heartbeat from core client for 30 sec - exiting 12:27:02 (7064): No heartbeat from core client for 30 sec - exiting 12:27:03 (7064): No heartbeat from core client for 30 sec - exiting 12:27:05 (7064): No heartbeat from core client for 30 sec - exiting 12:27:06 (7064): No heartbeat from core client for 30 sec - exiting 12:27:07 (7064): No heartbeat from core client for 30 sec - exiting 12:27:08 (7064): No heartbeat from core client for 30 sec - exiting 12:27:09 (7064): No heartbeat from core client for 30 sec - exiting 12:27:10 (7064): No heartbeat from core client for 30 sec - exiting 12:27:11 (7064): No heartbeat from core client for 30 sec - exiting 12:27:12 (7064): No heartbeat from core client for 30 sec - exiting 12:27:13 (7064): No heartbeat from core client for 30 sec - exiting 12:27:14 (7064): No heartbeat from core client for 30 sec - exiting 12:27:15 (7064): No heartbeat from core client for 30 sec - exiting 12:27:17 (7064): No heartbeat from core client for 30 sec - exiting 12:27:18 (7064): No heartbeat from core client for 30 sec - exiting 12:27:19 (7064): No heartbeat from core client for 30 sec - exiting 12:27:20 (7064): No heartbeat from core client for 30 sec - exiting 12:27:21 (7064): No heartbeat from core client for 30 sec - exiting 12:27:22 (7064): No heartbeat from core client for 30 sec - exiting 12:27:23 (7064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:27:24 (7064): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5272, iMonCtr=2 11:14:39 (6220): No heartbeat from core client for 30 sec - exiting 11:14:40 (6220): No heartbeat from core client for 30 sec - exiting 11:14:41 (6220): No heartbeat from core client for 30 sec - exiting 11:14:43 (6220): No heartbeat from core client for 30 sec - exiting 11:14:44 (6220): No heartbeat from core client for 30 sec - exiting 11:14:45 (6220): No heartbeat from core client for 30 sec - exiting 11:14:46 (6220): No heartbeat from core client for 30 sec - exiting 11:14:47 (6220): No heartbeat from core client for 30 sec - exiting 11:14:48 (6220): No heartbeat from core client for 30 sec - exiting 11:14:49 (6220): No heartbeat from core client for 30 sec - exiting 11:14:50 (6220): No heartbeat from core client for 30 sec - exiting 11:14:51 (6220): No heartbeat from core client for 30 sec - exiting 11:14:52 (6220): No heartbeat from core client for 30 sec - exiting 11:14:53 (6220): No heartbeat from core client for 30 sec - exiting 11:14:54 (6220): No heartbeat from core client for 30 sec - exiting 11:14:55 (6220): No heartbeat from core client for 30 sec - exiting 11:14:56 (6220): No heartbeat from core client for 30 sec - exiting 11:14:57 (6220): No heartbeat from core client for 30 sec - exiting 11:14:58 (6220): No heartbeat from core client for 30 sec - exiting 11:14:59 (6220): No heartbeat from core client for 30 sec - exiting 11:15:00 (6220): No heartbeat from core client for 30 sec - exiting 11:15:01 (6220): No heartbeat from core client for 30 sec - exiting 11:16:06 (6220): No heartbeat from core client for 30 sec - exiting 11:16:07 (6220): No heartbeat from core client for 30 sec - exiting 11:16:08 (6220): No heartbeat from core client for 30 sec - exiting 11:16:09 (6220): No heartbeat from core client for 30 sec - exiting 11:16:10 (6220): No heartbeat from core client for 30 sec - exiting 11:16:11 (6220): No heartbeat from core client for 30 sec - exiting 11:16:12 (6220): No heartbeat from core client for 30 sec - exiting 11:16:13 (6220): No heartbeat from core client for 30 sec - exiting 11:16:14 (6220): No heartbeat from core client for 30 sec - exiting 11:16:15 (6220): No heartbeat from core client for 30 sec - exiting 11:16:16 (6220): No heartbeat from core client for 30 sec - exiting 11:16:17 (6220): No heartbeat from core client for 30 sec - exiting 11:16:18 (6220): No heartbeat from core client for 30 sec - exiting 11:16:19 (6220): No heartbeat from core client for 30 sec - exiting 11:16:20 (6220): No heartbeat from core client for 30 sec - exiting 11:16:21 (6220): No heartbeat from core client for 30 sec - exiting 11:16:22 (6220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:25:11 (1112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:33:40 (7100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:33:41 (7100): No heartbeat from core client for 30 sec - exiting 11:44:47 (5212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:44:49 (5212): No heartbeat from core client for 30 sec - exiting 11:44:50 (5212): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 12:14:47 (7036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:14:48 (7036): No heartbeat from core client for 30 sec - exiting 12:14:49 (7036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:38:07 (2256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:39:08 (5348): No heartbeat from core client for 30 sec - exiting 07:39:09 (5348): No heartbeat from core client for 30 sec - exiting 07:39:10 (5348): No heartbeat from core client for 30 sec - exiting 07:39:12 (5348): No heartbeat from core client for 30 sec - exiting 07:39:13 (5348): No heartbeat from core client for 30 sec - exiting 07:39:14 (5348): No heartbeat from core client for 30 sec - exiting 07:39:15 (5348): No heartbeat from core client for 30 sec - exiting 07:39:16 (5348): No heartbeat from core client for 30 sec - exiting 07:39:17 (5348): No heartbeat from core client for 30 sec - exiting 07:39:18 (5348): No heartbeat from core client for 30 sec - exiting 07:39:19 (5348): No heartbeat from core client for 30 sec - exiting 07:39:20 (5348): No heartbeat from core client for 30 sec - exiting 07:39:21 (5348): No heartbeat from core client for 30 sec - exiting 07:39:22 (5348): No heartbeat from core client for 30 sec - exiting 07:39:24 (5348): No heartbeat from core client for 30 sec - exiting 07:39:25 (5348): No heartbeat from core client for 30 sec - exiting 07:39:26 (5348): No heartbeat from core client for 30 sec - exiting 07:39:27 (5348): No heartbeat from core client for 30 sec - exiting 07:39:28 (5348): No heartbeat from core client for 30 sec - exiting 07:39:29 (5348): No heartbeat from core client for 30 sec - exiting 07:39:30 (5348): No heartbeat from core client for 30 sec - exiting 07:39:31 (5348): No heartbeat from core client for 30 sec - exiting 07:39:32 (5348): No heartbeat from core client for 30 sec - exiting 07:39:33 (5348): No heartbeat from core client for 30 sec - exiting 07:39:34 (5348): No heartbeat from core client for 30 sec - exiting 07:39:36 (5348): No heartbeat from core client for 30 sec - exiting 07:39:37 (5348): No heartbeat from core client for 30 sec - exiting 07:39:38 (5348): No heartbeat from core client for 30 sec - exiting 07:39:39 (5348): No heartbeat from core client for 30 sec - exiting 07:39:40 (5348): No heartbeat from core client for 30 sec - exiting 07:39:41 (5348): No heartbeat from core client for 30 sec - exiting 07:39:42 (5348): No heartbeat from core client for 30 sec - exiting 07:39:43 (5348): No heartbeat from core client for 30 sec - exiting 07:39:44 (5348): No heartbeat from core client for 30 sec - exiting 07:39:45 (5348): No heartbeat from core client for 30 sec - exiting 07:39:46 (5348): No heartbeat from core client for 30 sec - exiting 07:39:48 (5348): No heartbeat from core client for 30 sec - exiting 07:39:49 (5348): No heartbeat from core client for 30 sec - exiting 07:39:50 (5348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=206664, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=205776, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 17:42:33 (206844): No heartbeat from core client for 30 sec - exiting 17:42:34 (206844): No heartbeat from core client for 30 sec - exiting 17:42:35 (206844): No heartbeat from core client for 30 sec - exiting 17:42:36 (206844): No heartbeat from core client for 30 sec - exiting 17:42:37 (206844): No heartbeat from core client for 30 sec - exiting 17:42:38 (206844): No heartbeat from core client for 30 sec - exiting 17:42:39 (206844): No heartbeat from core client for 30 sec - exiting 17:42:40 (206844): No heartbeat from core client for 30 sec - exiting 17:42:41 (206844): No heartbeat from core client for 30 sec - exiting 17:42:42 (206844): No heartbeat from core client for 30 sec - exiting 17:42:43 (206844): No heartbeat from core client for 30 sec - exiting 17:42:44 (206844): No heartbeat from core client for 30 sec - exiting 17:42:45 (206844): No heartbeat from core client for 30 sec - exiting 17:42:46 (206844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7828, selfPID=7828, iMonCtr=2 17:48:56 (205520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:14:13 (205556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:45:10 (192308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:39:58 (208588): No heartbeat from core client for 30 sec - exiting 04:39:59 (208588): No heartbeat from core client for 30 sec - exiting 04:40:00 (208588): No heartbeat from core client for 30 sec - exiting 04:40:01 (208588): No heartbeat from core client for 30 sec - exiting 04:40:02 (208588): No heartbeat from core client for 30 sec - exiting 04:40:03 (208588): No heartbeat from core client for 30 sec - exiting 04:40:04 (208588): No heartbeat from core client for 30 sec - exiting 04:40:05 (208588): No heartbeat from core client for 30 sec - exiting 04:40:06 (208588): No heartbeat from core client for 30 sec - exiting 04:40:07 (208588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... RegionaCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=220600, selfPID=220600, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:00:15 (234952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:28:52 (205860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=216056, selfPID=216056, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=218928, selfPID=218928, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=220684, selfPID=220684, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=110992, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=40816, selfPID=40816, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=40816, selfPID=45308, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_e2c4_2013_1_009759384_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e2c4_2013_1_009759384_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Jun 2015 17:50:36	1060531	18333133	hadam3p_anz_e2c4_2013_1_009759384_0	115,499	552,598	4.7844
18 Jun 2015 04:10:49	1060531	18333133	hadam3p_anz_e2c4_2013_1_009759384_0	103,979	498,130	4.7907
17 Jun 2015 02:28:21	1060531	18333133	hadam3p_anz_e2c4_2013_1_009759384_0	92,459	443,424	4.7959
15 Jun 2015 06:03:55	1060531	18333133	hadam3p_anz_e2c4_2013_1_009759384_0	80,939	389,674	4.8144
08 May 2015 19:04:52	1060531	18333133	hadam3p_anz_e2c4_2013_1_009759384_0	69,419	334,276	4.8153
08 May 2015 19:01:54	1060531	18333133	hadam3p_anz_e2c4_2013_1_009759384_0	57,899	277,838	4.7987
30 Apr 2015 05:37:54	1060531	18333133	hadam3p_anz_e2c4_2013_1_009759384_0	46,379	221,259	4.7707
29 Apr 2015 11:21:18	1060531	18333133	hadam3p_anz_e2c4_2013_1_009759384_0	34,859	166,594	4.7791
28 Apr 2015 15:50:27	1060531	18333133	hadam3p_anz_e2c4_2013_1_009759384_0	23,339	112,177	4.8064
27 Apr 2015 23:23:07	1060531	18333133	hadam3p_anz_e2c4_2013_1_009759384_0	11,819	55,995	4.7377