Task 16472447

Name	hadam3p_anz_p70l_2012_1_008639764_0
Workunit	8786276
Created	3 Apr 2014, 10:41:51 UTC
Sent	8 Apr 2014, 5:54:01 UTC
Report deadline	21 Mar 2015, 11:14:01 UTC
Received	15 May 2014, 2:47:45 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1048681
Run time	10 days 13 hours 3 min 22 sec
CPU time	10 days 1 hours 13 min 48 sec
Validate state	Invalid
Credit	5,477.92
Device peak FLOPS	2.90 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:01:45 (3152): No heartbeat from core client for 30 sec - exiting 18:01:46 (3152): No heartbeat from core client for 30 sec - exiting 18:01:47 (3152): No heartbeat from core client for 30 sec - exiting 18:01:48 (3152): No heartbeat from core client for 30 sec - exiting 18:01:49 (3152): No heartbeat from core client for 30 sec - exiting 18:01:50 (3152): No heartbeat from core client for 30 sec - exiting 18:01:51 (3152): No heartbeat from core client for 30 sec - exiting 18:01:52 (3152): No heartbeat from core client for 30 sec - exiting 18:01:53 (3152): No heartbeat from core client for 30 sec - exiting 18:01:54 (3152): No heartbeat from core client for 30 sec - exiting 18:01:55 (3152): No heartbeat from core client for 30 sec - exiting 18:01:56 (3152): No heartbeat from core client for 30 sec - exiting 18:01:57 (3152): No heartbeat from core client for 30 sec - exiting 18:01:58 (3152): No heartbeat from core client for 30 sec - exiting 18:01:59 (3152): No heartbeat from core client for 30 sec - exiting 18:02:00 (3152): No heartbeat from core client for 30 sec - exiting 18:02:01 (3152): No heartbeat from core client for 30 sec - exiting 18:02:02 (3152): No heartbeat from core client for 30 sec - exiting 18:02:03 (3152): No heartbeat from core client for 30 sec - exiting 18:02:04 (3152): No heartbeat from core client for 30 sec - exiting 18:02:05 (3152): No heartbeat from core client for 30 sec - exiting 18:02:06 (3152): No heartbeat from core client for 30 sec - exiting 18:02:07 (3152): No heartbeat from core client for 30 sec - exiting 18:02:08 (3152): No heartbeat from core client for 30 sec - exiting 18:02:09 (3152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2088, selfPID=2088, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6132, selfPID=6132, iMonCtr=2 00:58:40 (3836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:47:10 (1324): No heartbeat from core client for 30 sec - exiting 12:47:11 (1324): No heartbeat from core client for 30 sec - exiting 12:47:12 (1324): No heartbeat from core client for 30 sec - exiting 12:47:13 (1324): No heartbeat from core client for 30 sec - exiting 12:47:14 (1324): No heartbeat from core client for 30 sec - exiting 12:47:15 (1324): No heartbeat from core client for 30 sec - exiting 12:47:16 (1324): No heartbeat from core client for 30 sec - exiting 12:47:17 (1324): No heartbeat from core client for 30 sec - exiting 12:47:18 (1324): No heartbeat from core client for 30 sec - exiting 12:47:19 (1324): No heartbeat from core client for 30 sec - exiting 12:47:21 (1324): No heartbeat from core client for 30 sec - exiting 12:47:22 (1324): No heartbeat from core client for 30 sec - exiting 12:47:23 (1324): No heartbeat from core client for 30 sec - exiting 12:47:24 (1324): No heartbeat from core client for 30 sec - exiting 12:47:25 (1324): No heartbeat from core client for 30 sec - exiting 12:47:26 (1324): No heartbeat from core client for 30 sec - exiting 12:47:27 (1324): No heartbeat from core client for 30 sec - exiting 12:47:28 (1324): No heartbeat from core client for 30 sec - exiting 12:47:29 (1324): No heartbeat from core client for 30 sec - exiting 12:47:30 (1324): No heartbeat from core client for 30 sec - exiting 12:47:31 (1324): No heartbeat from core client for 30 sec - exiting 12:47:33 (1324): No heartbeat from core client for 30 sec - exiting 12:47:34 (1324): No heartbeat from core client for 30 sec - exiting 12:47:35 (1324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6192, selfPID=6192, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6664, selfPID=6664, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4408, selfPID=4408, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1436, selfPID=1436, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6560, selfPID=6560, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4268, selfPID=4268, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1964, selfPID=1964, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3772, selfPID=3772, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4540, selfPID=4540, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7048, selfPID=7048, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2660, selfPID=2660, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:06:46 (6400): No heartbeat from core client for 30 sec - exiting 17:06:47 (6400): No heartbeat from core client for 30 sec - exiting 17:06:48 (6400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:47:18 (5980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:19:27 (5608): No heartbeat from core client for 30 sec - exiting 13:19:28 (5608): No heartbeat from core client for 30 sec - exiting 13:19:29 (5608): No heartbeat from core client for 30 sec - exiting 13:19:30 (5608): No heartbeat from core client for 30 sec - exiting 13:19:31 (5608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3828, selfPID=3828, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:51:30 (1448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1804, selfPID=1804, iMonCtr=2 01:22:03 (6668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6136, selfPID=6136, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6240, selfPID=6240, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6068, selfPID=6068, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4688, selfPID=4688, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6764, selfPID=6764, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7824, selfPID=7824, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3040, selfPID=3040, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3040, selfPID=3040, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8376, selfPID=8376, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6700, selfPID=6700, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8216, selfPID=8216, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2392, selfPID=2392, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:50:15 (6480): No heartbeat from core client for 30 sec - exiting 20:50:16 (6480): No heartbeat from core client for 30 sec - exiting 20:50:18 (6480): No heartbeat from core client for 30 sec - exiting 20:50:19 (6480): No heartbeat from core client for 30 sec - exiting 20:50:20 (6480): No heartbeat from core client for 30 sec - exiting 20:50:21 (6480): No heartbeat from core client for 30 sec - exiting 20:50:22 (6480): No heartbeat from core client for 30 sec - exiting 20:50:23 (6480): No heartbeat from core client for 30 sec - exiting 20:50:24 (6480): No heartbeat from core client for 30 sec - exiting 20:50:25 (6480): No heartbeat from core client for 30 sec - exiting 20:50:26 (6480): No heartbeat from core client for 30 sec - exiting 20:50:27 (6480): No heartbeat from core client for 30 sec - exiting 20:50:28 (6480): No heartbeat from core client for 30 sec - exiting 20:50:30 (6480): No heartbeat from core client for 30 sec - exiting 20:50:31 (6480): No heartbeat from core client for 30 sec - exiting 20:50:32 (6480): No heartbeat from core client for 30 sec - exiting 20:50:33 (6480): No heartbeat from core client for 30 sec - exiting 20:50:34 (6480): No heartbeat from core client for 30 sec - exiting 20:50:35 (6480): No heartbeat from core client for 30 sec - exiting 20:50:36 (6480): No heartbeat from core client for 30 sec - exiting 20:50:37 (6480): No heartbeat from core client for 30 sec - exiting 20:50:38 (6480): No heartbeat from core client for 30 sec - exiting 20:50:39 (6480): No heartbeat from core client for 30 sec - exiting 20:50:40 (6480): No heartbeat from core client for 30 sec - exiting 20:50:42 (6480): No heartbeat from core client for 30 sec - exiting 20:50:43 (6480): No heartbeat from core client for 30 sec - exiting 20:50:44 (6480): No heartbeat from core client for 30 sec - exiting 20:50:45 (6480): No heartbeat from core client for 30 sec - exiting 20:50:46 (6480): No heartbeat from core client for 30 sec - exiting 20:50:47 (6480): No heartbeat from core client for 30 sec - exiting 20:50:48 (6480): No heartbeat from core client for 30 sec - exiting 20:50:49 (6480): No heartbeat from core client for 30 sec - exiting 20:50:50 (6480): No heartbeat from core client for 30 sec - exiting 20:50:51 (6480): No heartbeat from core client for 30 sec - exiting 20:50:52 (6480): No heartbeat from core client for 30 sec - exiting 20:50:54 (6480): No heartbeat from core client for 30 sec - exiting 20:50:55 (6480): No heartbeat from core client for 30 sec - exiting 20:50:56 (6480): No heartbeat from core client for 30 sec - exiting 20:50:57 (6480): No heartbeat from core client for 30 sec - exiting 20:50:58 (6480): No heartbeat from core client for 30 sec - exiting 20:50:59 (6480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=6380, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7352, selfPID=3548, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_p70l_2012_1_008639764_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 May 2014 14:46:36	1048681	16472447	hadam3p_anz_p70l_2012_1_008639764_0	127,019	836,044	6.5820
11 May 2014 13:54:36	1048681	16472447	hadam3p_anz_p70l_2012_1_008639764_0	115,499	760,354	6.5832
10 May 2014 06:07:47	1048681	16472447	hadam3p_anz_p70l_2012_1_008639764_0	103,979	681,004	6.5494
09 May 2014 07:00:43	1048681	16472447	hadam3p_anz_p70l_2012_1_008639764_0	92,459	602,005	6.5110
22 Apr 2014 14:17:54	1048681	16472447	hadam3p_anz_p70l_2012_1_008639764_0	80,939	522,661	6.4575
20 Apr 2014 03:37:16	1048681	16472447	hadam3p_anz_p70l_2012_1_008639764_0	69,419	443,653	6.3909
18 Apr 2014 22:17:33	1048681	16472447	hadam3p_anz_p70l_2012_1_008639764_0	57,899	368,511	6.3647
16 Apr 2014 15:12:58	1048681	16472447	hadam3p_anz_p70l_2012_1_008639764_0	46,379	295,570	6.3729
13 Apr 2014 12:47:13	1048681	16472447	hadam3p_anz_p70l_2012_1_008639764_0	34,859	221,852	6.3643
12 Apr 2014 09:00:41	1048681	16472447	hadam3p_anz_p70l_2012_1_008639764_0	23,339	148,418	6.3592
11 Apr 2014 11:38:42	1048681	16472447	hadam3p_anz_p70l_2012_1_008639764_0	11,819	75,216	6.3640