Task 19186145

Name	hadam3p_anz_h00u_200912_12_287_010252436_0
Workunit	10252436
Created	13 Jan 2016, 10:21:37 UTC
Sent	13 Jan 2016, 13:15:41 UTC
Report deadline	25 Dec 2016, 18:35:41 UTC
Received	3 Feb 2016, 0:19:49 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1288436
Run time	3 days 10 hours 7 min 11 sec
CPU time	2 days 23 hours 38 min 41 sec
Validate state	Invalid
Credit	2,497.00
Device peak FLOPS	3.40 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <stderr_txt> 05:55:19 (16884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:59:49 (6252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:57:33 (8164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:40:10 (7076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:03:13 (4668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:16:00 (7732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:32:33 (5608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:30:18 (6832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:54:27 (8232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:51:30 (5440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:46:54 (10200): No heartbeat from core client for 30 sec - exiting 22:46:55 (10200): No heartbeat from core client for 30 sec - exiting 22:46:56 (10200): No heartbeat from core client for 30 sec - exiting 22:46:57 (10200): No heartbeat from core client for 30 sec - exiting 22:46:58 (10200): No heartbeat from core client for 30 sec - exiting 22:46:59 (10200): No heartbeat from core client for 30 sec - exiting 22:47:00 (10200): No heartbeat from core client for 30 sec - exiting 22:47:01 (10200): No heartbeat from core client for 30 sec - exiting 22:47:02 (10200): No heartbeat from core client for 30 sec - exiting 22:47:03 (10200): No heartbeat from core client for 30 sec - exiting 22:47:04 (10200): No heartbeat from core client for 30 sec - exiting 22:47:05 (10200): No heartbeat from core client for 30 sec - exiting 22:47:06 (10200): No heartbeat from core client for 30 sec - exiting 22:47:07 (10200): No heartbeat from core client for 30 sec - exiting 22:47:08 (10200): No heartbeat from core client for 30 sec - exiting 22:47:09 (10200): No heartbeat from core client for 30 sec - exiting 22:47:10 (10200): No heartbeat from core client for 30 sec - exiting 22:47:11 (10200): No heartbeat from core client for 30 sec - exiting 22:47:12 (10200): No heartbeat from core client for 30 sec - exiting 22:47:13 (10200): No heartbeat from core client for 30 sec - exiting 22:47:15 (10200): No heartbeat from core client for 30 sec - exiting 22:47:16 (10200): No heartbeat from core client for 30 sec - exiting 22:47:17 (10200): No heartbeat from core client for 30 sec - exiting 22:47:18 (10200): No heartbeat from core client for 30 sec - exiting 22:47:19 (10200): No heartbeat from core client for 30 sec - exiting 22:47:20 (10200): No heartbeat from core client for 30 sec - exiting 22:47:21 (10200): No heartbeat from core client for 30 sec - exiting 22:47:22 (10200): No heartbeat from core client for 30 sec - exiting 22:47:23 (10200): No heartbeat from core client for 30 sec - exiting 22:47:24 (10200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:56:14 (6384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:29:28 (11432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:53:18 (3364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:17:47 (11300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 03:23:00 (11760): start_timer_thread(): CreateThread() failed, errno 0 03:23:01 (5244): start_timer_thread(): CreateThread() failed, errno 0 03:23:13 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:24:19 (11488): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 03:24:22 (6672): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 03:41:08 (9556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:13:07 (6304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:15:14 (1816): start_timer_thread(): CreateThread() failed, errno 0 04:15:16 (10028): start_timer_thread(): CreateThread() failed, errno 0 04:15:53 (4384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:15:56 (5332): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 04:42:17 (6500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:43:37 (12220): start_timer_thread(): CreateThread() failed, errno 0 04:51:02 (9696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:51:28 (9648): start_timer_thread(): CreateThread() failed, errno 0 05:17:12 (11932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:18:57 (13276): start_timer_thread(): CreateThread() failed, errno 0 05:19:11 (13156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:19:29 (13104): start_timer_thread(): CreateThread() failed, errno 0 05:19:31 (11772): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 05:41:39 (13000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 05:42:47 (4472): start_timer_thread(): CreateThread() failed, errno 0 05:43:04 (10420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 05:43:10 (11044): start_timer_thread(): CreateThread() failed, errno 0 05:43:11 (5468): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 06:00:21 (5384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:01:38 (9264): start_timer_thread(): CreateThread() failed, errno 0 06:01:39 (5148): start_timer_thread(): CreateThread() failed, errno 0 06:01:52 (11796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:02:09 (9400): start_timer_thread(): CreateThread() failed, errno 0 06:02:11 (11128): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 06:13:03 (11568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:14:55 (11412): start_timer_thread(): CreateThread() failed, errno 0 06:14:57 (3392): start_timer_thread(): CreateThread() failed, errno 0 06:15:12 (9628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:15:17 (9408): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 06:15:19 (9024): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:27:45 (3596): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 06:30:08 (10356): start_timer_thread(): CreateThread() failed, errno 0 06:30:10 (10980): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:34:06 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 06:34:39 (9372): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 06:43:58 (9340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 06:44:13 (9844): start_timer_thread(): CreateThread() failed, errno 0 06:44:14 (4388): start_timer_thread(): CreateThread() failed, errno 0 07:06:13 (6664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:46 (10428): start_timer_thread(): CreateThread() failed, errno 0 07:07:57 (5380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:08:08 (8760): start_timer_thread(): CreateThread() failed, errno 0 07:08:10 (3636): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 07:16:00 (6708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:17:46 (1776): start_timer_thread(): CreateThread() failed, errno 0 07:17:48 (13256): start_timer_thread(): CreateThread() failed, errno 0 07:17:59 (2380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:18:11 (8176): start_timer_thread(): CreateThread() failed, errno 0 07:18:12 (7640): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:27:10 (7732): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:54:34 (1780): start_timer_thread(): CreateThread() failed, errno 0 03:11:53 (11928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:16:17 (7980): start_timer_thread(): CreateThread() failed, errno 0 03:20:00 (6132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:30 (5460): start_timer_thread(): CreateThread() failed, errno 0 03:23:32 (6688): start_timer_thread(): CreateThread() failed, errno 0 03:29:16 (10576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:29:53 (4900): start_timer_thread(): CreateThread() failed, errno 0 03:29:55 (6608): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:43:21 (7036): start_timer_thread(): CreateThread() failed, errno 0 06:43:23 (3808): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7036, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3808, selfPID=4880, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_h00u_200912_12_287_010252436_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_h00u_200912_12_287_010252436_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_h00u_200912_12_287_010252436_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_h00u_200912_12_287_010252436_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_h00u_200912_12_287_010252436_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_h00u_200912_12_287_010252436_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_h00u_200912_12_287_010252436_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Feb 2016 10:50:42	1288436	19186145	hadam3p_anz_h00u_200912_12_287_010252436_0	57,899	238,375	4.1171
01 Feb 2016 21:59:30	1288436	19186145	hadam3p_anz_h00u_200912_12_287_010252436_0	46,379	193,696	4.1764
31 Jan 2016 19:15:22	1288436	19186145	hadam3p_anz_h00u_200912_12_287_010252436_0	34,859	143,541	4.1178
15 Jan 2016 05:13:23	1288436	19186145	hadam3p_anz_h00u_200912_12_287_010252436_0	23,339	97,458	4.1758
14 Jan 2016 04:53:17	1288436	19186145	hadam3p_anz_h00u_200912_12_287_010252436_0	11,819	49,535	4.1911