Task 19212169

Name	hadam3p_anz_k32q_201212_12_306_010266539_0
Workunit	10266539
Created	25 Jan 2016, 13:11:14 UTC
Sent	25 Jan 2016, 13:14:06 UTC
Report deadline	6 Jan 2017, 18:34:06 UTC
Received	19 Feb 2016, 19:18:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1384210
Run time	5 days 23 hours 0 min 35 sec
CPU time	5 days 16 hours 3 min 42 sec
Validate state	Invalid
Credit	2,497.00
Device peak FLOPS	2.65 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <stderr_txt> diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 16:16:02 (536): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 16:16:04 (1352): start_timer_thread(): CreateThread() failed, errno 0 13:16:48 (1660): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 14:11:00 (5088): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:17:10 (4148): start_timer_thread(): CreateThread() failed, errno 0 01:23:39 (4044): start_timer_thread(): CreateThread() failed, errno 0 01:23:41 (4032): start_timer_thread(): CreateThread() failed, errno 0 14:11:59 (5804): No heartbeat from core client for 30 sec - exiting 14:12:00 (5804): No heartbeat from core client for 30 sec - exiting 14:12:01 (5804): No heartbeat from core client for 30 sec - exiting 14:12:02 (5804): No heartbeat from core client for 30 sec - exiting 14:12:03 (5804): No heartbeat from core client for 30 sec - exiting 14:12:04 (5804): No heartbeat from core client for 30 sec - exiting 14:12:05 (5804): No heartbeat from core client for 30 sec - exiting 14:12:06 (5804): No heartbeat from core client for 30 sec - exiting 14:12:07 (5804): No heartbeat from core client for 30 sec - exiting 14:12:08 (5804): No heartbeat from core client for 30 sec - exiting 14:12:09 (5804): No heartbeat from core client for 30 sec - exiting 14:12:10 (5804): No heartbeat from core client for 30 sec - exiting 14:12:11 (5804): No heartbeat from core client for 30 sec - exiting 14:12:12 (5804): No heartbeat from core client for 30 sec - exiting 14:12:13 (5804): No heartbeat from core client for 30 sec - exiting 14:12:14 (5804): No heartbeat from core client for 30 sec - exiting 14:12:16 (5804): No heartbeat from core client for 30 sec - exiting 14:12:17 (5804): No heartbeat from core client for 30 sec - exiting 14:12:18 (5804): No heartbeat from core client for 30 sec - exiting 14:12:19 (5804): No heartbeat from core client for 30 sec - exiting 14:12:20 (5804): No heartbeat from core client for 30 sec - exiting 14:12:21 (5804): No heartbeat from core client for 30 sec - exiting 14:12:22 (5804): No heartbeat from core client for 30 sec - exiting 14:12:23 (5804): No heartbeat from core client for 30 sec - exiting 14:12:24 (5804): No heartbeat from core client for 30 sec - exiting 14:12:25 (5804): No heartbeat from core client for 30 sec - exiting 14:12:26 (5804): No heartbeat from core client for 30 sec - exiting 14:12:27 (5804): No heartbeat from core client for 30 sec - exiting 14:12:28 (5804): No heartbeat from core client for 30 sec - exiting 14:12:29 (5804): No heartbeat from core client for 30 sec - exiting 14:13:12 (1872): start_timer_thread(): CreateThread() failed, errno 0 14:13:14 (864): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... 14:13:18 (6220): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:34:04 (1872): start_timer_thread(): CreateThread() failed, errno 0 21:34:05 (5128): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:54:23 (3312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:55:11 (5844): start_timer_thread(): CreateThread() failed, errno 0 12:54:28 (6068): No heartbeat from core client for 30 sec - exiting 12:54:29 (6068): No heartbeat from core client for 30 sec - exiting 12:54:30 (6068): No heartbeat from core client for 30 sec - exiting 12:54:31 (6068): No heartbeat from core client for 30 sec - exiting 12:54:32 (6068): No heartbeat from core client for 30 sec - exiting 12:54:33 (6068): No heartbeat from core client for 30 sec - exiting 12:54:34 (6068): No heartbeat from core client for 30 sec - exiting 12:54:35 (6068): No heartbeat from core client for 30 sec - exiting 12:54:36 (6068): No heartbeat from core client for 30 sec - exiting 12:54:37 (6068): No heartbeat from core client for 30 sec - exiting 12:54:38 (6068): No heartbeat from core client for 30 sec - exiting 12:54:39 (6068): No heartbeat from core client for 30 sec - exiting 12:54:40 (6068): No heartbeat from core client for 30 sec - exiting 12:54:41 (6068): No heartbeat from core client for 30 sec - exiting 12:54:42 (6068): No heartbeat from core client for 30 sec - exiting 12:54:43 (6068): No heartbeat from core client for 30 sec - exiting 12:54:44 (6068): No heartbeat from core client for 30 sec - exiting 12:54:45 (6068): No heartbeat from core client for 30 sec - exiting 12:54:46 (6068): No heartbeat from core client for 30 sec - exiting 12:54:47 (6068): No heartbeat from core client for 30 sec - exiting 12:54:48 (6068): No heartbeat from core client for 30 sec - exiting 12:54:49 (6068): No heartbeat from core client for 30 sec - exiting 12:54:50 (6068): No heartbeat from core client for 30 sec - exiting 12:54:51 (6068): No heartbeat from core client for 30 sec - exiting 12:54:52 (6068): No heartbeat from core client for 30 sec - exiting 12:54:53 (6068): No heartbeat from core client for 30 sec - exiting 12:54:54 (6068): No heartbeat from core client for 30 sec - exiting 12:54:55 (6068): No heartbeat from core client for 30 sec - exiting 12:54:56 (6068): No heartbeat from core client for 30 sec - exiting 12:54:57 (6068): No heartbeat from core client for 30 sec - exiting 12:54:58 (6068): No heartbeat from core client for 30 sec - exiting 12:54:59 (6068): No heartbeat from core client for 30 sec - exiting 12:55:00 (6068): No heartbeat from core client for 30 sec - exiting 12:55:41 (6016): start_timer_thread(): CreateThread() failed, errno 0 12:55:42 (3784): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... 11:08:13 (6712): start_timer_thread(): CreateThread() failed, errno 0 11:08:15 (2868): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 13:59:14 (5896): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 00:29:55 (4152): start_timer_thread(): CreateThread() failed, errno 0 00:29:56 (264): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:23:54 (4660): start_timer_thread(): CreateThread() failed, errno 0 12:23:56 (5624): start_timer_thread(): CreateThread() failed, errno 0 15:40:15 (4372): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 16:20:29 (1452): start_timer_thread(): CreateThread() failed, errno 0 16:20:31 (3196): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:38:07 (2012): start_timer_thread(): CreateThread() failed, errno 0 12:38:09 (6172): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 13:22:07 (3932): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 22:07:43 (9784): start_timer_thread(): CreateThread() failed, errno 0 22:07:44 (4900): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:16:46 (9412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:55:27 (1692): start_timer_thread(): CreateThread() failed, errno 0 11:55:29 (3444): start_timer_thread(): CreateThread() failed, errno 0 21:50:13 (5440): No heartbeat from core client for 30 sec - exiting 21:50:14 (5440): No heartbeat from core client for 30 sec - exiting 21:50:15 (5440): No heartbeat from core client for 30 sec - exiting 21:50:16 (5440): No heartbeat from core client for 30 sec - exiting 21:50:17 (5440): No heartbeat from core client for 30 sec - exiting 21:50:18 (5440): No heartbeat from core client for 30 sec - exiting 21:50:19 (5440): No heartbeat from core client for 30 sec - exiting 21:50:20 (5440): No heartbeat from core client for 30 sec - exiting 21:50:21 (5440): No heartbeat from core client for 30 sec - exiting 21:50:22 (5440): No heartbeat from core client for 30 sec - exiting 21:50:23 (5440): No heartbeat from core client for 30 sec - exiting 21:50:24 (5440): No heartbeat from core client for 30 sec - exiting 21:50:25 (5440): No heartbeat from core client for 30 sec - exiting 21:50:26 (5440): No heartbeat from core client for 30 sec - exiting 21:50:27 (5440): No heartbeat from core client for 30 sec - exiting 21:50:28 (5440): No heartbeat from core client for 30 sec - exiting 21:50:29 (5440): No heartbeat from core client for 30 sec - exiting 21:50:30 (5440): No heartbeat from core client for 30 sec - exiting 21:50:31 (5440): No heartbeat from core client for 30 sec - exiting 21:50:32 (5440): No heartbeat from core client for 30 sec - exiting 21:50:33 (5440): No heartbeat from core client for 30 sec - exiting 21:50:34 (5440): No heartbeat from core client for 30 sec - exiting 21:50:35 (5440): No heartbeat from core client for 30 sec - exiting 21:50:36 (5440): No heartbeat from core client for 30 sec - exiting 21:50:37 (5440): No heartbeat from core client for 30 sec - exiting 21:50:38 (5440): No heartbeat from core client for 30 sec - exiting 21:50:39 (5440): No heartbeat from core client for 30 sec - exiting 21:50:40 (5440): No heartbeat from core client for 30 sec - exiting 21:50:41 (5440): No heartbeat from core client for 30 sec - exiting 21:50:42 (5440): No heartbeat from core client for 30 sec - exiting 21:50:43 (5440): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 11:04:19 (5592): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 11:04:21 (5712): start_timer_thread(): CreateThread() failed, errno 0 17:06:14 (3264): start_timer_thread(): CreateThread() failed, errno 0 17:06:16 (5876): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 16:00:33 (6044): start_timer_thread(): CreateThread() failed, errno 0 16:00:35 (1520): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:37:31 (6128): start_timer_thread(): CreateThread() failed, errno 0 13:37:32 (6100): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 15:04:38 (4436): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 15:04:39 (4588): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:52:23 (4836): start_timer_thread(): CreateThread() failed, errno 0 16:52:25 (2404): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:05:21 (5724): No heartbeat from core client for 30 sec - exiting 18:05:22 (5724): No heartbeat from core client for 30 sec - exiting 18:05:23 (5724): No heartbeat from core client for 30 sec - exiting 18:05:24 (5724): No heartbeat from core client for 30 sec - exiting 18:05:25 (5724): No heartbeat from core client for 30 sec - exiting 18:05:26 (5724): No heartbeat from core client for 30 sec - exiting 18:05:27 (5724): No heartbeat from core client for 30 sec - exiting 18:05:28 (5724): No heartbeat from core client for 30 sec - exiting 18:05:29 (5724): No heartbeat from core client for 30 sec - exiting 18:05:30 (5724): No heartbeat from core client for 30 sec - exiting 18:05:32 (5724): No heartbeat from core client for 30 sec - exiting 18:05:33 (5724): No heartbeat from core client for 30 sec - exiting 18:05:34 (5724): No heartbeat from core client for 30 sec - exiting 18:05:35 (5724): No heartbeat from core client for 30 sec - exiting 18:05:36 (5724): No heartbeat from core client for 30 sec - exiting 18:05:37 (5724): No heartbeat from core client for 30 sec - exiting 18:05:38 (5724): No heartbeat from core client for 30 sec - exiting 18:05:39 (5724): No heartbeat from core client for 30 sec - exiting 18:05:40 (5724): No heartbeat from core client for 30 sec - exiting 18:05:41 (5724): No heartbeat from core client for 30 sec - exiting 18:05:42 (5724): No heartbeat from core client for 30 sec - exiting 18:05:44 (5724): No heartbeat from core client for 30 sec - exiting 18:05:45 (5724): No heartbeat from core client for 30 sec - exiting 18:05:46 (5724): No heartbeat from core client for 30 sec - exiting 18:05:47 (5724): No heartbeat from core client for 30 sec - exiting 18:05:48 (5724): No heartbeat from core client for 30 sec - exiting 18:05:49 (5724): No heartbeat from core client for 30 sec - exiting 13:43:03 (3708): start_timer_thread(): CreateThread() failed, errno 0 13:43:05 (4632): start_timer_thread(): CreateThread() failed, errno 0 14:15:05 (6128): start_timer_thread(): CreateThread() failed, errno 0 14:15:06 (828): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:28:20 (4908): start_timer_thread(): CreateThread() failed, errno 0 21:28:22 (4724): start_timer_thread(): CreateThread() failed, errno 0 12:38:25 (1948): start_timer_thread(): CreateThread() failed, errno 0 12:38:26 (1020): start_timer_thread(): CreateThread() failed, errno 0 21:21:35 (1300): start_timer_thread(): CreateThread() failed, errno 0 21:21:37 (4520): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakg.pipe_dummy 2048 Leaving CPDN_Main::Monitor... zip error: Could not create output file (was replacing the original zip file) Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_k32q_201212_12_306_010266539_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k32q_201212_12_306_010266539_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k32q_201212_12_306_010266539_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k32q_201212_12_306_010266539_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k32q_201212_12_306_010266539_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k32q_201212_12_306_010266539_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k32q_201212_12_306_010266539_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Feb 2016 20:01:01	1384210	19212169	hadam3p_anz_k32q_201212_12_306_010266539_0	57,899	440,090	7.6010
11 Feb 2016 13:28:41	1384210	19212169	hadam3p_anz_k32q_201212_12_306_010266539_0	46,379	356,061	7.6772
05 Feb 2016 13:42:03	1384210	19212169	hadam3p_anz_k32q_201212_12_306_010266539_0	34,859	269,238	7.7236
31 Jan 2016 13:39:09	1384210	19212169	hadam3p_anz_k32q_201212_12_306_010266539_0	23,339	182,544	7.8214
27 Jan 2016 16:52:17	1384210	19212169	hadam3p_anz_k32q_201212_12_306_010266539_0	11,819	91,869	7.7730