Task 18809216

Name	hadam3p_anz_a2x6_2008_1_010098807_0
Workunit	10078397
Created	12 Aug 2015, 17:26:04 UTC
Sent	16 Aug 2015, 17:47:32 UTC
Report deadline	28 Jul 2016, 23:07:32 UTC
Received	20 Jan 2016, 8:33:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1291695
Run time	22 hours 48 min 29 sec
CPU time	20 hours 34 min 48 sec
Validate state	Invalid
Credit	1,006.54
Device peak FLOPS	3.94 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:15:47 (10604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:41:01 (6936): No heartbeat from core client for 30 sec - exiting 19:41:02 (6936): No heartbeat from core client for 30 sec - exiting 19:41:03 (6936): No heartbeat from core client for 30 sec - exiting 19:41:04 (6936): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:41:20 (5392): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:41:22 (7892): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:42:52 (13224): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:42:54 (2560): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:03:38 (11940): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:03:44 (12512): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:24:08 (8612): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:24:10 (12168): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:00:11 (6120): No heartbeat from core client for 30 sec - exiting 23:00:12 (6120): No heartbeat from core client for 30 sec - exiting 23:00:13 (6120): No heartbeat from core client for 30 sec - exiting 23:00:14 (6120): No heartbeat from core client for 30 sec - exiting 23:00:15 (6120): No heartbeat from core client for 30 sec - exiting 23:00:16 (6120): No heartbeat from core client for 30 sec - exiting 23:00:17 (6120): No heartbeat from core client for 30 sec - exiting 23:00:18 (6120): No heartbeat from core client for 30 sec - exiting 23:00:19 (6120): No heartbeat from core client for 30 sec - exiting 23:00:20 (6120): No heartbeat from core client for 30 sec - exiting 23:00:21 (6120): No heartbeat from core client for 30 sec - exiting 23:00:22 (6120): No heartbeat from core client for 30 sec - exiting 23:00:23 (6120): No heartbeat from core client for 30 sec - exiting 23:00:24 (6120): No heartbeat from core client for 30 sec - exiting 23:00:25 (6120): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 23:00:25 (11168): start_timer_thread(): CreateThread() failed, errno 0 23:00:26 (6120): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 23:00:27 (10888): start_timer_thread(): CreateThread() failed, errno 0 23:00:27 (6120): No heartbeat from core client for 30 sec - exiting 23:00:28 (6120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:29:59 (7088): No heartbeat from core client for 30 sec - exiting 18:30:00 (7088): No heartbeat from core client for 30 sec - exiting 18:30:01 (7088): No heartbeat from core client for 30 sec - exiting 18:30:02 (7088): No heartbeat from core client for 30 sec - exiting 18:30:03 (7088): No heartbeat from core client for 30 sec - exiting 18:30:04 (7088): No heartbeat from core client for 30 sec - exiting 18:30:05 (7088): No heartbeat from core client for 30 sec - exiting 18:30:06 (7088): No heartbeat from core client for 30 sec - exiting 18:30:07 (7088): No heartbeat from core client for 30 sec - exiting 18:30:08 (7088): No heartbeat from core client for 30 sec - exiting 18:30:09 (7088): No heartbeat from core client for 30 sec - exiting 18:30:10 (7088): No heartbeat from core client for 30 sec - exiting 18:30:11 (7088): No heartbeat from core client for 30 sec - exiting 18:30:12 (7088): No heartbeat from core client for 30 sec - exiting 18:30:13 (7088): No heartbeat from core client for 30 sec - exiting 18:30:14 (7088): No heartbeat from core client for 30 sec - exiting 18:30:15 (7088): No heartbeat from core client for 30 sec - exiting 18:30:16 (7088): No heartbeat from core client for 30 sec - exiting 18:30:17 (7088): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 18:30:17 (10672): start_timer_thread(): CreateThread() failed, errno 0 18:30:18 (7088): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 18:30:19 (10968): start_timer_thread(): CreateThread() failed, errno 0 18:30:19 (7088): No heartbeat from core client for 30 sec - exiting 18:30:20 (7088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 18:31:07 (10704): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 18:31:08 (1644): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:20:39 (6376): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:20:41 (1584): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:02:48 (5952): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:02:49 (3648): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 21:04:32 (6192): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 21:04:34 (1208): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 22:41:37 (1996): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 22:41:39 (1284): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:24:50 (4296): No heartbeat from core client for 30 sec - exiting 19:24:51 (4296): No heartbeat from core client for 30 sec - exiting 19:24:52 (4296): No heartbeat from core client for 30 sec - exiting 19:24:53 (4296): No heartbeat from core client for 30 sec - exiting 19:24:54 (4296): No heartbeat from core client for 30 sec - exiting 19:24:55 (4296): No heartbeat from core client for 30 sec - exiting 19:24:56 (4296): No heartbeat from core client for 30 sec - exiting 19:24:57 (4296): No heartbeat from core client for 30 sec - exiting 19:24:58 (4296): No heartbeat from core client for 30 sec - exiting 19:24:59 (4296): No heartbeat from core client for 30 sec - exiting 19:25:00 (4296): No heartbeat from core client for 30 sec - exiting 19:25:01 (4296): No heartbeat from core client for 30 sec - exiting 19:25:02 (4296): No heartbeat from core client for 30 sec - exiting 19:25:03 (4296): No heartbeat from core client for 30 sec - exiting 19:25:04 (6096): start_timer_thread(): CreateThread() failed, errno 0 19:25:04 (4296): No heartbeat from core client for 30 sec - exiting 19:25:05 (4296): No heartbeat from core client for 30 sec - exiting 19:25:05 (10664): start_timer_thread(): CreateThread() failed, errno 0 19:25:06 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:25:10 (5696): start_timer_thread(): CreateThread() failed, errno 0 19:25:11 (700): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:48:52 (12104): start_timer_thread(): CreateThread() failed, errno 0 19:48:53 (9528): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:35:48 (11392): start_timer_thread(): CreateThread() failed, errno 0 21:35:50 (12152): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:35:24 (7052): No heartbeat from core client for 30 sec - exiting 23:35:25 (7052): No heartbeat from core client for 30 sec - exiting 23:35:26 (7052): No heartbeat from core client for 30 sec - exiting 23:35:27 (7052): No heartbeat from core client for 30 sec - exiting 23:35:28 (7052): No heartbeat from core client for 30 sec - exiting 23:35:28 (6672): start_timer_thread(): CreateThread() failed, errno 0 23:35:29 (7052): No heartbeat from core client for 30 sec - exiting 23:35:30 (7052): No heartbeat from core client for 30 sec - exiting 23:35:30 (5972): start_timer_thread(): CreateThread() failed, errno 0 23:35:31 (7052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:35:41 (1084): start_timer_thread(): CreateThread() failed, errno 0 23:35:43 (10896): start_timer_thread(): CreateThread() failed, errno 0 20:45:15 (4060): No heartbeat from core client for 30 sec - exiting 20:45:16 (4060): No heartbeat from core client for 30 sec - exiting 20:45:17 (4060): No heartbeat from core client for 30 sec - exiting 20:45:18 (4060): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:45:18 (10544): start_timer_thread(): CreateThread() failed, errno 0 20:45:19 (4060): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:45:20 (2420): start_timer_thread(): CreateThread() failed, errno 0 20:45:20 (4060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:45:31 (14276): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:45:33 (13720): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:52:04 (12656): start_timer_thread(): CreateThread() failed, errno 0 20:52:06 (9224): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:00:36 (12292): start_timer_thread(): CreateThread() failed, errno 0 21:00:38 (15272): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 21:33:20 (10144): start_timer_thread(): CreateThread() failed, errno 0 21:33:21 (6104): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:35:42 (3048): start_timer_thread(): CreateThread() failed, errno 0 22:35:42 (9512): No heartbeat from core client for 30 sec - exiting 22:35:43 (13576): start_timer_thread(): CreateThread() failed, errno 0 22:35:43 (9512): No heartbeat from core client for 30 sec - exiting 22:35:44 (9512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:35:47 (2880): start_timer_thread(): CreateThread() failed, errno 0 22:35:48 (1192): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:44:54 (12732): start_timer_thread(): CreateThread() failed, errno 0 22:44:56 (12212): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:56:56 (11432): start_timer_thread(): CreateThread() failed, errno 0 22:56:58 (10284): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:47:36 (9608): start_timer_thread(): CreateThread() failed, errno 0 20:47:37 (3328): No heartbeat from core client for 30 sec - exiting 20:47:38 (3328): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:47:38 (2496): start_timer_thread(): CreateThread() failed, errno 0 20:47:39 (3328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:47:41 (10284): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:47:43 (10936): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:32:26 (840): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 23:32:26 (2320): start_timer_thread(): CreateThread() failed, errno 0 23:32:27 (840): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 23:32:27 (9220): start_timer_thread(): CreateThread() failed, errno 0 23:32:28 (840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 23:32:34 (14696): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 23:32:35 (6836): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 00:18:22 (10464): start_timer_thread(): CreateThread() failed, errno 0 00:18:29 (7564): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=10464, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7564, selfPID=2168, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_a2x6_2008_1_010098807_0_3.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a2x6_2008_1_010098807_0_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a2x6_2008_1_010098807_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a2x6_2008_1_010098807_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a2x6_2008_1_010098807_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a2x6_2008_1_010098807_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a2x6_2008_1_010098807_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a2x6_2008_1_010098807_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a2x6_2008_1_010098807_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a2x6_2008_1_010098807_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Jan 2016 07:33:35	1291695	18809216	hadam3p_anz_a2x6_2008_1_010098807_0	23,339	69,398	2.9735
29 Nov 2015 06:37:37	1291695	18809216	hadam3p_anz_a2x6_2008_1_010098807_0	11,819	35,578	3.0102