Task 19203433

Name	hadam3p_anz_q1kn_201212_12_290_010258538_2
Workunit	10258538
Created	16 Jan 2016, 5:25:38 UTC
Sent	16 Jan 2016, 5:25:50 UTC
Report deadline	28 Dec 2016, 10:45:50 UTC
Received	24 Jan 2016, 16:08:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1344317
Run time	2 days 17 hours 5 min 3 sec
CPU time	2 days 16 hours 15 min 52 sec
Validate state	Invalid
Credit	4,484.28
Device peak FLOPS	4.80 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <stderr_txt> 06:26:21 (12204): start_timer_thread(): CreateThread() failed, errno 0 06:26:23 (7504): start_timer_thread(): CreateThread() failed, errno 0 08:50:04 (6196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:23 (4012): start_timer_thread(): CreateThread() failed, errno 0 08:50:25 (5044): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:15:39 (9784): No heartbeat from core client for 30 sec - exiting 13:15:40 (9784): No heartbeat from core client for 30 sec - exiting 13:15:41 (9784): No heartbeat from core client for 30 sec - exiting 13:15:42 (9784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:50:19 (4728): No heartbeat from core client for 30 sec - exiting 16:50:20 (4728): No heartbeat from core client for 30 sec - exiting 16:50:21 (4728): No heartbeat from core client for 30 sec - exiting 16:50:22 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:59:54 (9752): No heartbeat from core client for 30 sec - exiting 00:59:55 (9752): No heartbeat from core client for 30 sec - exiting 00:59:57 (7296): start_timer_thread(): CreateThread() failed, errno 0 00:59:58 (1924): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... 01:00:03 (2952): start_timer_thread(): CreateThread() failed, errno 0 01:00:04 (9300): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:48:47 (11688): No heartbeat from core client for 30 sec - exiting 06:48:49 (11688): No heartbeat from core client for 30 sec - exiting 06:48:50 (11688): No heartbeat from core client for 30 sec - exiting 06:48:51 (11688): No heartbeat from core client for 30 sec - exiting 06:48:52 (11688): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 06:48:52 (1972): start_timer_thread(): CreateThread() failed, errno 0 06:48:54 (11492): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 06:49:14 (11976): start_timer_thread(): CreateThread() failed, errno 0 06:49:16 (4648): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:15:37 (7408): No heartbeat from core client for 30 sec - exiting 18:15:38 (7408): No heartbeat from core client for 30 sec - exiting 18:15:39 (7408): No heartbeat from core client for 30 sec - exiting 18:15:40 (7408): No heartbeat from core client for 30 sec - exiting 18:15:41 (7408): No heartbeat from core client for 30 sec - exiting 18:15:42 (7408): No heartbeat from core client for 30 sec - exiting 18:15:43 (7408): No heartbeat from core client for 30 sec - exiting 18:15:44 (7408): No heartbeat from core client for 30 sec - exiting 18:15:45 (7408): No heartbeat from core client for 30 sec - exiting 18:15:46 (7408): No heartbeat from core client for 30 sec - exiting 18:15:46 (11052): start_timer_thread(): CreateThread() failed, errno 0 18:15:47 (7408): No heartbeat from core client for 30 sec - exiting 18:15:48 (11088): start_timer_thread(): CreateThread() failed, errno 0 18:15:48 (7408): No heartbeat from core client for 30 sec - exiting 18:15:49 (7408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:53 (11220): start_timer_thread(): CreateThread() failed, errno 0 18:15:54 (10292): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 19:29:12 (7856): No heartbeat from core client for 30 sec - exiting 19:29:13 (7856): No heartbeat from core client for 30 sec - exiting 19:29:14 (7856): No heartbeat from core client for 30 sec - exiting 19:29:15 (7856): No heartbeat from core client for 30 sec - exiting 19:29:16 (7856): No heartbeat from core client for 30 sec - exiting 19:29:17 (7856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:23 (10692): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:48:08 (6088): No heartbeat from core client for 30 sec - exiting 06:48:09 (6088): No heartbeat from core client for 30 sec - exiting 06:48:10 (6088): No heartbeat from core client for 30 sec - exiting 06:48:11 (6088): No heartbeat from core client for 30 sec - exiting 06:48:12 (6088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:33:49 (11508): No heartbeat from core client for 30 sec - exiting 19:33:50 (11508): No heartbeat from core client for 30 sec - exiting 19:33:51 (11508): No heartbeat from core client for 30 sec - exiting 19:33:52 (11508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:07:44 (10056): No heartbeat from core client for 30 sec - exiting 16:07:45 (11048): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 16:07:45 (10056): No heartbeat from core client for 30 sec - exiting 16:07:46 (10056): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 16:07:46 (2888): start_timer_thread(): CreateThread() failed, errno 0 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 CPDN Monitor - No 'heartbeat' from BOINC... 16:07:50 (9820): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 16:07:52 (11028): start_timer_thread(): CreateThread() failed, errno 0 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11028, selfPID=6472, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_q1kn_201212_12_290_010258538_2_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_q1kn_201212_12_290_010258538_2_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_q1kn_201212_12_290_010258538_2_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Jan 2016 09:38:40	1344317	19203433	hadam3p_anz_q1kn_201212_12_290_010258538_2	103,979	225,296	2.1667
24 Jan 2016 02:44:24	1344317	19203433	hadam3p_anz_q1kn_201212_12_290_010258538_2	92,459	200,444	2.1679
23 Jan 2016 19:28:40	1344317	19203433	hadam3p_anz_q1kn_201212_12_290_010258538_2	80,939	175,291	2.1657
23 Jan 2016 09:00:56	1344317	19203433	hadam3p_anz_q1kn_201212_12_290_010258538_2	69,419	150,194	2.1636
22 Jan 2016 14:24:42	1344317	19203433	hadam3p_anz_q1kn_201212_12_290_010258538_2	57,899	125,420	2.1662
22 Jan 2016 07:17:07	1344317	19203433	hadam3p_anz_q1kn_201212_12_290_010258538_2	46,379	100,051	2.1572
19 Jan 2016 05:39:57	1344317	19203433	hadam3p_anz_q1kn_201212_12_290_010258538_2	34,859	75,333	2.1611
18 Jan 2016 13:17:40	1344317	19203433	hadam3p_anz_q1kn_201212_12_290_010258538_2	23,339	51,528	2.2078
18 Jan 2016 03:32:18	1344317	19203433	hadam3p_anz_q1kn_201212_12_290_010258538_2	11,819	26,155	2.2130