Task 19239792

Name	hadam3p_anz_na3s_201412_12_315_010288342_0
Workunit	10288342
Created	29 Jan 2016, 13:15:44 UTC
Sent	30 Jan 2016, 16:18:44 UTC
Report deadline	11 Jan 2017, 21:38:44 UTC
Received	25 Feb 2016, 3:05:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1257567
Run time	8 days 1 hours 54 min 50 sec
CPU time	7 days 12 hours 41 min 32 sec
Validate state	Invalid
Credit	5,477.92
Device peak FLOPS	2.91 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> finish file present too long </message> <stderr_txt> 13:49:03 (10492): start_timer_thread(): CreateThread() failed, errno 0 13:49:04 (9712): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:20:41 (12088): start_timer_thread(): CreateThread() failed, errno 0 21:20:43 (7924): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:19:45 (5096): start_timer_thread(): CreateThread() failed, errno 0 22:19:46 (10540): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:58:35 (12432): start_timer_thread(): CreateThread() failed, errno 0 23:58:37 (10420): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:51:03 (12064): start_timer_thread(): CreateThread() failed, errno 0 00:51:04 (7832): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:32:59 (13796): start_timer_thread(): CreateThread() failed, errno 0 08:33:01 (9476): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:18:38 (13132): start_timer_thread(): CreateThread() failed, errno 0 10:18:40 (16120): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:02:45 (1292): start_timer_thread(): CreateThread() failed, errno 0 18:02:46 (10792): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:50:42 (14752): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:46:43 (944): start_timer_thread(): CreateThread() failed, errno 0 01:46:45 (2708): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:53:35 (1200): start_timer_thread(): CreateThread() failed, errno 0 13:53:37 (9300): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:35:53 (7684): start_timer_thread(): CreateThread() failed, errno 0 08:35:55 (7764): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:31:04 (10056): start_timer_thread(): CreateThread() failed, errno 0 00:31:06 (1552): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 05:46:21 (1668): start_timer_thread(): CreateThread() failed, errno 0 05:46:23 (996): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:10:31 (5732): start_timer_thread(): CreateThread() failed, errno 0 13:10:34 (1548): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:49:03 (7052): start_timer_thread(): CreateThread() failed, errno 0 18:49:05 (9724): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:46:43 (8832): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:33:28 (5632): start_timer_thread(): CreateThread() failed, errno 0 13:33:30 (7556): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:45:44 (10140): start_timer_thread(): CreateThread() failed, errno 0 13:45:46 (2520): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:49:50 (4420): start_timer_thread(): CreateThread() failed, errno 0 15:49:52 (2784): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 18:27:34 (9412): start_timer_thread(): CreateThread() failed, errno 0 18:27:37 (9392): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:58:04 (6308): start_timer_thread(): CreateThread() failed, errno 0 22:58:06 (6440): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:08:03 (2568): start_timer_thread(): CreateThread() failed, errno 0 09:08:05 (7828): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:05:44 (11160): start_timer_thread(): CreateThread() failed, errno 0 15:05:46 (5036): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:45:50 (10568): start_timer_thread(): CreateThread() failed, errno 0 19:45:52 (9160): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:56:44 (10796): start_timer_thread(): CreateThread() failed, errno 0 00:19:14 (7152): start_timer_thread(): CreateThread() failed, errno 0 00:19:16 (6432): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:41:53 (2796): start_timer_thread(): CreateThread() failed, errno 0 22:41:55 (1944): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:52:33 (5456): start_timer_thread(): CreateThread() failed, errno 0 13:52:35 (3912): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:16:38 (3544): start_timer_thread(): CreateThread() failed, errno 0 19:16:39 (6056): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:40:59 (5852): start_timer_thread(): CreateThread() failed, errno 0 08:41:01 (6032): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 08:38:17 (4004): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 08:38:19 (2044): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:56:27 (13576): start_timer_thread(): CreateThread() failed, errno 0 08:56:28 (16196): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 18:17:21 (17076): start_timer_thread(): CreateThread() failed, errno 0 18:17:23 (3532): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 23:20:21 (15760): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 23:20:23 (15060): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:39:21 (9616): start_timer_thread(): CreateThread() failed, errno 0 15:39:23 (9656): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:28:21 (10252): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:16:43 (11412): start_timer_thread(): CreateThread() failed, errno 0 16:16:45 (5600): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:38:48 (14156): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:55:02 (5096): start_timer_thread(): CreateThread() failed, errno 0 19:55:05 (9628): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 04:01:30 (14228): start_timer_thread(): CreateThread() failed, errno 0 04:01:32 (11300): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:53:05 (13252): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:07:49 (13624): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 00:46:23 (6896): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:48:06 (12584): start_timer_thread(): CreateThread() failed, errno 0 08:48:08 (10584): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:16:42 (8352): start_timer_thread(): CreateThread() failed, errno 0 13:16:44 (6892): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:29:50 (7560): start_timer_thread(): CreateThread() failed, errno 0 21:29:52 (14152): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7560, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14152, selfPID=6344, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 23:53:11 (6344): No heartbeat from core client for 30 sec - exiting 23:53:12 (6344): No heartbeat from core client for 30 sec - exiting Called boinc_finish 23:53:14 (6344): No heartbeat from core client for 30 sec - exiting 23:53:15 (6344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Feb 2016 19:29:46	1257567	19239792	hadam3p_anz_na3s_201412_12_315_010288342_0	127,019	627,665	4.9415
23 Feb 2016 14:53:45	1257567	19239792	hadam3p_anz_na3s_201412_12_315_010288342_0	115,499	570,009	4.9352
21 Feb 2016 16:44:18	1257567	19239792	hadam3p_anz_na3s_201412_12_315_010288342_0	103,979	511,712	4.9213
20 Feb 2016 01:44:34	1257567	19239792	hadam3p_anz_na3s_201412_12_315_010288342_0	92,459	459,611	4.9710
18 Feb 2016 05:34:39	1257567	19239792	hadam3p_anz_na3s_201412_12_315_010288342_0	80,939	398,606	4.9248
17 Feb 2016 01:01:03	1257567	19239792	hadam3p_anz_na3s_201412_12_315_010288342_0	69,419	335,803	4.8373
11 Feb 2016 00:02:19	1257567	19239792	hadam3p_anz_na3s_201412_12_315_010288342_0	57,899	275,931	4.7657
08 Feb 2016 01:14:27	1257567	19239792	hadam3p_anz_na3s_201412_12_315_010288342_0	46,379	216,019	4.6577
04 Feb 2016 17:50:38	1257567	19239792	hadam3p_anz_na3s_201412_12_315_010288342_0	34,859	155,588	4.4634
03 Feb 2016 03:25:01	1257567	19239792	hadam3p_anz_na3s_201412_12_315_010288342_0	23,339	96,685	4.1426
01 Feb 2016 17:48:48	1257567	19239792	hadam3p_anz_na3s_201412_12_315_010288342_0	11,819	47,426	4.0127