Task 19231171

Name	hadam3p_anz_n1h0_201412_12_315_010279818_0
Workunit	10279818
Created	29 Jan 2016, 10:38:30 UTC
Sent	3 Feb 2016, 7:32:24 UTC
Report deadline	15 Jan 2017, 12:52:24 UTC
Received	29 Mar 2016, 20:24:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1371434
Run time	6 days 17 hours 27 min 28 sec
CPU time	6 days 13 hours 19 min 46 sec
Validate state	Invalid
Credit	5,477.92
Device peak FLOPS	2.98 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <stderr_txt> 07:32:59 (1108): start_timer_thread(): CreateThread() failed, errno 0 07:33:06 (760): start_timer_thread(): CreateThread() failed, errno 0 13:22:23 (6364): start_timer_thread(): CreateThread() failed, errno 0 13:22:24 (6396): start_timer_thread(): CreateThread() failed, errno 0 13:22:49 (9080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:30 (5264): start_timer_thread(): CreateThread() failed, errno 0 20:33:31 (2664): start_timer_thread(): CreateThread() failed, errno 0 20:34:02 (8144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:34:10 (6316): start_timer_thread(): CreateThread() failed, errno 0 21:40:27 (5708): No heartbeat from core client for 30 sec - exiting 21:40:28 (5708): No heartbeat from core client for 30 sec - exiting 21:40:29 (5708): No heartbeat from core client for 30 sec - exiting 21:40:31 (5708): No heartbeat from core client for 30 sec - exiting 21:40:32 (5708): No heartbeat from core client for 30 sec - exiting 21:40:33 (5708): No heartbeat from core client for 30 sec - exiting 21:40:34 (5708): No heartbeat from core client for 30 sec - exiting 21:40:35 (5708): No heartbeat from core client for 30 sec - exiting 21:40:36 (5708): No heartbeat from core client for 30 sec - exiting 21:40:37 (5708): No heartbeat from core client for 30 sec - exiting 21:40:38 (5708): No heartbeat from core client for 30 sec - exiting 21:40:39 (5708): No heartbeat from core client for 30 sec - exiting 21:40:40 (5708): No heartbeat from core client for 30 sec - exiting 21:40:41 (5708): No heartbeat from core client for 30 sec - exiting 21:40:43 (5708): No heartbeat from core client for 30 sec - exiting 21:40:44 (5708): No heartbeat from core client for 30 sec - exiting 21:40:45 (5708): No heartbeat from core client for 30 sec - exiting 21:40:46 (5708): No heartbeat from core client for 30 sec - exiting 21:40:47 (5708): No heartbeat from core client for 30 sec - exiting 21:40:48 (5708): No heartbeat from core client for 30 sec - exiting 21:40:49 (5748): start_timer_thread(): CreateThread() failed, errno 0 21:40:49 (5708): No heartbeat from core client for 30 sec - exiting 21:40:50 (5744): start_timer_thread(): CreateThread() failed, errno 0 21:40:50 (5708): No heartbeat from core client for 30 sec - exiting 21:40:51 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:05 (6284): start_timer_thread(): CreateThread() failed, errno 0 16:39:22 (4980): start_timer_thread(): CreateThread() failed, errno 0 20:52:55 (2496): start_timer_thread(): CreateThread() failed, errno 0 15:54:29 (888): start_timer_thread(): CreateThread() failed, errno 0 15:54:30 (5648): start_timer_thread(): CreateThread() failed, errno 0 15:54:59 (972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:04 (6944): start_timer_thread(): CreateThread() failed, errno 0 18:00:43 (3820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:01:01 (17920): start_timer_thread(): CreateThread() failed, errno 0 18:01:02 (18764): start_timer_thread(): CreateThread() failed, errno 0 20:20:28 (21280): start_timer_thread(): CreateThread() failed, errno 0 20:20:51 (4512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:20:57 (3564): start_timer_thread(): CreateThread() failed, errno 0 20:20:59 (11696): start_timer_thread(): CreateThread() failed, errno 0 21:23:33 (19856): start_timer_thread(): CreateThread() failed, errno 0 21:23:35 (21572): start_timer_thread(): CreateThread() failed, errno 0 18:36:04 (4108): start_timer_thread(): CreateThread() failed, errno 0 18:36:06 (5208): start_timer_thread(): CreateThread() failed, errno 0 21:17:27 (22228): start_timer_thread(): CreateThread() failed, errno 0 19:31:15 (19200): start_timer_thread(): CreateThread() failed, errno 0 19:31:15 (7136): start_timer_thread(): CreateThread() failed, errno 0 13:11:14 (12020): start_timer_thread(): CreateThread() failed, errno 0 13:11:14 (32020): start_timer_thread(): CreateThread() failed, errno 0 13:19:20 (4384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:19:56 (35408): start_timer_thread(): CreateThread() failed, errno 0 16:26:17 (34228): start_timer_thread(): CreateThread() failed, errno 0 19:18:42 (33240): start_timer_thread(): CreateThread() failed, errno 0 19:18:44 (35588): start_timer_thread(): CreateThread() failed, errno 0 19:18:58 (35328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:19:00 (32268): start_timer_thread(): CreateThread() failed, errno 0 19:59:41 (34252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:00:01 (31560): start_timer_thread(): CreateThread() failed, errno 0 20:00:03 (17304): start_timer_thread(): CreateThread() failed, errno 0 18:34:19 (4948): No heartbeat from core client for 30 sec - exiting 18:34:20 (4948): No heartbeat from core client for 30 sec - exiting 18:34:21 (4948): No heartbeat from core client for 30 sec - exiting 18:34:23 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:02:41 (3352): start_timer_thread(): CreateThread() failed, errno 0 22:02:42 (6484): start_timer_thread(): CreateThread() failed, errno 0 19:31:24 (7248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:24:04 (1408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:12 (8956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:03:21 (1400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:54:38 (7996): start_timer_thread(): CreateThread() failed, errno 0 00:54:40 (7080): start_timer_thread(): CreateThread() failed, errno 0 11:37:10 (7620): start_timer_thread(): CreateThread() failed, errno 0 11:37:11 (7768): start_timer_thread(): CreateThread() failed, errno 0 21:57:24 (9168): start_timer_thread(): CreateThread() failed, errno 0 21:57:26 (5652): start_timer_thread(): CreateThread() failed, errno 0 12:48:53 (1984): start_timer_thread(): CreateThread() failed, errno 0 12:48:53 (6692): start_timer_thread(): CreateThread() failed, errno 0 20:49:57 (5224): start_timer_thread(): CreateThread() failed, errno 0 20:49:58 (1624): start_timer_thread(): CreateThread() failed, errno 0 12:55:01 (8084): start_timer_thread(): CreateThread() failed, errno 0 12:55:02 (8240): start_timer_thread(): CreateThread() failed, errno 0 13:22:13 (7272): start_timer_thread(): CreateThread() failed, errno 0 13:22:14 (4368): start_timer_thread(): CreateThread() failed, errno 0 14:06:03 (5100): Can't acquire lockfile (32) - waiting 35s 14:06:08 (8544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:57:26 (6224): start_timer_thread(): CreateThread() failed, errno 0 19:57:28 (6196): start_timer_thread(): CreateThread() failed, errno 0 21:52:42 (10008): start_timer_thread(): CreateThread() failed, errno 0 21:52:43 (48208): start_timer_thread(): CreateThread() failed, errno 0 19:23:08 (52196): start_timer_thread(): CreateThread() failed, errno 0 19:23:10 (4276): start_timer_thread(): CreateThread() failed, errno 0 12:26:47 (1152): start_timer_thread(): CreateThread() failed, errno 0 12:26:49 (2520): start_timer_thread(): CreateThread() failed, errno 0 20:47:04 (3728): start_timer_thread(): CreateThread() failed, errno 0 20:47:07 (4992): start_timer_thread(): CreateThread() failed, errno 0 13:21:36 (2840): start_timer_thread(): CreateThread() failed, errno 0 13:21:38 (7004): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:37:13 (6700): start_timer_thread(): CreateThread() failed, errno 0 21:37:14 (9048): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:15:54 (1348): start_timer_thread(): CreateThread() failed, errno 0 23:15:56 (8768): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:09:33 (7756): start_timer_thread(): CreateThread() failed, errno 0 13:09:34 (8888): start_timer_thread(): CreateThread() failed, errno 0 12:30:33 (1748): start_timer_thread(): CreateThread() failed, errno 0 12:30:35 (4292): start_timer_thread(): CreateThread() failed, errno 0 16:58:47 (1428): No heartbeat from core client for 30 sec - exiting 16:58:48 (1428): No heartbeat from core client for 30 sec - exiting 16:58:49 (1428): No heartbeat from core client for 30 sec - exiting 16:58:50 (1428): No heartbeat from core client for 30 sec - exiting 16:58:51 (1428): No heartbeat from core client for 30 sec - exiting 16:58:52 (1428): No heartbeat from core client for 30 sec - exiting 16:58:54 (1428): No heartbeat from core client for 30 sec - exiting 16:58:55 (1428): No heartbeat from core client for 30 sec - exiting 16:58:56 (1428): No heartbeat from core client for 30 sec - exiting 16:58:57 (1428): No heartbeat from core client for 30 sec - exiting 16:58:58 (1428): No heartbeat from core client for 30 sec - exiting 16:58:59 (1428): No heartbeat from core client for 30 sec - exiting 16:59:00 (1428): No heartbeat from core client for 30 sec - exiting 16:59:01 (1428): No heartbeat from core client for 30 sec - exiting 16:59:02 (1428): No heartbeat from core client for 30 sec - exiting 16:59:03 (1428): No heartbeat from core client for 30 sec - exiting 16:59:05 (1428): No heartbeat from core client for 30 sec - exiting 16:59:06 (1428): No heartbeat from core client for 30 sec - exiting 16:59:07 (1428): No heartbeat from core client for 30 sec - exiting 16:59:08 (1428): No heartbeat from core client for 30 sec - exiting 16:59:09 (1428): No heartbeat from core client for 30 sec - exiting 16:59:10 (1428): No heartbeat from core client for 30 sec - exiting 16:59:11 (1428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:59:37 (4628): start_timer_thread(): CreateThread() failed, errno 0 21:54:45 (4848): start_timer_thread(): CreateThread() failed, errno 0 21:54:47 (7000): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:13:10 (9040): start_timer_thread(): CreateThread() failed, errno 0 22:13:12 (1676): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:45:02 (4540): start_timer_thread(): CreateThread() failed, errno 0 12:45:03 (8284): start_timer_thread(): CreateThread() failed, errno 0 20:36:07 (2264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:36 (6912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:50 (556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:19 (5436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:54:02 (6192): start_timer_thread(): CreateThread() failed, errno 0 18:54:04 (3320): start_timer_thread(): CreateThread() failed, errno 0 18:54:27 (3904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:54:34 (8980): start_timer_thread(): CreateThread() failed, errno 0 18:54:36 (6380): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:42:16 (8204): start_timer_thread(): CreateThread() failed, errno 0 19:00:37 (1144): start_timer_thread(): CreateThread() failed, errno 0 19:00:37 (4892): start_timer_thread(): CreateThread() failed, errno 0 20:43:17 (3992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:53:49 (8532): start_timer_thread(): CreateThread() failed, errno 0 21:53:49 (4924): start_timer_thread(): CreateThread() failed, errno 0 19:43:15 (6072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:30 (6740): start_timer_thread(): CreateThread() failed, errno 0 19:41:38 (7124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:43 (7520): start_timer_thread(): CreateThread() failed, errno 0 19:44:40 (1764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:44 (7708): start_timer_thread(): CreateThread() failed, errno 0 19:44:46 (4212): start_timer_thread(): CreateThread() failed, errno 0 20:38:09 (9116): start_timer_thread(): CreateThread() failed, errno 0 20:38:11 (7272): start_timer_thread(): CreateThread() failed, errno 0 20:11:11 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:26:10 (2024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:36:05 (5492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:05:17 (736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:33 (7916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:01 (10548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:17:14 (17204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:10:56 (2712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:14:07 (18084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:14:35 (3020): start_timer_thread(): CreateThread() failed, errno 0 07:14:37 (4672): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 07:16:40 (17688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:16:58 (7596): start_timer_thread(): CreateThread() failed, errno 0 07:56:58 (17084): No heartbeat from core client for 30 sec - exiting 07:56:59 (17084): No heartbeat from core client for 30 sec - exiting 07:57:01 (17084): No heartbeat from core client for 30 sec - exiting 07:57:02 (17084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:57:14 (13296): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 08:00:05 (2264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:00:14 (19104): start_timer_thread(): CreateThread() failed, errno 0 08:05:56 (16948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:06:35 (16752): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=16752, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16780, selfPID=2220, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n1h0_201412_12_315_010279818_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Mar 2016 20:37:47	1371434	19231171	hadam3p_anz_n1h0_201412_12_315_010279818_0	127,019	521,954	4.1093
05 Mar 2016 00:29:35	1371434	19231171	hadam3p_anz_n1h0_201412_12_315_010279818_0	115,499	474,201	4.1057
04 Mar 2016 05:19:07	1371434	19231171	hadam3p_anz_n1h0_201412_12_315_010279818_0	103,979	426,210	4.0990
02 Mar 2016 21:02:19	1371434	19231171	hadam3p_anz_n1h0_201412_12_315_010279818_0	92,459	377,936	4.0876
02 Mar 2016 00:21:41	1371434	19231171	hadam3p_anz_n1h0_201412_12_315_010279818_0	80,939	329,090	4.0659
01 Mar 2016 01:18:25	1371434	19231171	hadam3p_anz_n1h0_201412_12_315_010279818_0	69,419	280,803	4.0450
29 Feb 2016 00:40:53	1371434	19231171	hadam3p_anz_n1h0_201412_12_315_010279818_0	57,899	232,631	4.0179
27 Feb 2016 21:25:34	1371434	19231171	hadam3p_anz_n1h0_201412_12_315_010279818_0	46,379	184,442	3.9768
25 Feb 2016 01:07:10	1371434	19231171	hadam3p_anz_n1h0_201412_12_315_010279818_0	34,859	136,316	3.9105
23 Feb 2016 01:39:36	1371434	19231171	hadam3p_anz_n1h0_201412_12_315_010279818_0	23,339	87,899	3.7662
16 Feb 2016 19:39:21	1371434	19231171	hadam3p_anz_n1h0_201412_12_315_010279818_0	11,819	42,847	3.6253