Task 19420440

Name	hadcm3n_scoi_198012_480_375_010414775_0
Workunit	10414775
Created	21 Mar 2016, 16:46:09 UTC
Sent	21 Mar 2016, 17:55:25 UTC
Report deadline	3 Mar 2017, 23:15:25 UTC
Received	29 Jun 2016, 19:47:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1288468
Run time	1 days 5 hours 26 min 51 sec
CPU time	21 hours 50 min 11 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.20 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> 17:56:04 (18748): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:02:44 (18116): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:27:50 (9300): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:15:05 (13024): start_timer_thread(): CreateThread() failed, errno 0 09:16:17 (19264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:17:00 (17588): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:08:11 (7532): No heartbeat from core client for 30 sec - exiting 16:08:12 (7532): No heartbeat from core client for 30 sec - exiting 16:08:13 (7532): No heartbeat from core client for 30 sec - exiting 16:08:14 (7532): No heartbeat from core client for 30 sec - exiting 16:08:15 (7532): No heartbeat from core client for 30 sec - exiting 16:08:16 (7532): No heartbeat from core client for 30 sec - exiting 16:08:17 (7532): No heartbeat from core client for 30 sec - exiting 16:08:18 (7532): No heartbeat from core client for 30 sec - exiting 16:08:19 (7532): No heartbeat from core client for 30 sec - exiting 16:08:20 (7532): No heartbeat from core client for 30 sec - exiting 16:08:21 (7532): No heartbeat from core client for 30 sec - exiting 16:08:22 (7532): No heartbeat from core client for 30 sec - exiting 16:08:23 (7532): No heartbeat from core client for 30 sec - exiting 16:08:24 (7532): No heartbeat from core client for 30 sec - exiting 16:08:31 (8580): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... 16:08:34 (8784): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:47:59 (1620): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:10:25 (8808): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:04:54 (7760): No heartbeat from core client for 30 sec - exiting 20:04:55 (7760): No heartbeat from core client for 30 sec - exiting 20:04:56 (7760): No heartbeat from core client for 30 sec - exiting 20:04:57 (7760): No heartbeat from core client for 30 sec - exiting 20:04:58 (7760): No heartbeat from core client for 30 sec - exiting 20:04:59 (7760): No heartbeat from core client for 30 sec - exiting 20:05:00 (7760): No heartbeat from core client for 30 sec - exiting 20:05:00 (6320): start_timer_thread(): CreateThread() failed, errno 0 20:05:01 (7760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:06:56 (3056): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:26:08 (9412): start_timer_thread(): CreateThread() failed, errno 0 12:26:41 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:39 (9980): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:48:51 (10204): start_timer_thread(): CreateThread() failed, errno 0 15:48:52 (4132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:51:16 (8728): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:41:39 (6672): start_timer_thread(): CreateThread() failed, errno 0 18:41:46 (8072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:43:09 (7284): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:23:49 (5456): No heartbeat from core client for 30 sec - exiting 15:23:50 (5456): No heartbeat from core client for 30 sec - exiting 15:23:51 (5456): No heartbeat from core client for 30 sec - exiting 15:23:52 (5456): No heartbeat from core client for 30 sec - exiting 15:23:53 (5456): No heartbeat from core client for 30 sec - exiting 15:23:54 (2492): start_timer_thread(): CreateThread() failed, errno 0 15:23:54 (5456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:25:10 (1532): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:34:42 (4724): start_timer_thread(): CreateThread() failed, errno 0 16:35:02 (7836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:36:58 (10840): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 17:45:52 (7988): start_timer_thread(): CreateThread() failed, errno 0 17:46:02 (8212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:47:26 (7196): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 18:18:11 (7572): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:05:45 (9956): start_timer_thread(): CreateThread() failed, errno 0 19:05:53 (7992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:58 (12904): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:51:14 (4228): start_timer_thread(): CreateThread() failed, errno 0 12:51:25 (8492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:37 (4192): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 12:45:03 (7156): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:56:15 (1568): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:10:46 (9828): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 16:02:13 (12896): start_timer_thread(): CreateThread() failed, errno 0 19:36:39 (1152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:40 (1152): No heartbeat from core client for 30 sec - exiting 19:36:41 (1152): No heartbeat from core client for 30 sec - exiting 19:36:42 (1152): No heartbeat from core client for 30 sec - exiting 19:36:43 (1152): No heartbeat from core client for 30 sec - exiting 19:36:44 (1152): No heartbeat from core client for 30 sec - exiting 19:37:47 (1152): No heartbeat from core client for 30 sec - exiting 19:37:58 (12776): start_timer_thread(): CreateThread() failed, errno 0 Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:45:11 (9884): start_timer_thread(): CreateThread() failed, errno 0 14:45:17 (3476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:45:50 (6328): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:00:19 (9692): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:21:50 (8212): No heartbeat from core client for 30 sec - exiting 23:21:51 (8212): No heartbeat from core client for 30 sec - exiting 23:21:52 (8212): No heartbeat from core client for 30 sec - exiting 23:21:53 (8212): No heartbeat from core client for 30 sec - exiting 23:21:54 (9192): start_timer_thread(): CreateThread() failed, errno 0 23:21:54 (8212): No heartbeat from core client for 30 sec - exiting 23:21:55 (8212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:21:58 (3976): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 15:37:30 (6160): start_timer_thread(): CreateThread() failed, errno 0 15:17:18 (9344): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:59:46 (9344): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:55:50 (10924): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:53:17 (7704): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 15:51:55 (7032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:08:14 (10312): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 16:33:09 (2884): start_timer_thread(): CreateThread() failed, errno 0 16:38:07 (7452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:40:19 (12168): start_timer_thread(): CreateThread() failed, errno 0 Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12168, selfPID=12168, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:47:31 (7080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10984, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 14:27:04 (9164): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Jun 2016 16:10:29	1288468	19420440	hadcm3n_scoi_198012_480_375_010414775_0	259,200	97,043	0.3744
18 Jun 2016 18:21:40	1288468	19420440	hadcm3n_scoi_198012_480_375_010414775_0	233,280	49,381	0.2117
22 May 2016 19:36:38	1288468	19420440	hadcm3n_scoi_198012_480_375_010414775_0	207,360	35,069	0.1691
18 May 2016 17:41:29	1288468	19420440	hadcm3n_scoi_198012_480_375_010414775_0	181,440	30,469	0.1679
13 May 2016 17:09:55	1288468	19420440	hadcm3n_scoi_198012_480_375_010414775_0	155,520	7,029	0.0452
02 May 2016 17:07:02	1288468	19420440	hadcm3n_scoi_198012_480_375_010414775_0	129,600	4,807	0.0371
09 Apr 2016 18:58:15	1288468	19420440	hadcm3n_scoi_198012_480_375_010414775_0	103,680	7,626	0.0736
06 Apr 2016 18:43:51	1288468	19420440	hadcm3n_scoi_198012_480_375_010414775_0	77,760	15,232	0.1959
30 Mar 2016 16:50:56	1288468	19420440	hadcm3n_scoi_198012_480_375_010414775_0	51,840	12,865	0.2482
25 Mar 2016 17:52:35	1288468	19420440	hadcm3n_scoi_198012_480_375_010414775_0	25,920	8,123	0.3134