Task 16221269

Name	hadcm3n_o6d3_1980_40_008411200_2
Workunit	8562056
Created	14 Jan 2014, 1:13:54 UTC
Sent	14 Jan 2014, 1:39:59 UTC
Report deadline	15 Apr 2014, 9:07:10 UTC
Received	23 Jan 2014, 2:40:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1084069
Run time	6 days 15 hours 30 min 48 sec
CPU time	6 days 2 hours 49 min 20 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.06 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:49:19 (3672): No heartbeat from core client for 30 sec - exiting 07:49:21 (3672): No heartbeat from core client for 30 sec - exiting 07:49:22 (3672): No heartbeat from core client for 30 sec - exiting 07:49:23 (3672): No heartbeat from core client for 30 sec - exiting 07:49:24 (3672): No heartbeat from core client for 30 sec - exiting 07:49:25 (3672): No heartbeat from core client for 30 sec - exiting 07:49:26 (3672): No heartbeat from core client for 30 sec - exiting 07:49:27 (3672): No heartbeat from core client for 30 sec - exiting 07:49:28 (3672): No heartbeat from core client for 30 sec - exiting 07:49:29 (3672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:34:22 (9196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:48:58 (9264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:11:39 (8040): No heartbeat from core client for 30 sec - exiting 00:11:40 (8040): No heartbeat from core client for 30 sec - exiting 00:11:41 (8040): No heartbeat from core client for 30 sec - exiting 00:11:42 (8040): No heartbeat from core client for 30 sec - exiting 00:11:43 (8040): No heartbeat from core client for 30 sec - exiting 00:11:44 (8040): No heartbeat from core client for 30 sec - exiting 00:11:45 (8040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:48:57 (4584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:57:32 (2404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:19:28 (12056): No heartbeat from core client for 30 sec - exiting 19:19:29 (12056): No heartbeat from core client for 30 sec - exiting 19:19:30 (12056): No heartbeat from core client for 30 sec - exiting 19:19:31 (12056): No heartbeat from core client for 30 sec - exiting 19:19:32 (12056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:03:38 (13216): No heartbeat from core client for 30 sec - exiting 21:03:39 (13216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:03:40 (13216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:21:11 (10972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:13:51 (7740): No heartbeat from core client for 30 sec - exiting 00:13:52 (7740): No heartbeat from core client for 30 sec - exiting 00:13:53 (7740): No heartbeat from core client for 30 sec - exiting 00:13:54 (7740): No heartbeat from core client for 30 sec - exiting 00:13:55 (7740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:22:37 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:30:17 (8820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:52:22 (1296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:54:49 (8156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:38:34 (10788): No heartbeat from core client for 30 sec - exiting 16:38:36 (10788): No heartbeat from core client for 30 sec - exiting 16:38:37 (10788): No heartbeat from core client for 30 sec - exiting 16:38:38 (10788): No heartbeat from core client for 30 sec - exiting 16:38:39 (10788): No heartbeat from core client for 30 sec - exiting 16:38:40 (10788): No heartbeat from core client for 30 sec - exiting 16:38:41 (10788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:38:42 (10788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 16:51:30 (5532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:17:48 (9152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:05:51 (8764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:02:38 (8968): No heartbeat from core client for 30 sec - exiting 21:02:39 (8968): No heartbeat from core client for 30 sec - exiting 21:02:40 (8968): No heartbeat from core client for 30 sec - exiting 21:02:41 (8968): No heartbeat from core client for 30 sec - exiting 21:02:42 (8968): No heartbeat from core client for 30 sec - exiting 21:02:43 (8968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:36:26 (3792): No heartbeat from core client for 30 sec - exiting 00:36:27 (3792): No heartbeat from core client for 30 sec - exiting 00:36:28 (3792): No heartbeat from core client for 30 sec - exiting 00:36:29 (3792): No heartbeat from core client for 30 sec - exiting 00:36:30 (3792): No heartbeat from core client for 30 sec - exiting 00:36:31 (3792): No heartbeat from core client for 30 sec - exiting 00:36:32 (3792): No heartbeat from core client for 30 sec - exiting 00:36:33 (3792): No heartbeat from core client for 30 sec - exiting 00:36:34 (3792): No heartbeat from core client for 30 sec - exiting 00:36:35 (3792): No heartbeat from core client for 30 sec - exiting 00:36:36 (3792): No heartbeat from core client for 30 sec - exiting 00:36:37 (3792): No heartbeat from core client for 30 sec - exiting 00:36:38 (3792): No heartbeat from core client for 30 sec - exiting 00:36:39 (3792): No heartbeat from core client for 30 sec - exiting 00:36:40 (3792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:41:53 (15232): No heartbeat from core client for 30 sec - exiting 11:41:54 (15232): No heartbeat from core client for 30 sec - exiting 11:41:55 (15232): No heartbeat from core client for 30 sec - exiting 11:41:56 (15232): No heartbeat from core client for 30 sec - exiting 11:41:57 (15232): No heartbeat from core client for 30 sec - exiting 11:41:58 (15232): No heartbeat from core client for 30 sec - exiting 11:41:59 (15232): No heartbeat from core client for 30 sec - exiting 11:42:00 (15232): No heartbeat from core client for 30 sec - exiting 11:42:01 (15232): No heartbeat from core client for 30 sec - exiting 11:42:02 (15232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:23:37 (3524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:29:28 (15060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:30:26 (10260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:31:34 (15128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:50:09 (13040): No heartbeat from core client for 30 sec - exiting 00:50:10 (13040): No heartbeat from core client for 30 sec - exiting 00:50:11 (13040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:50:12 (13040): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:07:56 (12976): No heartbeat from core client for 30 sec - exiting 13:07:57 (12976): No heartbeat from core client for 30 sec - exiting 13:07:58 (12976): No heartbeat from core client for 30 sec - exiting 13:07:59 (12976): No heartbeat from core client for 30 sec - exiting 13:08:00 (12976): No heartbeat from core client for 30 sec - exiting 13:08:01 (12976): No heartbeat from core client for 30 sec - exiting 13:08:02 (12976): No heartbeat from core client for 30 sec - exiting 13:08:03 (12976): No heartbeat from core client for 30 sec - exiting 13:08:04 (12976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:12:14 (14964): No heartbeat from core client for 30 sec - exiting 00:12:15 (14964): No heartbeat from core client for 30 sec - exiting 00:12:16 (14964): No heartbeat from core client for 30 sec - exiting 00:12:17 (14964): No heartbeat from core client for 30 sec - exiting 00:12:18 (14964): No heartbeat from core client for 30 sec - exiting 00:12:19 (14964): No heartbeat from core client for 30 sec - exiting 00:12:20 (14964): No heartbeat from core client for 30 sec - exiting 00:12:21 (14964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:24:11 (14220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:56:02 (19144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:55:46 (24312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:37:37 (9460): No heartbeat from core client for 30 sec - exiting 23:37:38 (9460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:27 (1848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:39:08 (2064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:40:02 (1220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:40:58 (9292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:01:28 (6696): No heartbeat from core client for 30 sec - exiting 00:01:29 (6696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:30 (6696): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:53:23 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:51:52 (8876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:35:30 (14044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:49:56 (3888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:59:27 (5304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:01:56 (3932): No heartbeat from core client for 30 sec - exiting 00:01:57 (3932): No heartbeat from core client for 30 sec - exiting 00:01:58 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:20:38 (8448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:57:03 (3944): No heartbeat from core client for 30 sec - exiting 07:57:04 (3944): No heartbeat from core client for 30 sec - exiting 07:57:05 (3944): No heartbeat from core client for 30 sec - exiting 07:57:06 (3944): No heartbeat from core client for 30 sec - exiting 07:57:07 (3944): No heartbeat from core client for 30 sec - exiting 07:57:08 (3944): No heartbeat from core client for 30 sec - exiting 07:57:09 (3944): No heartbeat from core client for 30 sec - exiting 07:57:10 (3944): No heartbeat from core client for 30 sec - exiting 07:57:11 (3944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:57:12 (3944): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77513AC3 read attempt to address 0x4083FCB6 Engaging BOINC Windows Runtime Debugger... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Jan 2014 16:35:25	1084069	16221269	hadcm3n_o6d3_1980_40_008411200_2	259,200	518,030	1.9986
22 Jan 2014 00:06:45	1084069	16221269	hadcm3n_o6d3_1980_40_008411200_2	233,280	466,091	1.9980
21 Jan 2014 04:39:07	1084069	16221269	hadcm3n_o6d3_1980_40_008411200_2	207,360	414,009	1.9966
20 Jan 2014 09:40:29	1084069	16221269	hadcm3n_o6d3_1980_40_008411200_2	181,440	363,597	2.0040
19 Jan 2014 06:34:38	1084069	16221269	hadcm3n_o6d3_1980_40_008411200_2	155,520	313,221	2.0140
18 Jan 2014 01:35:26	1084069	16221269	hadcm3n_o6d3_1980_40_008411200_2	129,600	262,929	2.0288
17 Jan 2014 05:06:17	1084069	16221269	hadcm3n_o6d3_1980_40_008411200_2	103,680	210,130	2.0267
16 Jan 2014 09:18:35	1084069	16221269	hadcm3n_o6d3_1980_40_008411200_2	77,760	158,138	2.0337
15 Jan 2014 13:35:20	1084069	16221269	hadcm3n_o6d3_1980_40_008411200_2	51,840	105,842	2.0417
14 Jan 2014 18:10:02	1084069	16221269	hadcm3n_o6d3_1980_40_008411200_2	25,920	52,163	2.0125