Task 15812776

Name	hadcm3n_o4tc_1940_40_008381478_0
Workunit	8532337
Created	1 Jun 2013, 1:30:39 UTC
Sent	14 Jun 2013, 18:04:21 UTC
Report deadline	14 Sep 2013, 1:31:32 UTC
Received	26 Jul 2013, 10:22:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1245161
Run time	10 days 4 hours 56 min 8 sec
CPU time	9 days 15 hours 12 min 17 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.59 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:57:21 (5768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5600, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 09:14:52 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:03:27 (5332): No heartbeat from core client for 30 sec - exiting 10:03:28 (5332): No heartbeat from core client for 30 sec - exiting 10:03:29 (5332): No heartbeat from core client for 30 sec - exiting 10:03:30 (5332): No heartbeat from core client for 30 sec - exiting 10:03:31 (5332): No heartbeat from core client for 30 sec - exiting 10:03:32 (5332): No heartbeat from core client for 30 sec - exiting 10:03:33 (5332): No heartbeat from core client for 30 sec - exiting 10:03:34 (5332): No heartbeat from core client for 30 sec - exiting 10:03:35 (5332): No heartbeat from core client for 30 sec - exiting 10:03:36 (5332): No heartbeat from core client for 30 sec - exiting 10:03:37 (5332): No heartbeat from core client for 30 sec - exiting 10:03:38 (5332): No heartbeat from core client for 30 sec - exiting 10:03:39 (5332): No heartbeat from core client for 30 sec - exiting 10:03:40 (5332): No heartbeat from core client for 30 sec - exiting 10:03:41 (5332): No heartbeat from core client for 30 sec - exiting 10:03:42 (5332): No heartbeat from core client for 30 sec - exiting 10:03:43 (5332): No heartbeat from core client for 30 sec - exiting 10:03:44 (5332): No heartbeat from core client for 30 sec - exiting 10:03:45 (5332): No heartbeat from core client for 30 sec - exiting 10:03:46 (5332): No heartbeat from core client for 30 sec - exiting 10:03:47 (5332): No heartbeat from core client for 30 sec - exiting 10:03:48 (5332): No heartbeat from core client for 30 sec - exiting 10:03:49 (5332): No heartbeat from core client for 30 sec - exiting 10:03:50 (5332): No heartbeat from core client for 30 sec - exiting 10:03:51 (5332): No heartbeat from core client for 30 sec - exiting 10:03:52 (5332): No heartbeat from core client for 30 sec - exiting 10:03:53 (5332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:04:44 (884): No heartbeat from core client for 30 sec - exiting 18:04:46 (884): No heartbeat from core client for 30 sec - exiting 18:04:47 (884): No heartbeat from core client for 30 sec - exiting 18:04:48 (884): No heartbeat from core client for 30 sec - exiting 18:04:49 (884): No heartbeat from core client for 30 sec - exiting 18:04:50 (884): No heartbeat from core client for 30 sec - exiting 18:04:51 (884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4968, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 10:01:38 (4392): No heartbeat from core client for 30 sec - exiting 10:01:39 (4392): No heartbeat from core client for 30 sec - exiting 10:01:40 (4392): No heartbeat from core client for 30 sec - exiting 10:01:41 (4392): No heartbeat from core client for 30 sec - exiting 10:01:42 (4392): No heartbeat from core client for 30 sec - exiting 10:01:43 (4392): No heartbeat from core client for 30 sec - exiting 10:01:44 (4392): No heartbeat from core client for 30 sec - exiting 10:01:45 (4392): No heartbeat from core client for 30 sec - exiting 10:01:46 (4392): No heartbeat from core client for 30 sec - exiting 10:01:47 (4392): No heartbeat from core client for 30 sec - exiting 10:01:48 (4392): No heartbeat from core client for 30 sec - exiting 10:01:49 (4392): No heartbeat from core client for 30 sec - exiting 10:01:50 (4392): No heartbeat from core client for 30 sec - exiting 10:01:51 (4392): No heartbeat from core client for 30 sec - exiting 10:01:52 (4392): No heartbeat from core client for 30 sec - exiting 10:01:53 (4392): No heartbeat from core client for 30 sec - exiting 10:01:54 (4392): No heartbeat from core client for 30 sec - exiting 10:01:55 (4392): No heartbeat from core client for 30 sec - exiting 10:01:56 (4392): No heartbeat from core client for 30 sec - exiting 10:01:57 (4392): No heartbeat from core client for 30 sec - exiting 10:01:58 (4392): No heartbeat from core client for 30 sec - exiting 10:01:59 (4392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4740, iMonCtr=1 Model crash detected, will try to restart... 16:58:03 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:00:54 (5148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:49:10 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:03:02 (6076): No heartbeat from core client for 30 sec - exiting 10:03:03 (6076): No heartbeat from core client for 30 sec - exiting 10:03:04 (6076): No heartbeat from core client for 30 sec - exiting 10:03:05 (6076): No heartbeat from core client for 30 sec - exiting 10:03:06 (6076): No heartbeat from core client for 30 sec - exiting 10:03:07 (6076): No heartbeat from core client for 30 sec - exiting 10:03:08 (6076): No heartbeat from core client for 30 sec - exiting 10:03:09 (6076): No heartbeat from core client for 30 sec - exiting 10:03:10 (6076): No heartbeat from core client for 30 sec - exiting 10:03:11 (6076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:25:35 (6068): No heartbeat from core client for 30 sec - exiting 10:25:37 (6068): No heartbeat from core client for 30 sec - exiting 10:25:38 (6068): No heartbeat from core client for 30 sec - exiting 10:25:39 (6068): No heartbeat from core client for 30 sec - exiting 10:25:40 (6068): No heartbeat from core client for 30 sec - exiting 10:25:41 (6068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:43:30 (4628): No heartbeat from core client for 30 sec - exiting 18:43:31 (4628): No heartbeat from core client for 30 sec - exiting 18:43:32 (4628): No heartbeat from core client for 30 sec - exiting 18:43:33 (4628): No heartbeat from core client for 30 sec - exiting 18:43:34 (4628): No heartbeat from core client for 30 sec - exiting 18:43:35 (4628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:00:18 (3688): No heartbeat from core client for 30 sec - exiting 10:00:19 (3688): No heartbeat from core client for 30 sec - exiting 10:00:20 (3688): No heartbeat from core client for 30 sec - exiting 10:00:21 (3688): No heartbeat from core client for 30 sec - exiting 10:00:22 (3688): No heartbeat from core client for 30 sec - exiting 10:00:23 (3688): No heartbeat from core client for 30 sec - exiting 10:00:24 (3688): No heartbeat from core client for 30 sec - exiting 10:00:25 (3688): No heartbeat from core client for 30 sec - exiting 10:00:26 (3688): No heartbeat from core client for 30 sec - exiting 10:00:27 (3688): No heartbeat from core client for 30 sec - exiting 10:00:28 (3688): No heartbeat from core client for 30 sec - exiting 10:00:29 (3688): No heartbeat from core client for 30 sec - exiting 10:00:30 (3688): No heartbeat from core client for 30 sec - exiting 10:00:31 (3688): No heartbeat from core client for 30 sec - exiting 10:00:32 (3688): No heartbeat from core client for 30 sec - exiting 10:00:33 (3688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:10:06 (5104): No heartbeat from core client for 30 sec - exiting 17:10:07 (5104): No heartbeat from core client for 30 sec - exiting 17:10:08 (5104): No heartbeat from core client for 30 sec - exiting 17:10:09 (5104): No heartbeat from core client for 30 sec - exiting 17:10:10 (5104): No heartbeat from core client for 30 sec - exiting 17:10:11 (5104): No heartbeat from core client for 30 sec - exiting 17:10:12 (5104): No heartbeat from core client for 30 sec - exiting 17:10:13 (5104): No heartbeat from core client for 30 sec - exiting 17:10:14 (5104): No heartbeat from core client for 30 sec - exiting 17:10:15 (5104): No heartbeat from core client for 30 sec - exiting 17:10:16 (5104): No heartbeat from core client for 30 sec - exiting 17:10:17 (5104): No heartbeat from core client for 30 sec - exiting 17:10:18 (5104): No heartbeat from core client for 30 sec - exiting 17:10:19 (5104): No heartbeat from core client for 30 sec - exiting 17:10:20 (5104): No heartbeat from core client for 30 sec - exiting 17:10:21 (5104): No heartbeat from core client for 30 sec - exiting 17:10:22 (5104): No heartbeat from core client for 30 sec - exiting 17:10:23 (5104): No heartbeat from core client for 30 sec - exiting 17:10:24 (5104): No heartbeat from core client for 30 sec - exiting 17:10:25 (5104): No heartbeat from core client for 30 sec - exiting 17:10:26 (5104): No heartbeat from core client for 30 sec - exiting 17:10:27 (5104): No heartbeat from core client for 30 sec - exiting 17:10:28 (5104): No heartbeat from core client for 30 sec - exiting 17:10:29 (5104): No heartbeat from core client for 30 sec - exiting 17:10:30 (5104): No heartbeat from core client for 30 sec - exiting 17:10:31 (5104): No heartbeat from core client for 30 sec - exiting 17:10:32 (5104): No heartbeat from core client for 30 sec - exiting 17:10:33 (5104): No heartbeat from core client for 30 sec - exiting 17:10:34 (5104): No heartbeat from core client for 30 sec - exiting 17:10:35 (5104): No heartbeat from core client for 30 sec - exiting 17:10:36 (5104): No heartbeat from core client for 30 sec - exiting 17:10:37 (5104): No heartbeat from core client for 30 sec - exiting 17:10:38 (5104): No heartbeat from core client for 30 sec - exiting 17:10:39 (5104): No heartbeat from core client for 30 sec - exiting 17:10:40 (5104): No heartbeat from core client for 30 sec - exiting 17:10:41 (5104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:04:24 (5176): No heartbeat from core client for 30 sec - exiting 10:04:25 (5176): No heartbeat from core client for 30 sec - exiting 10:04:26 (5176): No heartbeat from core client for 30 sec - exiting 10:04:27 (5176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:21 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:48:40 (5912): No heartbeat from core client for 30 sec - exiting 17:48:41 (5912): No heartbeat from core client for 30 sec - exiting 17:48:42 (5912): No heartbeat from core client for 30 sec - exiting 17:48:43 (5912): No heartbeat from core client for 30 sec - exiting 17:48:44 (5912): No heartbeat from core client for 30 sec - exiting 17:48:45 (5912): No heartbeat from core client for 30 sec - exiting 17:48:46 (5912): No heartbeat from core client for 30 sec - exiting 17:48:47 (5912): No heartbeat from core client for 30 sec - exiting 17:48:48 (5912): No heartbeat from core client for 30 sec - exiting 17:48:49 (5912): No heartbeat from core client for 30 sec - exiting 17:48:50 (5912): No heartbeat from core client for 30 sec - exiting 17:48:51 (5912): No heartbeat from core client for 30 sec - exiting 17:48:52 (5912): No heartbeat from core client for 30 sec - exiting 17:48:53 (5912): No heartbeat from core client for 30 sec - exiting 17:48:54 (5912): No heartbeat from core client for 30 sec - exiting 17:48:55 (5912): No heartbeat from core client for 30 sec - exiting 17:48:56 (5912): No heartbeat from core client for 30 sec - exiting 17:48:57 (5912): No heartbeat from core client for 30 sec - exiting 17:48:58 (5912): No heartbeat from core client for 30 sec - exiting 17:48:59 (5912): No heartbeat from core client for 30 sec - exiting 17:49:00 (5912): No heartbeat from core client for 30 sec - exiting 17:49:01 (5912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:03:03 (4388): No heartbeat from core client for 30 sec - exiting 10:03:04 (4388): No heartbeat from core client for 30 sec - exiting 10:03:05 (4388): No heartbeat from core client for 30 sec - exiting 10:03:06 (4388): No heartbeat from core client for 30 sec - exiting 10:03:07 (4388): No heartbeat from core client for 30 sec - exiting 10:03:08 (4388): No heartbeat from core client for 30 sec - exiting 10:03:09 (4388): No heartbeat from core client for 30 sec - exiting 10:03:10 (4388): No heartbeat from core client for 30 sec - exiting 10:03:11 (4388): No heartbeat from core client for 30 sec - exiting 10:03:12 (4388): No heartbeat from core client for 30 sec - exiting 10:03:13 (4388): No heartbeat from core client for 30 sec - exiting 10:03:14 (4388): No heartbeat from core client for 30 sec - exiting 10:03:15 (4388): No heartbeat from core client for 30 sec - exiting 10:03:16 (4388): No heartbeat from core client for 30 sec - exiting 10:03:17 (4388): No heartbeat from core client for 30 sec - exiting 10:03:18 (4388): No heartbeat from core client for 30 sec - exiting 10:03:19 (4388): No heartbeat from core client for 30 sec - exiting 10:03:20 (4388): No heartbeat from core client for 30 sec - exiting 10:03:21 (4388): No heartbeat from core client for 30 sec - exiting 10:03:22 (4388): No heartbeat from core client for 30 sec - exiting 10:03:23 (4388): No heartbeat from core client for 30 sec - exiting 10:03:24 (4388): No heartbeat from core client for 30 sec - exiting 10:03:25 (4388): No heartbeat from core client for 30 sec - exiting 10:03:26 (4388): No heartbeat from core client for 30 sec - exiting 10:03:27 (4388): No heartbeat from core client for 30 sec - exiting 10:03:28 (4388): No heartbeat from core client for 30 sec - exiting 10:03:29 (4388): No heartbeat from core client for 30 sec - exiting 10:03:30 (4388): No heartbeat from core client for 30 sec - exiting 10:03:31 (4388): No heartbeat from core client for 30 sec - exiting 10:03:32 (4388): No heartbeat from core client for 30 sec - exiting 10:03:33 (4388): No heartbeat from core client for 30 sec - exiting 10:03:34 (4388): No heartbeat from core client for 30 sec - exiting 10:03:35 (4388): No heartbeat from core client for 30 sec - exiting 10:03:36 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:01:53 (4716): No heartbeat from core client for 30 sec - exiting 17:01:54 (4716): No heartbeat from core client for 30 sec - exiting 17:01:55 (4716): No heartbeat from core client for 30 sec - exiting 17:01:56 (4716): No heartbeat from core client for 30 sec - exiting 17:01:57 (4716): No heartbeat from core client for 30 sec - exiting 17:01:58 (4716): No heartbeat from core client for 30 sec - exiting 17:01:59 (4716): No heartbeat from core client for 30 sec - exiting 17:02:00 (4716): No heartbeat from core client for 30 sec - exiting 17:02:01 (4716): No heartbeat from core client for 30 sec - exiting 17:02:02 (4716): No heartbeat from core client for 30 sec - exiting 17:02:03 (4716): No heartbeat from core client for 30 sec - exiting 17:02:04 (4716): No heartbeat from core client for 30 sec - exiting 17:02:05 (4716): No heartbeat from core client for 30 sec - exiting 17:02:06 (4716): No heartbeat from core client for 30 sec - exiting 17:02:07 (4716): No heartbeat from core client for 30 sec - exiting 17:02:08 (4716): No heartbeat from core client for 30 sec - exiting 17:02:09 (4716): No heartbeat from core client for 30 sec - exiting 17:02:10 (4716): No heartbeat from core client for 30 sec - exiting 17:02:11 (4716): No heartbeat from core client for 30 sec - exiting 17:02:12 (4716): No heartbeat from core client for 30 sec - exiting 17:02:13 (4716): No heartbeat from core client for 30 sec - exiting 17:02:14 (4716): No heartbeat from core client for 30 sec - exiting 17:02:15 (4716): No heartbeat from core client for 30 sec - exiting 17:02:16 (4716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:43:35 (6708): No heartbeat from core client for 30 sec - exiting 10:43:36 (6708): No heartbeat from core client for 30 sec - exiting 10:43:37 (6708): No heartbeat from core client for 30 sec - exiting 10:43:38 (6708): No heartbeat from core client for 30 sec - exiting 10:43:39 (6708): No heartbeat from core client for 30 sec - exiting 10:43:40 (6708): No heartbeat from core client for 30 sec - exiting 10:43:41 (6708): No heartbeat from core client for 30 sec - exiting 10:43:42 (6708): No heartbeat from core client for 30 sec - exiting 10:43:43 (6708): No heartbeat from core client for 30 sec - exiting 10:43:44 (6708): No heartbeat from core client for 30 sec - exiting 10:43:45 (6708): No heartbeat from core client for 30 sec - exiting 10:43:46 (6708): No heartbeat from core client for 30 sec - exiting 10:43:47 (6708): No heartbeat from core client for 30 sec - exiting 10:43:48 (6708): No heartbeat from core client for 30 sec - exiting 10:43:49 (6708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:00:55 (1240): No heartbeat from core client for 30 sec - exiting 17:00:56 (1240): No heartbeat from core client for 30 sec - exiting 17:00:57 (1240): No heartbeat from core client for 30 sec - exiting 17:00:58 (1240): No heartbeat from core client for 30 sec - exiting 17:00:59 (1240): No heartbeat from core client for 30 sec - exiting 17:01:00 (1240): No heartbeat from core client for 30 sec - exiting 17:01:01 (1240): No heartbeat from core client for 30 sec - exiting 17:01:02 (1240): No heartbeat from core client for 30 sec - exiting 17:01:03 (1240): No heartbeat from core client for 30 sec - exiting 17:01:04 (1240): No heartbeat from core client for 30 sec - exiting 17:01:05 (1240): No heartbeat from core client for 30 sec - exiting 17:01:06 (1240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:04:59 (3620): No heartbeat from core client for 30 sec - exiting 17:05:00 (3620): No heartbeat from core client for 30 sec - exiting 17:05:01 (3620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:05:02 (3620): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:00:04 (6200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:54:43 (4132): No heartbeat from core client for 30 sec - exiting 16:54:44 (4132): No heartbeat from core client for 30 sec - exiting 16:54:45 (4132): No heartbeat from core client for 30 sec - exiting 16:54:46 (4132): No heartbeat from core client for 30 sec - exiting 16:54:47 (4132): No heartbeat from core client for 30 sec - exiting 16:54:48 (4132): No heartbeat from core client for 30 sec - exiting 16:54:49 (4132): No heartbeat from core client for 30 sec - exiting 16:54:50 (4132): No heartbeat from core client for 30 sec - exiting 16:54:51 (4132): No heartbeat from core client for 30 sec - exiting 16:54:52 (4132): No heartbeat from core client for 30 sec - exiting 16:54:53 (4132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:04:12 (5884): No heartbeat from core client for 30 sec - exiting 10:04:13 (5884): No heartbeat from core client for 30 sec - exiting 10:04:14 (5884): No heartbeat from core client for 30 sec - exiting 10:04:15 (5884): No heartbeat from core client for 30 sec - exiting 10:04:16 (5884): No heartbeat from core client for 30 sec - exiting 10:04:17 (5884): No heartbeat from core client for 30 sec - exiting 10:04:18 (5884): No heartbeat from core client for 30 sec - exiting 10:04:19 (5884): No heartbeat from core client for 30 sec - exiting 10:04:20 (5884): No heartbeat from core client for 30 sec - exiting 10:04:21 (5884): No heartbeat from core client for 30 sec - exiting 10:04:22 (5884): No heartbeat from core client for 30 sec - exiting 10:04:23 (5884): No heartbeat from core client for 30 sec - exiting 10:04:24 (5884): No heartbeat from core client for 30 sec - exiting 10:04:25 (5884): No heartbeat from core client for 30 sec - exiting 10:04:26 (5884): No heartbeat from core client for 30 sec - exiting 10:04:27 (5884): No heartbeat from core client for 30 sec - exiting 10:04:28 (5884): No heartbeat from core client for 30 sec - exiting 10:04:29 (5884): No heartbeat from core client for 30 sec - exiting 10:04:30 (5884): No heartbeat from core client for 30 sec - exiting 10:04:31 (5884): No heartbeat from core client for 30 sec - exiting 10:04:32 (5884): No heartbeat from core client for 30 sec - exiting 10:04:33 (5884): No heartbeat from core client for 30 sec - exiting 10:04:34 (5884): No heartbeat from core client for 30 sec - exiting 10:04:35 (5884): No heartbeat from core client for 30 sec - exiting 10:04:36 (5884): No heartbeat from core client for 30 sec - exiting 10:04:37 (5884): No heartbeat from core client for 30 sec - exiting 10:04:38 (5884): No heartbeat from core client for 30 sec - exiting 10:04:39 (5884): No heartbeat from core client for 30 sec - exiting 10:04:40 (5884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:04:41 (5884): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:00:20 (4412): No heartbeat from core client for 30 sec - exiting 13:00:21 (4412): No heartbeat from core client for 30 sec - exiting 13:00:22 (4412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:23 (4412): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:03:55 (3940): No heartbeat from core client for 30 sec - exiting 10:03:56 (3940): No heartbeat from core client for 30 sec - exiting 10:03:57 (3940): No heartbeat from core client for 30 sec - exiting 10:03:58 (3940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:02:17 (6072): No heartbeat from core client for 30 sec - exiting 17:02:19 (6072): No heartbeat from core client for 30 sec - exiting 17:02:20 (6072): No heartbeat from core client for 30 sec - exiting 17:02:21 (6072): No heartbeat from core client for 30 sec - exiting 17:02:22 (6072): No heartbeat from core client for 30 sec - exiting 17:02:23 (6072): No heartbeat from core client for 30 sec - exiting 17:02:24 (6072): No heartbeat from core client for 30 sec - exiting 17:02:25 (6072): No heartbeat from core client for 30 sec - exiting 17:02:26 (6072): No heartbeat from core client for 30 sec - exiting 17:02:27 (6072): No heartbeat from core client for 30 sec - exiting 17:02:28 (6072): No heartbeat from core client for 30 sec - exiting 17:02:29 (6072): No heartbeat from core client for 30 sec - exiting 17:02:30 (6072): No heartbeat from core client for 30 sec - exiting 17:02:31 (6072): No heartbeat from core client for 30 sec - exiting 17:02:32 (6072): No heartbeat from core client for 30 sec - exiting 17:02:33 (6072): No heartbeat from core client for 30 sec - exiting 17:02:34 (6072): No heartbeat from core client for 30 sec - exiting 17:02:35 (6072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:01:01 (176): No heartbeat from core client for 30 sec - exiting 10:01:02 (176): No heartbeat from core client for 30 sec - exiting 10:01:03 (176): No heartbeat from core client for 30 sec - exiting 10:01:04 (176): No heartbeat from core client for 30 sec - exiting 10:01:05 (176): No heartbeat from core client for 30 sec - exiting 10:01:06 (176): No heartbeat from core client for 30 sec - exiting 10:01:07 (176): No heartbeat from core client for 30 sec - exiting 10:01:08 (176): No heartbeat from core client for 30 sec - exiting 10:01:09 (176): No heartbeat from core client for 30 sec - exiting 10:01:10 (176): No heartbeat from core client for 30 sec - exiting 10:01:11 (176): No heartbeat from core client for 30 sec - exiting 10:01:12 (176): No heartbeat from core client for 30 sec - exiting 10:01:13 (176): No heartbeat from core client for 30 sec - exiting 10:01:14 (176): No heartbeat from core client for 30 sec - exiting 10:01:15 (176): No heartbeat from core client for 30 sec - exiting 10:01:16 (176): No heartbeat from core client for 30 sec - exiting 10:01:17 (176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:23:07 (6688): No heartbeat from core client for 30 sec - exiting 17:23:08 (6688): No heartbeat from core client for 30 sec - exiting 17:23:09 (6688): No heartbeat from core client for 30 sec - exiting 17:23:10 (6688): No heartbeat from core client for 30 sec - exiting 17:23:11 (6688): No heartbeat from core client for 30 sec - exiting 17:23:12 (6688): No heartbeat from core client for 30 sec - exiting 17:23:13 (6688): No heartbeat from core client for 30 sec - exiting 17:23:14 (6688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:55:51 (5748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:15:32 (5180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:03:31 (1332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5640, iMonCtr=1 Model crash detected, will try to restart... 16:34:31 (3068): No heartbeat from core client for 30 sec - exiting 16:34:32 (3068): No heartbeat from core client for 30 sec - exiting 16:34:33 (3068): No heartbeat from core client for 30 sec - exiting 16:34:34 (3068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:52:09 (6552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:51:15 (6128): No heartbeat from core client for 30 sec - exiting 09:51:16 (6128): No heartbeat from core client for 30 sec - exiting 09:51:17 (6128): No heartbeat from core client for 30 sec - exiting 09:51:18 (6128): No heartbeat from core client for 30 sec - exiting 09:51:19 (6128): No heartbeat from core client for 30 sec - exiting 09:51:20 (6128): No heartbeat from core client for 30 sec - exiting 09:51:21 (6128): No heartbeat from core client for 30 sec - exiting 09:51:22 (6128): No heartbeat from core client for 30 sec - exiting 09:51:23 (6128): No heartbeat from core client for 30 sec - exiting 09:51:24 (6128): No heartbeat from core client for 30 sec - exiting 09:51:25 (6128): No heartbeat from core client for 30 sec - exiting 09:51:26 (6128): No heartbeat from core client for 30 sec - exiting 09:51:27 (6128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:03:37 (4924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:11:42 (4724): No heartbeat from core client for 30 sec - exiting 10:11:43 (4724): No heartbeat from core client for 30 sec - exiting 10:11:44 (4724): No heartbeat from core client for 30 sec - exiting 10:11:45 (4724): No heartbeat from core client for 30 sec - exiting 10:11:46 (4724): No heartbeat from core client for 30 sec - exiting 10:11:47 (4724): No heartbeat from core client for 30 sec - exiting 10:11:48 (4724): No heartbeat from core client for 30 sec - exiting 10:11:49 (4724): No heartbeat from core client for 30 sec - exiting 10:11:50 (4724): No heartbeat from core client for 30 sec - exiting 10:11:51 (4724): No heartbeat from core client for 30 sec - exiting 10:11:52 (4724): No heartbeat from core client for 30 sec - exiting 10:11:53 (4724): No heartbeat from core client for 30 sec - exiting 10:11:54 (4724): No heartbeat from core client for 30 sec - exiting 10:11:55 (4724): No heartbeat from core client for 30 sec - exiting 10:11:56 (4724): No heartbeat from core client for 30 sec - exiting 10:11:57 (4724): No heartbeat from core client for 30 sec - exiting 10:11:58 (4724): No heartbeat from core client for 30 sec - exiting 10:11:59 (4724): No heartbeat from core client for 30 sec - exiting 10:12:00 (4724): No heartbeat from core client for 30 sec - exiting 10:12:01 (4724): No heartbeat from core client for 30 sec - exiting 10:12:02 (4724): No heartbeat from core client for 30 sec - exiting 10:12:03 (4724): No heartbeat from core client for 30 sec - exiting 10:12:04 (4724): No heartbeat from core client for 30 sec - exiting 10:12:05 (4724): No heartbeat from core client for 30 sec - exiting 10:12:06 (4724): No heartbeat from core client for 30 sec - exiting 10:12:07 (4724): No heartbeat from core client for 30 sec - exiting 10:12:08 (4724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:24:11 (4636): No heartbeat from core client for 30 sec - exiting 17:24:12 (4636): No heartbeat from core client for 30 sec - exiting 17:24:13 (4636): No heartbeat from core client for 30 sec - exiting 17:24:14 (4636): No heartbeat from core client for 30 sec - exiting 17:24:15 (4636): No heartbeat from core client for 30 sec - exiting 17:24:16 (4636): No heartbeat from core client for 30 sec - exiting 17:24:17 (4636): No heartbeat from core client for 30 sec - exiting 17:24:18 (4636): No heartbeat from core client for 30 sec - exiting 17:24:19 (4636): No heartbeat from core client for 30 sec - exiting 17:24:20 (4636): No heartbeat from core client for 30 sec - exiting 17:24:21 (4636): No heartbeat from core client for 30 sec - exiting 17:24:22 (4636): No heartbeat from core client for 30 sec - exiting 17:24:23 (4636): No heartbeat from core client for 30 sec - exiting 17:24:24 (4636): No heartbeat from core client for 30 sec - exiting 17:24:25 (4636): No heartbeat from core client for 30 sec - exiting 17:24:26 (4636): No heartbeat from core client for 30 sec - exiting 17:24:27 (4636): No heartbeat from core client for 30 sec - exiting 17:24:28 (4636): No heartbeat from core client for 30 sec - exiting 17:24:29 (4636): No heartbeat from core client for 30 sec - exiting 17:24:30 (4636): No heartbeat from core client for 30 sec - exiting 17:24:31 (4636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:56:57 (5428): No heartbeat from core client for 30 sec - exiting 09:56:58 (5428): No heartbeat from core client for 30 sec - exiting 09:56:59 (5428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:58:09 (5064): No heartbeat from core client for 30 sec - exiting 16:58:10 (5064): No heartbeat from core client for 30 sec - exiting 16:58:11 (5064): No heartbeat from core client for 30 sec - exiting 16:58:12 (5064): No heartbeat from core client for 30 sec - exiting 16:58:13 (5064): No heartbeat from core client for 30 sec - exiting 16:58:14 (5064): No heartbeat from core client for 30 sec - exiting 16:58:15 (5064): No heartbeat from core client for 30 sec - exiting 16:58:16 (5064): No heartbeat from core client for 30 sec - exiting 16:58:17 (5064): No heartbeat from core client for 30 sec - exiting 16:58:18 (5064): No heartbeat from core client for 30 sec - exiting 16:58:19 (5064): No heartbeat from core client for 30 sec - exiting 16:58:20 (5064): No heartbeat from core client for 30 sec - exiting 16:58:21 (5064): No heartbeat from core client for 30 sec - exiting 16:58:22 (5064): No heartbeat from core client for 30 sec - exiting 16:58:23 (5064): No heartbeat from core client for 30 sec - exiting 16:58:24 (5064): No heartbeat from core client for 30 sec - exiting 16:58:25 (5064): No heartbeat from core client for 30 sec - exiting 16:58:26 (5064): No heartbeat from core client for 30 sec - exiting 16:58:27 (5064): No heartbeat from core client for 30 sec - exiting 16:58:28 (5064): No heartbeat from core client for 30 sec - exiting 16:58:29 (5064): No heartbeat from core client for 30 sec - exiting 16:58:30 (5064): No heartbeat from core client for 30 sec - exiting 16:58:31 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:57:14 (3636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x776171F3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5872, selfPID=5872, iMonCtr=1 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Jul 2013 10:26:24	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	777,600	832,328	1.0704
25 Jul 2013 08:39:58	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	751,680	802,840	1.0681
23 Jul 2013 21:50:15	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	725,760	771,667	1.0633
23 Jul 2013 20:26:23	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	699,840	741,830	1.0600
23 Jul 2013 19:47:22	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	673,920	713,815	1.0592
23 Jul 2013 15:26:34	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	648,000	685,615	1.0580
23 Jul 2013 15:26:34	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	622,080	657,808	1.0574
23 Jul 2013 15:26:34	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	596,160	628,789	1.0547
23 Jul 2013 15:26:34	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	570,240	598,623	1.0498
23 Jul 2013 15:26:34	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	544,320	569,189	1.0457
11 Jul 2013 08:51:11	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	518,400	539,922	1.0415
09 Jul 2013 17:56:20	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	492,480	510,480	1.0365
09 Jul 2013 09:22:47	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	466,560	481,068	1.0311
06 Jul 2013 16:34:42	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	440,640	450,506	1.0224
06 Jul 2013 05:19:51	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	414,720	420,092	1.0130
03 Jul 2013 18:01:36	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	388,800	390,195	1.0036
02 Jul 2013 15:46:00	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	362,880	360,237	0.9927
02 Jul 2013 11:52:03	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	336,960	331,737	0.9845
02 Jul 2013 10:15:06	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	311,040	306,326	0.9848
02 Jul 2013 10:05:56	1245161	15812776	hadcm3n_o4tc_1940_40_008381478_0	285,120	280,391	0.9834