Task 15632600

Name	hadcm3n_3cjg_1980_40_008318526_0
Workunit	8469661
Created	24 Feb 2013, 5:48:55 UTC
Sent	24 Feb 2013, 5:49:44 UTC
Report deadline	26 May 2013, 13:16:55 UTC
Received	14 Mar 2013, 0:43:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	820684
Run time	8 days 22 hours 57 min 7 sec
CPU time	8 days 22 hours 57 min 7 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.72 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>5.10.30</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> 20:13:50 (6992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:52 (6992): No heartbeat from core client for 30 sec - exiting 20:13:53 (6992): No heartbeat from core client for 30 sec - exiting 20:13:54 (6992): No heartbeat from core client for 30 sec - exiting 20:13:55 (6992): No heartbeat from core client for 30 sec - exiting 20:13:56 (6992): No heartbeat from core client for 30 sec - exiting 20:13:57 (6992): No heartbeat from core client for 30 sec - exiting 20:13:58 (6992): No heartbeat from core client for 30 sec - exiting 20:13:59 (6992): No heartbeat from core client for 30 sec - exiting 20:14:00 (6992): No heartbeat from core client for 30 sec - exiting 20:14:01 (6992): No heartbeat from core client for 30 sec - exiting 20:14:02 (6992): No heartbeat from core client for 30 sec - exiting 21:05:44 (7968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:05:46 (7968): No heartbeat from core client for 30 sec - exiting 21:05:47 (7968): No heartbeat from core client for 30 sec - exiting 21:13:02 (6356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:13:03 (6356): No heartbeat from core client for 30 sec - exiting 21:13:04 (6356): No heartbeat from core client for 30 sec - exiting 21:13:05 (6356): No heartbeat from core client for 30 sec - exiting 21:13:06 (6356): No heartbeat from core client for 30 sec - exiting 21:13:07 (6356): No heartbeat from core client for 30 sec - exiting 21:13:08 (6356): No heartbeat from core client for 30 sec - exiting 21:13:09 (6356): No heartbeat from core client for 30 sec - exiting 21:26:13 (6932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:15 (6932): No heartbeat from core client for 30 sec - exiting 21:26:16 (6932): No heartbeat from core client for 30 sec - exiting 21:26:17 (6932): No heartbeat from core client for 30 sec - exiting 21:26:18 (6932): No heartbeat from core client for 30 sec - exiting 21:26:19 (6932): No heartbeat from core client for 30 sec - exiting 21:26:20 (6932): No heartbeat from core client for 30 sec - exiting 21:37:44 (7056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:37:45 (7056): No heartbeat from core client for 30 sec - exiting 21:43:51 (7380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:43:52 (7380): No heartbeat from core client for 30 sec - exiting 21:43:53 (7380): No heartbeat from core client for 30 sec - exiting 21:59:23 (5184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:04:50 (6604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:04:52 (6604): No heartbeat from core client for 30 sec - exiting 22:17:15 (5648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:17:17 (5648): No heartbeat from core client for 30 sec - exiting 22:23:37 (6344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:23:38 (6344): No heartbeat from core client for 30 sec - exiting 22:23:39 (6344): No heartbeat from core client for 30 sec - exiting 22:23:40 (6344): No heartbeat from core client for 30 sec - exiting 03:35:15 (7120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:08:58 (6680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:42 (7800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:57 (7972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:01:15 (5516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:39:48 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:14:30 (7320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:08:12 (4028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:43:39 (1900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:27:14 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:37:11 (2000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:22:34 (1612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:20:48 (976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:53:53 (3756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:52:53 (6092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:36:01 (5140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:44:06 (5532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:49:45 (3012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:23:21 (4684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:25:26 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:03 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:04 (5932): No heartbeat from core client for 30 sec - exiting 17:31:05 (5932): No heartbeat from core client for 30 sec - exiting 17:31:58 (5816): No heartbeat from core client for 30 sec - exiting 17:31:59 (5816): No heartbeat from core client for 30 sec - exiting 17:32:00 (5816): No heartbeat from core client for 30 sec - exiting 17:32:01 (5816): No heartbeat from core client for 30 sec - exiting 17:32:02 (5816): No heartbeat from core client for 30 sec - exiting 17:32:03 (5816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:32:04 (5816): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 20:58:53 (5664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:54 (5664): No heartbeat from core client for 30 sec - exiting 20:59:40 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:22:03 (4636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:22:05 (4636): No heartbeat from core client for 30 sec - exiting 21:22:06 (4636): No heartbeat from core client for 30 sec - exiting 21:23:04 (4212): No heartbeat from core client for 30 sec - exiting 21:23:05 (4212): No heartbeat from core client for 30 sec - exiting 21:23:06 (4212): No heartbeat from core client for 30 sec - exiting 21:23:07 (4212): No heartbeat from core client for 30 sec - exiting 21:23:08 (4212): No heartbeat from core client for 30 sec - exiting 21:23:09 (4212): No heartbeat from core client for 30 sec - exiting 21:23:10 (4212): No heartbeat from core client for 30 sec - exiting 21:23:11 (4212): No heartbeat from core client for 30 sec - exiting 21:23:12 (4212): No heartbeat from core client for 30 sec - exiting 21:23:13 (4212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:00 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:01 (4352): No heartbeat from core client for 30 sec - exiting 21:30:02 (4352): No heartbeat from core client for 30 sec - exiting 21:31:19 (4848): No heartbeat from core client for 30 sec - exiting 21:31:20 (4848): No heartbeat from core client for 30 sec - exiting 21:31:21 (4848): No heartbeat from core client for 30 sec - exiting 21:31:22 (4848): No heartbeat from core client for 30 sec - exiting 21:31:23 (4848): No heartbeat from core client for 30 sec - exiting 21:31:24 (4848): No heartbeat from core client for 30 sec - exiting 21:31:25 (4848): No heartbeat from core client for 30 sec - exiting 21:31:26 (4848):CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting 21:38:04 (6056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:38:05 (6056): No heartbeat from core client for 30 sec - exiting 21:38:06 (6056): No heartbeat from core client for 30 sec - exiting 21:38:07 (6056): No heartbeat from core client for 30 sec - exiting 21:38:08 (6056): No heartbeat from core client for 30 sec - exiting 21:38:09 (6056): No heartbeat from core client for 30 sec - exiting 21:38:10 (6056): No heartbeat from core client for 30 sec - exiting 21:38:11 (6056): No heartbeat from core client for 30 sec - exiting 21:38:12 (6056): No heartbeat from core client for 30 sec - exiting 21:38:13 (6056): No heartbeat from core client for 30 sec - exiting 21:38:14 (6056): No heartbeat from core client for 30 sec - exiting 21:39:58 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Ocean Restart file copy failed on 3cjgko.dai5830 21:51:32 (3192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:51:33 (3192): No heartbeat from core client for 30 sec - exiting 21:52:43 (4460): No heartbeat from core client for 30 sec - exiting 21:52:44 (4460): No heartbeat from core client for 30 sec - exiting 21:52:45 (4460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:54:07 (4572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:10:04 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:10:05 (5372): No heartbeat from core client for 30 sec - exiting 22:10:06 (5372): No heartbeat from core client for 30 sec - exiting 22:10:07 (5372): No heartbeat from core client for 30 sec - exiting 22:10:08 (5372): No heartbeat from core client for 30 sec - exiting 22:10:09 (5372): No heartbeat from core client for 30 sec - exiting 22:10:10 (5372): No heartbeat from core client for 30 sec - exiting 22:10:11 (5372): No heartbeat from core client for 30 sec - exiting 22:10:12 (5372): No heartbeat from core client for 30 sec - exiting 22:10:13 (5372): No heartbeat from core client for 30 sec - exiting 22:10:14 (5372): No heartbeat from core client for 30 sec - exiting 22:11:02 (324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:18:54 (668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:18:55 (668): No heartbeat from core client for 30 sec - exiting 22:20:07 (5932): No heartbeat from core client for 30 sec - exiting 22:20:08 (5932): No heartbeat from core client for 30 sec - exiting 22:20:09 (5932): No heartbeat from core client for 30 sec - exiting 22:20:10 (5932): No heartbeat from core client for 30 sec - exiting 22:20:11 (5932): No heartbeat from core client for 30 sec - exiting 22:20:12 (5932): No heartbeat from core client for 30 sec - exiting 22:20:13 (5932): No heartbeat from core client for 30 sec - exiting 22:20:14 (5932): No heartbeat from core client for 30 sec - exiting 22:20:15 (5932): No heartbeat from core client for 30 sec - exiting 22:20:16 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:19 (2768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:20 (2768): No heartbeat from core client for 30 sec - exiting 22:26:21 (2768): No heartbeat from core client for 30 sec - exiting 22:26:22 (2768): No heartbeat from core client for 30 sec - exiting 22:26:23 (2768): No heartbeat from core client for 30 sec - exiting 22:26:25 (2768): No heartbeat from core client for 30 sec - exiting 22:26:26 (2768): No heartbeat from core client for 30 sec - exiting 22:26:27 (2768): No heartbeat from core client for 30 sec - exiting 22:26:28 (2768): No heartbeat from core client for 30 sec - exiting 22:26:29 (2768): No heartbeat from core client for 30 sec - exiting 22:26:30 (2768): No heartbeat from core client for 30 sec - exiting 22:27:38 (4416): No heartbeat from core client for 30 sec - exiting 22:27:39 (4416): No heartbeat from core client for 30 sec - exiting 22:27:40 (4416): No heartbeat from core client for 30 sec - exiting 22:27:41 (4416): No heartbeat from core client for 30 sec - exiting 22:27:42 (4416): No heartbeat from core client for 30 sec - exiting 22:27:43 (4416): No heartbeat from core client for 30 sec - exiting 22:27:44 (4416): No heartbeat from core client for 30 sec - exiting 22:27:45 (4416): No heartbeat from core client for 30 sec - exiting 22:27:46 (4416): No heartbeat from core client for 30 sec - exiting 22:27:47 (4416): No heartbeat from core client for 30 sec - exiting 22:27:48 (4416): No heartbeat from core client for 30 sec - exiting 22:27:49 (4416): No heartbeat from core client for 30 sec - exiting 22:27:50 (4416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:21 (1464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:23 (1464): No heartbeat from core client for 30 sec - exiting 22:39:24 (1464): No heartbeat from core client for 30 sec - exiting 22:39:25 (1464): No heartbeat from core client for 30 sec - exiting 22:39:26 (1464): No heartbeat from core client for 30 sec - exiting 22:39:27 (1464): No heartbeat from core client for 30 sec - exiting 22:39:28 (1464): No heartbeat from core client for 30 sec - exiting 22:39:29 (1464): No heartbeat from core client for 30 sec - exiting 22:39:30 (1464): No heartbeat from core client for 30 sec - exiting 22:39:31 (1464): No heartbeat from core client for 30 sec - exiting 22:39:32 (1464): No heartbeat from core client for 30 sec - exiting 22:40:39 (2748): No heartbeat from core client for 30 sec - exiting 22:40:40 (2748): No heartbeat from core client for 30 sec - exiting 22:40:41 (2748): No heartbeat from core client for 30 sec - exiting 22:40:42 (2748): No heartbeat from core client for 30 sec - exiting 22:40:43 (2748): No heartbeat from core client for 30 sec - exiting 22:40:44 (2748): No heartbeat from core client for 30 sec - exiting 22:40:45 (2748): No heartbeat from core client for 30 sec - exiting 22:40:46 (2748): No heartbeat from core client for 30 sec - exiting 22:40:47 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:47:58 (5500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:47:59 (5500): No heartbeat from core client for 30 sec - exiting 22:48:00 (5500): No heartbeat from core client for 30 sec - exiting 22:48:01 (5500): No heartbeat from core client for 30 sec - exiting 22:48:02 (5500): No heartbeat from core client for 30 sec - exiting 22:55:02 (3784): No heartbeat from core client for 30 sec - exiting 22:55:03 (3784): No heartbeat from core client for 30 sec - exiting 22:55:04 (3784): No heartbeat from core client for 30 sec - exiting 22:55:05 (3784): No heartbeat from core client for 30 sec - exiting 22:55:07 (3784): No heartbeat from core client for 30 sec - exiting 22:55:08 (3784): No heartbeat from core client for 30 sec - exiting 22:55:09 (3784): No heartbeat from core client for 30 sec - exiting 22:55:10 (3784): No heartbeat from core client for 30 sec - exiting 22:55:11 (3784): No heartbeat from core client for 30 sec - exiting 22:55:12 (3784): No heartbeat from core client for 30 sec - exiting 22:55:13 (3784): No heartbeat from core client for 30 sec - exiting 22:55:14 (3784): No heartbeat from core client for 30 sec - exiting 22:55:15 (3784): No heartbeat from core client for 30 sec - exiting 22:55:16 (3784): No heartbeat from core client for 30 sec - exiting 22:55:17 (3784): No heartbeat from core client for 30 sec - exiting 22:55:18 (3784): No heartbeat from core client for 30 sec - exiting 22:55:19 (3784): No heartbeat from core client for 30 sec - exiting 22:55:20 (3784): No heartbeat from core client for 30 sec - exiting 22:55:21 (3784): No heartbeat from core client for 30 sec - exiting 22:55:22 (3784): No heartbeat from core client for 30 sec - exiting 22:55:23 (3784): No heartbeat from core client for 30 sec - exiting 22:55:24 (3784): No heartbeat from core client for 30 sec - exiting 22:55:25 (3784): No heartbeat from core client for 30 sec - exiting 22:55:26 (3784): No heartbeat from core client for 30 sec - exiting 22:55:27 (3784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:14 (3116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:16 (3116): No heartbeat from core client for 30 sec - exiting 23:07:17 (3116): No heartbeat from core client for 30 sec - exiting 23:07:18 (3116): No heartbeat from core client for 30 sec - exiting 23:07:19 (3116): No heartbeat from core client for 30 sec - exiting 23:07:20 (3116): No heartbeat from core client for 30 sec - exiting 23:07:21 (3116): No heartbeat from core client for 30 sec - exiting 23:07:22 (3116): No heartbeat from core client for 30 sec - exiting 23:07:23 (3116): No heartbeat from core client for 30 sec - exiting 23:07:24 (3116): No heartbeat from core client for 30 sec - exiting 23:07:25 (3116): No heartbeat from core client for 30 sec - exiting 23:07:26 (3116): No heartbeat from core client for 30 sec - exiting 04:36:02 (4928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:50:07 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:50:08 (5144): No heartbeat from core client for 30 sec - exiting 13:02:10 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:12 (4964): No heartbeat from core client for 30 sec - exiting 13:02:13 (4964): No heartbeat from core client for 30 sec - exiting 13:02:14 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:07:00 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:07:02 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 00:15:35 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:37 (4528): No heartbeat from core client for 30 sec - exiting 00:16:30 (5960): No heartbeat from core client for 30 sec - exiting 00:16:31 (5960): No heartbeat from core client for 30 sec - exiting 00:16:32 (5960): No heartbeat from core client for 30 sec - exiting 00:16:33 (5960): No heartbeat from core client for 30 sec - exiting 00:16:34 (5960): No heartbeat from core client for 30 sec - exiting 00:16:35 (5960): No heartbeat from core client for 30 sec - exiting 00:16:36 (5960): No heartbeat from core client for 30 sec - exiting 00:16:37 (5960): No heartbeat from core client for 30 sec - exiting 00:16:38 (5960): No heartbeat from core client for 30 sec - exiting 00:16:39 (5960): No heartbeat from core client for 30 sec - exiting 00:16:40 (5960): No heartbeat from core client for 30 sec - exiting 00:16:41 (5960): No heartbeat from core client for 30 sec - exiting 00:16:42 (5960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:30:47 (5608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:30:48 (5764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:29:42 (2624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:10:46 (5968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:10:48 (5968): No heartbeat from core client for 30 sec - exiting 22:16:01 (5544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:16:02 (5544): No heartbeat from core client for 30 sec - exiting 22:16:03 (5544): No heartbeat from core client for 30 sec - exiting 22:16:04 (5544): No heartbeat from core client for 30 sec - exiting 22:16:05 (5544): No heartbeat from core client for 30 sec - exiting 22:16:06 (5544): No heartbeat from core client for 30 sec - exiting 22:16:07 (5544): No heartbeat from core client for 30 sec - exiting 22:16:08 (5544): No heartbeat from core client for 30 sec - exiting 22:16:10 (5544): No heartbeat from core client for 30 sec - exiting 22:16:11 (5544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 03:28:29 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:28:30 (5692): No heartbeat from core client for 30 sec - exiting 03:28:31 (5692): No heartbeat from core client for 30 sec - exiting 03:28:32 (5692): No heartbeat from core client for 30 sec - exiting 03:28:33 (5692): No heartbeat from core client for 30 sec - exiting 03:28:34 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:39:57 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:49:06 (5480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:49:07 (5480): No heartbeat from core client for 30 sec - exiting 09:50:31 (3592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:13:31 (6784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:13:32 (6784): No heartbeat from core client for 30 sec - exiting 15:13:33 (6784): No heartbeat from core client for 30 sec - exiting 15:13:34 (6784): No heartbeat from core client for 30 sec - exiting 15:13:35 (6784): No heartbeat from core client for 30 sec - exiting 15:13:36 (6784): No heartbeat from core client for 30 sec - exiting 15:13:37 (6784): No heartbeat from core client for 30 sec - exiting 15:13:38 (6784): No heartbeat from core client for 30 sec - exiting 15:13:39 (6784): No heartbeat from core client for 30 sec - exiting 15:13:40 (6784): No heartbeat from core client for 30 sec - exiting 15:13:41 (6784): No heartbeat from core client for 30 sec - exiting 15:13:42 (6784): No heartbeat from core client for 30 sec - exiting 15:14:59 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:08:01 (6908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:12 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:13 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 05:50:40 (4576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:43 (7360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:29:53 (7924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:49:07 (6316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:18:44 (7024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:45 (7024): No heartbeat from core client for 30 sec - exiting 21:23:14 (6624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:23:16 (6624): No heartbeat from core client for 30 sec - exiting 21:28:27 (7912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:33 (8148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:34 (8148): No heartbeat from core client for 30 sec - exiting 21:38:35 (4516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:44 (3864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:45 (3864): No heartbeat from core client for 30 sec - exiting 21:44:53 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:46:02 (6460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:35:03 (7676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:43:33 (6664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:43:35 (6664): No heartbeat from core client for 30 sec - exiting 09:43:36 (6664): No heartbeat from core client for 30 sec - exiting 09:43:37 (6664): No heartbeat from core client for 30 sec - exiting 09:43:38 (6664): No heartbeat from core client for 30 sec - exiting 09:43:39 (6664): No heartbeat from core client for 30 sec - exiting 09:43:40 (6664): No heartbeat from core client for 30 sec - exiting 09:43:41 (6664): No heartbeat from core client for 30 sec - exiting 09:43:42 (6664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:23:04 (6876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:21 (6248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:22 (6248): No heartbeat from core client for 30 sec - exiting 19:29:23 (6248): No heartbeat from core client for 30 sec - exiting 19:40:11 (7800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:40:12 (7800): No heartbeat from core client for 30 sec - exiting 19:43:23 (7464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:20 (2472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:13 (7012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:18 (6060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:19:21 (204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:07:48 (7420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:15:42 (904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:32:51 (7876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:32:52 (7876): No heartbeat from core client for 30 sec - exiting 19:35:32 (7656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:53 (6208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:45 (3920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:47 (3920): No heartbeat from core client for 30 sec - exiting 19:48:27 (6664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:19 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:20 (5016): No heartbeat from core client for 30 sec - exiting 19:55:21 (5016): No heartbeat from core client for 30 sec - exiting 19:55:22 (5016): No heartbeat from core client for 30 sec - exiting 19:55:23 (5016): No heartbeat from core client for 30 sec - exiting 19:55:24 (5016): No heartbeat from core client for 30 sec - exiting 19:55:25 (5016): No heartbeat from core client for 30 sec - exiting 19:55:26 (5016): No heartbeat from core client for 30 sec - exiting 19:55:27 (5016): No heartbeat from core client for 30 sec - exiting 19:58:14 (4636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:03:22 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:03:23 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:52:49 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:56:32 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:03:48 (204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:03:49 (204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:24:09 (1752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:10:59 (4576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:16:52 (6148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:16:53 (6148): No heartbeat from core client for 30 sec - exiting 11:17:39 (3116): No heartbeat from core client for 30 sec - exiting 11:17:40 (3116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:37:56 (7988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:37:57 (7988): No heartbeat from core client for 30 sec - exiting 20:37:58 (7988): No heartbeat from core client for 30 sec - exiting 20:44:06 (7344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:07 (7344): No heartbeat from core client for 30 sec - exiting 20:45:05 (8044): No heartbeat from core client for 30 sec - exiting 20:45:06 (8044): No heartbeat from core client for 30 sec - exiting 20:45:07 (8044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:11:17 (6660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:44:18 (2692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:31 (7532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:37:59 (6632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:45:36 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:45:38 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 08:03:48 (6604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:19 (7064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:20 (7064): No heartbeat from core client for 30 sec - exiting 09:40:01 (548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:03 (548): No heartbeat from core client for 30 sec - exiting 09:40:59 (7528): No heartbeat from core client for 30 sec - exiting 09:41:00 (7528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:02 (6412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:20:44 (6572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:20:45 (6572): No heartbeat from core client for 30 sec - exiting 15:20:46 (6572): No heartbeat from core client for 30 sec - exiting 15:20:47 (6572): No heartbeat from core client for 30 sec - exiting 15:20:48 (6572): No heartbeat from core client for 30 sec - exiting 15:20:49 (6572): No heartbeat from core client for 30 sec - exiting 15:20:51 (6572): No heartbeat from core client for 30 sec - exiting 15:20:52 (6572): No heartbeat from core client for 30 sec - exiting 15:20:53 (6572): No heartbeat from core client for 30 sec - exiting 15:20:54 (6572): No heartbeat from core client for 30 sec - exiting 15:20:55 (6572): No heartbeat from core client for 30 sec - exiting 15:20:56 (6572): No heartbeat from core client for 30 sec - exiting 15:22:04 (7008): No heartbeat from core client for 30 sec - exiting 15:22:05 (7008): No heartbeat from core client for 30 sec - exiting 15:22:06 (7008): No heartbeat from core client for 30 sec - exiting 15:22:07 (7008): No heartbeat from core client for 30 sec - exiting 15:22:08 (7008): No heartbeat from core client for 30 sec - exiting 15:22:09 (7008): No heartbeat from core client for 30 sec - exiting 15:22:10 (7008): No heartbeat from core client for 30 sec - exiting 15:22:11 (7008): No heartbeat from core client for 30 sec - exiting 15:22:12 (7008): No heartbeat from core client for 30 sec - exiting 15:22:13 (7008): No heartbeat from core client for 30 sec - exiting 15:22:14 (7008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:28:02 (2360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:28:03 (2360): No heartbeat from core client for 30 sec - exiting 15:28:04 (2360): No heartbeat from core client for 30 sec - exiting 15:28:05 (2360): No heartbeat from core client for 30 sec - exiting 15:28:06 (2360): No heartbeat from core client for 30 sec - exiting 15:28:07 (2360): No heartbeat from core client for 30 sec - exiting 15:28:08 (2360): No heartbeat from core client for 30 sec - exiting 15:28:09 (2360): No heartbeat from core client for 30 sec - exiting 15:28:10 (2360): No heartbeat from core client for 30 sec - exiting 15:28:11 (2360): No heartbeat from core client for 30 sec - exiting 15:28:12 (2360): No heartbeat from core client for 30 sec - exiting 15:33:40 (8068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:33:42 (8068): No heartbeat from core client for 30 sec - exiting 15:33:43 (8068): No heartbeat from core client for 30 sec - exiting 15:33:44 (8068): No heartbeat from core client for 30 sec - exiting 15:34:44 (7816): No heartbeat from core client for 30 sec - exiting 15:34:45 (7816): No heartbeat from core client for 30 sec - exiting 15:34:46 (7816): No heartbeat from core client for 30 sec - exiting 15:34:47 (7816): No heartbeat from core client for 30 sec - exiting 15:34:48 (7816): No heartbeat from core client for 30 sec - exiting 15:34:49 (7816): No heartbeat from core client for 30 sec - exiting 15:34:50 (7816): No heartbeat from core client for 30 sec - exiting 15:34:51 (7816): No heartbeat from core client for 30 sec - exiting 15:34:52 (7816): No heartbeat from core client for 30 sec - exiting 15:34:53 (7816): No heartbeat from core client for 30 sec - exiting 15:34:54 (7816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... 19:51:47 (10112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:48 (10112): No heartbeat from core client for 30 sec - exiting 19:55:20 (10036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:10 (9396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:11 (9396): No heartbeat from core client for 30 sec - exiting 21:16:59 (8520): No heartbeat from core client for 30 sec - exiting 21:17:00 (8520): No heartbeat from core client for 30 sec - exiting 21:17:01 (8520): No heartbeat from core client for 30 sec - exiting 21:17:02 (8520): No heartbeat from core client for 30 sec - exiting 21:17:03 (8520): No heartbeat from core client for 30 sec - exiting 21:17:04 (8520): No heartbeat from core client for 30 sec - exiting 21:17:05 (8520): No heartbeat from core client for 30 sec - exiting 21:17:06 (8520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:17:07 (8520): No heartbeat from core client for 30 sec - exiting 21:17:08 (8520): No heartbeat from core client for 30 sec - exiting 21:17:09 (8520): No heartbeat from core client for 30 sec - exiting 21:17:10 (8520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:49:21 (8828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:08:33 (8216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:10:45 (9272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C921780 read attempt to address 0x3F643008 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Mar 2013 00:47:52	820684	15632600	hadcm3n_3cjg_1980_40_008318526_0	259,200	773,807	2.9854
11 Mar 2013 07:47:48	820684	15632600	hadcm3n_3cjg_1980_40_008318526_0	233,280	695,130	2.9798
09 Mar 2013 13:03:13	820684	15632600	hadcm3n_3cjg_1980_40_008318526_0	207,360	618,793	2.9841
07 Mar 2013 15:00:29	820684	15632600	hadcm3n_3cjg_1980_40_008318526_0	181,440	538,244	2.9665
05 Mar 2013 22:13:07	820684	15632600	hadcm3n_3cjg_1980_40_008318526_0	155,520	464,024	2.9837
04 Mar 2013 05:57:37	820684	15632600	hadcm3n_3cjg_1980_40_008318526_0	129,600	389,600	3.0062
03 Mar 2013 02:24:21	820684	15632600	hadcm3n_3cjg_1980_40_008318526_0	103,680	313,520	3.0239
01 Mar 2013 03:21:11	820684	15632600	hadcm3n_3cjg_1980_40_008318526_0	77,760	236,096	3.0362
26 Feb 2013 04:54:05	820684	15632600	hadcm3n_3cjg_1980_40_008318526_0	51,840	158,258	3.0528
25 Feb 2013 05:13:30	820684	15632600	hadcm3n_3cjg_1980_40_008318526_0	25,920	80,396	3.1017