Task 15464255

Name	hadcm3n_zezs_1920_40_008254267_2
Workunit	8409391
Created	27 Nov 2012, 10:03:29 UTC
Sent	27 Nov 2012, 10:03:37 UTC
Report deadline	26 Feb 2013, 17:30:48 UTC
Received	6 Jan 2013, 22:56:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1223127
Run time	27 days 3 hours 58 min 46 sec
CPU time	18 days 3 hours 37 min 48 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	0.84 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> 06:19:58 (9440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:47:45 (8456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:09:24 (8012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:12:32 (6860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:22:35 (10012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:05:36 (11168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:42 (11012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:15:49 (6980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:01:41 (9336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:52:54 (3812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:37 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:44 (4380): No heartbeat from core client for 30 sec - exiting 20:13:45 (4380): No heartbeat from core client for 30 sec - exiting 20:13:46 (4380): No heartbeat from core client for 30 sec - exiting 20:13:47 (4380): No heartbeat from core client for 30 sec - exiting 20:13:49 (4380): No heartbeat from core client for 30 sec - exiting 20:13:50 (4380): No heartbeat from core client for 30 sec - exiting 20:13:51 (4380): No heartbeat from core client for 30 sec - exiting 20:13:52 (4380): No heartbeat from core client for 30 sec - exiting 03:52:39 (6396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:41 (6396): No heartbeat from core client for 30 sec - exiting 18:51:48 (6056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:45:17 (7888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:51:27 (7776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:51:28 (7776): No heartbeat from core client for 30 sec - exiting 13:10:41 (5612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:10:43 (5612): No heartbeat from core client for 30 sec - exiting 13:35:21 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C19:47:40 (4148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:11 (6972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:12 (6972): No heartbeat from core client for 30 sec - exiting 23:10:33 (7104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:57 (4580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:58 (4580): No heartbeat from core client for 30 sec - exiting 02:26:00 (4580): No heartbeat from core client for 30 sec - exiting 02:26:01 (4580): No heartbeat from core client for 30 sec - exiting 02:26:02 (4580): No heartbeat from core client for 30 sec - exiting 03:32:51 (8708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:32:52 (8708): No heartbeat from core client for 30 sec - exiting 04:42:32 (8520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:42:33 (8520): No heartbeat from core client for 30 sec - exiting 04:42:34 (8520): No heartbeat from core client for 30 sec - exiting 04:48:38 (1776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:56 (7768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:43:45 (888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:43:46 (888): No heartbeat from core client for 30 sec - exiting 12:00:53 (8712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:20 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:21 (4540): No heartbeat from core client for 30 sec - exiting 14:00:29 (4656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:00:36 (4656): No heartbeat from core client for 30 sec - exiting 14:00:37 (4656): No heartbeat from core client for 30 sec - exiting 14:00:40 (4656): No heartbeat from core client for 30 sec - exiting 14:00:41 (4656): No heartbeat from core client for 30 sec - exiting 14:00:42 (4656): No heartbeat from core client for 30 sec - exiting 14:00:43 (4656): No heartbeat from core client for 30 sec - exiting 14:00:44 (4656): No heartbeat from core client for 30 sec - exiting 14:00:45 (4656): No heartbeat from core client for 30 sec - exiting 14:00:46 (4656): No heartbeat from core client for 30 sec - exiting 14:00:47 (4656): No heartbeat from core client for 30 sec - exiting 14:00:48 (4656): No heartbeat from core client for 30 sec - exiting 14:00:49 (4656): No heartbeat from core client for 30 sec - exiting 14:00:50 (4656): No heartbeat from core client for 30 sec - exiting 14:13:47 (5244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:17:55 (6860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:17:56 (6860): No heartbeat from core client for 30 sec - exiting 18:42:35 (7068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:42:36 (7068): No heartbeat from core client for 30 sec - exiting 18:42:37 (7068): No heartbeat from core client for 30 sec - exiting 18:42:38 (7068): No heartbeat from core client for 30 sec - exiting 18:42:39 (7068): No heartbeat from core client for 30 sec - exiting 19:43:34 (1868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:35 (1868): No heartbeat from core client for 30 sec - exiting 19:59:05 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:32:49 (1836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:03:24 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:49 (5356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:32:04 (7956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:18:00 (6184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:54 (5664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:34:43 (7956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:41:58 (184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:41 (124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:54:03 (5348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:15:19 (6984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:21:23 (5308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:59 (2492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:24 (8600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:27:40 (7620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:52:18 (7084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:04:28 (3736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:10:39 (5072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:00 (4788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:20:01 (6008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:41:39 (5344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:53:57 (4420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:18:29 (7404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:24:39 (8148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:33:43 (3760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:46:02 (4472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:09 (4280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:34 (8012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... C20:21:19 (7208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:21:26 (7208): No heartbeat from core client for 30 sec - exiting 20:21:28 (7208): No heartbeat from core client for 30 sec - exiting 20:21:29 (7208): No heartbeat from core client for 30 sec - exiting 20:21:30 (7208): No heartbeat from core client for 30 sec - exiting 20:21:31 (7208): No heartbeat from core client for 30 sec - exiting 20:21:32 (7208): No heartbeat from core client for 30 sec - exiting 20:45:45 (4424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C00:21:43 (2324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:21:51 (2324): No heartbeat from core client for 30 sec - exiting 00:21:52 (2324): No heartbeat from core client for 30 sec - exiting 01:32:08 (8048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:32:09 (8048): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:56:53 (8168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:39:47 (8452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:39:48 (8452): No heartbeat from core client for 30 sec - exiting 07:39:49 (8452): No heartbeat from core client for 30 sec - exiting 07:39:50 (8452): No heartbeat from core client for 30 sec - exiting 13:33:13 (8672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:33:17 (8672): No heartbeat from core client for 30 sec - exiting 13:33:18 (8672): No heartbeat from core client for 30 sec - exiting 13:33:20 (8672): No heartbeat from core client for 30 sec - exiting 13:33:21 (8672): No heartbeat from core client for 30 sec - exiting 13:33:22 (8672): No heartbeat from core client for 30 sec - exiting 13:33:23 (8672): No heartbeat from core client for 30 sec - exiting 17:08:57 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:13:38 (5024): No heartbeat from core client for 30 sec - exiting 17:16:06 (5024): No heartbeat from core client for 30 sec - exiting 17:16:10 (5024): No heartbeat from core client for 30 sec - exiting 17:16:11 (5024): No heartbeat from core client for 30 sec - exiting 17:16:12 (5024): No heartbeat from core client for 30 sec - exiting 17:16:14 (5024): No heartbeat from core client for 30 sec - exiting 17:16:15 (5024): No heartbeat from core client for 30 sec - exiting 17:16:16 (5024): No heartbeat from core client for 30 sec - exiting 17:16:17 (5024): No heartbeat from core client for 30 sec - exiting 17:16:19 (5024): No heartbeat from core client for 30 sec - exiting 17:16:20 (5024): No heartbeat from core client for 30 sec - exiting 17:16:22 (5024): No heartbeat from core client for 30 sec - exiting 17:16:23 (5024): No heartbeat from core client for 30 sec - exiting 04:26:23 (6716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:26:24 (6716): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4888, iMonCtr=1 Model crash detected, will try to restart... 08:46:52 (7328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:46:53 (7328): No heartbeat from core client for 30 sec - exiting 23:00:12 (7620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:14:01 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:39:24 (6928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:03 (4968): No heartbeat from core client for 30 sec - exiting 08:40:04 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:55:23 (7584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:35:06 (8928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:17:57 (6552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:17:59 (6552): No heartbeat from core client for 30 sec - exiting 12:45:23 (8560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:48:23 (6248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:59 (8100): No heartbeat from core client for 30 sec - exiting 12:55:00 (8100): No heartbeat from core client for 30 sec - exiting 12:55:01 (8100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:04:05 (920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:04:06 (920): No heartbeat from core client for 30 sec - exiting 13:10:21 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:39:31 (4220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:24:43 (7024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:20:40 (8284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7144, iMonCtr=1 Model crash detected, will try to restart... 02:22:40 (6740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:22:46 (6740): No heartbeat from core client for 30 sec - exiting 02:22:47 (6740): No heartbeat from core client for 30 sec - exiting 02:22:48 (6740): No heartbeat from core client for 30 sec - exiting 02:22:50 (6740): No heartbeat from core client for 30 sec - exiting 02:22:51 (6740): No heartbeat from core client for 30 sec - exiting 02:22:52 (6740): No heartbeat from core client for 30 sec - exiting 02:22:53 (6740): No heartbeat from core client for 30 sec - exiting 02:22:54 (6740): No heartbeat from core client for 30 sec - exiting 02:22:55 (6740): No heartbeat from core client for 30 sec - exiting 02:22:56 (6740): No heartbeat from core client for 30 sec - exiting 13:27:29 (6536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:36:32 (6308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:00:38 (7952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:10 (8272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:11 (8272): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:32:04 (6952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:32:05 (6952): No heartbeat from core client for 30 sec - exiting 06:38:17 (7000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:38:18 (7000): No heartbeat from core client for 30 sec - exiting 06:38:19 (7000): No heartbeat from core client for 30 sec - exiting 06:38:20 (7000): No heartbeat from core client for 30 sec - exiting 06:38:21 (7000): No heartbeat from core client for 30 sec - exiting 06:38:22 (7000): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 16:31:52 (7312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:31:58 (7312): No heartbeat from core client for 30 sec - exiting 16:31:59 (7312): No heartbeat from core client for 30 sec - exiting 16:32:00 (7312): No heartbeat from core client for 30 sec - exiting 16:32:01 (7312): No heartbeat from core client for 30 sec - exiting 16:32:02 (7312): No heartbeat from core client for 30 sec - exiting 16:32:03 (7312): No heartbeat from core client for 30 sec - exiting 02:55:21 (6472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:55:22 (6472): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7084, iMonCtr=1 Model crash detected, will try to restart... 05:21:07 (7932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:21:14 (7932): No heartbeat from core client for 30 sec - exiting 05:21:15 (7932): No heartbeat from core client for 30 sec - exiting 05:21:16 (7932): No heartbeat from core client for 30 sec - exiting 05:21:17 (7932): No heartbeat from core client for 30 sec - exiting 05:21:18 (7932): No heartbeat from core client for 30 sec - exiting 05:21:19 (7932): No heartbeat from core client for 30 sec - exiting 07:13:55 (5224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:13:57 (5224): No heartbeat from core client for 30 sec - exiting 12:43:08 (6904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:43:10 (6904): No heartbeat from core client for 30 sec - exiting 14:35:56 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:41:01 (8808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:01 (852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:02 (852): No heartbeat from core client for 30 sec - exiting 23:57:16 (8784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:43:52 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:19:19 (5320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:58 (8428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:59 (8428): No heartbeat from core client for 30 sec - exiting 11:52:59 (2636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:40:52 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:40:53 (4876): No heartbeat from core client for 30 sec - exiting 14:50:05 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:09:38 (2792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C02:56:21 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:56:48 (6048): No heartbeat from core client for 30 sec - exiting 02:56:51 (6048): No heartbeat from core client for 30 sec - exiting 02:56:53 (6048): No heartbeat from core client for 30 sec - exiting 02:56:54 (6048): No heartbeat from core client for 30 sec - exiting 02:56:56 (6048): No heartbeat from core client for 30 sec - exiting 02:56:57 (6048): No heartbeat from core client for 30 sec - exiting 02:56:58 (6048): No heartbeat from core client for 30 sec - exiting 02:56:59 (6048): No heartbeat from core client for 30 sec - exiting 02:57:00 (6048): No heartbeat from core client for 30 sec - exiting 02:57:01 (6048): No heartbeat from core client for 30 sec - exiting 02:57:02 (6048): No heartbeat from core client for 30 sec - exiting 02:57:03 (6048): No heartbeat from core client for 30 sec - exiting 02:57:04 (6048): No heartbeat from core client for 30 sec - exiting 02:57:05 (6048): No heartbeat from core client for 30 sec - exiting 02:57:06 (6048): No heartbeat from core client for 30 sec - exiting 02:57:07 (6048): No heartbeat from core client for 30 sec - exiting 03:31:45 (4044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:24:39 (7508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:24:40 (7508): No heartbeat from core client for 30 sec - exiting 09:31:54 (404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:21 (4272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:06:29 (6676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:06:30 (6676): No heartbeat from core client for 30 sec - exiting 13:06:31 (6676): No heartbeat from core client for 30 sec - exiting 13:12:22 (6184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:15:24 (7412): No heartbeat from core client for 30 sec - exiting 13:15:25 (7412): No heartbeat from core client for 30 sec - exiting 13:15:26 (7412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:24 (7460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:19:32 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:22:36 (7420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:41 (7968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:29:03 (1468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:41:25 (5492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:41:26 (5492): No heartbeat from core client for 30 sec - exiting 14:41:27 (5492): No heartbeat from core client for 30 sec - exiting 14:41:28 (5492): No heartbeat from core client for 30 sec - exiting 14:41:29 (5492): No heartbeat from core client for 30 sec - exiting 14:41:30 (5492): No heartbeat from core client for 30 sec - exiting 15:29:46 (8100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:38:55 (1492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:30:18 (7584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:30:19 (7584): No heartbeat from core client for 30 sec - exiting 16:30:20 (7584): No heartbeat from core client for 30 sec - exiting 16:30:21 (7584): No heartbeat from core client for 30 sec - exiting 16:30:22 (7584): No heartbeat from core client for 30 sec - exiting 16:30:23 (7584): No heartbeat from core client for 30 sec - exiting 16:30:24 (7584): No heartbeat from core client for 30 sec - exiting 16:30:25 (7584): No heartbeat from core client for 30 sec - exiting 16:30:26 (7584): No heartbeat from core client for 30 sec - exiting 22:26:24 (6664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:44:41 (8548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:44:43 (8548): No heartbeat from core client for 30 sec - exiting 23:33:48 (6436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:58:05 (7808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:10:10 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:16:14 (8144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:57:50 (6352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:57:51 (6352): No heartbeat from core client for 30 sec - exiting 06:13:07 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:34:20 (8908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:42 (124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:26 (8476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:32:09 (8036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:32:11 (8036): No heartbeat from core client for 30 sec - exiting 01:10:44 (7812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:29:27 (5768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:29:52 (5236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:21:21 (8964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:21:23 (8964): No heartbeat from core client for 30 sec - exiting 05:34:06 (6416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:34:07 (6416): No heartbeat from core client for 30 sec - exiting 05:34:08 (6416): No heartbeat from core client for 30 sec - exiting 05:34:09 (6416): No heartbeat from core client for 30 sec - exiting 07:04:52 (9188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:56 (7800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:57 (7800): No heartbeat from core client for 30 sec - exiting 09:12:45 (4176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:28 (5664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:29 (5664): No heartbeat from core client for 30 sec - exiting 12:18:32 (9004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:21:36 (1660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:54 (9116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:05:06 (7200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:34:53 (5104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5196, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4188, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:25:24 (7512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:25:26 (7512): No heartbeat from core client for 30 sec - exiting 16:25:27 (7512): No heartbeat from core client for 30 sec - exiting 16:25:28 (7512): No heartbeat from core client for 30 sec - exiting 16:25:29 (7512): No heartbeat from core client for 30 sec - exiting 16:25:30 (7512): No heartbeat from core client for 30 sec - exiting 16:25:31 (7512): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:55:20 (4552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:55:21 (4552): No heartbeat from core client for 30 sec - exiting 17:55:22 (4552): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77043AB3 read attempt to address 0x40C3DF2F Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Jan 2013 11:16:20	1223127	15464255	hadcm3n_zezs_1920_40_008254267_2	259,200	1,568,250	6.0503
28 Dec 2012 11:20:03	1223127	15464255	hadcm3n_zezs_1920_40_008254267_2	233,280	1,391,814	5.9663
23 Dec 2012 04:27:12	1223127	15464255	hadcm3n_zezs_1920_40_008254267_2	207,360	1,163,674	5.6119
20 Dec 2012 21:25:01	1223127	15464255	hadcm3n_zezs_1920_40_008254267_2	181,440	1,022,328	5.6345
18 Dec 2012 01:10:22	1223127	15464255	hadcm3n_zezs_1920_40_008254267_2	155,520	861,214	5.5376
14 Dec 2012 10:31:36	1223127	15464255	hadcm3n_zezs_1920_40_008254267_2	129,600	696,835	5.3768
14 Dec 2012 06:22:14	1223127	15464255	hadcm3n_zezs_1920_40_008254267_2	103,680	567,383	5.4724
14 Dec 2012 06:22:14	1223127	15464255	hadcm3n_zezs_1920_40_008254267_2	77,760	439,528	5.6524
05 Dec 2012 10:04:42	1223127	15464255	hadcm3n_zezs_1920_40_008254267_2	51,840	297,390	5.7367
30 Nov 2012 01:35:11	1223127	15464255	hadcm3n_zezs_1920_40_008254267_2	25,920	143,829	5.5490