Task 15650391

Name	hadcm3n_z8jk_1960_40_008321506_1
Workunit	8472641
Created	5 Mar 2013, 21:20:32 UTC
Sent	5 Mar 2013, 21:20:45 UTC
Report deadline	5 Jun 2013, 4:47:56 UTC
Received	1 Apr 2013, 7:51:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1186953
Run time	5 days 5 hours 43 min 26 sec
CPU time	4 days 23 hours 10 min 47 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.33 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 17:53:45 (6016): No heartbeat from core client for 30 sec - exiting 17:53:46 (6016): No heartbeat from core client for 30 sec - exiting 17:53:47 (6016): No heartbeat from core client for 30 sec - exiting 17:53:49 (6016): No heartbeat from core client for 30 sec - exiting 17:53:50 (6016): No heartbeat from core client for 30 sec - exiting 17:53:51 (6016): No heartbeat from core client for 30 sec - exiting 17:53:52 (6016): No heartbeat from core client for 30 sec - exiting 17:53:53 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:18:15 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:26:03 (2944): No heartbeat from core client for 30 sec - exiting 00:26:04 (2944): No heartbeat from core client for 30 sec - exiting 00:26:05 (2944): No heartbeat from core client for 30 sec - exiting 00:26:06 (2944): No heartbeat from core client for 30 sec - exiting 00:26:07 (2944): No heartbeat from core client for 30 sec - exiting 00:26:08 (2944): No heartbeat from core client for 30 sec - exiting 00:26:09 (2944): No heartbeat from core client for 30 sec - exiting 00:26:11 (2944): No heartbeat from core client for 30 sec - exiting 00:26:12 (2944): No heartbeat from core client for 30 sec - exiting 00:26:13 (2944): No heartbeat from core client for 30 sec - exiting 00:26:14 (2944): No heartbeat from core client for 30 sec - exiting 00:26:15 (2944): No heartbeat from core client for 30 sec - exiting 00:26:16 (2944): No heartbeat from core client for 30 sec - exiting 00:26:17 (2944): No heartbeat from core client for 30 sec - exiting 00:26:18 (2944): No heartbeat from core client for 30 sec - exiting 00:26:19 (2944): No heartbeat from core client for 30 sec - exiting 00:26:20 (2944): No heartbeat from core client for 30 sec - exiting 00:26:21 (2944): No heartbeat from core client for 30 sec - exiting 00:26:23 (2944): No heartbeat from core client for 30 sec - exiting 00:26:24 (2944): No heartbeat from core client for 30 sec - exiting 00:26:25 (2944): No heartbeat from core client for 30 sec - exiting 00:26:26 (2944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:10:29 (5184): No heartbeat from core client for 30 sec - exiting 19:10:30 (5184): No heartbeat from core client for 30 sec - exiting 19:10:31 (5184): No heartbeat from core client for 30 sec - exiting 19:10:32 (5184): No heartbeat from core client for 30 sec - exiting 19:10:33 (5184): No heartbeat from core client for 30 sec - exiting 19:10:34 (5184): No heartbeat from core client for 30 sec - exiting 19:10:35 (5184): No heartbeat from core client for 30 sec - exiting 19:10:37 (5184): No heartbeat from core client for 30 sec - exiting 19:10:38 (5184): No heartbeat from core client for 30 sec - exiting 19:10:39 (5184): No heartbeat from core client for 30 sec - exiting 19:10:40 (5184): No heartbeat from core client for 30 sec - exiting 19:10:41 (5184): No heartbeat from core client for 30 sec - exiting 19:10:42 (5184): No heartbeat from core client for 30 sec - exiting 19:10:43 (5184): No heartbeat from core client for 30 sec - exiting 19:10:44 (5184): No heartbeat from core client for 30 sec - exiting 19:10:45 (5184): No heartbeat from core client for 30 sec - exiting 19:10:46 (5184): No heartbeat from core client for 30 sec - exiting 19:10:48 (5184): No heartbeat from core client for 30 sec - exiting 19:10:49 (5184): No heartbeat from core client for 30 sec - exiting 19:10:50 (5184): No heartbeat from core client for 30 sec - exiting 19:10:51 (5184): No heartbeat from core client for 30 sec - exiting 19:10:52 (5184): No heartbeat from core client for 30 sec - exiting 19:10:53 (5184): No heartbeat from core client for 30 sec - exiting 19:10:54 (5184): No heartbeat from core client for 30 sec - exiting 19:10:55 (5184): No heartbeat from core client for 30 sec - exiting 19:10:56 (5184): No heartbeat from core client for 30 sec - exiting 19:10:57 (5184): No heartbeat from core client for 30 sec - exiting 19:10:58 (5184): No heartbeat from core client for 30 sec - exiting 19:11:00 (5184): No heartbeat from core client for 30 sec - exiting 19:11:01 (5184): No heartbeat from core client for 30 sec - exiting 19:11:02 (5184): No heartbeat from core client for 30 sec - exiting 19:11:03 (5184): No heartbeat from core client for 30 sec - exiting 19:11:04 (5184): No heartbeat from core client for 30 sec - exiting 19:11:05 (5184): No heartbeat from core client for 30 sec - exiting 19:11:06 (5184): No heartbeat from core client for 30 sec - exiting 19:11:07 (5184): No heartbeat from core client for 30 sec - exiting 19:11:08 (5184): No heartbeat from core client for 30 sec - exiting 19:11:09 (5184): No heartbeat from core client for 30 sec - exiting 19:11:10 (5184): No heartbeat from core client for 30 sec - exiting 19:11:12 (5184): No heartbeat from core client for 30 sec - exiting 19:11:13 (5184): No heartbeat from core client for 30 sec - exiting 19:11:14 (5184): No heartbeat from core client for 30 sec - exiting 19:11:15 (5184): No heartbeat from core client for 30 sec - exiting 19:11:16 (5184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:11:17 (5184): No heartbeat from core client for 30 sec - exiting 19:12:58 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:02:54 (4104): No heartbeat from core client for 30 sec - exiting 18:02:55 (4104): No heartbeat from core client for 30 sec - exiting 18:02:56 (4104): No heartbeat from core client for 30 sec - exiting 18:02:57 (4104): No heartbeat from core client for 30 sec - exiting 18:02:59 (4104): No heartbeat from core client for 30 sec - exiting 18:03:00 (4104): No heartbeat from core client for 30 sec - exiting 18:03:01 (4104): No heartbeat from core client for 30 sec - exiting 18:03:02 (4104): No heartbeat from core client for 30 sec - exiting 18:03:03 (4104): No heartbeat from core client for 30 sec - exiting 18:03:04 (4104): No heartbeat from core client for 30 sec - exiting 18:03:05 (4104): No heartbeat from core client for 30 sec - exiting 18:03:06 (4104): No heartbeat from core client for 30 sec - exiting 18:03:07 (4104): No heartbeat from core client for 30 sec - exiting 18:03:08 (4104): No heartbeat from core client for 30 sec - exiting 18:03:09 (4104): No heartbeat from core client for 30 sec - exiting 18:03:11 (4104): No heartbeat from core client for 30 sec - exiting 18:03:12 (4104): No heartbeat from core client for 30 sec - exiting 18:03:13 (4104): No heartbeat from core client for 30 sec - exiting 18:03:14 (4104): No heartbeat from core client for 30 sec - exiting 18:03:15 (4104): No heartbeat from core client for 30 sec - exiting 18:03:16 (4104): No heartbeat from core client for 30 sec - exiting 18:03:17 (4104): No heartbeat from core client for 30 sec - exiting 18:03:18 (4104): No heartbeat from core client for 30 sec - exiting 18:03:20 (4104): No heartbeat from core client for 30 sec - exiting 18:03:21 (4104): No heartbeat from core client for 30 sec - exiting 18:03:22 (4104): No heartbeat from core client for 30 sec - exiting 18:03:23 (4104): No heartbeat from core client for 30 sec - exiting 18:03:24 (4104): No heartbeat from core client for 30 sec - exiting 18:03:25 (4104): No heartbeat from core client for 30 sec - exiting 18:03:26 (4104): No heartbeat from core client for 30 sec - exiting 18:03:27 (4104): No heartbeat from core client for 30 sec - exiting 18:03:28 (4104): No heartbeat from core client for 30 sec - exiting 18:03:29 (4104): No heartbeat from core client for 30 sec - exiting 18:03:30 (4104): No heartbeat from core client for 30 sec - exiting 18:03:32 (4104): No heartbeat from core client for 30 sec - exiting 18:03:33 (4104): No heartbeat from core client for 30 sec - exiting 18:03:34 (4104): No heartbeat from core client for 30 sec - exiting 18:03:35 (4104): No heartbeat from core client for 30 sec - exiting 18:03:36 (4104): No heartbeat from core client for 30 sec - exiting 18:03:37 (4104): No heartbeat from core client for 30 sec - exiting 18:03:38 (4104): No heartbeat from core client for 30 sec - exiting 18:03:39 (4104): No heartbeat from core client for 30 sec - exiting 18:03:40 (4104): No heartbeat from core client for 30 sec - exiting 18:03:41 (4104): No heartbeat from core client for 30 sec - exiting 18:03:42 (4104): No heartbeat from core client for 30 sec - exiting 18:03:44 (4104): No heartbeat from core client for 30 sec - exiting 18:03:45 (4104): No heartbeat from core client for 30 sec - exiting 18:03:46 (4104): No heartbeat from core client for 30 sec - exiting 18:03:47 (4104): No heartbeat from core client for 30 sec - exiting 18:03:48 (4104): No heartbeat from core client for 30 sec - exiting 18:03:49 (4104): No heartbeat from core client for 30 sec - exiting 18:03:50 (4104): No heartbeat from core client for 30 sec - exiting 18:03:51 (4104): No heartbeat from core client for 30 sec - exiting 18:03:52 (4104): No heartbeat from core client for 30 sec - exiting 18:03:53 (4104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:05:58 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:01 (4248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:29:17 (5268): No heartbeat from core client for 30 sec - exiting 17:29:18 (5268): No heartbeat from core client for 30 sec - exiting 17:29:19 (5268): No heartbeat from core client for 30 sec - exiting 17:29:20 (5268): No heartbeat from core client for 30 sec - exiting 17:29:21 (5268): No heartbeat from core client for 30 sec - exiting 17:29:22 (5268): No heartbeat from core client for 30 sec - exiting 17:29:23 (5268): No heartbeat from core client for 30 sec - exiting 17:29:24 (5268): No heartbeat from core client for 30 sec - exiting 17:29:26 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:24 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4492, iMonCtr=1 Model crash detected, will try to restart... 19:44:49 (4564): No heartbeat from core client for 30 sec - exiting 19:44:50 (4564): No heartbeat from core client for 30 sec - exiting 19:44:51 (4564): No heartbeat from core client for 30 sec - exiting 19:44:52 (4564): No heartbeat from core client for 30 sec - exiting 19:44:53 (4564): No heartbeat from core client for 30 sec - exiting 19:44:54 (4564): No heartbeat from core client for 30 sec - exiting 19:44:56 (4564): No heartbeat from core client for 30 sec - exiting 19:44:57 (4564): No heartbeat from core client for 30 sec - exiting 19:44:58 (4564): No heartbeat from core client for 30 sec - exiting 19:44:59 (4564): No heartbeat from core client for 30 sec - exiting 19:45:00 (4564): No heartbeat from core client for 30 sec - exiting 19:45:01 (4564): No heartbeat from core client for 30 sec - exiting 19:45:02 (4564): No heartbeat from core client for 30 sec - exiting 19:45:03 (4564): No heartbeat from core client for 30 sec - exiting 19:45:04 (4564): No heartbeat from core client for 30 sec - exiting 19:45:05 (4564): No heartbeat from core client for 30 sec - exiting 19:45:06 (4564): No heartbeat from core client for 30 sec - exiting 19:45:08 (4564): No heartbeat from core client for 30 sec - exiting 19:45:09 (4564): No heartbeat from core client for 30 sec - exiting 19:45:10 (4564): No heartbeat from core client for 30 sec - exiting 19:45:11 (4564): No heartbeat from core client for 30 sec - exiting 19:45:12 (4564): No heartbeat from core client for 30 sec - exiting 19:45:13 (4564): No heartbeat from core client for 30 sec - exiting 19:45:14 (4564): No heartbeat from core client for 30 sec - exiting 19:45:15 (4564): No heartbeat from core client for 30 sec - exiting 19:45:16 (4564): No heartbeat from core client for 30 sec - exiting 19:45:17 (4564): No heartbeat from core client for 30 sec - exiting 19:45:19 (4564): No heartbeat from core client for 30 sec - exiting 19:45:20 (4564): No heartbeat from core client for 30 sec - exiting 19:45:21 (4564): No heartbeat from core client for 30 sec - exiting 19:45:22 (4564): No heartbeat from core client for 30 sec - exiting 19:45:23 (4564): No heartbeat from core client for 30 sec - exiting 19:45:24 (4564): No heartbeat from core client for 30 sec - exiting 19:45:25 (4564): No heartbeat from core client for 30 sec - exiting 19:45:26 (4564): No heartbeat from core client for 30 sec - exiting 19:45:27 (4564): No heartbeat from core client for 30 sec - exiting 19:45:28 (4564): No heartbeat from core client for 30 sec - exiting 19:45:29 (4564): No heartbeat from core client for 30 sec - exiting 19:45:31 (4564): No heartbeat from core client for 30 sec - exiting 19:45:32 (4564): No heartbeat from core client for 30 sec - exiting 19:45:33 (4564): No heartbeat from core client for 30 sec - exiting 19:45:34 (4564): No heartbeat from core client for 30 sec - exiting 19:45:35 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:21 (5420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:48:47 (5800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2152, iMonCtr=1 Model crash detected, will try to restart... 17:19:46 (5140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=848, iMonCtr=1 Model crash detected, will try to restart... 17:37:59 (1492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5236, iMonCtr=1 Model crash detected, will try to restart... 09:20:22 (2804): No heartbeat from core client for 30 sec - exiting 09:20:23 (2804): No heartbeat from core client for 30 sec - exiting 09:20:24 (2804): No heartbeat from core client for 30 sec - exiting 09:20:25 (2804): No heartbeat from core client for 30 sec - exiting 09:20:26 (2804): No heartbeat from core client for 30 sec - exiting 09:20:27 (2804): No heartbeat from core client for 30 sec - exiting 09:20:28 (2804): No heartbeat from core client for 30 sec - exiting 09:20:29 (2804): No heartbeat from core client for 30 sec - exiting 09:20:30 (2804): No heartbeat from core client for 30 sec - exiting 09:20:32 (2804): No heartbeat from core client for 30 sec - exiting 09:20:33 (2804): No heartbeat from core client for 30 sec - exiting 09:20:34 (2804): No heartbeat from core client for 30 sec - exiting 09:20:35 (2804): No heartbeat from core client for 30 sec - exiting 09:20:36 (2804): No heartbeat from core client for 30 sec - exiting 09:20:37 (2804): No heartbeat from core client for 30 sec - exiting 09:20:38 (2804): No heartbeat from core client for 30 sec - exiting 09:20:39 (2804): No heartbeat from core client for 30 sec - exiting 09:20:40 (2804): No heartbeat from core client for 30 sec - exiting 09:20:41 (2804): No heartbeat from core client for 30 sec - exiting 09:20:42 (2804): No heartbeat from core client for 30 sec - exiting 09:20:44 (2804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:22:26 (4516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:18:46 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:48:00 (4184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:04:40 (4300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:50:26 (4164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:22:13 (4280): No heartbeat from core client for 30 sec - exiting 13:22:14 (4280): No heartbeat from core client for 30 sec - exiting 13:22:15 (4280): No heartbeat from core client for 30 sec - exiting 13:22:16 (4280): No heartbeat from core client for 30 sec - exiting 13:22:17 (4280): No heartbeat from core client for 30 sec - exiting 13:22:18 (4280): No heartbeat from core client for 30 sec - exiting 13:22:19 (4280): No heartbeat from core client for 30 sec - exiting 13:22:21 (4280): No heartbeat from core client for 30 sec - exiting 13:22:22 (4280): No heartbeat from core client for 30 sec - exiting 13:22:23 (4280): No heartbeat from core client for 30 sec - exiting 13:22:24 (4280): No heartbeat from core client for 30 sec - exiting 13:22:25 (4280): No heartbeat from core client for 30 sec - exiting 13:22:26 (4280): No heartbeat from core client for 30 sec - exiting 13:22:27 (4280): No heartbeat from core client for 30 sec - exiting 13:22:28 (4280): No heartbeat from core client for 30 sec - exiting 13:22:29 (4280): No heartbeat from core client for 30 sec - exiting 13:22:30 (4280): No heartbeat from core client for 30 sec - exiting 13:22:31 (4280): No heartbeat from core client for 30 sec - exiting 13:22:33 (4280): No heartbeat from core client for 30 sec - exiting 13:22:34 (4280): No heartbeat from core client for 30 sec - exiting 13:22:35 (4280): No heartbeat from core client for 30 sec - exiting 13:22:36 (4280): No heartbeat from core client for 30 sec - exiting 13:22:37 (4280): No heartbeat from core client for 30 sec - exiting 13:22:38 (4280): No heartbeat from core client for 30 sec - exiting 13:22:39 (4280): No heartbeat from core client for 30 sec - exiting 13:22:40 (4280): No heartbeat from core client for 30 sec - exiting 13:22:41 (4280): No heartbeat from core client for 30 sec - exiting 13:22:42 (4280): No heartbeat from core client for 30 sec - exiting 13:22:43 (4280): No heartbeat from core client for 30 sec - exiting 13:22:45 (4280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:26:29 (5072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:02:26 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=848, iMonCtr=1 Model crash detected, will try to restart... 10:44:16 (1756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5160, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Mar 2013 21:35:09	1186953	15650391	hadcm3n_z8jk_1960_40_008321506_1	259,200	429,044	1.6553
30 Mar 2013 19:04:16	1186953	15650391	hadcm3n_z8jk_1960_40_008321506_1	233,280	383,228	1.6428
29 Mar 2013 17:49:18	1186953	15650391	hadcm3n_z8jk_1960_40_008321506_1	207,360	338,877	1.6342
28 Mar 2013 18:01:49	1186953	15650391	hadcm3n_z8jk_1960_40_008321506_1	181,440	295,504	1.6287
26 Mar 2013 20:07:58	1186953	15650391	hadcm3n_z8jk_1960_40_008321506_1	155,520	253,065	1.6272
21 Mar 2013 22:15:16	1186953	15650391	hadcm3n_z8jk_1960_40_008321506_1	129,600	210,240	1.6222
20 Mar 2013 12:58:02	1186953	15650391	hadcm3n_z8jk_1960_40_008321506_1	103,680	167,299	1.6136
18 Mar 2013 21:20:41	1186953	15650391	hadcm3n_z8jk_1960_40_008321506_1	77,760	125,812	1.6180
13 Mar 2013 23:57:12	1186953	15650391	hadcm3n_z8jk_1960_40_008321506_1	51,840	83,843	1.6173
11 Mar 2013 21:42:53	1186953	15650391	hadcm3n_z8jk_1960_40_008321506_1	25,920	41,701	1.6088