Task 15813927

Name	hadcm3n_o61h_1940_40_008382429_0
Workunit	8533288
Created	1 Jun 2013, 4:49:25 UTC
Sent	2 Jun 2013, 17:46:50 UTC
Report deadline	2 Sep 2013, 1:14:01 UTC
Received	5 Jul 2013, 14:59:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1072815
Run time	10 days 20 hours 14 min 13 sec
CPU time	10 days 9 hours 44 min 22 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.64 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 21:06:23 (3284): No heartbeat from core client for 30 sec - exiting 21:06:24 (3284): No heartbeat from core client for 30 sec - exiting 21:06:25 (3284): No heartbeat from core client for 30 sec - exiting 21:06:26 (3284): No heartbeat from core client for 30 sec - exiting 21:06:27 (3284): No heartbeat from core client for 30 sec - exiting 21:06:28 (3284): No heartbeat from core client for 30 sec - exiting 21:06:29 (3284): No heartbeat from core client for 30 sec - exiting 21:06:30 (3284): No heartbeat from core client for 30 sec - exiting 21:06:31 (3284): No heartbeat from core client for 30 sec - exiting 21:06:32 (3284): No heartbeat from core client for 30 sec - exiting 21:06:34 (3284): No heartbeat from core client for 30 sec - exiting 21:06:35 (3284): No heartbeat from core client for 30 sec - exiting 21:06:36 (3284): No heartbeat from core client for 30 sec - exiting 21:06:37 (3284): No heartbeat from core client for 30 sec - exiting 21:06:38 (3284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:06:39 (3284): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 19:53:01 (6976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:54:06 (6840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:08 (4700): No heartbeat from core client for 30 sec - exiting 20:16:09 (4700): No heartbeat from core client for 30 sec - exiting 20:16:10 (4700): No heartbeat from core client for 30 sec - exiting 20:16:11 (4700): No heartbeat from core client for 30 sec - exiting 20:16:12 (4700): No heartbeat from core client for 30 sec - exiting 20:16:13 (4700): No heartbeat from core client for 30 sec - exiting 20:16:14 (4700): No heartbeat from core client for 30 sec - exiting 20:16:15 (4700): No heartbeat from core client for 30 sec - exiting 20:16:16 (4700): No heartbeat from core client for 30 sec - exiting 20:16:17 (4700): No heartbeat from core client for 30 sec - exiting 20:16:18 (4700): No heartbeat from core client for 30 sec - exiting 20:16:19 (4700): No heartbeat from core client for 30 sec - exiting 20:16:20 (4700): No heartbeat from core client for 30 sec - exiting 20:16:22 (4700): No heartbeat from core client for 30 sec - exiting 20:16:23 (4700): No heartbeat from core client for 30 sec - exiting 20:16:24 (4700): No heartbeat from core client for 30 sec - exiting 20:16:25 (4700): No heartbeat from core client for 30 sec - exiting 20:16:26 (4700): No heartbeat from core client for 30 sec - exiting 20:16:27 (4700): No heartbeat from core client for 30 sec - exiting 20:16:28 (4700): No heartbeat from core client for 30 sec - exiting 20:16:29 (4700): No heartbeat from core client for 30 sec - exiting 20:16:30 (4700): No heartbeat from core client for 30 sec - exiting 20:16:31 (4700): No heartbeat from core client for 30 sec - exiting 20:16:32 (4700): No heartbeat from core client for 30 sec - exiting 20:16:33 (4700): No heartbeat from core client for 30 sec - exiting 20:16:34 (4700): No heartbeat from core client for 30 sec - exiting 20:16:35 (4700): No heartbeat from core client for 30 sec - exiting 20:16:36 (4700): No heartbeat from core client for 30 sec - exiting 20:16:37 (4700): No heartbeat from core client for 30 sec - exiting 20:16:38 (4700): No heartbeat from core client for 30 sec - exiting 20:16:39 (4700): No heartbeat from core client for 30 sec - exiting 20:16:40 (4700): No heartbeat from core client for 30 sec - exiting 20:16:41 (4700): No heartbeat from core client for 30 sec - exiting 20:16:42 (4700): No heartbeat from core client for 30 sec - exiting 20:16:43 (4700): No heartbeat from core client for 30 sec - exiting 20:16:44 (4700): No heartbeat from core client for 30 sec - exiting 20:16:45 (4700): No heartbeat from core client for 30 sec - exiting 20:16:46 (4700): No heartbeat from core client for 30 sec - exiting 20:16:47 (4700): No heartbeat from core client for 30 sec - exiting 20:16:48 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6748, iMonCtr=1 Model crash detected, will try to restart... 00:22:27 (6596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6376, iMonCtr=1 Model crash detected, will try to restart... 08:27:52 (5352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:27:53 (5352): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5748, iMonCtr=1 Model crash detected, will try to restart... 12:33:21 (4024): No heartbeat from core client for 30 sec - exiting 12:33:22 (4024): No heartbeat from core client for 30 sec - exiting 12:33:23 (4024): No heartbeat from core client for 30 sec - exiting 12:33:25 (4024): No heartbeat from core client for 30 sec - exiting 12:33:26 (4024): No heartbeat from core client for 30 sec - exiting 12:33:27 (4024): No heartbeat from core client for 30 sec - exiting 12:33:28 (4024): No heartbeat from core client for 30 sec - exiting 12:33:29 (4024): No heartbeat from core client for 30 sec - exiting 12:33:30 (4024): No heartbeat from core client for 30 sec - exiting 12:33:31 (4024): No heartbeat from core client for 30 sec - exiting 12:33:32 (4024): No heartbeat from core client for 30 sec - exiting 12:33:33 (4024): No heartbeat from core client for 30 sec - exiting 12:33:34 (4024): No heartbeat from core client for 30 sec - exiting 12:33:35 (4024): No heartbeat from core client for 30 sec - exiting 12:33:37 (4024): No heartbeat from core client for 30 sec - exiting 12:33:38 (4024): No heartbeat from core client for 30 sec - exiting 12:33:39 (4024): No heartbeat from core client for 30 sec - exiting 12:33:40 (4024): No heartbeat from core client for 30 sec - exiting 12:33:41 (4024): No heartbeat from core client for 30 sec - exiting 12:33:42 (4024): No heartbeat from core client for 30 sec - exiting 12:33:43 (4024): No heartbeat from core client for 30 sec - exiting 12:33:44 (4024): No heartbeat from core client for 30 sec - exiting 12:33:45 (4024): No heartbeat from core client for 30 sec - exiting 12:33:46 (4024): No heartbeat from core client for 30 sec - exiting 12:33:47 (4024): No heartbeat from core client for 30 sec - exiting 12:33:49 (4024): No heartbeat from core client for 30 sec - exiting 12:33:50 (4024): No heartbeat from core client for 30 sec - exiting 12:33:51 (4024): No heartbeat from core client for 30 sec - exiting 12:33:52 (4024): No heartbeat from core client for 30 sec - exiting 12:33:53 (4024): No heartbeat from core client for 30 sec - exiting 12:33:54 (4024): No heartbeat from core client for 30 sec - exiting 12:33:55 (4024): No heartbeat from core client for 30 sec - exiting 12:33:56 (4024): No heartbeat from core client for 30 sec - exiting 12:33:57 (4024): No heartbeat from core client for 30 sec - exiting 12:33:59 (4024): No heartbeat from core client for 30 sec - exiting 12:34:00 (4024): No heartbeat from core client for 30 sec - exiting 12:34:01 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:34:02 (4024): No heartbeat from core client for 30 sec - exiting 12:34:03 (4024): No heartbeat from core client for 30 sec - exiting 12:34:04 (4024): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... C11:31:04 (5652): No heartbeat from core client for 30 sec - exiting 11:31:05 (5652): No heartbeat from core client for 30 sec - exiting 11:31:07 (5652): No heartbeat from core client for 30 sec - exiting 11:31:08 (5652): No heartbeat from core client for 30 sec - exiting 11:31:09 (5652): No heartbeat from core client for 30 sec - exiting 11:31:10 (5652): No heartbeat from core client for 30 sec - exiting 11:31:11 (5652): No heartbeat from core client for 30 sec - exiting 11:31:12 (5652): No heartbeat from core client for 30 sec - exiting 11:31:13 (5652): No heartbeat from core client for 30 sec - exiting 11:31:14 (5652): No heartbeat from core client for 30 sec - exiting 11:31:15 (5652): No heartbeat from core client for 30 sec - exiting 11:31:16 (5652): No heartbeat from core client for 30 sec - exiting 11:31:18 (5652): No heartbeat from core client for 30 sec - exiting 11:31:19 (5652): No heartbeat from core client for 30 sec - exiting 11:31:20 (5652): No heartbeat from core client for 30 sec - exiting 11:31:21 (5652): No heartbeat from core client for 30 sec - exiting 11:31:22 (5652): No heartbeat from core client for 30 sec - exiting 11:31:23 (5652): No heartbeat from core client for 30 sec - exiting 11:31:24 (5652): No heartbeat from core client for 30 sec - exiting 11:31:25 (5652): No heartbeat from core client for 30 sec - exiting 11:31:26 (5652): No heartbeat from core client for 30 sec - exiting 11:31:27 (5652): No heartbeat from core client for 30 sec - exiting 11:31:28 (5652): No heartbeat from core client for 30 sec - exiting 11:31:30 (5652): No heartbeat from core client for 30 sec - exiting 11:31:31 (5652): No heartbeat from core client for 30 sec - exiting 11:31:32 (5652): No heartbeat from core client for 30 sec - exiting 11:31:33 (5652): No heartbeat from core client for 30 sec - exiting 11:31:34 (5652): No heartbeat from core client for 30 sec - exiting 11:31:35 (5652): No heartbeat from core client for 30 sec - exiting 11:31:36 (5652): No heartbeat from core client for 30 sec - exiting 11:31:37 (5652): No heartbeat from core client for 30 sec - exiting 11:31:38 (5652): No heartbeat from core client for 30 sec - exiting 11:31:39 (5652): No heartbeat from core client for 30 sec - exiting 11:31:40 (5652): No heartbeat from core client for 30 sec - exiting 11:31:42 (5652): No heartbeat from core client for 30 sec - exiting 11:31:43 (5652): No heartbeat from core client for 30 sec - exiting 11:31:44 (5652): No heartbeat from core client for 30 sec - exiting 11:31:45 (5652): No heartbeat from core client for 30 sec - exiting 11:31:46 (5652): No heartbeat from core client for 30 sec - exiting 11:31:47 (5652): No heartbeat from core client for 30 sec - exiting 11:31:48 (5652): No heartbeat from core client for 30 sec - exiting 11:31:49 (5652): No heartbeat from core client for 30 sec - exiting 11:31:50 (5652): No heartbeat from core client for 30 sec - exiting 11:31:51 (5652): No heartbeat from core client for 30 sec - exiting 11:31:53 (5652): No heartbeat from core client for 30 sec - exiting 11:31:54 (5652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:03:18 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:51:13 (3828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:48:18 (5360): No heartbeat from core client for 30 sec - exiting 18:48:19 (5360): No heartbeat from core client for 30 sec - exiting 18:48:20 (5360): No heartbeat from core client for 30 sec - exiting 18:48:21 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:34:59 (1500): No heartbeat from core client for 30 sec - exiting 18:35:00 (1500): No heartbeat from core client for 30 sec - exiting 18:35:01 (1500): No heartbeat from core client for 30 sec - exiting 18:35:02 (1500): No heartbeat from core client for 30 sec - exiting 18:35:03 (1500): No heartbeat from core client for 30 sec - exiting 18:35:04 (1500): No heartbeat from core client for 30 sec - exiting 18:35:05 (1500): No heartbeat from core client for 30 sec - exiting 18:35:06 (1500): No heartbeat from core client for 30 sec - exiting 18:35:07 (1500): No heartbeat from core client for 30 sec - exiting 18:35:08 (1500): No heartbeat from core client for 30 sec - exiting 18:35:09 (1500): No heartbeat from core client for 30 sec - exiting 18:35:10 (1500): No heartbeat from core client for 30 sec - exiting 18:35:11 (1500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:56:22 (3292): No heartbeat from core client for 30 sec - exiting 19:56:23 (3292): No heartbeat from core client for 30 sec - exiting 19:56:24 (3292): No heartbeat from core client for 30 sec - exiting 19:56:25 (3292): No heartbeat from core client for 30 sec - exiting 19:56:27 (3292): No heartbeat from core client for 30 sec - exiting 19:56:28 (3292): No heartbeat from core client for 30 sec - exiting 19:56:29 (3292): No heartbeat from core client for 30 sec - exiting 19:56:30 (3292): No heartbeat from core client for 30 sec - exiting 19:56:31 (3292): No heartbeat from core client for 30 sec - exiting 19:56:32 (3292): No heartbeat from core client for 30 sec - exiting 19:56:33 (3292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:34 (3292): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:55:22 (4644): No heartbeat from core client for 30 sec - exiting 19:55:23 (4644): No heartbeat from core client for 30 sec - exiting 19:55:24 (4644): No heartbeat from core client for 30 sec - exiting 19:55:25 (4644): No heartbeat from core client for 30 sec - exiting 19:55:26 (4644): No heartbeat from core client for 30 sec - exiting 19:55:27 (4644): No heartbeat from core client for 30 sec - exiting 19:55:28 (4644): No heartbeat from core client for 30 sec - exiting 19:55:29 (4644): No heartbeat from core client for 30 sec - exiting 19:55:31 (4644): No heartbeat from core client for 30 sec - exiting 19:55:32 (4644): No heartbeat from core client for 30 sec - exiting 19:55:33 (4644): No heartbeat from core client for 30 sec - exiting 19:55:34 (4644): No heartbeat from core client for 30 sec - exiting 19:55:35 (4644): No heartbeat from core client for 30 sec - exiting 19:55:36 (4644): No heartbeat from core client for 30 sec - exiting 19:55:37 (4644): No heartbeat from core client for 30 sec - exiting 19:55:38 (4644): No heartbeat from core client for 30 sec - exiting 19:55:39 (4644): No heartbeat from core client for 30 sec - exiting 19:55:40 (4644): No heartbeat from core client for 30 sec - exiting 19:55:41 (4644): No heartbeat from core client for 30 sec - exiting 19:55:42 (4644): No heartbeat from core client for 30 sec - exiting 19:55:43 (4644): No heartbeat from core client for 30 sec - exiting 19:55:44 (4644): No heartbeat from core client for 30 sec - exiting 19:55:45 (4644): No heartbeat from core client for 30 sec - exiting 19:55:46 (4644): No heartbeat from core client for 30 sec - exiting 19:55:47 (4644): No heartbeat from core client for 30 sec - exiting 19:55:48 (4644): No heartbeat from core client for 30 sec - exiting 19:55:49 (4644): No heartbeat from core client for 30 sec - exiting 19:55:50 (4644): No heartbeat from core client for 30 sec - exiting 19:55:51 (4644): No heartbeat from core client for 30 sec - exiting 19:55:52 (4644): No heartbeat from core client for 30 sec - exiting 19:55:53 (4644): No heartbeat from core client for 30 sec - exiting 19:55:54 (4644): No heartbeat from core client for 30 sec - exiting 19:55:55 (4644): No heartbeat from core client for 30 sec - exiting 19:55:56 (4644): No heartbeat from core client for 30 sec - exiting 19:55:57 (4644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:59 (4644): No heartbeat from core client for 30 sec - exiting 19:56:00 (4644): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:48:53 (1988): No heartbeat from core client for 30 sec - exiting 12:48:56 (1988): No heartbeat from core client for 30 sec - exiting 12:48:57 (1988): No heartbeat from core client for 30 sec - exiting 12:48:58 (1988): No heartbeat from core client for 30 sec - exiting 12:48:59 (1988): No heartbeat from core client for 30 sec - exiting 12:49:00 (1988): No heartbeat from core client for 30 sec - exiting 12:49:01 (1988): No heartbeat from core client for 30 sec - exiting 12:49:02 (1988): No heartbeat from core client for 30 sec - exiting 12:49:03 (1988): No heartbeat from core client for 30 sec - exiting 12:49:04 (1988): No heartbeat from core client for 30 sec - exiting 12:49:05 (1988): No heartbeat from core client for 30 sec - exiting 12:49:06 (1988): No heartbeat from core client for 30 sec - exiting 12:49:07 (1988): No heartbeat from core client for 30 sec - exiting 12:49:09 (1988): No heartbeat from core client for 30 sec - exiting 12:49:10 (1988): No heartbeat from core client for 30 sec - exiting 12:49:11 (1988): No heartbeat from core client for 30 sec - exiting 12:49:12 (1988): No heartbeat from core client for 30 sec - exiting 12:49:13 (1988): No heartbeat from core client for 30 sec - exiting 12:49:14 (1988): No heartbeat from core client for 30 sec - exiting 12:49:15 (1988): No heartbeat from core client for 30 sec - exiting 12:49:16 (1988): No heartbeat from core client for 30 sec - exiting 12:49:17 (1988): No heartbeat from core client for 30 sec - exiting 12:49:18 (1988): No heartbeat from core client for 30 sec - exiting 12:49:19 (1988): No heartbeat from core client for 30 sec - exiting 12:49:20 (1988): No heartbeat from core client for 30 sec - exiting 12:49:21 (1988): No heartbeat from core client for 30 sec - exiting 12:49:22 (1988): No heartbeat from core client for 30 sec - exiting 12:49:23 (1988): No heartbeat from core client for 30 sec - exiting 12:49:25 (1988): No heartbeat from core client for 30 sec - exiting 12:49:26 (1988): No heartbeat from core client for 30 sec - exiting 12:49:27 (1988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:51:26 (6860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:13:31 (5796): No heartbeat from core client for 30 sec - exiting 19:13:32 (5796): No heartbeat from core client for 30 sec - exiting 19:13:33 (5796): No heartbeat from core client for 30 sec - exiting 19:13:34 (5796): No heartbeat from core client for 30 sec - exiting 19:13:35 (5796): No heartbeat from core client for 30 sec - exiting 19:13:36 (5796): No heartbeat from core client for 30 sec - exiting 19:13:37 (5796): No heartbeat from core client for 30 sec - exiting 19:13:38 (5796): No heartbeat from core client for 30 sec - exiting 19:13:39 (5796): No heartbeat from core client for 30 sec - exiting 19:13:41 (5796): No heartbeat from core client for 30 sec - exiting 19:13:42 (5796): No heartbeat from core client for 30 sec - exiting 19:13:43 (5796): No heartbeat from core client for 30 sec - exiting 19:13:44 (5796): No heartbeat from core client for 30 sec - exiting 19:13:45 (5796): No heartbeat from core client for 30 sec - exiting 19:13:46 (5796): No heartbeat from core client for 30 sec - exiting 19:13:47 (5796): No heartbeat from core client for 30 sec - exiting 19:13:48 (5796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:14:46 (896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:07:58 (7560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:18:35 (3244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:19:09 (5744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:25:35 (7304): No heartbeat from core client for 30 sec - exiting 19:25:36 (7304): No heartbeat from core client for 30 sec - exiting 19:25:37 (7304): No heartbeat from core client for 30 sec - exiting 19:25:38 (7304): No heartbeat from core client for 30 sec - exiting 19:25:39 (7304): No heartbeat from core client for 30 sec - exiting 19:25:40 (7304): No heartbeat from core client for 30 sec - exiting 19:25:41 (7304): No heartbeat from core client for 30 sec - exiting 19:25:42 (7304): No heartbeat from core client for 30 sec - exiting 19:25:43 (7304): No heartbeat from core client for 30 sec - exiting 19:25:44 (7304): No heartbeat from core client for 30 sec - exiting 19:25:46 (7304): No heartbeat from core client for 30 sec - exiting 19:25:47 (7304): No heartbeat from core client for 30 sec - exiting 19:25:48 (7304): No heartbeat from core client for 30 sec - exiting 19:25:49 (7304): No heartbeat from core client for 30 sec - exiting 19:25:50 (7304): No heartbeat from core client for 30 sec - exiting 19:25:51 (7304): No heartbeat from core client for 30 sec - exiting 19:25:52 (7304): No heartbeat from core client for 30 sec - exiting 19:25:53 (7304): No heartbeat from core client for 30 sec - exiting 19:25:54 (7304): No heartbeat from core client for 30 sec - exiting 19:25:55 (7304): No heartbeat from core client for 30 sec - exiting 19:25:56 (7304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:25:58 (7304): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:05:07 (6924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:09:36 (3332): No heartbeat from core client for 30 sec - exiting 23:09:37 (3332): No heartbeat from core client for 30 sec - exiting 23:09:38 (3332): No heartbeat from core client for 30 sec - exiting 23:09:39 (3332): No heartbeat from core client for 30 sec - exiting 23:09:40 (3332): No heartbeat from core client for 30 sec - exiting 23:09:41 (3332): No heartbeat from core client for 30 sec - exiting 23:09:42 (3332): No heartbeat from core client for 30 sec - exiting 23:09:43 (3332): No heartbeat from core client for 30 sec - exiting 23:09:44 (3332): No heartbeat from core client for 30 sec - exiting 23:09:45 (3332): No heartbeat from core client for 30 sec - exiting 23:09:47 (3332): No heartbeat from core client for 30 sec - exiting 23:09:48 (3332): No heartbeat from core client for 30 sec - exiting 23:09:49 (3332): No heartbeat from core client for 30 sec - exiting 23:09:50 (3332): No heartbeat from core client for 30 sec - exiting 23:09:51 (3332): No heartbeat from core client for 30 sec - exiting 23:09:52 (3332): No heartbeat from core client for 30 sec - exiting 23:09:53 (3332): No heartbeat from core client for 30 sec - exiting 23:09:54 (3332): No heartbeat from core client for 30 sec - exiting 23:09:55 (3332): No heartbeat from core client for 30 sec - exiting 23:09:56 (3332): No heartbeat from core client for 30 sec - exiting 23:09:58 (3332): No heartbeat from core client for 30 sec - exiting 23:09:59 (3332): No heartbeat from core client for 30 sec - exiting 23:10:00 (3332): No heartbeat from core client for 30 sec - exiting 23:10:01 (3332): No heartbeat from core client for 30 sec - exiting 23:10:02 (3332): No heartbeat from core client for 30 sec - exiting 23:10:03 (3332): No heartbeat from core client for 30 sec - exiting 23:10:04 (3332): No heartbeat from core client for 30 sec - exiting 23:10:05 (3332): No heartbeat from core client for 30 sec - exiting 23:10:07 (3332): No heartbeat from core client for 30 sec - exiting 23:10:08 (3332): No heartbeat from core client for 30 sec - exiting 23:10:09 (3332): No heartbeat from core client for 30 sec - exiting 23:10:10 (3332): No heartbeat from core client for 30 sec - exiting 23:10:11 (3332): No heartbeat from core client for 30 sec - exiting 23:10:12 (3332): No heartbeat from core client for 30 sec - exiting 23:10:13 (3332): No heartbeat from core client for 30 sec - exiting 23:10:14 (3332): No heartbeat from core client for 30 sec - exiting 23:10:16 (3332): No heartbeat from core client for 30 sec - exiting 23:10:17 (3332): No heartbeat from core client for 30 sec - exiting 23:10:18 (3332): No heartbeat from core client for 30 sec - exiting 23:10:19 (3332): No heartbeat from core client for 30 sec - exiting 23:10:20 (3332): No heartbeat from core client for 30 sec - exiting 23:10:21 (3332): No heartbeat from core client for 30 sec - exiting 23:10:23 (3332): No heartbeat from core client for 30 sec - exiting 23:10:24 (3332): No heartbeat from core client for 30 sec - exiting 23:10:25 (3332): No heartbeat from core client for 30 sec - exiting 23:10:26 (3332): No heartbeat from core client for 30 sec - exiting 23:10:27 (3332): No heartbeat from core client for 30 sec - exiting 23:10:28 (3332): No heartbeat from core client for 30 sec - exiting 23:10:29 (3332): No heartbeat from core client for 30 sec - exiting 23:10:30 (3332): No heartbeat from core client for 30 sec - exiting 23:10:32 (3332): No heartbeat from core client for 30 sec - exiting 23:10:33 (3332): No heartbeat from core client for 30 sec - exiting 23:10:34 (3332): No heartbeat from core client for 30 sec - exiting 23:10:35 (3332): No heartbeat from core client for 30 sec - exiting 23:10:36 (3332): No heartbeat from core client for 30 sec - exiting 23:10:37 (3332): No heartbeat from core client for 30 sec - exiting 23:10:38 (3332): No heartbeat from core client for 30 sec - exiting 23:10:40 (3332): No heartbeat from core client for 30 sec - exiting 23:10:41 (3332): No heartbeat from core client for 30 sec - exiting 23:10:42 (3332): No heartbeat from core client for 30 sec - exiting 23:10:43 (3332): No heartbeat from core client for 30 sec - exiting 23:10:44 (3332): No heartbeat from core client for 30 sec - exiting 23:10:45 (3332): No heartbeat from core client for 30 sec - exiting 23:10:46 (3332): No heartbeat from core client for 30 sec - exiting 23:10:47 (3332): No heartbeat from core client for 30 sec - exiting 23:10:48 (3332): No heartbeat from core client for 30 sec - exiting 23:10:49 (3332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:39:40 (5852): No heartbeat from core client for 30 sec - exiting 11:39:41 (5852): No heartbeat from core client for 30 sec - exiting 11:39:42 (5852): No heartbeat from core client for 30 sec - exiting 11:39:43 (5852): No heartbeat from core client for 30 sec - exiting 11:39:44 (5852): No heartbeat from core client for 30 sec - exiting 11:40:18 (5852): No heartbeat from core client for 30 sec - exiting 11:40:19 (5852): No heartbeat from core client for 30 sec - exiting 11:40:21 (5852): No heartbeat from core client for 30 sec - exiting 11:40:22 (5852): No heartbeat from core client for 30 sec - exiting 11:40:23 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:40:24 (5852): No heartbeat from core client for 30 sec - exiting 11:40:25 (5852): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:48:43 (5864): No heartbeat from core client for 30 sec - exiting 11:48:44 (5864): No heartbeat from core client for 30 sec - exiting 11:48:45 (5864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:02:37 (1212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:20:24 (6164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:43:55 (3084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:33:37 (1204): No heartbeat from core client for 30 sec - exiting 18:33:38 (1204): No heartbeat from core client for 30 sec - exiting 18:33:39 (1204): No heartbeat from core client for 30 sec - exiting 18:33:41 (1204): No heartbeat from core client for 30 sec - exiting 18:33:42 (1204): No heartbeat from core client for 30 sec - exiting 18:33:43 (1204): No heartbeat from core client for 30 sec - exiting 18:33:44 (1204): No heartbeat from core client for 30 sec - exiting 18:33:45 (1204): No heartbeat from core client for 30 sec - exiting 18:33:46 (1204): No heartbeat from core client for 30 sec - exiting 18:33:47 (1204): No heartbeat from core client for 30 sec - exiting 18:33:48 (1204): No heartbeat from core client for 30 sec - exiting 18:33:49 (1204): No heartbeat from core client for 30 sec - exiting 18:33:50 (1204): No heartbeat from core client for 30 sec - exiting 18:33:51 (1204): No heartbeat from core client for 30 sec - exiting 18:33:53 (1204): No heartbeat from core client for 30 sec - exiting 18:33:54 (1204): No heartbeat from core client for 30 sec - exiting 18:33:55 (1204): No heartbeat from core client for 30 sec - exiting 18:33:56 (1204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6740, iMonCtr=1 Model crash detected, will try to restart... 19:55:52 (1380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:00:33 (6196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:15 (5516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:10:30 (3304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:10:31 (3304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:31:15 (6276): No heartbeat from core client for 30 sec - exiting 18:31:16 (6276): No heartbeat from core client for 30 sec - exiting 18:31:17 (6276): No heartbeat from core client for 30 sec - exiting 18:31:18 (6276): No heartbeat from core client for 30 sec - exiting 18:31:20 (6276): No heartbeat from core client for 30 sec - exiting 18:31:21 (6276): No heartbeat from core client for 30 sec - exiting 18:31:22 (6276): No heartbeat from core client for 30 sec - exiting 18:31:23 (6276): No heartbeat from core client for 30 sec - exiting 18:31:24 (6276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:21:44 (5212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:22:21 (3432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jul 2013 05:04:36	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	518,400	899,058	1.7343
04 Jul 2013 16:41:53	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	492,480	854,035	1.7342
02 Jul 2013 11:52:00	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	466,560	809,757	1.7356
02 Jul 2013 10:37:31	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	440,640	764,984	1.7361
02 Jul 2013 09:45:10	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	414,720	720,150	1.7365
27 Jun 2013 20:15:12	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	388,800	674,471	1.7348
24 Jun 2013 22:20:36	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	362,880	629,992	1.7361
23 Jun 2013 13:03:30	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	336,960	585,461	1.7375
21 Jun 2013 22:53:58	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	311,040	540,311	1.7371
21 Jun 2013 09:38:50	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	285,120	495,348	1.7373
18 Jun 2013 21:20:14	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	259,200	450,924	1.7397
17 Jun 2013 13:07:42	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	233,280	406,700	1.7434
16 Jun 2013 12:37:24	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	207,360	362,429	1.7478
14 Jun 2013 22:54:47	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	181,440	317,349	1.7491
12 Jun 2013 17:38:53	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	155,520	272,889	1.7547
09 Jun 2013 21:31:51	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	129,600	228,146	1.7604
08 Jun 2013 23:20:54	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	103,680	182,932	1.7644
08 Jun 2013 09:34:00	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	77,760	136,326	1.7532
07 Jun 2013 10:56:25	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	51,840	91,038	1.7561
04 Jun 2013 20:59:06	1072815	15813927	hadcm3n_o61h_1940_40_008382429_0	25,920	45,363	1.7501