Task 15987709

Name	hadcm3n_7wy0_1980_40_008453979_0
Workunit	8604835
Created	30 Aug 2013, 17:31:41 UTC
Sent	16 Sep 2013, 19:13:37 UTC
Report deadline	17 Dec 2013, 2:40:48 UTC
Received	21 Dec 2013, 17:43:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1116570
Run time	18 days 20 hours 59 min 15 sec
CPU time	18 days 7 hours 59 min 6 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.65 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1684, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:58:24 (5604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:20:36 (2436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:27:55 (5988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:18:31 (4016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:14:14 (2096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2076, iMonCtr=1 Model crash detected, will try to restart... 19:16:34 (5488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:52:58 (3000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:26:20 (5248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4132, iMonCtr=1 Model crash detected, will try to restart... 09:05:06 (5448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:18:19 (4676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:37:08 (3564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:42:03 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5952, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5520, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 17:02:53 (4720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5668, iMonCtr=1 Model crash detected, will try to restart... 10:38:11 (5984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:24:33 (5132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:24:01 (5188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:50:03 (1324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:31:51 (5828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:54:59 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:55:00 (5792): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:27:22 (5552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:03:47 (5044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:58 (3340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:59 (3340): No heartbeat from core client for 30 sec - exiting 20:31:08 (2812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:20 (5484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:10 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2296, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3076, iMonCtr=1 Model crash detected, will try to restart... 20:21:58 (3860): No heartbeat from core client for 30 sec - exiting 20:21:59 (3860): No heartbeat from core client for 30 sec - exiting 20:22:00 (3860): No heartbeat from core client for 30 sec - exiting 20:22:01 (3860): No heartbeat from core client for 30 sec - exiting 20:22:02 (3860): No heartbeat from core client for 30 sec - exiting 20:22:03 (3860): No heartbeat from core client for 30 sec - exiting 20:22:04 (3860): No heartbeat from core client for 30 sec - exiting 20:22:06 (3860): No heartbeat from core client for 30 sec - exiting 20:22:07 (3860): No heartbeat from core client for 30 sec - exiting 20:22:08 (3860): No heartbeat from core client for 30 sec - exiting 20:22:09 (3860): No heartbeat from core client for 30 sec - exiting 20:22:10 (3860): No heartbeat from core client for 30 sec - exiting 20:22:11 (3860): No heartbeat from core client for 30 sec - exiting 20:22:12 (3860): No heartbeat from core client for 30 sec - exiting 20:22:13 (3860): No heartbeat from core client for 30 sec - exiting 20:22:14 (3860): No heartbeat from core client for 30 sec - exiting 20:22:15 (3860): No heartbeat from core client for 30 sec - exiting 20:22:16 (3860): No heartbeat from core client for 30 sec - exiting 20:22:18 (3860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:12 (2756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:13:49 (5276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:15:44 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:28 (3608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... C20:13:00 (3368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:40 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:43:19 (5648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:22:31 (5468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:05:59 (2272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:46:59 (4736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:16:19 (5620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... C10:03:51 (1036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2848, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:03:24 (6084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:10:31 (4932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:17:22 (5484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5312, iMonCtr=1 Model crash detected, will try to restart... 10:31:23 (3064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:29:15 (5380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:02:34 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:53:26 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:38:08 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:41:48 (5276): No heartbeat from core client for 30 sec - exiting 08:41:49 (5276): No heartbeat from core client for 30 sec - exiting 08:41:50 (5276): No heartbeat from core client for 30 sec - exiting 08:41:51 (5276): No heartbeat from core client for 30 sec - exiting 08:41:52 (5276): No heartbeat from core client for 30 sec - exiting 08:41:53 (5276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:32:26 (4084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:02:24 (4472): No heartbeat from core client for 30 sec - exiting 18:02:26 (4472): No heartbeat from core client for 30 sec - exiting 18:02:27 (4472): No heartbeat from core client for 30 sec - exiting 18:02:28 (4472): No heartbeat from core client for 30 sec - exiting 18:02:29 (4472): No heartbeat from core client for 30 sec - exiting 18:02:30 (4472): No heartbeat from core client for 30 sec - exiting 18:02:31 (4472): No heartbeat from core client for 30 sec - exiting 18:02:32 (4472): No heartbeat from core client for 30 sec - exiting 18:02:33 (4472): No heartbeat from core client for 30 sec - exiting 18:02:34 (4472): No heartbeat from core client for 30 sec - exiting 18:02:35 (4472): No heartbeat from core client for 30 sec - exiting 18:02:37 (4472): No heartbeat from core client for 30 sec - exiting 18:02:38 (4472): No heartbeat from core client for 30 sec - exiting 18:02:39 (4472): No heartbeat from core client for 30 sec - exiting 18:02:40 (4472): No heartbeat from core client for 30 sec - exiting 18:02:41 (4472): No heartbeat from core client for 30 sec - exiting 18:02:42 (4472): No heartbeat from core client for 30 sec - exiting 18:02:43 (4472): No heartbeat from core client for 30 sec - exiting 18:02:44 (4472): No heartbeat from core client for 30 sec - exiting 18:02:45 (4472): No heartbeat from core client for 30 sec - exiting 18:02:46 (4472): No heartbeat from core client for 30 sec - exiting 18:02:47 (4472): No heartbeat from core client for 30 sec - exiting 18:02:48 (4472): No heartbeat from core client for 30 sec - exiting 18:02:49 (4472): No heartbeat from core client for 30 sec - exiting 18:02:50 (4472): No heartbeat from core client for 30 sec - exiting 18:02:51 (4472): No heartbeat from core client for 30 sec - exiting 18:02:52 (4472): No heartbeat from core client for 30 sec - exiting 18:02:53 (4472): No heartbeat from core client for 30 sec - exiting 18:02:54 (4472): No heartbeat from core client for 30 sec - exiting 18:02:55 (4472): No heartbeat from core client for 30 sec - exiting 18:02:56 (4472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:14:41 (3804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:54:56 (4116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:09:21 (5612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:35:46 (4436): No heartbeat from core client for 30 sec - exiting 17:35:47 (4436): No heartbeat from core client for 30 sec - exiting 17:35:48 (4436): No heartbeat from core client for 30 sec - exiting 17:35:49 (4436): No heartbeat from core client for 30 sec - exiting 17:35:51 (4436): No heartbeat from core client for 30 sec - exiting 17:35:52 (4436): No heartbeat from core client for 30 sec - exiting 17:35:53 (4436): No heartbeat from core client for 30 sec - exiting 17:35:54 (4436): No heartbeat from core client for 30 sec - exiting 17:35:55 (4436): No heartbeat from core client for 30 sec - exiting 17:35:56 (4436): No heartbeat from core client for 30 sec - exiting 17:35:57 (4436): No heartbeat from core client for 30 sec - exiting 17:35:58 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:45:32 (5120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:15:24 (4348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:13:37 (5640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:01:43 (3020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:52:21 (5128): No heartbeat from core client for 30 sec - exiting 08:52:22 (5128): No heartbeat from core client for 30 sec - exiting 08:52:23 (5128): No heartbeat from core client for 30 sec - exiting 08:52:24 (5128): No heartbeat from core client for 30 sec - exiting 08:52:25 (5128): No heartbeat from core client for 30 sec - exiting 08:52:26 (5128): No heartbeat from core client for 30 sec - exiting 08:52:27 (5128): No heartbeat from core client for 30 sec - exiting 08:52:28 (5128): No heartbeat from core client for 30 sec - exiting 08:52:29 (5128): No heartbeat from core client for 30 sec - exiting 08:52:30 (5128): No heartbeat from core client for 30 sec - exiting 08:52:31 (5128): No heartbeat from core client for 30 sec - exiting 08:52:32 (5128): No heartbeat from core client for 30 sec - exiting 08:52:33 (5128): No heartbeat from core client for 30 sec - exiting 08:52:34 (5128): No heartbeat from core client for 30 sec - exiting 08:52:35 (5128): No heartbeat from core client for 30 sec - exiting 08:52:36 (5128): No heartbeat from core client for 30 sec - exiting 08:52:37 (5128): No heartbeat from core client for 30 sec - exiting 08:52:38 (5128): No heartbeat from core client for 30 sec - exiting 08:52:39 (5128): No heartbeat from core client for 30 sec - exiting 08:52:40 (5128): No heartbeat from core client for 30 sec - exiting 08:52:41 (5128): No heartbeat from core client for 30 sec - exiting 08:52:42 (5128): No heartbeat from core client for 30 sec - exiting 08:52:43 (5128): No heartbeat from core client for 30 sec - exiting 08:52:44 (5128): No heartbeat from core client for 30 sec - exiting 08:52:45 (5128): No heartbeat from core client for 30 sec - exiting 08:52:46 (5128): No heartbeat from core client for 30 sec - exiting 08:52:47 (5128): No heartbeat from core client for 30 sec - exiting 08:52:48 (5128): No heartbeat from core client for 30 sec - exiting 08:52:49 (5128): No heartbeat from core client for 30 sec - exiting 08:52:50 (5128): No heartbeat from core client for 30 sec - exiting 08:52:51 (5128): No heartbeat from core client for 30 sec - exiting 08:52:52 (5128): No heartbeat from core client for 30 sec - exiting 08:52:53 (5128): No heartbeat from core client for 30 sec - exiting 08:52:54 (5128): No heartbeat from core client for 30 sec - exiting 08:52:55 (5128): No heartbeat from core client for 30 sec - exiting 08:52:56 (5128): No heartbeat from core client for 30 sec - exiting 08:52:57 (5128): No heartbeat from core client for 30 sec - exiting 08:52:58 (5128): No heartbeat from core client for 30 sec - exiting 08:52:59 (5128): No heartbeat from core client for 30 sec - exiting 08:53:00 (5128): No heartbeat from core client for 30 sec - exiting 08:53:01 (5128): No heartbeat from core client for 30 sec - exiting 08:53:02 (5128): No heartbeat from core client for 30 sec - exiting 08:53:03 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:39:16 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 20:22:25 (5000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:11:38 (5444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:14:37 (5456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:59:04 (5532): No heartbeat from core client for 30 sec - exiting 17:59:05 (5532): No heartbeat from core client for 30 sec - exiting 17:59:06 (5532): No heartbeat from core client for 30 sec - exiting 17:59:07 (5532): No heartbeat from core client for 30 sec - exiting 17:59:08 (5532): No heartbeat from core client for 30 sec - exiting 17:59:09 (5532): No heartbeat from core client for 30 sec - exiting 17:59:10 (5532): No heartbeat from core client for 30 sec - exiting 17:59:11 (5532): No heartbeat from core client for 30 sec - exiting 17:59:12 (5532): No heartbeat from core client for 30 sec - exiting 17:59:13 (5532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:01:36 (4196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:26:50 (4252): No heartbeat from core client for 30 sec - exiting 18:26:51 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:00:46 (5800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:07 (5936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:14:43 (4336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... 09:20:19 (5264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:56:40 (2920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:39:10 (2300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:39:48 (5568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:28 (4924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:59:36 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:28:21 (1728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:52:11 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:11:23 (292): No heartbeat from core client for 30 sec - exiting 18:11:24 (292): No heartbeat from core client for 30 sec - exiting 18:11:25 (292): No heartbeat from core client for 30 sec - exiting 18:11:26 (292): No heartbeat from core client for 30 sec - exiting 18:11:28 (292): No heartbeat from core client for 30 sec - exiting 18:11:29 (292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:11:30 (292): No heartbeat from core client for 30 sec - exiting 18:11:31 (292): No heartbeat from core client for 30 sec - exiting 18:11:32 (292): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:05:23 (1448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:50:10 (4600): No heartbeat from core client for 30 sec - exiting 17:50:11 (4600): No heartbeat from core client for 30 sec - exiting 17:50:12 (4600): No heartbeat from core client for 30 sec - exiting 17:50:13 (4600): No heartbeat from core client for 30 sec - exiting 17:50:14 (4600): No heartbeat from core client for 30 sec - exiting 17:50:15 (4600): No heartbeat from core client for 30 sec - exiting 17:50:16 (4600): No heartbeat from core client for 30 sec - exiting 17:50:17 (4600): No heartbeat from core client for 30 sec - exiting 17:50:18 (4600): No heartbeat from core client for 30 sec - exiting 17:50:19 (4600): No heartbeat from core client for 30 sec - exiting 17:50:21 (4600): No heartbeat from core client for 30 sec - exiting 17:50:22 (4600): No heartbeat from core client for 30 sec - exiting 17:50:23 (4600): No heartbeat from core client for 30 sec - exiting 17:50:24 (4600): No heartbeat from core client for 30 sec - exiting 17:50:25 (4600): No heartbeat from core client for 30 sec - exiting 17:50:26 (4600): No heartbeat from core client for 30 sec - exiting 17:50:27 (4600): No heartbeat from core client for 30 sec - exiting 17:50:28 (4600): No heartbeat from core client for 30 sec - exiting 17:50:29 (4600): No heartbeat from core client for 30 sec - exiting 17:50:30 (4600): No heartbeat from core client for 30 sec - exiting 17:50:31 (4600): No heartbeat from core client for 30 sec - exiting 17:50:33 (4600): No heartbeat from core client for 30 sec - exiting 17:50:34 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:50:35 (4600): No heartbeat from core client for 30 sec - exiting 17:50:36 (4600): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:52:54 (4784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:13:30 (6140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:14 (2488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:35:14 (1352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:21:05 (1808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:21:42 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:30:20 (3192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:33:10 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:24:19 (1688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Dec 2013 16:45:05	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	777,600	1,583,943	2.0370
19 Dec 2013 21:25:35	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	751,680	1,530,589	2.0362
15 Dec 2013 19:05:00	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	725,760	1,477,967	2.0364
14 Dec 2013 14:43:06	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	699,840	1,425,509	2.0369
08 Dec 2013 18:48:14	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	673,920	1,373,109	2.0375
07 Dec 2013 13:33:20	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	648,000	1,321,143	2.0388
25 Nov 2013 20:17:20	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	622,080	1,270,339	2.0421
23 Nov 2013 13:48:15	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	596,160	1,217,520	2.0423
18 Nov 2013 20:11:19	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	570,240	1,165,017	2.0430
17 Nov 2013 16:18:48	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	544,320	1,114,099	2.0468
15 Nov 2013 21:47:31	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	518,400	1,062,346	2.0493
05 Nov 2013 16:26:00	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	492,480	1,006,493	2.0437
03 Nov 2013 09:53:15	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	466,560	951,540	2.0395
01 Nov 2013 20:33:27	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	440,640	894,588	2.0302
28 Oct 2013 20:56:47	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	414,720	843,783	2.0346
20 Oct 2013 12:16:00	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	388,800	791,806	2.0365
17 Oct 2013 18:44:13	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	362,880	739,444	2.0377
13 Oct 2013 13:07:40	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	336,960	687,053	2.0390
11 Oct 2013 20:28:38	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	311,040	633,965	2.0382
10 Oct 2013 20:33:58	1116570	15987709	hadcm3n_7wy0_1980_40_008453979_0	285,120	581,836	2.0407