Task 15134748

Name	hadcm3n_zhti_1880_40_008026188_4
Workunit	8181302
Created	17 Aug 2012, 13:01:18 UTC
Sent	17 Aug 2012, 14:21:53 UTC
Report deadline	16 Nov 2012, 21:49:04 UTC
Received	25 Sep 2012, 11:05:38 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1143449
Run time	6 days 0 hours 16 min 41 sec
CPU time	5 days 11 hours 33 min 11 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.41 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6588, iMonCtr=1 Model crash detected, will try to restart... 17:14:06 (1748): No heartbeat from core client for 30 sec - exiting 17:14:07 (1748): No heartbeat from core client for 30 sec - exiting 17:14:08 (1748): No heartbeat from core client for 30 sec - exiting 17:14:09 (1748): No heartbeat from core client for 30 sec - exiting 17:14:10 (1748): No heartbeat from core client for 30 sec - exiting 17:14:11 (1748): No heartbeat from core client for 30 sec - exiting 17:14:12 (1748): No heartbeat from core client for 30 sec - exiting 17:14:13 (1748): No heartbeat from core client for 30 sec - exiting 17:14:14 (1748): No heartbeat from core client for 30 sec - exiting 17:14:15 (1748): No heartbeat from core client for 30 sec - exiting 17:14:16 (1748): No heartbeat from core client for 30 sec - exiting 17:14:17 (1748): No heartbeat from core client for 30 sec - exiting 17:14:18 (1748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:11:50 (5408): No heartbeat from core client for 30 sec - exiting 12:11:51 (5408): No heartbeat from core client for 30 sec - exiting 12:11:52 (5408): No heartbeat from core client for 30 sec - exiting 12:11:53 (5408): No heartbeat from core client for 30 sec - exiting 12:11:54 (5408): No heartbeat from core client for 30 sec - exiting 12:11:55 (5408): No heartbeat from core client for 30 sec - exiting 12:11:56 (5408): No heartbeat from core client for 30 sec - exiting 12:11:57 (5408): No heartbeat from core client for 30 sec - exiting 12:11:58 (5408): No heartbeat from core client for 30 sec - exiting 12:11:59 (5408): No heartbeat from core client for 30 sec - exiting 12:12:00 (5408): No heartbeat from core client for 30 sec - exiting 12:12:01 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:31:36 (5604): No heartbeat from core client for 30 sec - exiting 10:31:37 (5604): No heartbeat from core client for 30 sec - exiting 10:31:38 (5604): No heartbeat from core client for 30 sec - exiting 10:31:39 (5604): No heartbeat from core client for 30 sec - exiting 10:31:40 (5604): No heartbeat from core client for 30 sec - exiting 10:31:41 (5604): No heartbeat from core client for 30 sec - exiting 10:31:42 (5604): No heartbeat from core client for 30 sec - exiting 10:31:43 (5604): No heartbeat from core client for 30 sec - exiting 10:31:44 (5604): No heartbeat from core client for 30 sec - exiting 10:31:45 (5604): No heartbeat from core client for 30 sec - exiting 10:31:46 (5604): No heartbeat from core client for 30 sec - exiting 10:31:47 (5604): No heartbeat from core client for 30 sec - exiting 10:31:48 (5604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4328, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6432, iMonCtr=1 Model crash detected, will try to restart... 11:51:57 (5596): No heartbeat from core client for 30 sec - exiting 11:51:58 (5596): No heartbeat from core client for 30 sec - exiting 11:51:59 (5596): No heartbeat from core client for 30 sec - exiting 11:52:00 (5596): No heartbeat from core client for 30 sec - exiting 11:52:01 (5596): No heartbeat from core client for 30 sec - exiting 11:52:02 (5596): No heartbeat from core client for 30 sec - exiting 11:52:03 (5596): No heartbeat from core client for 30 sec - exiting 11:52:04 (5596): No heartbeat from core client for 30 sec - exiting 11:52:05 (5596): No heartbeat from core client for 30 sec - exiting 11:52:06 (5596): No heartbeat from core client for 30 sec - exiting 11:52:07 (5596): No heartbeat from core client for 30 sec - exiting 11:52:08 (5596): No heartbeat from core client for 30 sec - exiting 11:52:09 (5596): No heartbeat from core client for 30 sec - exiting 11:52:10 (5596): No heartbeat from core client for 30 sec - exiting 11:52:11 (5596): No heartbeat from core client for 30 sec - exiting 11:52:12 (5596): No heartbeat from core client for 30 sec - exiting 11:52:13 (5596): No heartbeat from core client for 30 sec - exiting 11:52:14 (5596): No heartbeat from core client for 30 sec - exiting 11:52:15 (5596): No heartbeat from core client for 30 sec - exiting 11:52:16 (5596): No heartbeat from core client for 30 sec - exiting 11:52:17 (5596): No heartbeat from core client for 30 sec - exiting 11:52:18 (5596): No heartbeat from core client for 30 sec - exiting 11:52:19 (5596): No heartbeat from core client for 30 sec - exiting 11:52:20 (5596): No heartbeat from core client for 30 sec - exiting 11:52:21 (5596): No heartbeat from core client for 30 sec - exiting 11:52:22 (5596): No heartbeat from core client for 30 sec - exiting 11:52:23 (5596): No heartbeat from core client for 30 sec - exiting 11:52:24 (5596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:05:30 (5620): No heartbeat from core client for 30 sec - exiting 22:05:31 (5620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:08:17 (5628): No heartbeat from core client for 30 sec - exiting 15:08:18 (5628): No heartbeat from core client for 30 sec - exiting 15:08:19 (5628): No heartbeat from core client for 30 sec - exiting 15:08:20 (5628): No heartbeat from core client for 30 sec - exiting 15:08:21 (5628): No heartbeat from core client for 30 sec - exiting 15:08:22 (5628): No heartbeat from core client for 30 sec - exiting 15:08:23 (5628): No heartbeat from core client for 30 sec - exiting 15:08:24 (5628): No heartbeat from core client for 30 sec - exiting 15:08:25 (5628): No heartbeat from core client for 30 sec - exiting 15:08:26 (5628): No heartbeat from core client for 30 sec - exiting 15:08:27 (5628): No heartbeat from core client for 30 sec - exiting 15:08:28 (5628): No heartbeat from core client for 30 sec - exiting 15:08:29 (5628): No heartbeat from core client for 30 sec - exiting 15:08:30 (5628): No heartbeat from core client for 30 sec - exiting 15:08:31 (5628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1516, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2788, iMonCtr=1 Model crash detected, will try to restart... 19:56:57 (6152): No heartbeat from core client for 30 sec - exiting 19:56:58 (6152): No heartbeat from core client for 30 sec - exiting 19:56:59 (6152): No heartbeat from core client for 30 sec - exiting 19:57:00 (6152): No heartbeat from core client for 30 sec - exiting 19:57:01 (6152): No heartbeat from core client for 30 sec - exiting 19:57:02 (6152): No heartbeat from core client for 30 sec - exiting 19:57:03 (6152): No heartbeat from core client for 30 sec - exiting 19:57:04 (6152): No heartbeat from core client for 30 sec - exiting 19:57:05 (6152): No heartbeat from core client for 30 sec - exiting 19:57:06 (6152): No heartbeat from core client for 30 sec - exiting 19:57:07 (6152): No heartbeat from core client for 30 sec - exiting 19:57:08 (6152): No heartbeat from core client for 30 sec - exiting 19:57:09 (6152): No heartbeat from core client for 30 sec - exiting 19:57:10 (6152): No heartbeat from core client for 30 sec - exiting 19:57:11 (6152): No heartbeat from core client for 30 sec - exiting 19:57:12 (6152): No heartbeat from core client for 30 sec - exiting 19:57:13 (6152): No heartbeat from core client for 30 sec - exiting 19:57:14 (6152): No heartbeat from core client for 30 sec - exiting 19:57:15 (6152): No heartbeat from core client for 30 sec - exiting 19:57:16 (6152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:52:10 (6232): No heartbeat from core client for 30 sec - exiting 11:52:11 (6232): No heartbeat from core client for 30 sec - exiting 11:52:12 (6232): No heartbeat from core client for 30 sec - exiting 11:52:13 (6232): No heartbeat from core client for 30 sec - exiting 11:52:14 (6232): No heartbeat from core client for 30 sec - exiting 11:52:15 (6232): No heartbeat from core client for 30 sec - exiting 11:52:16 (6232): No heartbeat from core client for 30 sec - exiting 11:52:17 (6232): No heartbeat from core client for 30 sec - exiting 11:52:18 (6232): No heartbeat from core client for 30 sec - exiting 11:52:19 (6232): No heartbeat from core client for 30 sec - exiting 11:52:20 (6232): No heartbeat from core client for 30 sec - exiting 11:52:21 (6232): No heartbeat from core client for 30 sec - exiting 11:52:22 (6232): No heartbeat from core client for 30 sec - exiting 11:52:23 (6232): No heartbeat from core client for 30 sec - exiting 11:52:24 (6232): No heartbeat from core client for 30 sec - exiting 11:52:25 (6232): No heartbeat from core client for 30 sec - exiting 11:52:26 (6232): No heartbeat from core client for 30 sec - exiting 11:52:27 (6232): No heartbeat from core client for 30 sec - exiting 11:52:28 (6232): No heartbeat from core client for 30 sec - exiting 11:52:29 (6232): No heartbeat from core client for 30 sec - exiting 11:52:30 (6232): No heartbeat from core client for 30 sec - exiting 11:52:31 (6232): No heartbeat from core client for 30 sec - exiting 11:52:32 (6232): No heartbeat from core client for 30 sec - exiting 11:52:33 (6232): No heartbeat from core client for 30 sec - exiting 11:52:34 (6232): No heartbeat from core client for 30 sec - exiting 11:52:35 (6232): No heartbeat from core client for 30 sec - exiting 11:52:36 (6232): No heartbeat from core client for 30 sec - exiting 11:52:37 (6232): No heartbeat from core client for 30 sec - exiting 11:52:38 (6232): No heartbeat from core client for 30 sec - exiting 11:52:39 (6232): No heartbeat from core client for 30 sec - exiting 11:52:40 (6232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:25:25 (3540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6792, iMonCtr=1 Model crash detected, will try to restart... 12:09:06 (6232): No heartbeat from core client for 30 sec - exiting 12:09:07 (6232): No heartbeat from core client for 30 sec - exiting 12:09:08 (6232): No heartbeat from core client for 30 sec - exiting 12:09:09 (6232): No heartbeat from core client for 30 sec - exiting 12:09:10 (6232): No heartbeat from core client for 30 sec - exiting 12:09:11 (6232): No heartbeat from core client for 30 sec - exiting 12:09:12 (6232): No heartbeat from core client for 30 sec - exiting 12:09:13 (6232): No heartbeat from core client for 30 sec - exiting 12:09:14 (6232): No heartbeat from core client for 30 sec - exiting 12:09:15 (6232): No heartbeat from core client for 30 sec - exiting 12:09:16 (6232): No heartbeat from core client for 30 sec - exiting 12:09:17 (6232): No heartbeat from core client for 30 sec - exiting 12:09:18 (6232): No heartbeat from core client for 30 sec - exiting 12:09:19 (6232): No heartbeat from core client for 30 sec - exiting 12:09:20 (6232): No heartbeat from core client for 30 sec - exiting 12:09:21 (6232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:17:35 (5856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6684, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 11:38:16 (5616): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7732, iMonCtr=1 Model crash detected, will try to restart... 20:22:28 (5748): No heartbeat from core client for 30 sec - exiting 20:22:29 (5748): No heartbeat from core client for 30 sec - exiting 20:22:30 (5748): No heartbeat from core client for 30 sec - exiting 20:22:31 (5748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7116, iMonCtr=1 Model crash detected, will try to restart... 17:05:09 (4788): No heartbeat from core client for 30 sec - exiting 17:05:10 (4788): No heartbeat from core client for 30 sec - exiting 17:05:11 (4788): No heartbeat from core client for 30 sec - exiting 17:05:12 (4788): No heartbeat from core client for 30 sec - exiting 17:05:13 (4788): No heartbeat from core client for 30 sec - exiting 17:05:14 (4788): No heartbeat from core client for 30 sec - exiting 17:05:15 (4788): No heartbeat from core client for 30 sec - exiting 17:05:16 (4788): No heartbeat from core client for 30 sec - exiting 17:05:17 (4788): No heartbeat from core client for 30 sec - exiting 17:05:18 (4788): No heartbeat from core client for 30 sec - exiting 17:05:19 (4788): No heartbeat from core client for 30 sec - exiting 17:05:20 (4788): No heartbeat from core client for 30 sec - exiting 17:05:21 (4788): No heartbeat from core client for 30 sec - exiting 17:05:22 (4788): No heartbeat from core client for 30 sec - exiting 17:05:23 (4788): No heartbeat from core client for 30 sec - exiting 17:05:24 (4788): No heartbeat from core client for 30 sec - exiting 17:05:25 (4788): No heartbeat from core client for 30 sec - exiting 17:05:26 (4788): No heartbeat from core client for 30 sec - exiting 17:05:27 (4788): No heartbeat from core client for 30 sec - exiting 17:05:28 (4788): No heartbeat from core client for 30 sec - exiting 17:05:29 (4788): No heartbeat from core client for 30 sec - exiting 17:05:30 (4788): No heartbeat from core client for 30 sec - exiting 17:05:31 (4788): No heartbeat from core client for 30 sec - exiting 17:05:32 (4788): No heartbeat from core client for 30 sec - exiting 17:05:33 (4788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4352, iMonCtr=1 Model crash detected, will try to restart... 16:45:07 (5532): No heartbeat from core client for 30 sec - exiting 16:45:08 (5532): No heartbeat from core client for 30 sec - exiting 16:45:09 (5532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:10 (5532): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:42:37 (5716): No heartbeat from core client for 30 sec - exiting 20:42:38 (5716): No heartbeat from core client for 30 sec - exiting 20:42:39 (5716): No heartbeat from core client for 30 sec - exiting 20:42:40 (5716): No heartbeat from core client for 30 sec - exiting 20:42:41 (5716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5152, iMonCtr=1 Model crash detected, will try to restart... 22:01:53 (4160): No heartbeat from core client for 30 sec - exiting 22:01:55 (4160): No heartbeat from core client for 30 sec - exiting 22:01:56 (4160): No heartbeat from core client for 30 sec - exiting 22:01:57 (4160): No heartbeat from core client for 30 sec - exiting 22:01:58 (4160): No heartbeat from core client for 30 sec - exiting 22:01:59 (4160): No heartbeat from core client for 30 sec - exiting 22:02:00 (4160): No heartbeat from core client for 30 sec - exiting 22:02:01 (4160): No heartbeat from core client for 30 sec - exiting 22:02:02 (4160): No heartbeat from core client for 30 sec - exiting 22:02:03 (4160): No heartbeat from core client for 30 sec - exiting 22:02:05 (4160): No heartbeat from core client for 30 sec - exiting 22:02:06 (4160): No heartbeat from core client for 30 sec - exiting 22:02:07 (4160): No heartbeat from core client for 30 sec - exiting 22:02:08 (4160): No heartbeat from core client for 30 sec - exiting 22:02:09 (4160): No heartbeat from core client for 30 sec - exiting 22:02:10 (4160): No heartbeat from core client for 30 sec - exiting 22:02:11 (4160): No heartbeat from core client for 30 sec - exiting 22:02:12 (4160): No heartbeat from core client for 30 sec - exiting 22:02:13 (4160): No heartbeat from core client for 30 sec - exiting 22:02:14 (4160): No heartbeat from core client for 30 sec - exiting 22:02:15 (4160): No heartbeat from core client for 30 sec - exiting 22:02:16 (4160): No heartbeat from core client for 30 sec - exiting 22:02:17 (4160): No heartbeat from core client for 30 sec - exiting 22:02:18 (4160): No heartbeat from core client for 30 sec - exiting 22:02:19 (4160): No heartbeat from core client for 30 sec - exiting 22:02:20 (4160): No heartbeat from core client for 30 sec - exiting 22:02:21 (4160): No heartbeat from core client for 30 sec - exiting 22:02:22 (4160): No heartbeat from core client for 30 sec - exiting 22:02:23 (4160): No heartbeat from core client for 30 sec - exiting 22:02:24 (4160): No heartbeat from core client for 30 sec - exiting 22:02:25 (4160): No heartbeat from core client for 30 sec - exiting 22:02:26 (4160): No heartbeat from core client for 30 sec - exiting 22:02:27 (4160): No heartbeat from core client for 30 sec - exiting 22:02:28 (4160): No heartbeat from core client for 30 sec - exiting 22:02:29 (4160): No heartbeat from core client for 30 sec - exiting 22:02:30 (4160): No heartbeat from core client for 30 sec - exiting 22:02:31 (4160): No heartbeat from core client for 30 sec - exiting 22:02:32 (4160): No heartbeat from core client for 30 sec - exiting 22:02:33 (4160): No heartbeat from core client for 30 sec - exiting 22:02:34 (4160): No heartbeat from core client for 30 sec - exiting 22:02:35 (4160): No heartbeat from core client for 30 sec - exiting 22:02:36 (4160): No heartbeat from core client for 30 sec - exiting 22:02:37 (4160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:07:07 (4108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6116, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7032, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Sep 2012 12:00:44	1143449	15134748	hadcm3n_zhti_1880_40_008026188_4	259,200	473,582	1.8271
21 Sep 2012 20:03:58	1143449	15134748	hadcm3n_zhti_1880_40_008026188_4	233,280	425,940	1.8259
17 Sep 2012 21:07:29	1143449	15134748	hadcm3n_zhti_1880_40_008026188_4	207,360	377,906	1.8225
13 Sep 2012 22:09:27	1143449	15134748	hadcm3n_zhti_1880_40_008026188_4	181,440	331,048	1.8246
09 Sep 2012 15:11:30	1143449	15134748	hadcm3n_zhti_1880_40_008026188_4	155,520	283,895	1.8255
05 Sep 2012 20:19:31	1143449	15134748	hadcm3n_zhti_1880_40_008026188_4	129,600	236,321	1.8235
02 Sep 2012 17:34:49	1143449	15134748	hadcm3n_zhti_1880_40_008026188_4	103,680	189,451	1.8273
29 Aug 2012 18:29:51	1143449	15134748	hadcm3n_zhti_1880_40_008026188_4	77,760	141,824	1.8239
27 Aug 2012 17:51:58	1143449	15134748	hadcm3n_zhti_1880_40_008026188_4	51,840	94,357	1.8202
21 Aug 2012 22:13:48	1143449	15134748	hadcm3n_zhti_1880_40_008026188_4	25,920	47,275	1.8239