Task 13017131

Name	hadcm3n_t429_1940_40_007312530_2
Workunit	7509960
Created	28 Jun 2011, 4:48:41 UTC
Sent	28 Jun 2011, 8:11:21 UTC
Report deadline	27 Sep 2011, 15:38:32 UTC
Received	22 Nov 2011, 12:05:31 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1065650
Run time	30 days 9 hours 21 min 17 sec
CPU time	26 days 1 hours 40 min 35 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.11 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <stderr_txt> 09:10:53 (3200): No heartbeat from core client for 30 sec - exiting 09:10:54 (3200): No heartbeat from core client for 30 sec - exiting 09:10:55 (3200): No heartbeat from core client for 30 sec - exiting 09:10:56 (3200): No heartbeat from core client for 30 sec - exiting 09:10:57 (3200): No heartbeat from core client for 30 sec - exiting 09:10:58 (3200): No heartbeat from core client for 30 sec - exiting 09:11:00 (3200): No heartbeat from core client for 30 sec - exiting 09:11:01 (3200): No heartbeat from core client for 30 sec - exiting 09:11:02 (3200): No heartbeat from core client for 30 sec - exiting 09:11:03 (3200): No heartbeat from core client for 30 sec - exiting 09:11:04 (3200): No heartbeat from core client for 30 sec - exiting 09:11:11 (3200): No heartbeat from core client for 30 sec - exiting 09:11:19 (3200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=532, iMonCtr=1 Model crash detected, will try to restart... 09:09:11 (996): No heartbeat from core client for 30 sec - exiting 09:09:29 (996): No heartbeat from core client for 30 sec - exiting 09:09:31 (996): No heartbeat from core client for 30 sec - exiting 09:09:33 (996): No heartbeat from core client for 30 sec - exiting 09:09:34 (996): No heartbeat from core client for 30 sec - exiting 09:10:26 (996): No heartbeat from core client for 30 sec - exiting 09:10:45 (996): No heartbeat from core client for 30 sec - exiting 09:11:03 (996): No heartbeat from core client for 30 sec - exiting 09:11:20 (996): No heartbeat from core client for 30 sec - exiting 09:11:58 (996): No heartbeat from core client for 30 sec - exiting 09:12:21 (996): No heartbeat from core client for 30 sec - exiting 09:13:06 (996): No heartbeat from core client for 30 sec - exiting 09:13:49 (996): No heartbeat from core client for 30 sec - exiting 09:14:18 (996): No heartbeat from core client for 30 sec - exiting 09:14:20 (996): No heartbeat from core client for 30 sec - exiting 09:14:22 (996): No heartbeat from core client for 30 sec - exiting 09:14:24 (996): No heartbeat from core client for 30 sec - exiting 09:15:25 (996): No heartbeat from core client for 30 sec - exiting 09:15:27 (996): No heartbeat from core client for 30 sec - exiting 09:15:54 (996): No heartbeat from core client for 30 sec - exiting 09:16:19 (996): No heartbeat from core client for 30 sec - exiting 09:17:20 (996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:07:25 (3720): No heartbeat from core client for 30 sec - exiting 09:07:41 (3720): No heartbeat from core client for 30 sec - exiting 09:07:43 (3720): No heartbeat from core client for 30 sec - exiting 09:07:45 (3720): No heartbeat from core client for 30 sec - exiting 09:07:56 (3720): No heartbeat from core client for 30 sec - exiting 09:08:08 (3720): No heartbeat from core client for 30 sec - exiting 09:08:16 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2804, iMonCtr=1 Model crash detected, will try to restart... 10:41:24 (4192): No heartbeat from core client for 30 sec - exiting 10:41:45 (4192): No heartbeat from core client for 30 sec - exiting 10:41:46 (4192): No heartbeat from core client for 30 sec - exiting 10:41:47 (4192): No heartbeat from core client for 30 sec - exiting 10:41:48 (4192): No heartbeat from core client for 30 sec - exiting 10:41:49 (4192): No heartbeat from core client for 30 sec - exiting 10:41:50 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:44 (1300): No heartbeat from core client for 30 sec - exiting 09:05:50 (1300): No heartbeat from core client for 30 sec - exiting 09:05:54 (1300): No heartbeat from core client for 30 sec - exiting 09:06:10 (1300): No heartbeat from core client for 30 sec - exiting 09:06:14 (1300): No heartbeat from core client for 30 sec - exiting 09:06:19 (1300): No heartbeat from core client for 30 sec - exiting 09:06:25 (1300): No heartbeat from core client for 30 sec - exiting 09:06:28 (1300): No heartbeat from core client for 30 sec - exiting 09:06:30 (1300): No heartbeat from core client for 30 sec - exiting 09:06:32 (1300): No heartbeat from core client for 30 sec - exiting 09:06:34 (1300): No heartbeat from core client for 30 sec - exiting 09:06:36 (1300): No heartbeat from core client for 30 sec - exiting 09:06:38 (1300): No heartbeat from core client for 30 sec - exiting 09:06:40 (1300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3828, iMonCtr=1 Model crash detected, will try to restart... 09:03:30 (484): No heartbeat from core client for 30 sec - exiting 09:03:41 (484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3508, iMonCtr=1 Model crash detected, will try to restart... 11:33:10 (2344): No heartbeat from core client for 30 sec - exiting 11:33:29 (2344): No heartbeat from core client for 30 sec - exiting 11:33:44 (2344): No heartbeat from core client for 30 sec - exiting 11:33:57 (2344): No heartbeat from core client for 30 sec - exiting 11:34:09 (2344): No heartbeat from core client for 30 sec - exiting 11:34:12 (2344): No heartbeat from core client for 30 sec - exiting 11:34:14 (2344): No heartbeat from core client for 30 sec - exiting 11:34:15 (2344): No heartbeat from core client for 30 sec - exiting 11:34:17 (2344): No heartbeat from core client for 30 sec - exiting 11:34:18 (2344): No heartbeat from core client for 30 sec - exiting 11:34:20 (2344): No heartbeat from core client for 30 sec - exiting 11:34:21 (2344): No heartbeat from core client for 30 sec - exiting 11:34:23 (2344): No heartbeat from core client for 30 sec - exiting 11:34:24 (2344): No heartbeat from core client for 30 sec - exiting 11:34:26 (2344): No heartbeat from core client for 30 sec - exiting 11:34:28 (2344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:15:34 (4900): No heartbeat from core client for 30 sec - exiting 09:16:03 (4900): No heartbeat from core client for 30 sec - exiting 09:16:10 (4900): No heartbeat from core client for 30 sec - exiting 09:16:11 (4900): No heartbeat from core client for 30 sec - exiting 09:16:12 (4900): No heartbeat from core client for 30 sec - exiting 09:16:13 (4900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5620, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4420, iMonCtr=1 Model crash detected, will try to restart... 09:10:15 (4492): No heartbeat from core client for 30 sec - exiting 09:10:29 (4492): No heartbeat from core client for 30 sec - exiting 09:10:41 (4492): No heartbeat from core client for 30 sec - exiting 09:10:59 (4492): No heartbeat from core client for 30 sec - exiting 09:11:14 (4492): No heartbeat from core client for 30 sec - exiting 09:11:17 (4492): No heartbeat from core client for 30 sec - exiting 09:11:19 (4492): No heartbeat from core client for 30 sec - exiting 09:11:20 (4492): No heartbeat from core client for 30 sec - exiting 09:11:37 (4492): No heartbeat from core client for 30 sec - exiting 09:11:43 (4492): No heartbeat from core client for 30 sec - exiting 09:11:49 (4492): No heartbeat from core client for 30 sec - exiting 09:11:50 (4492): No heartbeat from core client for 30 sec - exiting 09:11:52 (4492): No heartbeat from core client for 30 sec - exiting 09:11:53 (4492): No heartbeat from core client for 30 sec - exiting 09:12:02 (4492): No heartbeat from core client for 30 sec - exiting 09:12:28 (4492): No heartbeat from core client for 30 sec - exiting 09:12:29 (4492): No heartbeat from core client for 30 sec - exiting 09:12:31 (4492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:17:09 (4040): No heartbeat from core client for 30 sec - exiting 09:17:12 (4040): No heartbeat from core client for 30 sec - exiting 09:17:14 (4040): No heartbeat from core client for 30 sec - exiting 09:17:16 (4040): No heartbeat from core client for 30 sec - exiting 09:17:17 (4040): No heartbeat from core client for 30 sec - exiting 09:17:19 (4040): No heartbeat from core client for 30 sec - exiting 09:17:21 (4040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5116, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1520, iMonCtr=1 Model crash detected, will try to restart... 09:04:38 (2788): No heartbeat from core client for 30 sec - exiting 09:04:40 (2788): No heartbeat from core client for 30 sec - exiting 09:04:42 (2788): No heartbeat from core client for 30 sec - exiting 09:04:44 (2788): No heartbeat from core client for 30 sec - exiting 09:04:46 (2788): No heartbeat from core client for 30 sec - exiting 09:04:48 (2788): No heartbeat from core client for 30 sec - exiting 09:04:50 (2788): No heartbeat from core client for 30 sec - exiting 09:04:51 (2788): No heartbeat from core client for 30 sec - exiting 09:04:53 (2788): No heartbeat from core client for 30 sec - exiting 09:04:55 (2788): No heartbeat from core client for 30 sec - exiting 09:04:56 (2788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:08:41 (3988): No heartbeat from core client for 30 sec - exiting 09:08:47 (3988): No heartbeat from core client for 30 sec - exiting 09:08:52 (3988): No heartbeat from core client for 30 sec - exiting 09:08:55 (3988): No heartbeat from core client for 30 sec - exiting 09:08:58 (3988): No heartbeat from core client for 30 sec - exiting 09:09:00 (3988): No heartbeat from core client for 30 sec - exiting 09:09:01 (3988): No heartbeat from core client for 30 sec - exiting 09:09:11 (3988): No heartbeat from core client for 30 sec - exiting 09:09:14 (3988): No heartbeat from core client for 30 sec - exiting 09:09:20 (3988): No heartbeat from core client for 30 sec - exiting 09:09:35 (3988): No heartbeat from core client for 30 sec - exiting 09:09:49 (3988): No heartbeat from core client for 30 sec - exiting 09:10:03 (3988): No heartbeat from core client for 30 sec - exiting 09:10:11 (3988): No heartbeat from core client for 30 sec - exiting 09:10:12 (3988): No heartbeat from core client for 30 sec - exiting 09:10:14 (3988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6088, iMonCtr=1 Model crash detected, will try to restart... 10:02:19 (728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3804, iMonCtr=1 Model crash detected, will try to restart... 09:04:42 (4376): No heartbeat from core client for 30 sec - exiting 09:04:44 (4376): No heartbeat from core client for 30 sec - exiting 09:04:59 (4376): No heartbeat from core client for 30 sec - exiting 09:05:07 (4376): No heartbeat from core client for 30 sec - exiting 09:05:22 (4376): No heartbeat from core client for 30 sec - exiting 09:05:57 (4376): No heartbeat from core client for 30 sec - exiting 09:05:59 (4376): No heartbeat from core client for 30 sec - exiting 09:06:01 (4376): No heartbeat from core client for 30 sec - exiting 09:06:03 (4376): No heartbeat from core client for 30 sec - exiting 09:06:04 (4376): No heartbeat from core client for 30 sec - exiting 09:06:05 (4376): No heartbeat from core client for 30 sec - exiting 09:06:07 (4376): No heartbeat from core client for 30 sec - exiting 09:06:08 (4376): No heartbeat from core client for 30 sec - exiting 09:06:09 (4376): No heartbeat from core client for 30 sec - exiting 09:06:11 (4376): No heartbeat from core client for 30 sec - exiting 09:06:12 (4376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:01:32 (4816): No heartbeat from core client for 30 sec - exiting 09:01:49 (4816): No heartbeat from core client for 30 sec - exiting 09:01:51 (4816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:03:43 (3764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4432, iMonCtr=1 Model crash detected, will try to restart... 09:08:08 (1976): No heartbeat from core client for 30 sec - exiting 09:08:15 (1976): No heartbeat from core client for 30 sec - exiting 09:08:17 (1976): No heartbeat from core client for 30 sec - exiting 09:08:19 (1976): No heartbeat from core client for 30 sec - exiting 09:08:20 (1976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4320, iMonCtr=1 Model crash detected, will try to restart... 09:08:50 (4780): No heartbeat from core client for 30 sec - exiting 09:09:01 (4780): No heartbeat from core client for 30 sec - exiting 09:09:02 (4780): No heartbeat from core client for 30 sec - exiting 09:09:04 (4780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:54:52 (396): No heartbeat from core client for 30 sec - exiting 09:54:54 (396): No heartbeat from core client for 30 sec - exiting 09:54:56 (396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:03:37 (4292): No heartbeat from core client for 30 sec - exiting 09:03:54 (4292): No heartbeat from core client for 30 sec - exiting 09:04:00 (4292): No heartbeat from core client for 30 sec - exiting 09:04:03 (4292): No heartbeat from core client for 30 sec - exiting 09:04:04 (4292): No heartbeat from core client for 30 sec - exiting 09:04:06 (4292): No heartbeat from core client for 30 sec - exiting 09:04:47 (4292): No heartbeat from core client for 30 sec - exiting 09:05:07 (4292): No heartbeat from core client for 30 sec - exiting 09:05:11 (4292): No heartbeat from core client for 30 sec - exiting 09:05:13 (4292): No heartbeat from core client for 30 sec - exiting 09:05:15 (4292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5400, iMonCtr=1 Model crash detected, will try to restart... 09:15:29 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5676, iMonCtr=1 Model crash detected, will try to restart... 09:16:15 (1380): No heartbeat from core client for 30 sec - exiting 09:16:27 (1380): No heartbeat from core client for 30 sec - exiting 09:16:35 (1380): No heartbeat from core client for 30 sec - exiting 09:16:52 (1380): No heartbeat from core client for 30 sec - exiting 09:17:13 (1380): No heartbeat from core client for 30 sec - exiting 09:17:14 (1380): No heartbeat from core client for 30 sec - exiting 09:17:15 (1380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5164, iMonCtr=1 Model crash detected, will try to restart... 09:28:41 (5024): No heartbeat from core client for 30 sec - exiting 09:28:44 (5024): No heartbeat from core client for 30 sec - exiting 09:28:45 (5024): No heartbeat from core client for 30 sec - exiting 09:28:47 (5024): No heartbeat from core client for 30 sec - exiting 09:28:49 (5024): No heartbeat from core client for 30 sec - exiting 09:28:50 (5024): No heartbeat from core client for 30 sec - exiting 09:28:52 (5024): No heartbeat from core client for 30 sec - exiting 09:28:54 (5024): No heartbeat from core client for 30 sec - exiting 09:28:56 (5024): No heartbeat from core client for 30 sec - exiting 09:28:58 (5024): No heartbeat from core client for 30 sec - exiting 09:29:00 (5024): No heartbeat from core client for 30 sec - exiting 09:29:01 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C09:15:13 (4572): No heartbeat from core client for 30 sec - exiting 09:15:15 (4572): No heartbeat from core client for 30 sec - exiting 09:15:16 (4572): No heartbeat from core client for 30 sec - exiting 09:15:18 (4572): No heartbeat from core client for 30 sec - exiting 09:15:20 (4572): No heartbeat from core client for 30 sec - exiting 09:15:22 (4572): No heartbeat from core client for 30 sec - exiting 09:15:23 (4572): No heartbeat from core client for 30 sec - exiting 09:15:25 (4572): No heartbeat from core client for 30 sec - exiting 09:15:37 (4572): No heartbeat from core client for 30 sec - exiting 09:15:52 (4572): No heartbeat from core client for 30 sec - exiting 09:16:04 (4572): No heartbeat from core client for 30 sec - exiting 09:16:07 (4572): No heartbeat from core client for 30 sec - exiting 09:16:13 (4572): No heartbeat from core client for 30 sec - exiting 09:16:22 (4572): No heartbeat from core client for 30 sec - exiting 09:16:24 (4572): No heartbeat from core client for 30 sec - exiting 09:16:26 (4572): No heartbeat from core client for 30 sec - exiting 09:16:28 (4572): No heartbeat from core client for 30 sec - exiting 09:16:30 (4572): No heartbeat from core client for 30 sec - exiting 09:16:32 (4572): No heartbeat from core client for 30 sec - exiting 09:16:34 (4572): No heartbeat from core client for 30 sec - exiting 09:16:35 (4572): No heartbeat from core client for 30 sec - exiting 09:16:37 (4572): No heartbeat from core client for 30 sec - exiting 09:16:39 (4572): No heartbeat from core client for 30 sec - exiting 09:16:41 (4572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6136, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4652, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5460, iMonCtr=1 Model crash detected, will try to restart... 09:08:47 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:17:57 (2228): No heartbeat from core client for 30 sec - exiting 09:17:59 (2228): No heartbeat from core client for 30 sec - exiting 09:18:00 (2228): No heartbeat from core client for 30 sec - exiting 09:18:02 (2228): No heartbeat from core client for 30 sec - exiting 09:18:04 (2228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:10:21 (4020): No heartbeat from core client for 30 sec - exiting 09:10:44 (4020): No heartbeat from core client for 30 sec - exiting 09:11:02 (4020): No heartbeat from core client for 30 sec - exiting 09:11:19 (4020): No heartbeat from core client for 30 sec - exiting 09:11:35 (4020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:29 (5428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:15 (396): No heartbeat from core client for 30 sec - exiting 09:18:16 (396): No heartbeat from core client for 30 sec - exiting 09:18:17 (396): No heartbeat from core client for 30 sec - exiting 09:18:18 (396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5312, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3868, iMonCtr=1 Model crash detected, will try to restart... 09:12:48 (1404): No heartbeat from core client for 30 sec - exiting 09:12:51 (1404): No heartbeat from core client for 30 sec - exiting 09:13:07 (1404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3296, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3296, iMonCtr=1 Model crash detected, will try to restart... 09:15:42 (4464): No heartbeat from core client for 30 sec - exiting 09:15:59 (4464): No heartbeat from core client for 30 sec - exiting 09:16:10 (4464): No heartbeat from core client for 30 sec - exiting 09:16:16 (4464): No heartbeat from core client for 30 sec - exiting 09:16:22 (4464): No heartbeat from core client for 30 sec - exiting 09:16:31 (4464): No heartbeat from core client for 30 sec - exiting 09:16:42 (4464): No heartbeat from core client for 30 sec - exiting 09:16:54 (4464): No heartbeat from core client for 30 sec - exiting 09:17:08 (4464): No heartbeat from core client for 30 sec - exiting 09:17:19 (4464): No heartbeat from core client for 30 sec - exiting 09:17:22 (4464): No heartbeat from core client for 30 sec - exiting 09:17:24 (4464): No heartbeat from core client for 30 sec - exiting 09:17:25 (4464): No heartbeat from core client for 30 sec - exiting 09:17:28 (4464): No heartbeat from core client for 30 sec - exiting 09:17:31 (4464): No heartbeat from core client for 30 sec - exiting 09:17:33 (4464): No heartbeat from core client for 30 sec - exiting 09:17:35 (4464): No heartbeat from core client for 30 sec - exiting 09:17:40 (4464): No heartbeat from core client for 30 sec - exiting 09:17:47 (4464): No heartbeat from core client for 30 sec - exiting 09:17:48 (4464): No heartbeat from core client for 30 sec - exiting 09:17:49 (4464): No heartbeat from core client for 30 sec - exiting 09:17:50 (4464): No heartbeat from core client for 30 sec - exiting 09:17:51 (4464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4568, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4568, iMonCtr=1 Model crash detected, will try to restart... 09:17:05 (4712): No heartbeat from core client for 30 sec - exiting 09:17:25 (4712): No heartbeat from core client for 30 sec - exiting 09:17:41 (4712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6012, iMonCtr=1 Model crash detected, will try to restart... 09:11:22 (2940): No heartbeat from core client for 30 sec - exiting 09:11:40 (2940): No heartbeat from core client for 30 sec - exiting 09:11:46 (2940): No heartbeat from core client for 30 sec - exiting 09:12:03 (2940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5556, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 09:15:06 (4652): No heartbeat from core client for 30 sec - exiting 09:15:08 (4652): No heartbeat from core client for 30 sec - exiting 09:15:09 (4652): No heartbeat from core client for 30 sec - exiting 09:15:11 (4652): No heartbeat from core client for 30 sec - exiting 09:15:25 (4652): No heartbeat from core client for 30 sec - exiting 09:15:36 (4652): No heartbeat from core client for 30 sec - exiting 09:15:53 (4652): No heartbeat from core client for 30 sec - exiting 09:16:02 (4652): No heartbeat from core client for 30 sec - exiting 09:16:03 (4652): No heartbeat from core client for 30 sec - exiting 09:16:05 (4652): No heartbeat from core client for 30 sec - exiting 09:16:07 (4652): No heartbeat from core client for 30 sec - exiting 09:16:08 (4652): No heartbeat from core client for 30 sec - exiting 09:16:10 (4652): No heartbeat from core client for 30 sec - exiting 09:16:11 (4652): No heartbeat from core client for 30 sec - exiting 09:16:13 (4652): No heartbeat from core client for 30 sec - exiting 09:16:15 (4652): No heartbeat from core client for 30 sec - exiting 09:16:16 (4652): No heartbeat from core client for 30 sec - exiting 09:16:51 (4652): No heartbeat from core client for 30 sec - exiting 09:16:52 (4652): No heartbeat from core client for 30 sec - exiting 09:16:54 (4652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:46 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:47 (4124): No heartbeat from core client for 30 sec - exiting 09:24:48 (4124): No heartbeat from core client for 30 sec - exiting 09:24:49 (4124): No heartbeat from core client for 30 sec - exiting 09:24:50 (4124): No heartbeat from core client for 30 sec - exiting 09:24:51 (4124): No heartbeat from core client for 30 sec - exiting 09:24:53 (4124): No heartbeat from core client for 30 sec - exiting 09:24:54 (4124): No heartbeat from core client for 30 sec - exiting 09:24:55 (4124): No heartbeat from core client for 30 sec - exiting 09:24:56 (4124): No heartbeat from core client for 30 sec - exiting 09:24:57 (4124): No heartbeat from core client for 30 sec - exiting 09:47:05 (2588): No heartbeat from core client for 30 sec - exiting 09:47:07 (2588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5128, iMonCtr=1 Model crash detected, will try to restart... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Nov 2011 12:09:46	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	1,036,800	2,251,729	2.1718
18 Nov 2011 09:54:28	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	1,010,880	2,197,346	2.1737
16 Nov 2011 09:05:07	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	984,960	2,143,561	2.1763
15 Nov 2011 17:04:03	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	959,040	2,088,626	2.1778
09 Nov 2011 10:48:10	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	933,120	2,034,168	2.1800
04 Nov 2011 13:01:19	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	907,200	1,978,975	2.1814
02 Nov 2011 10:37:04	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	881,280	1,924,404	2.1836
31 Oct 2011 16:57:39	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	855,360	1,869,957	2.1862
31 Oct 2011 13:29:10	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	829,440	1,814,393	2.1875
31 Oct 2011 13:29:10	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	803,520	1,759,610	2.1899
17 Oct 2011 14:02:11	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	777,600	1,703,298	2.1905
13 Oct 2011 12:03:47	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	751,680	1,648,983	2.1937
07 Oct 2011 13:51:18	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	725,760	1,593,198	2.1952
05 Oct 2011 12:08:30	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	699,840	1,536,461	2.1954
03 Oct 2011 12:06:06	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	673,920	1,478,626	2.1941
29 Sep 2011 12:13:49	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	648,000	1,421,812	2.1942
27 Sep 2011 12:00:15	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	622,080	1,364,727	2.1938
23 Sep 2011 11:36:59	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	596,160	1,308,147	2.1943
21 Sep 2011 11:38:19	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	570,240	1,251,101	2.1940
19 Sep 2011 12:30:40	1065650	13017131	hadcm3n_t429_1940_40_007312530_2	544,320	1,194,425	2.1943