Task 15230091

Name	hadam3p_saf_1c99_2004_1_006934117_1
Workunit	7137433
Created	3 Sep 2012, 20:24:57 UTC
Sent	3 Sep 2012, 20:47:29 UTC
Report deadline	17 Aug 2013, 2:07:29 UTC
Received	17 Sep 2012, 21:58:52 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1072815
Run time	3 days 21 hours 18 min 3 sec
CPU time	3 days 19 hours 44 min 15 sec
Validate state	Initial
Credit	2,244.09
Device peak FLOPS	2.65 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> 18:06:11 (4948): No heartbeat from core client for 30 sec - exiting 18:06:12 (4948): No heartbeat from core client for 30 sec - exiting 18:06:13 (4948): No heartbeat from core client for 30 sec - exiting 18:06:14 (4948): No heartbeat from core client for 30 sec - exiting 18:06:15 (4948): No heartbeat from core client for 30 sec - exiting 18:06:16 (4948): No heartbeat from core client for 30 sec - exiting 18:06:17 (4948): No heartbeat from core client for 30 sec - exiting 18:06:18 (4948): No heartbeat from core client for 30 sec - exiting 18:06:19 (4948): No heartbeat from core client for 30 sec - exiting 18:06:20 (4948): No heartbeat from core client for 30 sec - exiting 18:06:21 (4948): No heartbeat from core client for 30 sec - exiting 18:06:22 (4948): No heartbeat from core client for 30 sec - exiting 18:06:23 (4948): No heartbeat from core client for 30 sec - exiting 18:06:24 (4948): No heartbeat from core client for 30 sec - exiting 18:06:25 (4948): No heartbeat from core client for 30 sec - exiting 18:06:27 (4948): No heartbeat from core client for 30 sec - exiting 18:06:28 (4948): No heartbeat from core client for 30 sec - exiting 18:06:29 (4948): No heartbeat from core client for 30 sec - exiting 18:06:30 (4948): No heartbeat from core client for 30 sec - exiting 18:06:31 (4948): No heartbeat from core client for 30 sec - exiting 18:06:32 (4948): No heartbeat from core client for 30 sec - exiting 18:06:33 (4948): No heartbeat from core client for 30 sec - exiting 18:06:34 (4948): No heartbeat from core client for 30 sec - exiting 18:06:35 (4948): No heartbeat from core client for 30 sec - exiting 18:06:36 (4948): No heartbeat from core client for 30 sec - exiting 18:06:37 (4948): No heartbeat from core client for 30 sec - exiting 18:06:39 (4948): No heartbeat from core client for 30 sec - exiting 18:06:40 (4948): No heartbeat from core client for 30 sec - exiting 18:06:41 (4948): No heartbeat from core client for 30 sec - exiting 18:06:42 (4948): No heartbeat from core client for 30 sec - exiting 18:06:43 (4948): No heartbeat from core client for 30 sec - exiting 18:06:44 (4948): No heartbeat from core client for 30 sec - exiting 18:06:45 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... G19:22:24 (4004): No heartbeat from core client for 30 sec - exiting 19:22:25 (4004): No heartbeat from core client for 30 sec - exiting 19:22:26 (4004): No heartbeat from core client for 30 sec - exiting 19:22:27 (4004): No heartbeat from core client for 30 sec - exiting 19:22:29 (4004): No heartbeat from core client for 30 sec - exiting 19:22:30 (4004): No heartbeat from core client for 30 sec - exiting 19:22:31 (4004): No heartbeat from core client for 30 sec - exiting 19:22:32 (4004): No heartbeat from core client for 30 sec - exiting 19:22:33 (4004): No heartbeat from core client for 30 sec - exiting 19:22:34 (4004): No heartbeat from core client for 30 sec - exiting 19:22:35 (4004): No heartbeat from core client for 30 sec - exiting 19:22:36 (4004): No heartbeat from core client for 30 sec - exiting 19:22:37 (4004): No heartbeat from core client for 30 sec - exiting 19:22:38 (4004): No heartbeat from core client for 30 sec - exiting 19:22:40 (4004): No heartbeat from core client for 30 sec - exiting 19:22:41 (4004): No heartbeat from core client for 30 sec - exiting 19:22:42 (4004): No heartbeat from core client for 30 sec - exiting 19:22:43 (4004): No heartbeat from core client for 30 sec - exiting 19:22:44 (4004): No heartbeat from core client for 30 sec - exiting 19:22:45 (4004): No heartbeat from core client for 30 sec - exiting 19:22:46 (4004): No heartbeat from core client for 30 sec - exiting 19:22:47 (4004): No heartbeat from core client for 30 sec - exiting 19:22:48 (4004): No heartbeat from core client for 30 sec - exiting 19:22:49 (4004): No heartbeat from core client for 30 sec - exiting 19:22:50 (4004): No heartbeat from core client for 30 sec - exiting 19:22:52 (4004): No heartbeat from core client for 30 sec - exiting 19:22:53 (4004): No heartbeat from core client for 30 sec - exiting 19:22:54 (4004): No heartbeat from core client for 30 sec - exiting 19:22:55 (4004): No heartbeat from core client for 30 sec - exiting 19:22:56 (4004): No heartbeat from core client for 30 sec - exiting 19:22:57 (4004): No heartbeat from core client for 30 sec - exiting 19:22:58 (4004): No heartbeat from core client for 30 sec - exiting 19:22:59 (4004): No heartbeat from core client for 30 sec - exiting 19:23:00 (4004): No heartbeat from core client for 30 sec - exiting 19:23:01 (4004): No heartbeat from core client for 30 sec - exiting 19:23:02 (4004): No heartbeat from core client for 30 sec - exiting 19:23:04 (4004): No heartbeat from core client for 30 sec - exiting 19:23:05 (4004): No heartbeat from core client for 30 sec - exiting 19:23:06 (4004): No heartbeat from core client for 30 sec - exiting 19:23:07 (4004): No heartbeat from core client for 30 sec - exiting 19:23:08 (4004): No heartbeat from core client for 30 sec - exiting 19:23:09 (4004): No heartbeat from core client for 30 sec - exiting 19:23:10 (4004): No heartbeat from core client for 30 sec - exiting 19:23:11 (4004): No heartbeat from core client for 30 sec - exiting 19:23:12 (4004): No heartbeat from core client for 30 sec - exiting 19:23:13 (4004): No heartbeat from core client for 30 sec - exiting 19:23:14 (4004): No heartbeat from core client for 30 sec - exiting 19:23:16 (4004): No heartbeat from core client for 30 sec - exiting 19:23:17 (4004): No heartbeat from core client for 30 sec - exiting 19:23:18 (4004): No heartbeat from core client for 30 sec - exiting 19:23:19 (4004): No heartbeat from core client for 30 sec - exiting 19:23:20 (4004): No heartbeat from core client for 30 sec - exiting 19:23:21 (4004): No heartbeat from core client for 30 sec - exiting 19:23:22 (4004): No heartbeat from core client for 30 sec - exiting 19:23:23 (4004): No heartbeat from core client for 30 sec - exiting 19:23:24 (4004): No heartbeat from core client for 30 sec - exiting 19:23:25 (4004): No heartbeat from core client for 30 sec - exiting 19:23:26 (4004): No heartbeat from core client for 30 sec - exiting 19:23:27 (4004): No heartbeat from core client for 30 sec - exiting 19:23:28 (4004): No heartbeat from core client for 30 sec - exiting 19:23:29 (4004): No heartbeat from core client for 30 sec - exiting 19:23:30 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:31 (4004): No heartbeat from core client for 30 sec - exiting 19:23:32 (4004): No heartbeat from core client for 30 sec - exiting 19:23:33 (4004): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:52:53 (4000): No heartbeat from core client for 30 sec - exiting 18:52:54 (4000): No heartbeat from core client for 30 sec - exiting 18:52:55 (4000): No heartbeat from core client for 30 sec - exiting 18:52:56 (4000): No heartbeat from core client for 30 sec - exiting 18:52:57 (4000): No heartbeat from core client for 30 sec - exiting 18:52:58 (4000): No heartbeat from core client for 30 sec - exiting 18:52:59 (4000): No heartbeat from core client for 30 sec - exiting 18:53:00 (4000): No heartbeat from core client for 30 sec - exiting 18:53:01 (4000): No heartbeat from core client for 30 sec - exiting 18:53:02 (4000): No heartbeat from core client for 30 sec - exiting 18:53:03 (4000): No heartbeat from core client for 30 sec - exiting 18:53:04 (4000): No heartbeat from core client for 30 sec - exiting 18:53:05 (4000): No heartbeat from core client for 30 sec - exiting 18:53:06 (4000): No heartbeat from core client for 30 sec - exiting 18:53:07 (4000): No heartbeat from core client for 30 sec - exiting 18:53:08 (4000): No heartbeat from core client for 30 sec - exiting 18:53:09 (4000): No heartbeat from core client for 30 sec - exiting 18:53:10 (4000): No heartbeat from core client for 30 sec - exiting 18:53:11 (4000): No heartbeat from core client for 30 sec - exiting 18:53:12 (4000): No heartbeat from core client for 30 sec - exiting 18:53:13 (4000): No heartbeat from core client for 30 sec - exiting 18:53:14 (4000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5768, selfPID=5768, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:21:19 (4336): No heartbeat from core client for 30 sec - exiting 00:21:20 (4336): No heartbeat from core client for 30 sec - exiting 00:21:21 (4336): No heartbeat from core client for 30 sec - exiting 00:21:22 (4336): No heartbeat from core client for 30 sec - exiting 00:21:23 (4336): No heartbeat from core client for 30 sec - exiting 00:21:24 (4336): No heartbeat from core client for 30 sec - exiting 00:21:25 (4336): No heartbeat from core client for 30 sec - exiting 00:21:26 (4336): No heartbeat from core client for 30 sec - exiting 00:21:28 (4336): No heartbeat from core client for 30 sec - exiting 00:21:29 (4336): No heartbeat from core client for 30 sec - exiting 00:21:30 (4336): No heartbeat from core client for 30 sec - exiting 00:21:31 (4336): No heartbeat from core client for 30 sec - exiting 00:21:32 (4336): No heartbeat from core client for 30 sec - exiting 00:21:33 (4336): No heartbeat from core client for 30 sec - exiting 00:21:34 (4336): No heartbeat from core client for 30 sec - exiting 00:21:35 (4336): No heartbeat from core client for 30 sec - exiting 00:21:36 (4336): No heartbeat from core client for 30 sec - exiting 00:21:37 (4336): No heartbeat from core client for 30 sec - exiting 00:21:38 (4336): No heartbeat from core client for 30 sec - exiting 00:21:40 (4336): No heartbeat from core client for 30 sec - exiting 00:21:41 (4336): No heartbeat from core client for 30 sec - exiting 00:21:42 (4336): No heartbeat from core client for 30 sec - exiting 00:21:43 (4336): No heartbeat from core client for 30 sec - exiting 00:21:44 (4336): No heartbeat from core client for 30 sec - exiting 00:21:45 (4336): No heartbeat from core client for 30 sec - exiting 00:21:46 (4336): No heartbeat from core client for 30 sec - exiting 00:21:47 (4336): No heartbeat from core client for 30 sec - exiting 00:21:48 (4336): No heartbeat from core client for 30 sec - exiting 00:21:49 (4336): No heartbeat from core client for 30 sec - exiting 00:21:50 (4336): No heartbeat from core client for 30 sec - exiting 00:21:52 (4336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:21:53 (4336): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 11:29:15 (5824): No heartbeat from core client for 30 sec - exiting 11:29:17 (5824): No heartbeat from core client for 30 sec - exiting 11:29:18 (5824): No heartbeat from core client for 30 sec - exiting 11:29:19 (5824): No heartbeat from core client for 30 sec - exiting 11:29:20 (5824): No heartbeat from core client for 30 sec - exiting 11:29:21 (5824): No heartbeat from core client for 30 sec - exiting 11:29:22 (5824): No heartbeat from core client for 30 sec - exiting 11:29:23 (5824): No heartbeat from core client for 30 sec - exiting 11:29:24 (5824): No heartbeat from core client for 30 sec - exiting 11:29:25 (5824): No heartbeat from core client for 30 sec - exiting 11:29:26 (5824): No heartbeat from core client for 30 sec - exiting 11:29:27 (5824): No heartbeat from core client for 30 sec - exiting 11:29:28 (5824): No heartbeat from core client for 30 sec - exiting 11:29:29 (5824): No heartbeat from core client for 30 sec - exiting 11:29:30 (5824): No heartbeat from core client for 30 sec - exiting 11:29:31 (5824): No heartbeat from core client for 30 sec - exiting 11:29:32 (5824): No heartbeat from core client for 30 sec - exiting 11:29:33 (5824): No heartbeat from core client for 30 sec - exiting 11:29:35 (5824): No heartbeat from core client for 30 sec - exiting 11:29:36 (5824): No heartbeat from core client for 30 sec - exiting 11:30:07 (5824): No heartbeat from core client for 30 sec - exiting 11:30:08 (5824): No heartbeat from core client for 30 sec - exiting 11:30:09 (5824): No heartbeat from core client for 30 sec - exiting 11:30:10 (5824): No heartbeat from core client for 30 sec - exiting 11:30:11 (5824): No heartbeat from core client for 30 sec - exiting 11:30:12 (5824): No heartbeat from core client for 30 sec - exiting 11:30:13 (5824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:30:14 (5824): No heartbeat from core client for 30 sec - exiting 11:30:15 (5824): No heartbeat from core client for 30 sec - exiting 16:26:54 (5844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:25:54 (4428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:05 (4828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1552, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 12:33:48 (3156): No heartbeat from core client for 30 sec - exiting 12:33:49 (3156): No heartbeat from core client for 30 sec - exiting 12:33:51 (3156): No heartbeat from core client for 30 sec - exiting 12:33:52 (3156): No heartbeat from core client for 30 sec - exiting 12:33:53 (3156): No heartbeat from core client for 30 sec - exiting 12:33:54 (3156): No heartbeat from core client for 30 sec - exiting 12:33:55 (3156): No heartbeat from core client for 30 sec - exiting 12:33:56 (3156): No heartbeat from core client for 30 sec - exiting 12:33:57 (3156): No heartbeat from core client for 30 sec - exiting 12:33:58 (3156): No heartbeat from core client for 30 sec - exiting 12:33:59 (3156): No heartbeat from core client for 30 sec - exiting 12:34:00 (3156): No heartbeat from core client for 30 sec - exiting 12:34:01 (3156): No heartbeat from core client for 30 sec - exiting 12:34:02 (3156): No heartbeat from core client for 30 sec - exiting 12:34:03 (3156): No heartbeat from core client for 30 sec - exiting 12:34:04 (3156): No heartbeat from core client for 30 sec - exiting 12:34:05 (3156): No heartbeat from core client for 30 sec - exiting 12:34:06 (3156): No heartbeat from core client for 30 sec - exiting 12:34:07 (3156): No heartbeat from core client for 30 sec - exiting 12:34:08 (3156): No heartbeat from core client for 30 sec - exiting 12:34:10 (3156): No heartbeat from core client for 30 sec - exiting 12:34:11 (3156): No heartbeat from core client for 30 sec - exiting 12:34:12 (3156): No heartbeat from core client for 30 sec - exiting 12:34:13 (3156): No heartbeat from core client for 30 sec - exiting 12:34:14 (3156): No heartbeat from core client for 30 sec - exiting 12:34:15 (3156): No heartbeat from core client for 30 sec - exiting 12:34:16 (3156): No heartbeat from core client for 30 sec - exiting 12:34:17 (3156): No heartbeat from core client for 30 sec - exiting 12:34:18 (3156): No heartbeat from core client for 30 sec - exiting 12:34:19 (3156): No heartbeat from core client for 30 sec - exiting 12:34:20 (3156): No heartbeat from core client for 30 sec - exiting 12:34:22 (3156): No heartbeat from core client for 30 sec - exiting 12:34:23 (3156): No heartbeat from core client for 30 sec - exiting 12:34:24 (3156): No heartbeat from core client for 30 sec - exiting 12:34:25 (3156): No heartbeat from core client for 30 sec - exiting 12:34:26 (3156): No heartbeat from core client for 30 sec - exiting 12:34:27 (3156): No heartbeat from core client for 30 sec - exiting 12:34:28 (3156): No heartbeat from core client for 30 sec - exiting 12:34:29 (3156): No heartbeat from core client for 30 sec - exiting 12:34:30 (3156): No heartbeat from core client for 30 sec - exiting 12:34:31 (3156): No heartbeat from core client for 30 sec - exiting 12:34:32 (3156): No heartbeat from core client for 30 sec - exiting 12:35:03 (3156): No heartbeat from core client for 30 sec - exiting 12:35:04 (3156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:20:14 (6680): No heartbeat from core client for 30 sec - exiting 13:20:15 (6680): No heartbeat from core client for 30 sec - exiting 13:20:16 (6680): No heartbeat from core client for 30 sec - exiting 13:20:17 (6680): No heartbeat from core client for 30 sec - exiting 13:20:18 (6680): No heartbeat from core client for 30 sec - exiting 13:20:19 (6680): No heartbeat from core client for 30 sec - exiting 13:20:20 (6680): No heartbeat from core client for 30 sec - exiting 13:20:21 (6680): No heartbeat from core client for 30 sec - exiting 13:20:23 (6680): No heartbeat from core client for 30 sec - exiting 13:20:24 (6680): No heartbeat from core client for 30 sec - exiting 13:20:25 (6680): No heartbeat from core client for 30 sec - exiting 13:20:26 (6680): No heartbeat from core client for 30 sec - exiting 13:20:27 (6680): No heartbeat from core client for 30 sec - exiting 13:20:28 (6680): No heartbeat from core client for 30 sec - exiting 13:20:29 (6680): No heartbeat from core client for 30 sec - exiting 13:20:30 (6680): No heartbeat from core client for 30 sec - exiting 13:20:31 (6680): No heartbeat from core client for 30 sec - exiting 13:20:32 (6680): No heartbeat from core client for 30 sec - exiting 13:20:33 (6680): No heartbeat from core client for 30 sec - exiting 13:20:34 (6680): No heartbeat from core client for 30 sec - exiting 13:20:35 (6680): No heartbeat from core client for 30 sec - exiting 13:20:36 (6680): No heartbeat from core client for 30 sec - exiting 13:20:38 (6680): No heartbeat from core client for 30 sec - exiting 13:20:39 (6680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:20:40 (6680): No heartbeat from core client for 30 sec - exiting 13:20:41 (6680): No heartbeat from core client for 30 sec - exiting 13:20:42 (6680): No heartbeat from core client for 30 sec - exiting 13:20:43 (6680): No heartbeat from core client for 30 sec - exiting 17:29:48 (6232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6928, selfPID=6928, iMonCtr=2 01:00:58 (4484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:02:00 (1756): No heartbeat from core client for 30 sec - exiting 01:02:01 (1756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5716, selfPID=6992, iMonCtr=1 Model crash detected, will try to restart... 18:34:27 (4464): No heartbeat from core client for 30 sec - exiting 18:34:28 (4464): No heartbeat from core client for 30 sec - exiting 18:34:29 (4464): No heartbeat from core client for 30 sec - exiting 18:34:30 (4464): No heartbeat from core client for 30 sec - exiting 18:34:31 (4464): No heartbeat from core client for 30 sec - exiting 18:34:32 (4464): No heartbeat from core client for 30 sec - exiting 18:34:33 (4464): No heartbeat from core client for 30 sec - exiting 18:34:34 (4464): No heartbeat from core client for 30 sec - exiting 18:34:35 (4464): No heartbeat from core client for 30 sec - exiting 18:34:36 (4464): No heartbeat from core client for 30 sec - exiting 18:34:37 (4464): No heartbeat from core client for 30 sec - exiting 18:34:38 (4464): No heartbeat from core client for 30 sec - exiting 18:34:39 (4464): No heartbeat from core client for 30 sec - exiting 18:34:40 (4464): No heartbeat from core client for 30 sec - exiting 18:34:41 (4464): No heartbeat from core client for 30 sec - exiting 18:34:42 (4464): No heartbeat from core client for 30 sec - exiting 18:34:43 (4464): No heartbeat from core client for 30 sec - exiting 18:34:44 (4464): No heartbeat from core client for 30 sec - exiting 18:34:45 (4464): No heartbeat from core client for 30 sec - exiting 18:34:46 (4464): No heartbeat from core client for 30 sec - exiting 18:34:47 (4464): No heartbeat from core client for 30 sec - exiting 18:34:48 (4464): No heartbeat from core client for 30 sec - exiting 18:34:49 (4464): No heartbeat from core client for 30 sec - exiting 18:34:50 (4464): No heartbeat from core client for 30 sec - exiting 18:34:51 (4464): No heartbeat from core client for 30 sec - exiting 18:34:52 (4464): No heartbeat from core client for 30 sec - exiting 18:34:53 (4464): No heartbeat from core client for 30 sec - exiting 18:34:54 (4464): No heartbeat from core client for 30 sec - exiting 18:34:55 (4464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:34:57 (4464): No heartbeat from core client for 30 sec - exiting 18:34:58 (4464): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:31:37 (3208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:31:38 (3208): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4992, selfPID=1644, iMonCtr=1 Model crash detected, will try to restart... 19:03:25 (2256): No heartbeat from core client for 30 sec - exiting 19:03:26 (2256): No heartbeat from core client for 30 sec - exiting 19:03:27 (2256): No heartbeat from core client for 30 sec - exiting 19:03:28 (2256): No heartbeat from core client for 30 sec - exiting 19:03:29 (2256): No heartbeat from core client for 30 sec - exiting 19:03:30 (2256): No heartbeat from core client for 30 sec - exiting 19:03:31 (2256): No heartbeat from core client for 30 sec - exiting 19:03:32 (2256): No heartbeat from core client for 30 sec - exiting 19:03:33 (2256): No heartbeat from core client for 30 sec - exiting 19:03:34 (2256): No heartbeat from core client for 30 sec - exiting 19:03:35 (2256): No heartbeat from core client for 30 sec - exiting 19:03:36 (2256): No heartbeat from core client for 30 sec - exiting 19:03:37 (2256): No heartbeat from core client for 30 sec - exiting 19:03:38 (2256): No heartbeat from core client for 30 sec - exiting 19:03:39 (2256): No heartbeat from core client for 30 sec - exiting 19:03:40 (2256): No heartbeat from core client for 30 sec - exiting 19:03:41 (2256): No heartbeat from core client for 30 sec - exiting 19:03:42 (2256): No heartbeat from core client for 30 sec - exiting 19:03:43 (2256): No heartbeat from core client for 30 sec - exiting 19:03:44 (2256): No heartbeat from core client for 30 sec - exiting 19:03:45 (2256): No heartbeat from core client for 30 sec - exiting 19:03:46 (2256): No heartbeat from core client for 30 sec - exiting 19:03:47 (2256): No heartbeat from core client for 30 sec - exiting 19:03:48 (2256): No heartbeat from core client for 30 sec - exiting 19:03:49 (2256): No heartbeat from core client for 30 sec - exiting 19:03:50 (2256): No heartbeat from core client for 30 sec - exiting 19:03:51 (2256): No heartbeat from core client for 30 sec - exiting 19:03:52 (2256): No heartbeat from core client for 30 sec - exiting 19:03:53 (2256): No heartbeat from core client for 30 sec - exiting 19:03:54 (2256): No heartbeat from core client for 30 sec - exiting 19:03:55 (2256): No heartbeat from core client for 30 sec - exiting 19:03:56 (2256): No heartbeat from core client for 30 sec - exiting 19:03:57 (2256): No heartbeat from core client for 30 sec - exiting 19:03:58 (2256): No heartbeat from core client for 30 sec - exiting 19:03:59 (2256): No heartbeat from core client for 30 sec - exiting 19:04:00 (2256): No heartbeat from core client for 30 sec - exiting 19:04:01 (2256): No heartbeat from core client for 30 sec - exiting 19:04:02 (2256): No heartbeat from core client for 30 sec - exiting 19:04:03 (2256): No heartbeat from core client for 30 sec - exiting 19:04:04 (2256): No heartbeat from core client for 30 sec - exiting 19:04:05 (2256): No heartbeat from core client for 30 sec - exiting 19:04:06 (2256): No heartbeat from core client for 30 sec - exiting 19:04:07 (2256): No heartbeat from core client for 30 sec - exiting 19:04:08 (2256): No heartbeat from core client for 30 sec - exiting 19:04:09 (2256): No heartbeat from core client for 30 sec - exiting 19:04:10 (2256): No heartbeat from core client for 30 sec - exiting 19:04:11 (2256): No heartbeat from core client for 30 sec - exiting 19:04:13 (2256): No heartbeat from core client for 30 sec - exiting 19:04:14 (2256): No heartbeat from core client for 30 sec - exiting 19:04:15 (2256): No heartbeat from core client for 30 sec - exiting 19:04:16 (2256): No heartbeat from core client for 30 sec - exiting 19:04:17 (2256): No heartbeat from core client for 30 sec - exiting 19:04:18 (2256): No heartbeat from core client for 30 sec - exiting 19:04:19 (2256): No heartbeat from core client for 30 sec - exiting 19:04:20 (2256): No heartbeat from core client for 30 sec - exiting 19:04:21 (2256): No heartbeat from core client for 30 sec - exiting 19:04:22 (2256): No heartbeat from core client for 30 sec - exiting 19:04:23 (2256): No heartbeat from core client for 30 sec - exiting 19:04:24 (2256): No heartbeat from core client for 30 sec - exiting 19:04:25 (2256): No heartbeat from core client for 30 sec - exiting 19:04:26 (2256): No heartbeat from core client for 30 sec - exiting 19:04:27 (2256): No heartbeat from core client for 30 sec - exiting 19:04:28 (2256): No heartbeat from core client for 30 sec - exiting 19:04:29 (2256): No heartbeat from core client for 30 sec - exiting 19:04:31 (2256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:04:32 (2256): No heartbeat from core client for 30 sec - exiting 19:04:33 (2256): No heartbeat from core client for 30 sec - exiting 19:04:34 (2256): No heartbeat from core client for 30 sec - exiting 19:04:35 (2256): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5644, selfPID=5644, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:00:14 (2220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:01:56 (5788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3696, selfPID=4804, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 22:38:46 (3844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:13:55 (5716): No heartbeat from core client for 30 sec - exiting 19:13:56 (5716): No heartbeat from core client for 30 sec - exiting 19:13:57 (5716): No heartbeat from core client for 30 sec - exiting 19:13:58 (5716): No heartbeat from core client for 30 sec - exiting 19:13:59 (5716): No heartbeat from core client for 30 sec - exiting 19:14:00 (5716): No heartbeat from core client for 30 sec - exiting 19:14:01 (5716): No heartbeat from core client for 30 sec - exiting 19:14:03 (5716): No heartbeat from core client for 30 sec - exiting 19:14:04 (5716): No heartbeat from core client for 30 sec - exiting 19:14:05 (5716): No heartbeat from core client for 30 sec - exiting 19:14:06 (5716): No heartbeat from core client for 30 sec - exiting 19:14:07 (5716): No heartbeat from core client for 30 sec - exiting 19:14:08 (5716): No heartbeat from core client for 30 sec - exiting 19:14:09 (5716): No heartbeat from core client for 30 sec - exiting 19:14:10 (5716): No heartbeat from core client for 30 sec - exiting 19:14:11 (5716): No heartbeat from core client for 30 sec - exiting 19:14:12 (5716): No heartbeat from core client for 30 sec - exiting 19:14:13 (5716): No heartbeat from core client for 30 sec - exiting 19:14:14 (5716): No heartbeat from core client for 30 sec - exiting 19:14:15 (5716): No heartbeat from core client for 30 sec - exiting 19:14:16 (5716): No heartbeat from core client for 30 sec - exiting 19:14:17 (5716): No heartbeat from core client for 30 sec - exiting 19:14:18 (5716): No heartbeat from core client for 30 sec - exiting 19:14:19 (5716): No heartbeat from core client for 30 sec - exiting 19:14:20 (5716): No heartbeat from core client for 30 sec - exiting 19:14:21 (5716): No heartbeat from core client for 30 sec - exiting 19:14:22 (5716): No heartbeat from core client for 30 sec - exiting 19:14:24 (5716): No heartbeat from core client for 30 sec - exiting 19:14:25 (5716): No heartbeat from core client for 30 sec - exiting 19:14:26 (5716): No heartbeat from core client for 30 sec - exiting 19:14:27 (5716): No heartbeat from core client for 30 sec - exiting 19:14:28 (5716): No heartbeat from core client for 30 sec - exiting 19:14:29 (5716): No heartbeat from core client for 30 sec - exiting 19:14:30 (5716): No heartbeat from core client for 30 sec - exiting 19:14:31 (5716): No heartbeat from core client for 30 sec - exiting 19:14:32 (5716): No heartbeat from core client for 30 sec - exiting 19:14:33 (5716): No heartbeat from core client for 30 sec - exiting 19:14:34 (5716): No heartbeat from core client for 30 sec - exiting 19:14:35 (5716): No heartbeat from core client for 30 sec - exiting 19:14:36 (5716): No heartbeat from core client for 30 sec - exiting 19:14:37 (5716): No heartbeat from core client for 30 sec - exiting 19:15:10 (5716): No heartbeat from core client for 30 sec - exiting 19:15:11 (5716): No heartbeat from core client for 30 sec - exiting 19:15:12 (5716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5692, selfPID=5692, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 00:10:14 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3772, selfPID=4112, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 12:16:14 (5600): No heartbeat from core client for 30 sec - exiting 12:16:15 (5600): No heartbeat from core client for 30 sec - exiting 12:16:16 (5600): No heartbeat from core client for 30 sec - exiting 12:16:17 (5600): No heartbeat from core client for 30 sec - exiting 12:16:18 (5600): No heartbeat from core client for 30 sec - exiting 12:16:19 (5600): No heartbeat from core client for 30 sec - exiting 12:16:20 (5600): No heartbeat from core client for 30 sec - exiting 12:16:21 (5600): No heartbeat from core client for 30 sec - exiting 12:16:55 (5600): No heartbeat from core client for 30 sec - exiting 12:16:56 (5600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:06:33 (3852): No heartbeat from core client for 30 sec - exiting 13:06:34 (3852): No heartbeat from core client for 30 sec - exiting 13:06:35 (3852): No heartbeat from core client for 30 sec - exiting 13:06:36 (3852): No heartbeat from core client for 30 sec - exiting 13:06:37 (3852): No heartbeat from core client for 30 sec - exiting 13:06:38 (3852): No heartbeat from core client for 30 sec - exiting 13:06:40 (3852): No heartbeat from core client for 30 sec - exiting 13:06:41 (3852): No heartbeat from core client for 30 sec - exiting 13:06:42 (3852): No heartbeat from core client for 30 sec - exiting 13:06:43 (3852): No heartbeat from core client for 30 sec - exiting 13:06:44 (3852): No heartbeat from core client for 30 sec - exiting 13:06:45 (3852): No heartbeat from core client for 30 sec - exiting 13:06:46 (3852): No heartbeat from core client for 30 sec - exiting 13:06:47 (3852): No heartbeat from core client for 30 sec - exiting 13:06:48 (3852): No heartbeat from core client for 30 sec - exiting 13:06:49 (3852): No heartbeat from core client for 30 sec - exiting 13:06:50 (3852): No heartbeat from core client for 30 sec - exiting 13:06:52 (3852): No heartbeat from core client for 30 sec - exiting 13:06:53 (3852): No heartbeat from core client for 30 sec - exiting 13:06:54 (3852): No heartbeat from core client for 30 sec - exiting 13:06:55 (3852): No heartbeat from core client for 30 sec - exiting 13:06:56 (3852): No heartbeat from core client for 30 sec - exiting 13:06:57 (3852): No heartbeat from core client for 30 sec - exiting 13:06:58 (3852): No heartbeat from core client for 30 sec - exiting 13:06:59 (3852): No heartbeat from core client for 30 sec - exiting 13:07:00 (3852): No heartbeat from core client for 30 sec - exiting 13:07:01 (3852): No heartbeat from core client for 30 sec - exiting 13:07:03 (3852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:22:35 (4928): No heartbeat from core client for 30 sec - exiting 13:22:36 (4928): No heartbeat from core client for 30 sec - exiting 13:22:37 (4928): No heartbeat from core client for 30 sec - exiting 13:22:38 (4928): No heartbeat from core client for 30 sec - exiting 13:22:39 (4928): No heartbeat from core client for 30 sec - exiting 13:22:40 (4928): No heartbeat from core client for 30 sec - exiting 13:22:41 (4928): No heartbeat from core client for 30 sec - exiting 13:22:43 (4928): No heartbeat from core client for 30 sec - exiting 13:22:44 (4928): No heartbeat from core client for 30 sec - exiting 13:22:45 (4928): No heartbeat from core client for 30 sec - exiting 13:22:46 (4928): No heartbeat from core client for 30 sec - exiting 13:22:47 (4928): No heartbeat from core client for 30 sec - exiting 13:22:48 (4928): No heartbeat from core client for 30 sec - exiting 13:22:49 (4928): No heartbeat from core client for 30 sec - exiting 13:22:50 (4928): No heartbeat from core client for 30 sec - exiting 13:22:51 (4928): No heartbeat from core client for 30 sec - exiting 13:22:52 (4928): No heartbeat from core client for 30 sec - exiting 13:22:54 (4928): No heartbeat from core client for 30 sec - exiting 13:22:55 (4928): No heartbeat from core client for 30 sec - exiting 13:22:56 (4928): No heartbeat from core client for 30 sec - exiting 13:22:57 (4928): No heartbeat from core client for 30 sec - exiting 13:22:58 (4928): No heartbeat from core client for 30 sec - exiting 13:22:59 (4928): No heartbeat from core client for 30 sec - exiting 13:23:00 (4928): No heartbeat from core client for 30 sec - exiting 13:23:01 (4928): No heartbeat from core client for 30 sec - exiting 13:23:02 (4928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4988, selfPID=4988, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5492, selfPID=5492, iMonCtr=2 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5940, selfPID=5940, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4040, selfPID=4040, iMonCtr=2 19:52:40 (5872): No heartbeat from core client for 30 sec - exiting 19:52:41 (5872): No heartbeat from core client for 30 sec - exiting 19:52:42 (5872): No heartbeat from core client for 30 sec - exiting 19:52:43 (5872): No heartbeat from core client for 30 sec - exiting 19:52:44 (5872): No heartbeat from core client for 30 sec - exiting 19:52:45 (5872): No heartbeat from core client for 30 sec - exiting 19:52:46 (5872): No heartbeat from core client for 30 sec - exiting 19:52:47 (5872): No heartbeat from core client for 30 sec - exiting 19:52:48 (5872): No heartbeat from core client for 30 sec - exiting 19:52:49 (5872): No heartbeat from core client for 30 sec - exiting 19:52:50 (5872): No heartbeat from core client for 30 sec - exiting 19:52:51 (5872): No heartbeat from core client for 30 sec - exiting 19:52:52 (5872): No heartbeat from core client for 30 sec - exiting 19:52:53 (5872): No heartbeat from core client for 30 sec - exiting 19:52:54 (5872): No heartbeat from core client for 30 sec - exiting 19:52:55 (5872): No heartbeat from core client for 30 sec - exiting 19:52:56 (5872): No heartbeat from core client for 30 sec - exiting 19:52:57 (5872): No heartbeat from core client for 30 sec - exiting 19:52:58 (5872): No heartbeat from core client for 30 sec - exiting 19:52:59 (5872): No heartbeat from core client for 30 sec - exiting 19:53:00 (5872): No heartbeat from core client for 30 sec - exiting 19:53:01 (5872): No heartbeat from core client for 30 sec - exiting 19:53:02 (5872): No heartbeat from core client for 30 sec - exiting 19:53:03 (5872): No heartbeat from core client for 30 sec - exiting 19:53:04 (5872): No heartbeat from core client for 30 sec - exiting 19:53:05 (5872): No heartbeat from core client for 30 sec - exiting 19:53:06 (5872): No heartbeat from core client for 30 sec - exiting 19:53:07 (5872): No heartbeat from core client for 30 sec - exiting 19:53:09 (5872): No heartbeat from core client for 30 sec - exiting 19:53:10 (5872): No heartbeat from core client for 30 sec - exiting 19:53:11 (5872): No heartbeat from core client for 30 sec - exiting 19:53:12 (5872): No heartbeat from core client for 30 sec - exiting 19:53:13 (5872): No heartbeat from core client for 30 sec - exiting 19:53:14 (5872): No heartbeat from core client for 30 sec - exiting 19:53:15 (5872): No heartbeat from core client for 30 sec - exiting 19:53:16 (5872): No heartbeat from core client for 30 sec - exiting 19:53:17 (5872): No heartbeat from core client for 30 sec - exiting 19:53:18 (5872): No heartbeat from core client for 30 sec - exiting 19:53:19 (5872): No heartbeat from core client for 30 sec - exiting 19:53:20 (5872): No heartbeat from core client for 30 sec - exiting 19:53:21 (5872): No heartbeat from core client for 30 sec - exiting 19:53:22 (5872): No heartbeat from core client for 30 sec - exiting 19:53:23 (5872): No heartbeat from core client for 30 sec - exiting 19:53:24 (5872): No heartbeat from core client for 30 sec - exiting 19:53:25 (5872): No heartbeat from core client for 30 sec - exiting 19:53:26 (5872): No heartbeat from core client for 30 sec - exiting 19:53:27 (5872): No heartbeat from core client for 30 sec - exiting 19:53:28 (5872): No heartbeat from core client for 30 sec - exiting 19:53:29 (5872): No heartbeat from core client for 30 sec - exiting 19:53:30 (5872): No heartbeat from core client for 30 sec - exiting 19:53:31 (5872): No heartbeat from core client for 30 sec - exiting 19:53:32 (5872): No heartbeat from core client for 30 sec - exiting 19:53:33 (5872): No heartbeat from core client for 30 sec - exiting 19:53:34 (5872): No heartbeat from core client for 30 sec - exiting 19:53:35 (5872): No heartbeat from core client for 30 sec - exiting 19:53:36 (5872): No heartbeat from core client for 30 sec - exiting 19:53:37 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:53:38 (5872): No heartbeat from core client for 30 sec - exiting 19:53:39 (5872): No heartbeat from core client for 30 sec - exiting 19:53:40 (5872): No heartbeat from core client for 30 sec - exiting 19:53:41 (5872): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Sep 2012 22:02:47	1072815	15230091	hadam3p_saf_1c99_2004_1_006934117_1	138,336	329,689	2.3832
16 Sep 2012 16:52:20	1072815	15230091	hadam3p_saf_1c99_2004_1_006934117_1	126,837	302,250	2.3830
16 Sep 2012 15:51:14	1072815	15230091	hadam3p_saf_1c99_2004_1_006934117_1	126,816	301,863	2.3803
14 Sep 2012 19:22:14	1072815	15230091	hadam3p_saf_1c99_2004_1_006934117_1	115,296	274,392	2.3799
13 Sep 2012 17:48:43	1072815	15230091	hadam3p_saf_1c99_2004_1_006934117_1	103,776	246,774	2.3779
11 Sep 2012 23:37:24	1072815	15230091	hadam3p_saf_1c99_2004_1_006934117_1	92,256	219,436	2.3786
10 Sep 2012 22:08:00	1072815	15230091	hadam3p_saf_1c99_2004_1_006934117_1	80,736	192,421	2.3833
09 Sep 2012 22:19:14	1072815	15230091	hadam3p_saf_1c99_2004_1_006934117_1	69,216	165,266	2.3877
09 Sep 2012 14:41:22	1072815	15230091	hadam3p_saf_1c99_2004_1_006934117_1	57,696	138,471	2.4000
08 Sep 2012 18:32:48	1072815	15230091	hadam3p_saf_1c99_2004_1_006934117_1	46,176	111,072	2.4054
08 Sep 2012 10:37:06	1072815	15230091	hadam3p_saf_1c99_2004_1_006934117_1	34,656	83,247	2.4021
06 Sep 2012 19:29:10	1072815	15230091	hadam3p_saf_1c99_2004_1_006934117_1	23,136	55,765	2.4103
05 Sep 2012 18:33:13	1072815	15230091	hadam3p_saf_1c99_2004_1_006934117_1	11,616	28,292	2.4356