Task 12627005

Name	hadam3p_pnw_35oj_1964_1_007187515_0
Workunit	7385797
Created	22 Feb 2011, 13:25:10 UTC
Sent	24 Feb 2011, 2:55:08 UTC
Report deadline	6 Feb 2012, 8:15:08 UTC
Received	21 May 2011, 16:20:34 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1090105
Run time	6 days 20 hours 30 min 12 sec
CPU time	6 days 4 hours 46 min 30 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	3.01 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.08 windows_intelx86
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:42:05 (3176): No heartbeat from core client for 30 sec - exiting 17:42:06 (3176): No heartbeat from core client for 30 sec - exiting 17:42:07 (3176): No heartbeat from core client for 30 sec - exiting 17:42:08 (3176): No heartbeat from core client for 30 sec - exiting 17:42:09 (3176): No heartbeat from core client for 30 sec - exiting 17:42:10 (3176): No heartbeat from core client for 30 sec - exiting 17:42:11 (3176): No heartbeat from core client for 30 sec - exiting 17:42:12 (3176): No heartbeat from core client for 30 sec - exiting 17:42:13 (3176): No heartbeat from core client for 30 sec - exiting 17:42:14 (3176): No heartbeat from core client for 30 sec - exiting 17:42:15 (3176): No heartbeat from core client for 30 sec - exiting 17:42:16 (3176): No heartbeat from core client for 30 sec - exiting 17:42:17 (3176): No heartbeat from core client for 30 sec - exiting 17:42:18 (3176): No heartbeat from core client for 30 sec - exiting 17:42:19 (3176): No heartbeat from core client for 30 sec - exiting 17:42:20 (3176): No heartbeat from core client for 30 sec - exiting 17:42:21 (3176): No heartbeat from core client for 30 sec - exiting 17:42:22 (3176): No heartbeat from core client for 30 sec - exiting 17:42:23 (3176): No heartbeat from core client for 30 sec - exiting 17:42:24 (3176): No heartbeat from core client for 30 sec - exiting 17:42:25 (3176): No heartbeat from core client for 30 sec - exiting 17:42:26 (3176): No heartbeat from core client for 30 sec - exiting 17:42:27 (3176): No heartbeat from core client for 30 sec - exiting 17:42:28 (3176): No heartbeat from core client for 30 sec - exiting 17:42:29 (3176): No heartbeat from core client for 30 sec - exiting 17:42:30 (3176): No heartbeat from core client for 30 sec - exiting 17:42:31 (3176): No heartbeat from core client for 30 sec - exiting 17:42:32 (3176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1456, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 14:18:20 (1660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:18:22 (1660): No heartbeat from core client for 30 sec - exiting 14:18:23 (1660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8788, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2360, selfPID=9364, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional WCPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4672, selfPID=4672, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5448, selfPID=5448, iMonCtr=2 23:59:00 (7988): No heartbeat from core client for 30 sec - exiting 23:59:01 (7988): No heartbeat from core client for 30 sec - exiting 23:59:02 (7988): No heartbeat from core client for 30 sec - exiting 23:59:03 (7988): No heartbeat from core client for 30 sec - exiting 23:59:04 (7988): No heartbeat from core client for 30 sec - exiting 23:59:05 (7988): No heartbeat from core client for 30 sec - exiting 23:59:06 (7988): No heartbeat from core client for 30 sec - exiting 23:59:07 (7988): No heartbeat from core client for 30 sec - exiting 23:59:08 (7988): No heartbeat from core client for 30 sec - exiting 23:59:09 (7988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:30:26 (7216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:30:28 (7216): No heartbeat from core client for 30 sec - exiting 07:30:29 (7216): No heartbeat from core client for 30 sec - exiting 07:30:30 (7216): No heartbeat from core client for 30 sec - exiting 07:30:31 (7216): No heartbeat from core client for 30 sec - exiting 07:30:32 (7216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4940, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9152, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3952, selfPID=3952, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4212, selfPID=4212, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=852, selfPID=852, iMonCtr=2 02:49:06 (7600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:49:08 (7600): No heartbeat from core client for 30 sec - exiting 02:49:09 (7600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Colobalntrokerer: CPDN process is not ot running, exiting,Ret al = 1, checkPID=0, selfPID=2108, iMonCtr=2 Ctr=2 Model crash detected, will try to restart... 08:13:25 (7692): No heartbeat from core client for 30 sec - exiting 08:13:26 (7692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7048, iMonCtr=2 05:42:27 (7740): No heartbeat from core client for 30 sec - exiting 05:42:28 (7740): No heartbeat from core client for 30 sec - exiting 05:42:29 (7740): No heartbeat from core client for 30 sec - exiting 05:42:30 (7740): No heartbeat from core client for 30 sec - exiting 05:42:31 (7740): No heartbeat from core client for 30 sec - exiting 05:42:32 (7740): No heartbeat from core client for 30 sec - exiting 05:42:33 (7740): No heartbeat from core client for 30 sec - exiting 05:42:34 (7740): No heartbeat from core client for 30 sec - exiting 05:42:35 (7740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6956, selfPID=6956, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:12:06 (3728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:12:08 (3728): No heartbeat from core client for 30 sec - exiting 01:12:09 (3728): No heartbeat from core client for 30 sec - exiting 01:12:10 (3728): No heartbeat from core client for 30 sec - exiting 01:13:25 (7336): No heartbeat from core client for 30 sec - exiting 01:13:26 (7336): No heartbeat from core client for 30 sec - exiting 01:13:27 (7336): No heartbeat from core client for 30 sec - exiting 01:13:28 (7336): No heartbeat from core client for 30 sec - exiting 01:13:29 (7336): No heartbeat from core client for 30 sec - exiting 01:13:30 (7336): No heartbeat from core client for 30 sec - exiting 01:13:31 (7336): No heartbeat from core client for 30 sec - exiting 01:13:32 (7336): No heartbeat from core client for 30 sec - exiting 01:13:33 (7336): No heartbeat from core client for 30 sec - exiting 01:13:34 (7336): No heartbeat from core client for 30 sec - exiting 01:13:35 (7336): No heartbeat from core client for 30 sec - exiting 01:14:06 (7336): No heartbeat from core client for 30 sec - exiting 01:14:07 (7336): No heartbeat from core client for 30 sec - exiting 01:14:08 (7336): No heartbeat from core client for 30 sec - exiting 01:14:09 (7336): No heartbeat from core client for 30 sec - exiting 01:14:10 (7336): No heartbeat from core client for 30 sec - exiting 01:14:11 (7336): No heartbeat from core client for 30 sec - exiting 01:14:12 (7336): No heartbeat from core client for 30 sec - exiting 01:14:13 (7336): No heartbeat from core client for 30 sec - exiting 01:14:14 (7336): No heartbeat from core client for 30 sec - exiting 01:14:15 (7336): No heartbeat from core client for 30 sec - exiting 01:14:16 (7336): No heartbeat from core client for 30 sec - exiting 01:14:17 (7336): No heartbeat from core client for 30 sec - exiting 01:14:18 (7336): No heartbeat from core client for 30 sec - exiting 01:14:19 (7336): No heartbeat from core client for 30 sec - exiting 01:14:20 (7336): No heartbeat from core client for 30 sec - exiting 01:14:21 (7336): No heartbeat from core client for 30 sec - exiting 01:14:22 (7336): No heartbeat from core client for 30 sec - exiting 01:14:23 (7336): No heartbeat from core client for 30 sec - exiting 01:14:24 (7336): No heartbeat from core client for 30 sec - exiting 01:14:25 (7336): No heartbeat from core client for 30 sec - exiting 01:14:26 (7336): No heartbeat from core client for 30 sec - exiting 01:14:27 (7336): No heartbeat from core client for 30 sec - exiting 01:14:28 (7336): No heartbeat from core client for 30 sec - exiting 01:14:29 (7336): No heartbeat from core client for 30 sec - exiting 01:14:30 (7336): No heartbeat from core client for 30 sec - exiting 01:14:31 (7336): No heartbeat from core client for 30 sec - exiting 01:14:32 (7336): No heartbeat from core client for 30 sec - exiting 01:14:33 (7336): No heartbeat from core client for 30 sec - exiting 01:14:34 (7336): No heartbeat from core client for 30 sec - exiting 01:14:35 (7336): No heartbeat from core client for 30 sec - exiting 01:14:36 (7336): No heartbeat from core client for 30 sec - exiting 01:14:37 (7336): No heartbeat from core client for 30 sec - exiting 01:14:38 (7336): No heartbeat from core client for 30 sec - exiting 01:14:39 (7336): No heartbeat from core client for 30 sec - exiting 01:14:40 (7336): No heartbeat from core client for 30 sec - exiting 01:14:41 (7336): No heartbeat from core client for 30 sec - exiting 01:14:42 (7336): No heartbeat from core client for 30 sec - exiting 01:14:43 (7336): No heartbeat from core client for 30 sec - exiting 01:14:44 (7336): No heartbeat from core client for 30 sec - exiting 01:14:45 (7336): No heartbeat from core client for 30 sec - exiting 01:14:46 (7336): No heartbeat from core client for 30 sec - exiting 01:14:47 (7336): No heartbeat from core client for 30 sec - exiting 01:14:48 (7336): No heartbeat from core client for 30 sec - exiting 01:14:49 (7336): No heartbeat from core client for 30 sec - exiting 01:14:50 (7336): No heartbeat from core client for 30 sec - exiting 01:14:51 (7336): No heartbeat from core client for 30 sec - exiting 01:14:52 (7336): No heartbeat from core client for 30 sec - exiting 01:14:53 (7336): No heartbeat from core client for 30 sec - exiting 01:14:54 (7336): No heartbeat from core client for 30 sec - exiting 01:14:55 (7336): No heartbeat from core client for 30 sec - exiting 01:14:56 (7336): No heartbeat from core client for 30 sec - exiting 01:14:57 (7336): No heartbeat from core client for 30 sec - exiting 01:14:58 (7336): No heartbeat from core client for 30 sec - exiting 01:14:59 (7336): No heartbeat from core client for 30 sec - exiting 01:15:00 (7336): No heartbeat from core client for 30 sec - exiting 01:15:01 (7336): No heartbeat from core client for 30 sec - exiting 01:15:02 (7336): No heartbeat from core client for 30 sec - exiting 01:15:03 (7336): No heartbeat from core client for 30 sec - exiting 01:15:04 (7336): No heartbeat from core client for 30 sec - exiting 01:15:05 (7336): No heartbeat from core client for 30 sec - exiting 01:15:06 (7336): No heartbeat from core client for 30 sec - exiting 01:15:07 (7336): No heartbeat from core client for 30 sec - exiting 01:15:08 (7336): No heartbeat from core client for 30 sec - exiting 01:15:09 (7336): No heartbeat from core client for 30 sec - exiting 01:15:10 (7336): No heartbeat from core client for 30 sec - exiting 01:15:11 (7336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:15:12 (7336): No heartbeat from core client for 30 sec - exiting 01:16:06 (4704): No heartbeat from core client for 30 sec - exiting 01:16:07 (4704): No heartbeat from core client for 30 sec - exiting 01:16:08 (4704): No heartbeat from core client for 30 sec - exiting 01:16:09 (4704): No heartbeat from core client for 30 sec - exiting 01:16:10 (4704): No heartbeat from core client for 30 sec - exiting 01:16:11 (4704): No heartbeat from core client for 30 sec - exiting 01:16:12 (4704): No heartbeat from core client for 30 sec - exiting 01:16:13 (4704): No heartbeat from core client for 30 sec - exiting 01:16:14 (4704): No heartbeat from core client for 30 sec - exiting 01:16:15 (4704): No heartbeat from core client for 30 sec - exiting 01:16:16 (4704): No heartbeat from core client for 30 sec - exiting 01:16:17 (4704): No heartbeat from core client for 30 sec - exiting 01:16:18 (4704): No heartbeat from core client for 30 sec - exiting 01:16:19 (4704): No heartbeat from core client for 30 sec - exiting 01:16:20 (4704): No heartbeat from core client for 30 sec - exiting 07:43:56 (6796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8248, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6620, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:34:13 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7868, selfPID=7868, iMonCtr=2 02:35:38 (7752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7016, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 8 05:49:53 (3532): No heartbeat from core client for 30 sec - exiting 05:49:54 (3532): No heartbeat from core client for 30 sec - exiting 05:49:55 (3532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1364, iMonCtr=2 07:11:37 (6028): No heartbeat from core client for 30 sec - exiting 07:11:38 (6028): No heartbeat from core client for 30 sec - exiting 07:11:39 (6028): No heartbeat from core client for 30 sec - exiting 07:11:40 (6028): No heartbeat from core client for 30 sec - exiting 07:11:41 (6028): No heartbeat from core client for 30 sec - exiting 07:11:42 (6028): No heartbeat from core client for 30 sec - exiting 07:11:43 (6028): No heartbeat from core client for 30 sec - exiting 07:11:44 (6028): No heartbeat from core client for 30 sec - exiting 07:11:45 (6028): No heartbeat from core client for 30 sec - exiting 07:11:46 (6028): No heartbeat from core client for 30 sec - exiting 07:11:47 (6028): No heartbeat from core client for 30 sec - exiting 07:11:48 (6028): No heartbeat from core client for 30 sec - exiting 07:11:49 (6028): No heartbeat from core client for 30 sec - exiting 07:11:50 (6028): No heartbeat from core client for 30 sec - exiting 07:11:51 (6028): No heartbeat from core client for 30 sec - exiting 07:11:52 (6028): No heartbeat from core client for 30 sec - exiting 07:11:53 (6028): No heartbeat from core client for 30 sec - exiting 07:11:54 (6028): No heartbeat from core client for 30 sec - exiting 07:11:55 (6028): No heartbeat from core client for 30 sec - exiting 07:11:56 (6028): No heartbeat from core client for 30 sec - exiting 07:11:57 (6028): No heartbeat from core client for 30 sec - exiting 07:11:58 (6028): No heartbeat from core client for 30 sec - exiting 07:11:59 (6028): No heartbeat from core client for 30 sec - exiting 07:12:00 (6028): No heartbeat from core client for 30 sec - exiting 07:12:01 (6028): No heartbeat from core client for 30 sec - exiting 07:12:02 (6028): No heartbeat from core client for 30 sec - exiting 07:12:03 (6028): No heartbeat from core client for 30 sec - exiting 07:12:04 (6028): No heartbeat from core client for 30 sec - exiting 07:12:05 (6028): No heartbeat from core client for 30 sec - exiting 07:12:06 (6028): No heartbeat from core client for 30 sec - exiting 07:12:07 (6028): No heartbeat from core client for 30 sec - exiting 07:12:08 (6028): No heartbeat from core client for 30 sec - exiting 07:12:09 (6028): No heartbeat from core client for 30 sec - exiting 07:12:10 (6028): No heartbeat from core client for 30 sec - exiting 07:12:11 (6028): No heartbeat from core client for 30 sec - exiting 07:12:12 (6028): No heartbeat from core client for 30 sec - exiting 07:12:13 (6028): No heartbeat from core client for 30 sec - exiting 07:12:14 (6028): No heartbeat from core client for 30 sec - exiting 07:12:15 (6028): No heartbeat from core client for 30 sec - exiting 07:12:16 (6028): No heartbeat from core client for 30 sec - exiting 07:12:17 (6028): No heartbeat from core client for 30 sec - exiting 07:12:18 (6028): No heartbeat from core client for 30 sec - exiting 07:12:19 (6028): No heartbeat from core client for 30 sec - exiting 07:12:20 (6028): No heartbeat from core client for 30 sec - exiting 07:12:21 (6028): No heartbeat from core client for 30 sec - exiting 07:12:22 (6028): No heartbeat from core client for 30 sec - exiting 07:12:23 (6028): No heartbeat from core client for 30 sec - exiting 07:12:24 (6028): No heartbeat from core client for 30 sec - exiting 07:12:25 (6028): No heartbeat from core client for 30 sec - exiting 07:12:27 (6028): No heartbeat from core client for 30 sec - exiting 07:12:28 (6028): No heartbeat from core client for 30 sec - exiting 07:12:29 (6028): No heartbeat from core client for 30 sec - exiting 07:12:30 (6028): No heartbeat from core client for 30 sec - exiting 07:12:31 (6028): No heartbeat from core client for 30 sec - exiting 07:12:32 (6028): No heartbeat from core client for 30 sec - exiting 07:12:33 (6028): No heartbeat from core client for 30 sec - exiting 07:12:34 (6028): No heartbeat from core client for 30 sec - exiting 07:12:35 (6028): No heartbeat from core client for 30 sec - exiting 07:12:36 (6028): No heartbeat from core client for 30 sec - exiting 07:12:37 (6028): No heartbeat from core client for 30 sec - exiting 07:12:38 (6028): No heartbeat from core client for 30 sec - exiting 07:12:39 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:12:40 (6028): No heartbeat from core client for 30 sec - exiting 07:12:41 (6028): No heartbeat from core client for 30 sec - exiting 07:13:42 (1668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7804, selfPID=7804, iMonCtr=2 07:13:43 (1668): No heartbeat from core client for 30 sec - exiting 07:13:44 (1668): No heartbeat from core client for 30 sec - exiting 07:14:28 (6908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:33:05 (248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:33:06 (248): No heartbeat from core client for 30 sec - exiting 07:33:07 (248): No heartbeat from core client for 30 sec - exiting 07:33:08 (248): No heartbeat from core client for 30 sec - exiting 07:46:33 (6244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:34 (6244): No heartbeat from core client for 30 sec - exiting 07:46:35 (6244): No heartbeat from core client for 30 sec - exiting 07:46:36 (6244): No heartbeat from core client for 30 sec - exiting 07:46:37 (6244): No heartbeat from core client for 30 sec - exiting 07:46:38 (6244): No heartbeat from core client for 30 sec - exiting 07:48:13 (7520): No heartbeat from core client for 30 sec - exiting 07:48:14 (7520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:02:30 (7876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:02:31 (7876): No heartbeat from core client for 30 sec - exiting 08:02:32 (7876): No heartbeat from core client for 30 sec - exiting 08:02:33 (7876): No heartbeat from core client for 30 sec - exiting 08:02:34 (7876): No heartbeat from core client for 30 sec - exiting 08:02:35 (7876): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4496, selfPID=4672, iMonCtr=1 Model crash detected, will try to restart... 08:14:53 (3796): No heartbeat from core client for 30 sec - exiting 08:14:54 (3796): No heartbeat from core client for 30 sec - exiting 08:14:55 (3796): No heartbeat from core client for 30 sec - exiting 08:14:56 (3796): No heartbeat from core client for 30 sec - exiting 08:14:57 (3796): No heartbeat from core client for 30 sec - exiting 08:14:58 (3796): No heartbeat from core client for 30 sec - exiting 08:14:59 (3796): No heartbeat from core client for 30 sec - exiting 08:15:00 (3796): No heartbeat from core client for 30 sec - exiting 08:15:01 (3796): No heartbeat from core client for 30 sec - exiting 08:15:02 (3796): No heartbeat from core client for 30 sec - exiting 08:15:33 (3796): No heartbeat from core client for 30 sec - exiting 08:15:34 (3796): No heartbeat from core client for 30 sec - exiting 08:15:35 (3796): No heartbeat from core client for 30 sec - exiting 08:15:36 (3796): No heartbeat from core client for 30 sec - exiting 08:15:37 (3796): No heartbeat from core client for 30 sec - exiting 08:15:38 (3796): No heartbeat from core client for 30 sec - exiting 08:15:39 (3796): No heartbeat from core client for 30 sec - exiting 08:15:40 (3796): No heartbeat from core client for 30 sec - exiting 08:15:41 (3796): No heartbeat from core client for 30 sec - exiting 08:15:42 (3796): No heartbeat from core client for 30 sec - exiting 08:15:43 (3796): No heartbeat from core client for 30 sec - exiting 08:15:44 (3796): No heartbeat from core client for 30 sec - exiting 08:15:45 (3796): No heartbeat from core client for 30 sec - exiting 08:15:46 (3796): No heartbeat from core client for 30 sec - exiting 08:15:47 (3796): No heartbeat from core client for 30 sec - exiting 08:15:48 (3796): No heartbeat from core client for 30 sec - exiting 08:15:49 (3796): No heartbeat from core client for 30 sec - exiting 08:15:50 (3796): No heartbeat from core client for 30 sec - exiting 08:15:51 (3796): No heartbeat from core client for 30 sec - exiting 08:15:52 (3796): No heartbeat from core client for 30 sec - exiting 08:15:53 (3796): No heartbeat from core client for 30 sec - exiting 08:15:54 (3796): No heartbeat from core client for 30 sec - exiting 08:15:55 (3796): No heartbeat from core client for 30 sec - exiting 08:15:56 (3796): No heartbeat from core client for 30 sec - exiting 08:15:57 (3796): No heartbeat from core client for 30 sec - exiting 08:15:58 (3796): No heartbeat from core client for 30 sec - exiting 08:15:59 (3796): No heartbeat from core client for 30 sec - exiting 08:16:00 (3796): No heartbeat from core client for 30 sec - exiting 08:16:01 (3796): No heartbeat from core client for 30 sec - exiting 08:16:02 (3796): No heartbeat from core client for 30 sec - exiting 08:16:03 (3796): No heartbeat from core client for 30 sec - exiting 08:16:04 (3796): No heartbeat from core client for 30 sec - exiting 08:16:05 (3796): No heartbeat from core client for 30 sec - exiting 08:16:06 (3796): No heartbeat from core client for 30 sec - exiting 08:16:07 (3796): No heartbeat from core client for 30 sec - exiting 08:16:08 (3796): No heartbeat from core client for 30 sec - exiting 08:16:09 (3796): No heartbeat from core client for 30 sec - exiting 08:16:10 (3796): No heartbeat from core client for 30 sec - exiting 08:16:11 (3796): No heartbeat from core client for 30 sec - exiting 08:16:12 (3796): No heartbeat from core client for 30 sec - exiting 08:16:13 (3796): No heartbeat from core client for 30 sec - exiting 08:16:14 (3796): No heartbeat from core client for 30 sec - exiting 08:16:15 (3796): No heartbeat from core client for 30 sec - exiting 08:16:16 (3796): No heartbeat from core client for 30 sec - exiting 08:16:17 (3796): No heartbeat from core client for 30 sec - exiting 08:16:18 (3796): No heartbeat from core client for 30 sec - exiting 08:16:19 (3796): No heartbeat from core client for 30 sec - exiting 08:16:20 (3796): No heartbeat from core client for 30 sec - exiting 08:16:21 (3796): No heartbeat from core client for 30 sec - exiting 08:16:22 (3796): No heartbeat from core client for 30 sec - exiting 08:16:23 (3796): No heartbeat from core client for 30 sec - exiting 08:16:24 (3796): No heartbeat from core client for 30 sec - exiting 08:16:25 (3796): No heartbeat from core client for 30 sec - exiting 08:16:26 (3796): No heartbeat from core client for 30 sec - exiting 08:16:27 (3796): No heartbeat from core client for 30 sec - exiting 08:16:28 (3796): No heartbeat from core client for 30 sec - exiting 08:16:29 (3796): No heartbeat from core client for 30 sec - exiting 08:16:30 (3796): No heartbeat from core client for 30 sec - exiting 08:16:31 (3796): No heartbeat from core client for 30 sec - exiting 08:16:32 (3796): No heartbeat from core client for 30 sec - exiting 08:16:33 (3796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:16:34 (3796): No heartbeat from core client for 30 sec - exiting 08:17:34 (2496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:18:14 (4808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:22:06 (4940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:22:07 (4940): No heartbeat from core client for 30 sec - exiting 08:22:08 (4940): No heartbeat from core client for 30 sec - exiting 08:22:09 (4940): No heartbeat from core client for 30 sec - exiting 08:22:10 (4940): No heartbeat from core client for 30 sec - exiting 08:23:29 (3828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:25:08 (4184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:25:09 (4184): No heartbeat from core client for 30 sec - exiting 08:25:10 (4184): No heartbeat from core client for 30 sec - exiting 08:25:11 (4184): No heartbeat from core client for 30 sec - exiting 08:26:06 (2132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:33:22 (2952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:33:24 (2952): No heartbeat from core client for 30 sec - exiting 09:33:25 (2952): No heartbeat from core client for 30 sec - exiting 09:33:26 (2952): No heartbeat from core client for 30 sec - exiting 09:33:27 (2952): No heartbeat from core client for 30 sec - exiting 09:33:28 (2952): No heartbeat from core client for 30 sec - exiting 09:33:29 (2952): No heartbeat from core client for 30 sec - exiting 09:33:30 (2952): No heartbeat from core client for 30 sec - exiting 09:33:31 (2952): No heartbeat from core client for 30 sec - exiting 09:33:32 (2952): No heartbeat from core client for 30 sec - exiting 09:33:33 (2952): No heartbeat from core client for 30 sec - exiting 11:30:29 (6104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:30:30 (6104): No heartbeat from core client for 30 sec - exiting 11:30:31 (6104): No heartbeat from core client for 30 sec - exiting 11:30:32 (6104): No heartbeat from core client for 30 sec - exiting 11:30:33 (6104): No heartbeat from core client for 30 sec - exiting 11:30:34 (6104): No heartbeat from core client for 30 sec - exiting 11:30:35 (6104): No heartbeat from core client for 30 sec - exiting 11:30:36 (6104): No heartbeat from core client for 30 sec - exiting 11:30:37 (6104): No heartbeat from core client for 30 sec - exiting 11:30:38 (6104): No heartbeat from core client for 30 sec - exiting 11:30:39 (6104): No heartbeat from core client for 30 sec - exiting 11:30:40 (6104): No heartbeat from core client for 30 sec - exiting 11:32:12 (5208): No heartbeat from core client for 30 sec - exiting 11:32:13 (5208): No heartbeat from core client for 30 sec - exiting 11:32:14 (5208): No heartbeat from core client for 30 sec - exiting 11:32:15 (5208): No heartbeat from core client for 30 sec - exiting 11:32:16 (5208): No heartbeat from core client for 30 sec - exiting 11:32:17 (5208): No heartbeat from core client for 30 sec - exiting 11:32:18 (5208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:38:11 (6764): No heartbeat from core client for 30 sec - exiting 15:38:12 (6764): No heartbeat from core client for 30 sec - exiting 15:38:13 (6764): No heartbeat from core client for 30 sec - exiting 15:38:14 (6764): No heartbeat from core client for 30 sec - exiting 15:38:15 (6764): No heartbeat from core client for 30 sec - exiting 15:38:16 (6764): No heartbeat from core client for 30 sec - exiting 15:38:17 (6764): No heartbeat from core client for 30 sec - exiting 15:38:18 (6764): No heartbeat from core client for 30 sec - exiting 15:38:19 (6764): No heartbeat from core client for 30 sec - exiting 15:38:20 (6764): No heartbeat from core client for 30 sec - exiting 15:38:21 (6764): No heartbeat from core client for 30 sec - exiting 15:38:22 (6764): No heartbeat from core client for 30 sec - exiting 15:38:23 (6764): No heartbeat from core client for 30 sec - exiting 15:38:24 (6764): No heartbeat from core client for 30 sec - exiting 15:38:25 (6764): No heartbeat from core client for 30 sec - exiting 15:38:26 (6764): No heartbeat from core client for 30 sec - exiting 15:38:27 (6764): No heartbeat from core client for 30 sec - exiting 15:38:28 (6764): No heartbeat from core client for 30 sec - exiting 15:38:29 (6764): No heartbeat from core client for 30 sec - exiting 15:38:30 (6764): No heartbeat from core client for 30 sec - exiting 15:38:31 (6764): No heartbeat from core client for 30 sec - exiting 15:38:32 (6764): No heartbeat from core client for 30 sec - exiting 15:38:33 (6764): No heartbeat from core client for 30 sec - exiting 15:38:34 (6764): No heartbeat from core client for 30 sec - exiting 15:38:35 (6764): No heartbeat from core client for 30 sec - exiting 15:38:36 (6764): No heartbeat from core client for 30 sec - exiting 15:38:37 (6764): No heartbeat from core client for 30 sec - exiting 15:38:38 (6764): No heartbeat from core client for 30 sec - exiting 15:38:39 (6764): No heartbeat from core client for 30 sec - exiting 15:38:40 (6764): No heartbeat from core client for 30 sec - exiting 15:38:41 (6764): No heartbeat from core client for 30 sec - exiting 15:38:42 (6764): No heartbeat from core client for 30 sec - exiting 15:38:43 (6764): No heartbeat from core client for 30 sec - exiting 15:38:44 (6764): No heartbeat from core client for 30 sec - exiting 15:38:45 (6764): No heartbeat from core client for 30 sec - exiting 15:38:46 (6764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:38:47 (6764): No heartbeat from core client for 30 sec - exiting 15:38:48 (6764): No heartbeat from core client for 30 sec - exiting 15:38:49 (6764): No heartbeat from core client for 30 sec - exiting 15:38:50 (6764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7728, selfPID=7728, iMonCtr=2 07:16:30 (6316): No heartbeat from core client for 30 sec - exiting 07:16:31 (6316): No heartbeat from core client for 30 sec - exiting 07:16:32 (6316): No heartbeat from core client for 30 sec - exiting 07:16:33 (6316): No heartbeat from core client for 30 sec - exiting 07:16:34 (6316): No heartbeat from core client for 30 sec - exiting 07:16:35 (6316): No heartbeat from core client for 30 sec - exiting 07:16:36 (6316): No heartbeat from core client for 30 sec - exiting 07:16:37 (6316): No heartbeat from core client for 30 sec - exiting 07:16:38 (6316): No heartbeat from core client for 30 sec - exiting 07:16:39 (6316): No heartbeat from core client for 30 sec - exiting 07:16:40 (6316): No heartbeat from core client for 30 sec - exiting 07:16:41 (6316): No heartbeat from core client for 30 sec - exiting 07:16:42 (6316): No heartbeat from core client for 30 sec - exiting 07:16:43 (6316): No heartbeat from core client for 30 sec - exiting 07:16:44 (6316): No heartbeat from core client for 30 sec - exiting 07:16:45 (6316): No heartbeat from core client for 30 sec - exiting 07:16:46 (6316): No heartbeat from core client for 30 sec - exiting 07:16:47 (6316): No heartbeat from core client for 30 sec - exiting 07:16:48 (6316): No heartbeat from core client for 30 sec - exiting 07:16:49 (6316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:18:37 (4556): No heartbeat from core client for 30 sec - exiting 09:18:38 (4556): No heartbeat from core client for 30 sec - exiting 09:18:39 (4556): No heartbeat from core client for 30 sec - exiting 09:18:40 (4556): No heartbeat from core client for 30 sec - exiting 09:18:41 (4556): No heartbeat from core client for 30 sec - exiting 09:18:42 (4556): No heartbeat from core client for 30 sec - exiting 09:18:43 (4556): No heartbeat from core client for 30 sec - exiting 09:18:44 (4556): No heartbeat from core client for 30 sec - exiting 09:18:45 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:33:49 (7708): No heartbeat from core client for 30 sec - exiting 12:33:50 (7708): No heartbeat from core client for 30 sec - exiting 12:33:51 (7708): No heartbeat from core client for 30 sec - exiting 12:33:52 (7708): No heartbeat from core client for 30 sec - exiting 12:33:53 (7708): No heartbeat from core client for 30 sec - exiting 12:33:54 (7708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:41:09 (2456): No heartbeat from core client for 30 sec - exiting 16:41:10 (2456): No heartbeat from core client for 30 sec - exiting 16:41:11 (2456): No heartbeat from core client for 30 sec - exiting 16:41:12 (2456): No heartbeat from core client for 30 sec - exiting 16:41:13 (2456): No heartbeat from core client for 30 sec - exiting 16:41:14 (2456): No heartbeat from core client for 30 sec - exiting 16:41:15 (2456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:41:16 (2456): No heartbeat from core client for 30 sec - exiting 16:42:53 (6640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6440, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... 13:33:40 (1812): No heartbeat from core client for 30 sec - exiting 13:33:41 (1812): No heartbeat from core client for 30 sec - exiting 13:33:42 (1812): No heartbeat from core client for 30 sec - exiting 13:33:43 (1812): No heartbeat from core client for 30 sec - exiting 13:33:44 (1812): No heartbeat from core client for 30 sec - exiting 13:33:45 (1812): No heartbeat from core client for 30 sec - exiting 13:33:46 (1812): No heartbeat from core client for 30 sec - exiting 13:33:47 (1812): No heartbeat from core client for 30 sec - exiting 13:33:48 (1812): No heartbeat from core client for 30 sec - exiting 13:33:49 (1812): No heartbeat from core client for 30 sec - exiting 13:33:50 (1812): No heartbeat from core client for 30 sec - exiting 13:33:51 (1812): No heartbeat from core client for 30 sec - exiting 13:33:52 (1812): No heartbeat from core client for 30 sec - exiting 13:33:53 (1812): No heartbeat from core client for 30 sec - exiting 13:33:54 (1812): No heartbeat from core client for 30 sec - exiting 13:33:55 (1812): No heartbeat from core client for 30 sec - exiting 13:33:56 (1812): No heartbeat from core client for 30 sec - exiting 13:33:57 (1812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6484, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8128, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 07:58:17 (7964): No heartbeat from core client for 30 sec - exiting 07:58:18 (7964): No heartbeat from core client for 30 sec - exiting 07:58:19 (7964): No heartbeat from core client for 30 sec - exiting 07:58:20 (7964): No heartbeat from core client for 30 sec - exiting 07:58:21 (7964): No heartbeat from core client for 30 sec - exiting 07:58:22 (7964): No heartbeat from core client for 30 sec - exiting 07:58:23 (7964): No heartbeat from core client for 30 sec - exiting 07:58:24 (7964): No heartbeat from core client for 30 sec - exiting 07:58:25 (7964): No heartbeat from core client for 30 sec - exiting 07:58:26 (7964): No heartbeat from core client for 30 sec - exiting 07:58:27 (7964): No heartbeat from core client for 30 sec - exiting 07:58:28 (7964): No heartbeat from core client for 30 sec - exiting 07:58:29 (7964): No heartbeat from core client for 30 sec - exiting 07:58:30 (7964): No heartbeat from core client for 30 sec - exiting 07:58:31 (7964): No heartbeat from core client for 30 sec - exiting 07:58:32 (7964): No heartbeat from core client for 30 sec - exiting 07:58:33 (7964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9340, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10004, selfPID=7084, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2040, selfPID=7968, iMonCtr=1 Model crash detected, will try to restart... 15:04:21 (7096): No heartbeat from core client for 30 sec - exiting 15:04:22 (7096): No heartbeat from core client for 30 sec - exiting 15:04:23 (7096): No heartbeat from core client for 30 sec - exiting 15:04:24 (7096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14236, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 CPDN Monitor - Quit request from BOINC... RCPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5984, selfPCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7468, selfPID=7632, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 11 CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... 09:33:47 (6468): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 May 2011 06:19:20	1090105	12627005	hadam3p_pnw_35oj_1964_1_007187515_0	138,336	534,510	3.8639
07 May 2011 13:25:47	1090105	12627005	hadam3p_pnw_35oj_1964_1_007187515_0	126,820	480,919	3.7921
06 May 2011 10:31:29	1090105	12627005	hadam3p_pnw_35oj_1964_1_007187515_0	126,816	479,959	3.7847
07 Apr 2011 22:25:40	1090105	12627005	hadam3p_pnw_35oj_1964_1_007187515_0	115,296	432,303	3.7495
04 Apr 2011 04:54:57	1090105	12627005	hadam3p_pnw_35oj_1964_1_007187515_0	103,776	388,939	3.7479
26 Mar 2011 11:22:19	1090105	12627005	hadam3p_pnw_35oj_1964_1_007187515_0	92,256	346,725	3.7583
25 Mar 2011 05:07:58	1090105	12627005	hadam3p_pnw_35oj_1964_1_007187515_0	80,736	303,992	3.7653
24 Mar 2011 01:03:26	1090105	12627005	hadam3p_pnw_35oj_1964_1_007187515_0	69,216	260,104	3.7579
21 Mar 2011 09:37:17	1090105	12627005	hadam3p_pnw_35oj_1964_1_007187515_0	57,696	216,484	3.7521
19 Mar 2011 10:40:24	1090105	12627005	hadam3p_pnw_35oj_1964_1_007187515_0	46,176	172,635	3.7386
18 Mar 2011 15:20:03	1090105	12627005	hadam3p_pnw_35oj_1964_1_007187515_0	34,656	130,201	3.7570
15 Mar 2011 04:27:23	1090105	12627005	hadam3p_pnw_35oj_1964_1_007187515_0	23,136	87,812	3.7955
12 Mar 2011 15:00:00	1090105	12627005	hadam3p_pnw_35oj_1964_1_007187515_0	11,616	44,009	3.7887