Task 18301888

Name	hadam3p_anz_a7p3_2012_1_008616311_1
Workunit	8762823
Created	10 Apr 2015, 16:02:35 UTC
Sent	10 Apr 2015, 16:03:41 UTC
Report deadline	22 Mar 2016, 21:23:41 UTC
Received	29 Jul 2015, 18:50:50 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1355412
Run time	20 days 16 hours 54 min 23 sec
CPU time	18 days 2 hours 5 min 47 sec
Validate state	Workunit error - check skipped
Credit	5,974.74
Device peak FLOPS	2.39 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.36</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7820, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3596, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3740, selfPID=2140, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3768, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3152, selfPID=2104, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... G21:45:00 (3608): No heartbeat from core client for 30 sec - exiting 21:45:01 (3608): No heartbeat from core client for 30 sec - exiting 21:45:02 (3608): No heartbeat from core client for 30 sec - exiting 21:45:03 (3608): No heartbeat from core client for 30 sec - exiting 21:45:04 (3608): No heartbeat from core client for 30 sec - exiting 21:45:05 (3608): No heartbeat from core client for 30 sec - exiting 21:45:06 (3608): No heartbeat from core client for 30 sec - exiting 21:45:07 (3608): No heartbeat from core client for 30 sec - exiting 21:45:08 (3608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:45:09 (3608): No heartbeat from core client for 30 sec - exiting 20:47:05 (3924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4788, selfPID=4788, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3860, selfPID=2252, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4180, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5452, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2464, selfPID=2464, iMonCtr=2 06:25:19 (2248): No heartbeat from core client for 30 sec - exiting 06:25:20 (2248): No heartbeat from core client for 30 sec - exiting 06:25:21 (2248): No heartbeat from core client for 30 sec - exiting 06:25:22 (2248): No heartbeat from core client for 30 sec - exiting 06:25:24 (2248): No heartbeat from core client for 30 sec - exiting 06:25:25 (2248): No heartbeat from core client for 30 sec - exiting 06:25:26 (2248): No heartbeat from core client for 30 sec - exiting 06:25:27 (2248): No heartbeat from core client for 30 sec - exiting 06:25:28 (2248): No heartbeat from core client for 30 sec - exiting 06:25:29 (2248): No heartbeat from core client for 30 sec - exiting 06:25:30 (2248): No heartbeat from core client for 30 sec - exiting 06:25:31 (2248): No heartbeat from core client for 30 sec - exiting 06:25:32 (2248): No heartbeat from core client for 30 sec - exiting 06:25:33 (2248): No heartbeat from core client for 30 sec - exiting 06:25:35 (2248): No heartbeat from core client for 30 sec - exiting 06:25:36 (2248): No heartbeat from core client for 30 sec - exiting 06:25:37 (2248): No heartbeat from core client for 30 sec - exiting 06:25:38 (2248): No heartbeat from core client for 30 sec - exiting 06:25:39 (2248): No heartbeat from core client for 30 sec - exiting 06:25:40 (2248): No heartbeat from core client for 30 sec - exiting 06:25:41 (2248): No heartbeat from core client for 30 sec - exiting 06:25:42 (2248): No heartbeat from core client for 30 sec - exiting 06:25:43 (2248): No heartbeat from core client for 30 sec - exiting 06:25:45 (2248): No heartbeat from core client for 30 sec - exiting 06:25:46 (2248): No heartbeat from core client for 30 sec - exiting 06:25:47 (2248): No heartbeat from core client for 30 sec - exiting 06:25:48 (2248): No heartbeat from core client for 30 sec - exiting 06:25:49 (2248): No heartbeat from core client for 30 sec - exiting 06:25:50 (2248): No heartbeat from core client for 30 sec - exiting 06:25:51 (2248): No heartbeat from core client for 30 sec - exiting 06:25:52 (2248): No heartbeat from core client for 30 sec - exiting 06:25:53 (2248): No heartbeat from core client for 30 sec - exiting 06:25:54 (2248): No heartbeat from core client for 30 sec - exiting 06:25:55 (2248): No heartbeat from core client for 30 sec - exiting 06:25:57 (2248): No heartbeat from core client for 30 sec - exiting 06:25:58 (2248): No heartbeat from core client for 30 sec - exiting 06:25:59 (2248): No heartbeat from core client for 30 sec - exiting 06:26:00 (2248): No heartbeat from core client for 30 sec - exiting 06:26:01 (2248): No heartbeat from core client for 30 sec - exiting 06:26:02 (2248): No heartbeat from core client for 30 sec - exiting 06:26:03 (2248): No heartbeat from core client for 30 sec - exiting 06:26:04 (2248): No heartbeat from core client for 30 sec - exiting 06:26:05 (2248): No heartbeat from core client for 30 sec - exiting 06:26:06 (2248): No heartbeat from core client for 30 sec - exiting 06:26:07 (2248): No heartbeat from core client for 30 sec - exiting 06:26:09 (2248): No heartbeat from core client for 30 sec - exiting 06:26:10 (2248): No heartbeat from core client for 30 sec - exiting 06:26:11 (2248): No heartbeat from core client for 30 sec - exiting 06:26:12 (2248): No heartbeat from core client for 30 sec - exiting 06:26:13 (2248): No heartbeat from core client for 30 sec - exiting 06:26:14 (2248): No heartbeat from core client for 30 sec - exiting 06:26:15 (2248): No heartbeat from core client for 30 sec - exiting 06:26:16 (2248): No heartbeat from core client for 30 sec - exiting 06:26:17 (2248): No heartbeat from core client for 30 sec - exiting 06:26:18 (2248): No heartbeat from core client for 30 sec - exiting 06:26:20 (2248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1280, selfPID=2268, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:32:54 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:54:30 (2256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:00:43 (5796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:43:47 (6140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:53:13 (5948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:58 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:18:16 (5000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4956, selfPID=4956, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3816, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5804, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2540, selfPID=2436, iMonCtr=1 Model crash detected, will try to restart... 06:16:20 (2360): No heartbeat from core client for 30 sec - exiting 06:16:21 (2360): No heartbeat from core client for 30 sec - exiting 06:16:22 (2360): No heartbeat from core client for 30 sec - exiting 06:16:23 (2360): No heartbeat from core client for 30 sec - exiting 06:16:24 (2360): No heartbeat from core client for 30 sec - exiting 06:16:25 (2360): No heartbeat from core client for 30 sec - exiting 06:16:26 (2360): No heartbeat from core client for 30 sec - exiting 06:16:27 (2360): No heartbeat from core client for 30 sec - exiting 06:16:28 (2360): No heartbeat from core client for 30 sec - exiting 06:16:30 (2360): No heartbeat from core client for 30 sec - exiting 06:16:31 (2360): No heartbeat from core client for 30 sec - exiting 06:16:32 (2360): No heartbeat from core client for 30 sec - exiting 06:16:33 (2360): No heartbeat from core client for 30 sec - exiting 06:16:34 (2360): No heartbeat from core client for 30 sec - exiting 06:16:35 (2360): No heartbeat from core client for 30 sec - exiting 06:16:36 (2360): No heartbeat from core client for 30 sec - exiting 06:16:37 (2360): No heartbeat from core client for 30 sec - exiting 06:16:38 (2360): No heartbeat from core client for 30 sec - exiting 06:16:39 (2360): No heartbeat from core client for 30 sec - exiting 06:16:41 (2360): No heartbeat from core client for 30 sec - exiting 06:16:42 (2360): No heartbeat from core client for 30 sec - exiting 06:16:43 (2360): No heartbeat from core client for 30 sec - exiting 06:16:44 (2360): No heartbeat from core client for 30 sec - exiting 06:16:45 (2360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1884, selfPID=1884, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3820, iMonCtr=2 Model crash detected, will try to restart... 06:24:48 (2428): No heartbeat from core client for 30 sec - exiting 06:24:49 (2428): No heartbeat from core client for 30 sec - exiting 06:24:51 (2428): No heartbeat from core client for 30 sec - exiting 06:24:52 (2428): No heartbeat from core client for 30 sec - exiting 06:24:53 (2428): No heartbeat from core client for 30 sec - exiting 06:24:54 (2428): No heartbeat from core client for 30 sec - exiting 06:24:55 (2428): No heartbeat from core client for 30 sec - exiting 06:24:56 (2428): No heartbeat from core client for 30 sec - exiting 06:24:57 (2428): No heartbeat from core client for 30 sec - exiting 06:24:58 (2428): No heartbeat from core client for 30 sec - exiting 06:24:59 (2428): No heartbeat from core client for 30 sec - exiting 06:25:00 (2428): No heartbeat from core client for 30 sec - exiting 06:25:02 (2428): No heartbeat from core client for 30 sec - exiting 06:25:03 (2428): No heartbeat from core client for 30 sec - exiting 06:25:04 (2428): No heartbeat from core client for 30 sec - exiting 06:25:05 (2428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2080, iMonCtr=2 Model crash detected, will try to restart... 06:17:41 (2308): No heartbeat from core client for 30 sec - exiting 06:17:42 (2308): No heartbeat from core client for 30 sec - exiting 06:17:43 (2308): No heartbeat from core client for 30 sec - exiting 06:17:44 (2308): No heartbeat from core client for 30 sec - exiting 06:17:45 (2308): No heartbeat from core client for 30 sec - exiting 06:17:46 (2308): No heartbeat from core client for 30 sec - exiting 06:17:47 (2308): No heartbeat from core client for 30 sec - exiting 06:17:48 (2308): No heartbeat from core client for 30 sec - exiting 06:17:50 (2308): No heartbeat from core client for 30 sec - exiting 06:17:51 (2308): No heartbeat from core client for 30 sec - exiting 06:17:52 (2308): No heartbeat from core client for 30 sec - exiting 06:17:53 (2308): No heartbeat from core client for 30 sec - exiting 06:17:55 (2308): No heartbeat from core client for 30 sec - exiting 06:17:56 (2308): No heartbeat from core client for 30 sec - exiting 06:17:58 (2308): No heartbeat from core client for 30 sec - exiting 06:18:00 (2308): No heartbeat from core client for 30 sec - exiting 06:18:02 (2308): No heartbeat from core client for 30 sec - exiting 06:18:03 (2308): No heartbeat from core client for 30 sec - exiting 06:18:05 (2308): No heartbeat from core client for 30 sec - exiting 06:18:06 (2308): No heartbeat from core client for 30 sec - exiting 06:18:08 (2308): No heartbeat from core client for 30 sec - exiting 06:18:09 (2308): No heartbeat from core client for 30 sec - exiting 06:18:10 (2308): No heartbeat from core client for 30 sec - exiting 06:18:11 (2308): No heartbeat from core client for 30 sec - exiting 06:18:12 (2308): No heartbeat from core client for 30 sec - exiting 06:18:14 (2308): No heartbeat from core client for 30 sec - exiting 06:18:15 (2308): No heartbeat from core client for 30 sec - exiting 06:18:17 (2308): No heartbeat from core client for 30 sec - exiting 06:18:20 (2308): No heartbeat from core client for 30 sec - exiting 06:18:21 (2308): No heartbeat from core client for 30 sec - exiting 06:18:22 (2308): No heartbeat from core client for 30 sec - exiting 06:18:23 (2308): No heartbeat from core client for 30 sec - exiting 06:18:24 (2308): No heartbeat from core client for 30 sec - exiting 06:18:25 (2308): No heartbeat from core client for 30 sec - exiting 06:18:26 (2308): No heartbeat from core client for 30 sec - exiting 06:18:27 (2308): No heartbeat from core client for 30 sec - exiting 06:18:28 (2308): No heartbeat from core client for 30 sec - exiting 06:18:29 (2308): No heartbeat from core client for 30 sec - exiting 06:18:30 (2308): No heartbeat from core client for 30 sec - exiting 06:18:32 (2308): No heartbeat from core client for 30 sec - exiting 06:18:33 (2308): No heartbeat from core client for 30 sec - exiting 06:18:34 (2308): No heartbeat from core client for 30 sec - exiting 06:18:35 (2308): No heartbeat from core client for 30 sec - exiting 06:18:36 (2308): No heartbeat from core client for 30 sec - exiting 06:18:37 (2308): No heartbeat from core client for 30 sec - exiting 06:18:38 (2308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:18:39 (2308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3896, selfPID=1852, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5024, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5488, selfPID=5968, iMonCtr=1 Model crash detected, will try to restart... 06:19:10 (2028): No heartbeat from core client for 30 sec - exiting 06:19:11 (2028): No heartbeat from core client for 30 sec - exiting 06:19:12 (2028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4552, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5148, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7892, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8180, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2420, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3548, selfPID=2276, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6120, selfPID=4252, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:25:19 (304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2120, selfPID=2120, iMonCtr=2 CGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3840, iMonCtr=2 ontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3404, iMonCtr=2 Model crash detected, will try to restart... 06:20:25 (2168): No heartbeat from core client for 30 sec - exiting 06:20:27 (2168): No heartbeat from core client for 30 sec - exiting 06:20:28 (2168): No heartbeat from core client for 30 sec - exiting 06:20:29 (2168): No heartbeat from core client for 30 sec - exiting 06:20:30 (2168): No heartbeat from core client for 30 sec - exiting 06:20:31 (2168): No heartbeat from core client for 30 sec - exiting 06:20:32 (2168): No heartbeat from core client for 30 sec - exiting 06:20:33 (2168): No heartbeat from core client for 30 sec - exiting 06:20:34 (2168): No heartbeat from core client for 30 sec - exiting 06:20:35 (2168): No heartbeat from core client for 30 sec - exiting 06:20:36 (2168): No heartbeat from core client for 30 sec - exiting 06:20:38 (2168): No heartbeat from core client for 30 sec - exiting 06:20:39 (2168): No heartbeat from core client for 30 sec - exiting 06:20:40 (2168): No heartbeat from core client for 30 sec - exiting 06:20:41 (2168): No heartbeat from core client for 30 sec - exiting 06:20:42 (2168): No heartbeat from core client for 30 sec - exiting 06:20:43 (2168): No heartbeat from core client for 30 sec - exiting 06:20:44 (2168): No heartbeat from core client for 30 sec - exiting 06:20:45 (2168): No heartbeat from core client for 30 sec - exiting 06:20:46 (2168): No heartbeat from core client for 30 sec - exiting 06:20:48 (2168): No heartbeat from core client for 30 sec - exiting 06:20:49 (2168): No heartbeat from core client for 30 sec - exiting 06:20:50 (2168): No heartbeat from core client for 30 sec - exiting 06:20:51 (2168): No heartbeat from core client for 30 sec - exiting 06:20:52 (2168): No heartbeat from core client for 30 sec - exiting 06:20:53 (2168): No heartbeat from core client for 30 sec - exiting 06:20:54 (2168): No heartbeat from core client for 30 sec - exiting 06:20:55 (2168): No heartbeat from core client for 30 sec - exiting 06:20:56 (2168): No heartbeat from core client for 30 sec - exiting 06:20:57 (2168): No heartbeat from core client for 30 sec - exiting 06:20:59 (2168): No heartbeat from core client for 30 sec - exiting 06:21:00 (2168): No heartbeat from core client for 30 sec - exiting 06:21:01 (2168): No heartbeat from core client for 30 sec - exiting 06:21:02 (2168): No heartbeat from core client for 30 sec - exiting 06:21:03 (2168): No heartbeat from core client for 30 sec - exiting 06:21:04 (2168): No heartbeat from core client for 30 sec - exiting 06:21:05 (2168): No heartbeat from core client for 30 sec - exiting 06:21:06 (2168): No heartbeat from core client for 30 sec - exiting 06:21:07 (2168): No heartbeat from core client for 30 sec - exiting 06:21:08 (2168): No heartbeat from core client for 30 sec - exiting 06:21:09 (2168): No heartbeat from core client for 30 sec - exiting 06:21:11 (2168): No heartbeat from core client for 30 sec - exiting 06:21:12 (2168): No heartbeat from core client for 30 sec - exiting 06:21:13 (2168): No heartbeat from core client for 30 sec - exiting 06:21:14 (2168): No heartbeat from core client for 30 sec - exiting 06:21:15 (2168): No heartbeat from core client for 30 sec - exiting 06:21:16 (2168): No heartbeat from core client for 30 sec - exiting 06:21:17 (2168): No heartbeat from core client for 30 sec - exiting 06:21:19 (2168): No heartbeat from core client for 30 sec - exiting 06:21:20 (2168): No heartbeat from core client for 30 sec - exiting 06:21:21 (2168): No heartbeat from core client for 30 sec - exiting 06:21:22 (2168): No heartbeat from core client for 30 sec - exiting 06:21:23 (2168): No heartbeat from core client for 30 sec - exiting 06:21:24 (2168): No heartbeat from core client for 30 sec - exiting 06:21:25 (2168): No heartbeat from core client for 30 sec - exiting 06:21:26 (2168): No heartbeat from core client for 30 sec - exiting 06:21:27 (2168): No heartbeat from core client for 30 sec - exiting 06:21:28 (2168): No heartbeat from core client for 30 sec - exiting 06:21:29 (2168): No heartbeat from core client for 30 sec - exiting 06:21:31 (2168): No heartbeat from core client for 30 sec - exiting 06:21:32 (2168): No heartbeat from core client for 30 sec - exiting 06:21:33 (2168): No heartbeat from core client for 30 sec - exiting 06:21:34 (2168): No heartbeat from core client for 30 sec - exiting 06:21:35 (2168): No heartbeat from core client for 30 sec - exiting 06:21:36 (2168): No heartbeat from core client for 30 sec - exiting 06:21:37 (2168): No heartbeat from core client for 30 sec - exiting 06:21:38 (2168): No heartbeat from core client for 30 sec - exiting 06:21:39 (2168): No heartbeat from core client for 30 sec - exiting 06:21:40 (2168): No heartbeat from core client for 30 sec - exiting 06:21:41 (2168): No heartbeat from core client for 30 sec - exiting 06:21:43 (2168): No heartbeat from core client for 30 sec - exiting 06:21:44 (2168): No heartbeat from core client for 30 sec - exiting 06:21:45 (2168): No heartbeat from core client for 30 sec - exiting 06:21:46 (2168): No heartbeat from core client for 30 sec - exiting 06:21:47 (2168): No heartbeat from core client for 30 sec - exiting 06:21:48 (2168): No heartbeat from core client for 30 sec - exiting 06:21:49 (2168): No heartbeat from core client for 30 sec - exiting 06:21:50 (2168): No heartbeat from core client for 30 sec - exiting 06:21:51 (2168): No heartbeat from core client for 30 sec - exiting 06:21:52 (2168): No heartbeat from core client for 30 sec - exiting 06:21:53 (2168): No heartbeat from core client for 30 sec - exiting 06:21:55 (2168): No heartbeat from core client for 30 sec - exiting 06:21:56 (2168): No heartbeat from core client for 30 sec - exiting 06:21:57 (2168): No heartbeat from core client for 30 sec - exiting 06:21:58 (2168): No heartbeat from core client for 30 sec - exiting 06:21:59 (2168): No heartbeat from core client for 30 sec - exiting 06:22:00 (2168): No heartbeat from core client for 30 sec - exiting 06:22:01 (2168): No heartbeat from core client for 30 sec - exiting 06:22:02 (2168): No heartbeat from core client for 30 sec - exiting 06:22:03 (2168): No heartbeat from core client for 30 sec - exiting 06:22:04 (2168): No heartbeat from core client for 30 sec - exiting 06:22:05 (2168): No heartbeat from core client for 30 sec - exiting 06:22:06 (2168): No heartbeat from core client for 30 sec - exiting 06:22:07 (2168): No heartbeat from core client for 30 sec - exiting 06:22:08 (2168): No heartbeat from core client for 30 sec - exiting 06:22:09 (2168): No heartbeat from core client for 30 sec - exiting 06:22:10 (2168): No heartbeat from core client for 30 sec - exiting 06:22:12 (2168): No heartbeat from core client for 30 sec - exiting 06:22:13 (2168): No heartbeat from core client for 30 sec - exiting 06:22:14 (2168): No heartbeat from core client for 30 sec - exiting 06:22:15 (2168): No heartbeat from core client for 30 sec - exiting 06:22:16 (2168): No heartbeat from core client for 30 sec - exiting 06:22:17 (2168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3508, selfPID=3508, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=360, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2680, selfPID=3560, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4276, iMonCtr=2 10:21:29 (2296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5456, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4028, selfPID=1704, iMonCtr=1 Model crash detected, will try to restart... 08:01:50 (2132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2264, selfPID=2264, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1800, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4528, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=932, selfPID=5000, iMonCtr=1 Model crash detected, will try to restart... 08:44:30 (3332): No heartbeat from core client for 30 sec - exiting 08:44:31 (3332): No heartbeat from core client for 30 sec - exiting 08:44:32 (3332): No heartbeat from core client for 30 sec - exiting 08:44:33 (3332): No heartbeat from core client for 30 sec - exiting 08:44:34 (3332): No heartbeat from core client for 30 sec - exiting 08:44:36 (3332): No heartbeat from core client for 30 sec - exiting 08:44:37 (3332): No heartbeat from core client for 30 sec - exiting 08:44:38 (3332): No heartbeat from core client for 30 sec - exiting 08:44:39 (3332): No heartbeat from core client for 30 sec - exiting 08:44:40 (3332): No heartbeat from core client for 30 sec - exiting 08:44:41 (3332): No heartbeat from core client for 30 sec - exiting 08:44:42 (3332): No heartbeat from core client for 30 sec - exiting 08:44:43 (3332): No heartbeat from core client for 30 sec - exiting 08:44:44 (3332): No heartbeat from core client for 30 sec - exiting 08:44:46 (3332): No heartbeat from core client for 30 sec - exiting 08:44:47 (3332): No heartbeat from core client for 30 sec - exiting 08:44:48 (3332): No heartbeat from core client for 30 sec - exiting 08:44:49 (3332): No heartbeat from core client for 30 sec - exiting 08:44:50 (3332): No heartbeat from core client for 30 sec - exiting 08:44:51 (3332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3816, selfPID=3816, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:41:16 (2208): No heartbeat from core client for 30 sec - exiting 07:41:17 (2208): No heartbeat from core client for 30 sec - exiting 07:41:18 (2208): No heartbeat from core client for 30 sec - exiting 07:41:19 (2208): No heartbeat from core client for 30 sec - exiting 07:41:20 (2208): No heartbeat from core client for 30 sec - exiting 07:41:21 (2208): No heartbeat from core client for 30 sec - exiting 07:41:22 (2208): No heartbeat from core client for 30 sec - exiting 07:41:23 (2208): No heartbeat from core client for 30 sec - exiting 07:41:25 (2208): No heartbeat from core client for 30 sec - exiting 07:41:26 (2208): No heartbeat from core client for 30 sec - exiting 07:41:27 (2208): No heartbeat from core client for 30 sec - exiting 07:41:28 (2208): No heartbeat from core client for 30 sec - exiting 07:41:29 (2208): No heartbeat from core client for 30 sec - exiting 07:41:30 (2208): No heartbeat from core client for 30 sec - exiting 07:41:31 (2208): No heartbeat from core client for 30 sec - exiting 07:41:32 (2208): No heartbeat from core client for 30 sec - exiting 07:41:33 (2208): No heartbeat from core client for 30 sec - exiting 07:41:34 (2208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:31 (2176): No heartbeat from core client for 30 sec - exiting 09:19:33 (2176): No heartbeat from core client for 30 sec - exiting 09:19:34 (2176): No heartbeat from core client for 30 sec - exiting 09:19:35 (2176): No heartbeat from core client for 30 sec - exiting 09:19:36 (2176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1472, selfPID=2044, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4448, selfPID=4448, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1364, iMonCtr=2 Model crash detected, will try to restart... 12:58:02 (2224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:51:46 (2688): No heartbeat from core client for 30 sec - exiting 07:51:47 (2688): No heartbeat from core client for 30 sec - exiting 07:51:48 (2688): No heartbeat from core client for 30 sec - exiting 07:51:49 (2688): No heartbeat from core client for 30 sec - exiting 07:51:50 (2688): No heartbeat from core client for 30 sec - exiting 07:51:51 (2688): No heartbeat from core client for 30 sec - exiting 07:51:53 (2688): No heartbeat from core client for 30 sec - exiting 07:51:54 (2688): No heartbeat from core client for 30 sec - exiting 07:51:55 (2688): No heartbeat from core client for 30 sec - exiting 07:51:56 (2688): No heartbeat from core client for 30 sec - exiting 07:51:57 (2688): No heartbeat from core client for 30 sec - exiting 07:51:58 (2688): No heartbeat from core client for 30 sec - exiting 07:51:59 (2688): No heartbeat from core client for 30 sec - exiting 07:52:00 (2688): No heartbeat from core client for 30 sec - exiting 07:52:01 (2688): No heartbeat from core client for 30 sec - exiting 07:52:02 (2688): No heartbeat from core client for 30 sec - exiting 07:52:03 (2688): No heartbeat from core client for 30 sec - exiting 07:52:05 (2688): No heartbeat from core client for 30 sec - exiting 07:52:06 (2688): No heartbeat from core client for 30 sec - exiting 07:52:07 (2688): No heartbeat from core client for 30 sec - exiting 07:52:08 (2688): No heartbeat from core client for 30 sec - exiting 07:52:09 (2688): No heartbeat from core client for 30 sec - exiting 07:52:10 (2688): No heartbeat from core client for 30 sec - exiting 07:52:11 (2688): No heartbeat from core client for 30 sec - exiting 07:52:12 (2688): No heartbeat from core client for 30 sec - exiting 07:52:13 (2688): No heartbeat from core client for 30 sec - exiting 07:52:14 (2688): No heartbeat from core client for 30 sec - exiting 07:52:15 (2688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3532, selfPID=3532, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3180, iMonCtr=2 08:13:30 (2212): No heartbeat from core client for 30 sec - exiting 08:13:31 (2212): No heartbeat from core client for 30 sec - exiting 08:13:32 (2212): No heartbeat from core client for 30 sec - exiting 08:13:33 (2212): No heartbeat from core client for 30 sec - exiting 08:13:35 (2212): No heartbeat from core client for 30 sec - exiting 08:13:36 (2212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5288, selfPID=5288, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5056, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:40:35 (2228): No heartbeat from core client for 30 sec - exiting 11:40:36 (2228): No heartbeat from core client for 30 sec - exiting 11:40:37 (2228): No heartbeat from core client for 30 sec - exiting 11:40:38 (2228): No heartbeat from core client for 30 sec - exiting 11:40:39 (2228): No heartbeat from core client for 30 sec - exiting 11:40:40 (2228): No heartbeat from core client for 30 sec - exiting 11:40:41 (2228): No heartbeat from core client for 30 sec - exiting 11:40:42 (2228): No heartbeat from core client for 30 sec - exiting 11:40:43 (2228): No heartbeat from core client for 30 sec - exiting 11:40:45 (2228): No heartbeat from core client for 30 sec - exiting 11:40:46 (2228): No heartbeat from core client for 30 sec - exiting 11:40:47 (2228): No heartbeat from core client for 30 sec - exiting 11:40:48 (2228): No heartbeat from core client for 30 sec - exiting 11:40:49 (2228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3316, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2840, selfPID=5436, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Glo07:26:17 (2500): No heartbeat from core client for 30 sec - exiting 07:26:18 (2500): No heartbeat from core client for 30 sec - exiting 07:26:20 (2500): No heartbeat from core client for 30 sec - exiting 07:26:21 (2500): No heartbeat from core client for 30 sec - exiting 07:26:22 (2500): No heartbeat from core client for 30 sec - exiting 07:26:23 (2500): No heartbeat from core client for 30 sec - exiting 07:26:24 (2500): No heartbeat from core client for 30 sec - exiting 07:26:25 (2500): No heartbeat from core client for 30 sec - exiting 07:26:26 (2500): No heartbeat from core client for 30 sec - exiting 07:26:27 (2500): No heartbeat from core client for 30 sec - exiting 07:26:28 (2500): No heartbeat from core client for 30 sec - exiting 07:26:29 (2500): No heartbeat from core client for 30 sec - exiting 07:26:30 (2500): No heartbeat from core client for 30 sec - exiting 07:26:32 (2500): No heartbeat from core client for 30 sec - exiting 07:26:33 (2500): No heartbeat from core client for 30 sec - exiting 07:26:34 (2500): No heartbeat from core client for 30 sec - exiting 07:26:35 (2500): No heartbeat from core client for 30 sec - exiting 07:26:36 (2500): No heartbeat from core client for 30 sec - exiting 07:26:37 (2500): No heartbeat from core client for 30 sec - exiting 07:26:38 (2500): No heartbeat from core client for 30 sec - exiting 07:26:39 (2500): No heartbeat from core client for 30 sec - exiting 07:26:41 (2500): No heartbeat from core client for 30 sec - exiting 07:26:42 (2500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Jul 2015 18:53:50	1355412	18301888	hadam3p_anz_a7p3_2012_1_008616311_1	138,539	1,561,841	11.2737
21 Jul 2015 10:02:13	1355412	18301888	hadam3p_anz_a7p3_2012_1_008616311_1	127,019	1,439,545	11.3333
15 Jul 2015 14:39:01	1355412	18301888	hadam3p_anz_a7p3_2012_1_008616311_1	115,499	1,316,116	11.3950
08 Jul 2015 14:04:32	1355412	18301888	hadam3p_anz_a7p3_2012_1_008616311_1	103,979	1,196,284	11.5051
29 Jun 2015 14:56:17	1355412	18301888	hadam3p_anz_a7p3_2012_1_008616311_1	92,459	1,067,664	11.5474
19 Jun 2015 14:44:26	1355412	18301888	hadam3p_anz_a7p3_2012_1_008616311_1	80,939	934,312	11.5434
12 Jun 2015 08:48:14	1355412	18301888	hadam3p_anz_a7p3_2012_1_008616311_1	69,419	807,334	11.6299
03 Jun 2015 10:59:21	1355412	18301888	hadam3p_anz_a7p3_2012_1_008616311_1	57,899	686,351	11.8543
28 May 2015 10:28:28	1355412	18301888	hadam3p_anz_a7p3_2012_1_008616311_1	46,379	543,282	11.7140
22 May 2015 10:11:37	1355412	18301888	hadam3p_anz_a7p3_2012_1_008616311_1	34,859	414,230	11.8830
18 May 2015 11:53:14	1355412	18301888	hadam3p_anz_a7p3_2012_1_008616311_1	23,339	270,689	11.5981
16 Apr 2015 19:33:22	1355412	18301888	hadam3p_anz_a7p3_2012_1_008616311_1	11,819	139,376	11.7925