Task 13730484

Name	hadam3p_saf_284p_2000_1_007606565_0
Workunit	7784695
Created	5 Dec 2011, 17:01:10 UTC
Sent	5 Dec 2011, 17:06:35 UTC
Report deadline	16 Nov 2012, 22:26:35 UTC
Received	21 Mar 2012, 10:24:42 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1115222
Run time	4 days 6 hours 56 min 31 sec
CPU time	4 days 0 hours 3 min 42 sec
Validate state	Workunit error - check skipped
Credit	2,242.53
Device peak FLOPS	2.61 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6344, selfPID=6344, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:29:56 (1896): No heartbeat from core client for 30 sec - exiting 01:29:57 (1896): No heartbeat from core client for 30 sec - exiting 01:29:58 (1896): No heartbeat from core client for 30 sec - exiting 01:29:59 (1896): No heartbeat from core client for 30 sec - exiting 01:30:00 (1896): No heartbeat from core client for 30 sec - exiting 01:30:01 (1896): No heartbeat from core client for 30 sec - exiting 01:30:02 (1896): No heartbeat from core client for 30 sec - exiting 01:30:03 (1896): No heartbeat from core client for 30 sec - exiting 01:30:04 (1896): No heartbeat from core client for 30 sec - exiting 01:30:05 (1896): No heartbeat from core client for 30 sec - exiting 01:30:06 (1896): No heartbeat from core client for 30 sec - exiting 01:30:07 (1896): No heartbeat from core client for 30 sec - exiting 01:30:08 (1896): No heartbeat from core client for 30 sec - exiting 01:30:09 (1896): No heartbeat from core client for 30 sec - exiting 01:30:10 (1896): No heartbeat from core client for 30 sec - exiting 01:30:11 (1896): No heartbeat from core client for 30 sec - exiting 01:30:12 (1896): No heartbeat from core client for 30 sec - exiting 01:30:13 (1896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:35:45 (6200): No heartbeat from core client for 30 sec - exiting 16:35:46 (6200): No heartbeat from core client for 30 sec - exiting 16:35:47 (6200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3308, selfPID=3308, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:57:48 (2492): No heartbeat from core client for 30 sec - exiting 10:57:50 (2492): No heartbeat from core client for 30 sec - exiting 10:57:51 (2492): No heartbeat from core client for 30 sec - exiting 10:57:52 (2492): No heartbeat from core client for 30 sec - exiting 10:57:53 (2492): No heartbeat from core client for 30 sec - exiting 10:57:54 (2492): No heartbeat from core client for 30 sec - exiting 10:57:55 (2492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:41:39 (6912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:14:42 (1152): No heartbeat from core client for 30 sec - exiting 16:14:43 (1152): No heartbeat from core client for 30 sec - exiting 16:14:44 (1152): No heartbeat from core client for 30 sec - exiting 16:14:45 (1152): No heartbeat from core client for 30 sec - exiting 16:14:46 (1152): No heartbeat from core client for 30 sec - exiting 16:14:47 (1152): No heartbeat from core client for 30 sec - exiting 16:14:48 (1152): No heartbeat from core client for 30 sec - exiting 16:14:50 (1152): No heartbeat from core client for 30 sec - exiting 16:14:51 (1152): No heartbeat from core client for 30 sec - exiting 16:14:52 (1152): No heartbeat from core client for 30 sec - exiting 16:14:53 (1152): No heartbeat from core client for 30 sec - exiting 16:14:54 (1152): No heartbeat from core client for 30 sec - exiting 16:14:55 (1152): No heartbeat from core client for 30 sec - exiting 16:14:56 (1152): No heartbeat from core client for 30 sec - exiting 16:14:57 (1152): No heartbeat from core client for 30 sec - exiting 16:14:58 (1152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6720, selfPID=6720, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:52:49 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... G09:53:39 (3296): No heartbeat from core client for 30 sec - exiting 09:53:40 (3296): No heartbeat from core client for 30 sec - exiting 09:53:41 (3296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:42:19 (5824): No heartbeat from core client for 30 sec - exiting 16:42:21 (5824): No heartbeat from core client for 30 sec - exiting 16:42:22 (5824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:11:25 (5124): No heartbeat from core client for 30 sec - exiting 13:11:26 (5124): No heartbeat from core client for 30 sec - exiting 13:11:27 (5124): No heartbeat from core client for 30 sec - exiting 13:11:28 (5124): No heartbeat from core client for 30 sec - exiting 13:11:29 (5124): No heartbeat from core client for 30 sec - exiting 13:11:30 (5124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4384, selfPID=5884, iMonCtr=1 Model crash detected, will try to restart... 16:32:00 (2072): No heartbeat from core client for 30 sec - exiting 16:32:01 (2072): No heartbeat from core client for 30 sec - exiting 16:32:35 (2072): No heartbeat from core client for 30 sec - exiting 16:32:36 (2072): No heartbeat from core client for 30 sec - exiting 16:32:37 (2072): No heartbeat from core client for 30 sec - exiting 16:32:38 (2072): No heartbeat from core client for 30 sec - exiting 16:32:39 (2072): No heartbeat from core client for 30 sec - exiting 16:32:41 (2072): No heartbeat from core client for 30 sec - exiting 16:32:42 (2072): No heartbeat from core client for 30 sec - exiting 16:32:43 (2072): No heartbeat from core client for 30 sec - exiting 16:32:44 (2072): No heartbeat from core client for 30 sec - exiting 16:32:45 (2072): No heartbeat from core client for 30 sec - exiting 16:32:46 (2072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:51:38 (4804): No heartbeat from core client for 30 sec - exiting 11:51:39 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1564, selfPID=6536, iMonCtr=1 Model crash detected, will try to restart... 14:54:42 (3728): No heartbeat from core client for 30 sec - exiting 14:54:43 (3728): No heartbeat from core client for 30 sec - exiting 14:54:44 (3728): No heartbeat from core client for 30 sec - exiting 14:54:45 (3728): No heartbeat from core client for 30 sec - exiting 14:54:46 (3728): No heartbeat from core client for 30 sec - exiting 14:54:47 (3728): No heartbeat from core client for 30 sec - exiting 14:54:48 (3728): No heartbeat from core client for 30 sec - exiting 14:54:49 (3728): No heartbeat from core client for 30 sec - exiting 14:54:50 (3728): No heartbeat from core client for 30 sec - exiting 14:54:51 (3728): No heartbeat from core client for 30 sec - exiting 14:54:53 (3728): No heartbeat from core client for 30 sec - exiting 14:54:54 (3728): No heartbeat from core client for 30 sec - exiting 14:54:55 (3728): No heartbeat from core client for 30 sec - exiting 14:54:56 (3728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:50:16 (6044): No heartbeat from core client for 30 sec - exiting 16:50:18 (6044): No heartbeat from core client for 30 sec - exiting 16:50:19 (6044): No heartbeat from core client for 30 sec - exiting 16:50:20 (6044): No heartbeat from core client for 30 sec - exiting 16:50:21 (6044): No heartbeat from core client for 30 sec - exiting 16:50:22 (6044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:19:13 (6456): No heartbeat from core client for 30 sec - exiting 11:19:14 (6456): No heartbeat from core client for 30 sec - exiting 11:19:15 (6456): No heartbeat from core client for 30 sec - exiting 11:19:16 (6456): No heartbeat from core client for 30 sec - exiting 11:19:17 (6456): No heartbeat from core client for 30 sec - exiting 11:19:18 (6456): No heartbeat from core client for 30 sec - exiting 11:19:20 (6456): No heartbeat from core client for 30 sec - exiting 11:19:21 (6456): No heartbeat from core client for 30 sec - exiting 11:19:22 (6456): No heartbeat from core client for 30 sec - exiting 11:19:23 (6456): No heartbeat from core client for 30 sec - exiting 11:19:24 (6456): No heartbeat from core client for 30 sec - exiting 11:19:25 (6456): No heartbeat from core client for 30 sec - exiting 11:19:26 (6456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:47:36 (1760): No heartbeat from core client for 30 sec - exiting 16:47:37 (1760): No heartbeat from core client for 30 sec - exiting 16:47:38 (1760): No heartbeat from core client for 30 sec - exiting 16:47:39 (1760): No heartbeat from core client for 30 sec - exiting 16:47:40 (1760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:19:20 (6460): No heartbeat from core client for 30 sec - exiting 18:19:21 (6460): No heartbeat from core client for 30 sec - exiting 18:19:55 (6460): No heartbeat from core client for 30 sec - exiting 18:19:56 (6460): No heartbeat from core client for 30 sec - exiting 18:19:57 (6460): No heartbeat from core client for 30 sec - exiting 18:19:58 (6460): No heartbeat from core client for 30 sec - exiting 18:19:59 (6460): No heartbeat from core client for 30 sec - exiting 18:20:00 (6460): No heartbeat from core client for 30 sec - exiting 18:20:01 (6460): No heartbeat from core client for 30 sec - exiting 18:20:02 (6460): No heartbeat from core client for 30 sec - exiting 18:20:03 (6460): No heartbeat from core client for 30 sec - exiting 18:20:04 (6460): No heartbeat from core client for 30 sec - exiting 18:20:06 (6460): No heartbeat from core client for 30 sec - exiting 18:20:07 (6460): No heartbeat from core client for 30 sec - exiting 18:20:08 (6460): No heartbeat from core client for 30 sec - exiting 18:20:09 (6460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:15:56 (5772): No heartbeat from core client for 30 sec - exiting 10:15:57 (5772): No heartbeat from core client for 30 sec - exiting 10:15:58 (5772): No heartbeat from core client for 30 sec - exiting 10:15:59 (5772): No heartbeat from core client for 30 sec - exiting 10:16:00 (5772): No heartbeat from core client for 30 sec - exiting 10:16:02 (5772): No heartbeat from core client for 30 sec - exiting 10:16:03 (5772): No heartbeat from core client for 30 sec - exiting 10:16:04 (5772): No heartbeat from core client for 30 sec - exiting 10:16:05 (5772): No heartbeat from core client for 30 sec - exiting 10:16:06 (5772): No heartbeat from core client for 30 sec - exiting 10:16:07 (5772): No heartbeat from core client for 30 sec - exiting 10:16:08 (5772): No heartbeat from core client for 30 sec - exiting 10:16:09 (5772): No heartbeat from core client for 30 sec - exiting 10:16:10 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:57:42 (6380): No heartbeat from core client for 30 sec - exiting 19:57:43 (6380): No heartbeat from core client for 30 sec - exiting 19:57:45 (6380): No heartbeat from core client for 30 sec - exiting 19:57:46 (6380): No heartbeat from core client for 30 sec - exiting 19:57:47 (6380): No heartbeat from core client for 30 sec - exiting 19:57:48 (6380): No heartbeat from core client for 30 sec - exiting 19:57:49 (6380): No heartbeat from core client for 30 sec - exiting 19:57:50 (6380): No heartbeat from core client for 30 sec - exiting 19:57:51 (6380): No heartbeat from core client for 30 sec - exiting 19:57:52 (6380): No heartbeat from core client for 30 sec - exiting 19:57:53 (6380): No heartbeat from core client for 30 sec - exiting 19:57:54 (6380): No heartbeat from core client for 30 sec - exiting 19:57:55 (6380): No heartbeat from core client for 30 sec - exiting 19:57:56 (6380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4632, selfPID=4632, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3696, selfPID=2836, iMonCtr=1 Model crash detected, will try to restart... 23:58:31 (2136): No heartbeat from core client for 30 sec - exiting 23:58:32 (2136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:47:11 (948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:47:47 (5928): No heartbeat from core client for 30 sec - exiting 01:47:49 (5928): No heartbeat from core client for 30 sec - exiting 01:47:50 (5928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:06:08 (4192): No heartbeat from core client for 30 sec - exiting 03:06:10 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1980, iMonCtr=2 Model crash detected, will try to restart... 16:29:47 (6164): No heartbeat from core client for 30 sec - exiting 16:29:48 (6164): No heartbeat from core client for 30 sec - exiting 16:29:49 (6164): No heartbeat from core client for 30 sec - exiting 16:29:50 (6164): No heartbeat from core client for 30 sec - exiting 16:29:51 (6164): No heartbeat from core client for 30 sec - exiting 16:29:52 (6164): No heartbeat from core client for 30 sec - exiting 16:29:53 (6164): No heartbeat from core client for 30 sec - exiting 16:29:54 (6164): No heartbeat from core client for 30 sec - exiting 16:29:55 (6164): No heartbeat from core client for 30 sec - exiting 16:29:56 (6164): No heartbeat from core client for 30 sec - exiting 16:29:58 (6164): No heartbeat from core client for 30 sec - exiting 16:29:59 (6164): No heartbeat from core client for 30 sec - exiting 16:30:00 (6164): No heartbeat from core client for 30 sec - exiting 16:30:01 (6164): No heartbeat from core client for 30 sec - exiting 16:30:02 (6164): No heartbeat from core client for 30 sec - exiting 16:30:03 (6164): No heartbeat from core client for 30 sec - exiting 16:30:04 (6164): No heartbeat from core client for 30 sec - exiting 16:30:39 (6164): No heartbeat from core client for 30 sec - exiting 16:30:40 (6164): No heartbeat from core client for 30 sec - exiting 16:30:41 (6164): No heartbeat from core client for 30 sec - exiting 16:30:42 (6164): No heartbeat from core client for 30 sec - exiting 16:30:43 (6164): No heartbeat from core client for 30 sec - exiting 16:30:45 (6164): No heartbeat from core client for 30 sec - exiting 16:30:46 (6164): No heartbeat from core client for 30 sec - exiting 16:30:47 (6164): No heartbeat from core client for 30 sec - exiting 16:30:48 (6164): No heartbeat from core client for 30 sec - exiting 16:30:49 (6164): No heartbeat from core client for 30 sec - exiting 16:30:50 (6164): No heartbeat from core client for 30 sec - exiting 16:30:51 (6164): No heartbeat from core client for 30 sec - exiting 16:30:52 (6164): No heartbeat from core client for 30 sec - exiting 16:30:53 (6164): No heartbeat from core client for 30 sec - exiting 16:30:54 (6164): No heartbeat from core client for 30 sec - exiting 16:30:55 (6164): No heartbeat from core client for 30 sec - exiting 16:30:57 (6164): No heartbeat from core client for 30 sec - exiting 16:30:58 (6164): No heartbeat from core client for 30 sec - exiting 16:30:59 (6164): No heartbeat from core client for 30 sec - exiting 16:31:00 (6164): No heartbeat from core client for 30 sec - exiting 16:31:01 (6164): No heartbeat from core client for 30 sec - exiting 16:31:02 (6164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:25:50 (2264): No heartbeat from core client for 30 sec - exiting 23:25:51 (2264): No heartbeat from core client for 30 sec - exiting 23:25:52 (2264): No heartbeat from core client for 30 sec - exiting 23:25:53 (2264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:02:03 (5824): No heartbeat from core client for 30 sec - exiting 08:02:05 (5824): No heartbeat from core client for 30 sec - exiting 08:02:06 (5824): No heartbeat from core client for 30 sec - exiting 08:02:07 (5824): No heartbeat from core client for 30 sec - exiting 08:02:08 (5824): No heartbeat from core client for 30 sec - exiting 08:02:09 (5824): No heartbeat from core client for 30 sec - exiting 08:02:10 (5824): No heartbeat from core client for 30 sec - exiting 08:02:11 (5824): No heartbeat from core client for 30 sec - exiting 08:02:12 (5824): No heartbeat from core client for 30 sec - exiting 08:02:13 (5824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:12:46 (6900): No heartbeat from core client for 30 sec - exiting 14:12:47 (6900): No heartbeat from core client for 30 sec - exiting 14:12:48 (6900): No heartbeat from core client for 30 sec - exiting 14:12:49 (6900): No heartbeat from core client for 30 sec - exiting 14:12:50 (6900): No heartbeat from core client for 30 sec - exiting 14:12:51 (6900): No heartbeat from core client for 30 sec - exiting 14:12:53 (6900): No heartbeat from core client for 30 sec - exiting 14:12:54 (6900): No heartbeat from core client for 30 sec - exiting 14:12:55 (6900): No heartbeat from core client for 30 sec - exiting 14:12:56 (6900): No heartbeat from core client for 30 sec - exiting 14:12:57 (6900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1044, selfPID=1044, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:27:25 (5236): No heartbeat from core client for 30 sec - exiting 00:27:26 (5236): No heartbeat from core client for 30 sec - exiting 00:27:27 (5236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6680, selfPID=2584, iMonCtr=1 Model crash detected, will try to restart... 19:34:18 (5520): No heartbeat from core client for 30 sec - exiting 19:34:19 (5520): No heartbeat from core client for 30 sec - exiting 19:34:20 (5520): No heartbeat from core client for 30 sec - exiting 19:34:21 (5520): No heartbeat from core client for 30 sec - exiting 19:34:22 (5520): No heartbeat from core client for 30 sec - exiting 19:34:24 (5520): No heartbeat from core client for 30 sec - exiting 19:34:25 (5520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:44:15 (5536): No heartbeat from core client for 30 sec - exiting 16:44:16 (5536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Mar 2012 16:47:38	1115222	13730484	hadam3p_saf_284p_2000_1_007606565_0	138,240	344,872	2.4947
18 Mar 2012 19:14:51	1115222	13730484	hadam3p_saf_284p_2000_1_007606565_0	126,720	315,281	2.4880
16 Mar 2012 18:05:48	1115222	13730484	hadam3p_saf_284p_2000_1_007606565_0	115,200	286,475	2.4868
15 Mar 2012 16:35:51	1115222	13730484	hadam3p_saf_284p_2000_1_007606565_0	103,680	257,635	2.4849
14 Mar 2012 11:32:32	1115222	13730484	hadam3p_saf_284p_2000_1_007606565_0	92,160	229,110	2.4860
12 Mar 2012 10:39:19	1115222	13730484	hadam3p_saf_284p_2000_1_007606565_0	80,640	200,659	2.4883
10 Mar 2012 13:01:45	1115222	13730484	hadam3p_saf_284p_2000_1_007606565_0	69,120	172,604	2.4972
08 Mar 2012 20:11:36	1115222	13730484	hadam3p_saf_284p_2000_1_007606565_0	57,600	144,234	2.5041
07 Mar 2012 12:49:02	1115222	13730484	hadam3p_saf_284p_2000_1_007606565_0	46,080	115,660	2.5100
05 Mar 2012 18:23:54	1115222	13730484	hadam3p_saf_284p_2000_1_007606565_0	34,560	86,487	2.5025
05 Mar 2012 01:50:16	1115222	13730484	hadam3p_saf_284p_2000_1_007606565_0	23,136	58,708	2.5375
02 Mar 2012 16:35:36	1115222	13730484	hadam3p_saf_284p_2000_1_007606565_0	11,616	29,885	2.5727