Task 14396779

Name	hadam3p_eu_90e0_1970_1_007869068_0
Workunit	8024180
Created	12 Apr 2012, 20:49:58 UTC
Sent	12 Apr 2012, 20:50:02 UTC
Report deadline	26 Mar 2013, 2:10:02 UTC
Received	3 Sep 2012, 21:56:01 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1129407
Run time	18 days 1 hours 47 min 58 sec
CPU time	11 days 3 hours 30 min 16 sec
Validate state	Workunit error - check skipped
Credit	2,386.39
Device peak FLOPS	2.01 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3572, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2468, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4808, selfPID=2884, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3472, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=904, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2896, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=824, selfPID=1796, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1664, selfPID=4044, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3332, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3732, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3588, selfPID=3972, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3612, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2276, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1596, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2388, selfPID=3192, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2972, selfPID=3600, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3628, selfPID=3956, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3904, selfPID=3060, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3128, selfPID=2076, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2860, selfPID=3908, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1252, selfPID=1172, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3400, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=928, selfPID=2440, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1020, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2784, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2684, selfPID=3904, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5680, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5752, selfPID=3484, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1760, selfPID=2124, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3700, iMonCtr=2 00:13:59 (3404): No heartbeat from core client for 30 sec - exiting 00:14:00 (3404): No heartbeat from core client for 30 sec - exiting 00:14:01 (3404): No heartbeat from core client for 30 sec - exiting 00:14:02 (3404): No heartbeat from core client for 30 sec - exiting 00:14:03 (3404): No heartbeat from core client for 30 sec - exiting 00:14:04 (3404): No heartbeat from core client for 30 sec - exiting 00:14:05 (3404): No heartbeat from core client for 30 sec - exiting 00:14:06 (3404): No heartbeat from core client for 30 sec - exiting 00:14:07 (3404): No heartbeat from core client for 30 sec - exiting 00:14:08 (3404): No heartbeat from core client for 30 sec - exiting 00:14:09 (3404): No heartbeat from core client for 30 sec - exiting 00:14:10 (3404): No heartbeat from core client for 30 sec - exiting 00:14:11 (3404): No heartbeat from core client for 30 sec - exiting 00:14:12 (3404): No heartbeat from core client for 30 sec - exiting 00:14:13 (3404): No heartbeat from core client for 30 sec - exiting 00:14:14 (3404): No heartbeat from core client for 30 sec - exiting 00:14:15 (3404): No heartbeat from core client for 30 sec - exiting 00:14:16 (3404): No heartbeat from core client for 30 sec - exiting 00:14:17 (3404): No heartbeat from core client for 30 sec - exiting 00:14:18 (3404): No heartbeat from core client for 30 sec - exiting 00:14:19 (3404): No heartbeat from core client for 30 sec - exiting 00:14:20 (3404): No heartbeat from core client for 30 sec - exiting 00:14:21 (3404): No heartbeat from core client for 30 sec - exiting 00:14:22 (3404): No heartbeat from core client for 30 sec - exiting 00:14:23 (3404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4272, selfPID=4368, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3824, selfPID=3432, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3900, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3312, selfPID=2692, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4072, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1748, iMonCtr=2 Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1272, selfPID=3972, iMonCtr=1 Model crash detected, will try to restart... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3312, selfPID=3496, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4260, selfPID=2508, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1372, selfPID=1256, iMonCtr=1 Model crash detected, will try to restart... 19:57:46 (3732): No heartbeat from core client for 30 sec - exiting 19:57:47 (3732): No heartbeat from core client for 30 sec - exiting 19:57:48 (3732): No heartbeat from core client for 30 sec - exiting 19:57:49 (3732): No heartbeat from core client for 30 sec - exiting 19:57:50 (3732): No heartbeat from core client for 30 sec - exiting 19:57:51 (3732): No heartbeat from core client for 30 sec - exiting 19:57:52 (3732): No heartbeat from core client for 30 sec - exiting 19:57:53 (3732): No heartbeat from core client for 30 sec - exiting 19:57:54 (3732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3864, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=472, selfPID=2332, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1128, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3028, selfPID=3668, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3460, selfPID=2348, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3224, iMonCtr=2 Model crash detected, will try to restart... 19:44:32 (2792): No heartbeat from core client for 30 sec - exiting 19:44:33 (2792): No heartbeat from core client for 30 sec - exiting 19:44:34 (2792): No heartbeat from core client for 30 sec - exiting 19:44:35 (2792): No heartbeat from core client for 30 sec - exiting 19:44:36 (2792): No heartbeat from core client for 30 sec - exiting 19:44:37 (2792): No heartbeat from core client for 30 sec - exiting 19:44:38 (2792): No heartbeat from core client for 30 sec - exiting 19:44:39 (2792): No heartbeat from core client for 30 sec - exiting 19:44:40 (2792): No heartbeat from core client for 30 sec - exiting 19:44:41 (2792): No heartbeat from core client for 30 sec - exiting 19:44:42 (2792): No heartbeat from core client for 30 sec - exiting 19:44:43 (2792): No heartbeat from core client for 30 sec - exiting 19:44:44 (2792): No heartbeat from core client for 30 sec - exiting 19:44:45 (2792): No heartbeat from core client for 30 sec - exiting 19:44:46 (2792): No heartbeat from core client for 30 sec - exiting 19:44:47 (2792): No heartbeat from core client for 30 sec - exiting 19:44:48 (2792): No heartbeat from core client for 30 sec - exiting 19:44:49 (2792): No heartbeat from core client for 30 sec - exiting 19:44:50 (2792): No heartbeat from core client for 30 sec - exiting 19:44:51 (2792): No heartbeat from core client for 30 sec - exiting 19:44:52 (2792): No heartbeat from core client for 30 sec - exiting 19:44:53 (2792): No heartbeat from core client for 30 sec - exiting 19:44:54 (2792): No heartbeat from core client for 30 sec - exiting 19:44:55 (2792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2648, selfPID=3320, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2968, selfPID=2680, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3780, selfPID=2300, iMonCtr=1 Model crash detected, will try to restart... 20:24:29 (2784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1668, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1376, selfPID=3492, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3608, selfPID=3656, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3112, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4028, selfPID=3296, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3584, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2488, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1356, selfPID=3680, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2668, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3772, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1144, selfPID=3920, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3764, selfPID=3620, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2264, selfPID=3652, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3960, selfPID=3864, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3568, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4880, selfPID=2540, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4692, selfPID=4016, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4712, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4812, selfPID=3800, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1700, selfPID=3784, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3480, selfPID=3608, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1936, selfPID=2604, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3972, selfPID=3292, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3516, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=912, selfPID=3336, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4888, selfPID=2748, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2968, selfPID=2948, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3704, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2560, selfPID=3312, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3064, selfPID=3488, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2836, selfPID=1344, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4744, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4620, selfPID=3840, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4688, selfPID=3392, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4304, selfPID=208, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1608, selfPID=3388, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1028, selfPID=3576, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3096, selfPID=3364, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3900, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1080, selfPID=3964, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4452, selfPID=3884, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3284, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3544, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2928, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 13:29:41 (3384): No heartbeat from core client for 30 sec - exiting 13:29:42 (3384): No heartbeat from core client for 30 sec - exiting 13:29:43 (3384): No heartbeat from core client for 30 sec - exiting 13:29:44 (3384): No heartbeat from core client for 30 sec - exiting 13:29:45 (3384): No heartbeat from core client for 30 sec - exiting 13:29:46 (3384): No heartbeat from core client for 30 sec - exiting 13:29:47 (3384): No heartbeat from core client for 30 sec - exiting 13:29:48 (3384): No heartbeat from core client for 30 sec - exiting 13:29:49 (3384): No heartbeat from core client for 30 sec - exiting 13:29:50 (3384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2032, selfPID=792, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5784, selfPID=3864, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2860, selfPID=2768, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 21:05:10 (3460): No heartbeat from core client for 30 sec - exiting 21:05:11 (3460): No heartbeat from core client for 30 sec - exiting 21:05:12 (3460): No heartbeat from core client for 30 sec - exiting 21:05:13 (3460): No heartbeat from core client for 30 sec - exiting 21:05:14 (3460): No heartbeat from core client for 30 sec - exiting 21:05:15 (3460): No heartbeat from core client for 30 sec - exiting 21:05:16 (3460): No heartbeat from core client for 30 sec - exiting 21:05:17 (3460): No heartbeat from core client for 30 sec - exiting 21:05:18 (3460): No heartbeat from core client for 30 sec - exiting 21:05:19 (3460): No heartbeat from core client for 30 sec - exiting 21:05:20 (3460): No heartbeat from core client for 30 sec - exiting 21:05:21 (3460): No heartbeat from core client for 30 sec - exiting 21:05:22 (3460): No heartbeat from core client for 30 sec - exiting 21:05:23 (3460): No heartbeat from core client for 30 sec - exiting 21:05:24 (3460): No heartbeat from core client for 30 sec - exiting 21:05:25 (3460): No heartbeat from core client for 30 sec - exiting 21:05:26 (3460): No heartbeat from core client for 30 sec - exiting 21:05:27 (3460): No heartbeat from core client for 30 sec - exiting 21:05:28 (3460): No heartbeat from core client for 30 sec - exiting 21:05:29 (3460): No heartbeat from core client for 30 sec - exiting 21:05:30 (3460): No heartbeat from core client for 30 sec - exiting 21:05:31 (3460): No heartbeat from core client for 30 sec - exiting 21:05:32 (3460): No heartbeat from core client for 30 sec - exiting 21:05:33 (3460): No heartbeat from core client for 30 sec - exiting 21:05:34 (3460): No heartbeat from core client for 30 sec - exiting 21:05:35 (3460): No heartbeat from core client for 30 sec - exiting 21:05:36 (3460): No heartbeat from core client for 30 sec - exiting 21:05:37 (3460): No heartbeat from core client for 30 sec - exiting 21:05:38 (3460): No heartbeat from core client for 30 sec - exiting 21:05:39 (3460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5332, selfPID=3828, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5088, selfPID=3472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3752, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3600, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4052, iMonCtr=2 Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3028, selfPID=3792, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5252, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5504, selfPID=4040, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1980, selfPID=4512, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3444, selfPID=3852, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1852, selfPID=2496, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 01:40:37 (3580): No heartbeat from core client for 30 sec - exiting 01:40:38 (3580): No heartbeat from core client for 30 sec - exiting 01:40:39 (3580): No heartbeat from core client for 30 sec - exiting 01:40:40 (3580): No heartbeat from core client for 30 sec - exiting 01:40:41 (3580): No heartbeat from core client for 30 sec - exiting 01:40:42 (3580): No heartbeat from core client for 30 sec - exiting 01:40:43 (3580): No heartbeat from core client for 30 sec - exiting 01:40:44 (3580): No heartbeat from core client for 30 sec - exiting 01:40:45 (3580): No heartbeat from core client for 30 sec - exiting 01:40:46 (3580): No heartbeat from core client for 30 sec - exiting 01:40:47 (3580): No heartbeat from core client for 30 sec - exiting 01:40:48 (3580): No heartbeat from core client for 30 sec - exiting 01:40:49 (3580): No heartbeat from core client for 30 sec - exiting 01:40:50 (3580): No heartbeat from core client for 30 sec - exiting 01:40:51 (3580): No heartbeat from core client for 30 sec - exiting 01:40:52 (3580): No heartbeat from core client for 30 sec - exiting 01:40:53 (3580): No heartbeat from core client for 30 sec - exiting 01:40:54 (3580): No heartbeat from core client for 30 sec - exiting 01:40:55 (3580): No heartbeat from core client for 30 sec - exiting 01:40:56 (3580): No heartbeat from core client for 30 sec - exiting 01:40:57 (3580): No heartbeat from core client for 30 sec - exiting 01:40:58 (3580): No heartbeat from core client for 30 sec - exiting 01:40:59 (3580): No heartbeat from core client for 30 sec - exiting 01:41:00 (3580): No heartbeat from core client for 30 sec - exiting 01:41:01 (3580): No heartbeat from core client for 30 sec - exiting 01:41:02 (3580): No heartbeat from core client for 30 sec - exiting 01:41:03 (3580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4436, selfPID=4404, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4824, selfPID=3944, iMonCtr=1 Model crash detected, will try to restart... 13:03:53 (3836): No heartbeat from core client for 30 sec - exiting 13:03:54 (3836): No heartbeat from core client for 30 sec - exiting 13:03:55 (3836): No heartbeat from core client for 30 sec - exiting 13:03:56 (3836): No heartbeat from core client for 30 sec - exiting 13:03:57 (3836): No heartbeat from core client for 30 sec - exiting 13:03:58 (3836): No heartbeat from core client for 30 sec - exiting 13:03:59 (3836): No heartbeat from core client for 30 sec - exiting 13:04:00 (3836): No heartbeat from core client for 30 sec - exiting 13:04:01 (3836): No heartbeat from core client for 30 sec - exiting 13:04:02 (3836): No heartbeat from core client for 30 sec - exiting 13:04:03 (3836): No heartbeat from core client for 30 sec - exiting 13:04:04 (3836): No heartbeat from core client for 30 sec - exiting 13:04:05 (3836): No heartbeat from core client for 30 sec - exiting 13:04:06 (3836): No heartbeat from core client for 30 sec - exiting 13:04:07 (3836): No heartbeat from core client for 30 sec - exiting 13:04:08 (3836): No heartbeat from core client for 30 sec - exiting 13:04:09 (3836): No heartbeat from core client for 30 sec - exiting 13:04:10 (3836): No heartbeat from core client for 30 sec - exiting 13:04:11 (3836): No heartbeat from core client for 30 sec - exiting 13:04:12 (3836): No heartbeat from core client for 30 sec - exiting 13:04:13 (3836): No heartbeat from core client for 30 sec - exiting 13:04:14 (3836): No heartbeat from core client for 30 sec - exiting 13:04:15 (3836): No heartbeat from core client for 30 sec - exiting 13:04:16 (3836): No heartbeat from core client for 30 sec - exiting 13:04:17 (3836): No heartbeat from core client for 30 sec - exiting 13:04:18 (3836): No heartbeat from core client for 30 sec - exiting 13:04:19 (3836): No heartbeat from core client for 30 sec - exiting 13:04:20 (3836): No heartbeat from core client for 30 sec - exiting 13:04:21 (3836): No heartbeat from core client for 30 sec - exiting 13:04:22 (3836): No heartbeat from core client for 30 sec - exiting 13:04:23 (3836): No heartbeat from core client for 30 sec - exiting 13:04:24 (3836): No heartbeat from core client for 30 sec - exiting 13:04:25 (3836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:11:07 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4284, selfPID=5920, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5060, selfPID=4036, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2016, selfPID=3532, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3832, selfPID=3584, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4560, selfPID=3492, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1404, selfPID=3540, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3160, selfPID=2304, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4896, selfPID=3764, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4180, selfPID=3764, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2504, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 10:20:05 (3060): No heartbeat from core client for 30 sec - exiting 10:20:06 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1180, selfPID=3080, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3296, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5388, selfPID=3588, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4692, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5336, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4840, selfPID=208, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3792, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2992, selfPID=3140, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4092, selfPID=3088, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5128, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5172, selfPID=3380, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4812, selfPID=3360, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5128, selfPID=836, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 17:57:06 (2876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5628, selfPID=3524, iMonCtr=1 Model crash detected, will try to restart... 14:17:16 (4044): No heartbeat from core client for 30 sec - exiting 14:17:17 (4044): No heartbeat from core client for 30 sec - exiting 14:17:18 (4044): No heartbeat from core client for 30 sec - exiting 14:17:19 (4044): No heartbeat from core client for 30 sec - exiting 14:17:20 (4044): No heartbeat from core client for 30 sec - exiting 14:17:21 (4044): No heartbeat from core client for 30 sec - exiting 14:17:22 (4044): No heartbeat from core client for 30 sec - exiting 14:17:23 (4044): No heartbeat from core client for 30 sec - exiting 14:17:24 (4044): No heartbeat from core client for 30 sec - exiting 14:17:25 (4044): No heartbeat from core client for 30 sec - exiting 14:17:26 (4044): No heartbeat from core client for 30 sec - exiting 14:17:27 (4044): No heartbeat from core client for 30 sec - exiting 14:17:28 (4044): No heartbeat from core client for 30 sec - exiting 14:17:29 (4044): No heartbeat from core client for 30 sec - exiting 14:17:30 (4044): No heartbeat from core client for 30 sec - exiting 14:17:31 (4044): No heartbeat from core client for 30 sec - exiting 14:17:32 (4044): No heartbeat from core client for 30 sec - exiting 14:17:33 (4044): No heartbeat from core client for 30 sec - exiting 14:17:34 (4044): No heartbeat from core client for 30 sec - exiting 14:17:35 (4044): No heartbeat from core client for 30 sec - exiting 14:17:36 (4044): No heartbeat from core client for 30 sec - exiting 14:17:37 (4044): No heartbeat from core client for 30 sec - exiting 14:17:38 (4044): No heartbeat from core client for 30 sec - exiting 14:17:39 (4044): No heartbeat from core client for 30 sec - exiting 14:17:40 (4044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5312, selfPID=340, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4708, selfPID=3000, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1612, selfPID=2472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2928, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2792, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5204, selfPID=980, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4440, selfPID=4004, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4720, selfPID=3828, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2884, selfPID=1380, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5164, selfPID=2084, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3948, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1620, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1344, selfPID=2432, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3160, selfPID=2368, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1332, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5428, selfPID=2568, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4928, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5060, selfPID=1076, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4384, selfPID=1304, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4800, selfPID=3348, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4944, selfPID=2004, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 17:06:11 (2640): No heartbeat from core client for 30 sec - exiting 17:06:12 (2640): No heartbeat from core client for 30 sec - exiting 17:06:13 (2640): No heartbeat from core client for 30 sec - exiting 17:06:14 (2640): No heartbeat from core client for 30 sec - exiting 17:06:15 (2640): No heartbeat from core client for 30 sec - exiting 17:06:16 (2640): No heartbeat from core client for 30 sec - exiting 17:06:17 (2640): No heartbeat from core client for 30 sec - exiting 17:06:18 (2640): No heartbeat from core client for 30 sec - exiting 17:06:19 (2640): No heartbeat from core client for 30 sec - exiting 17:06:20 (2640): No heartbeat from core client for 30 sec - exiting 17:06:21 (2640): No heartbeat from core client for 30 sec - exiting 17:06:22 (2640): No heartbeat from core client for 30 sec - exiting 17:06:23 (2640): No heartbeat from core client for 30 sec - exiting 17:06:24 (2640): No heartbeat from core client for 30 sec - exiting 17:06:25 (2640): No heartbeat from core client for 30 sec - exiting 17:06:26 (2640): No heartbeat from core client for 30 sec - exiting 17:06:27 (2640): No heartbeat from core client for 30 sec - exiting 17:06:28 (2640): No heartbeat from core client for 30 sec - exiting 17:06:29 (2640): No heartbeat from core client for 30 sec - exiting 17:06:30 (2640): No heartbeat from core client for 30 sec - exiting 17:06:31 (2640): No heartbeat from core client for 30 sec - exiting 17:06:32 (2640): No heartbeat from core client for 30 sec - exiting 17:06:33 (2640): No heartbeat from core client for 30 sec - exiting 17:06:34 (2640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1764, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4036, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3988, selfPID=2516, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5688, selfPID=3340, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1972, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2124, selfPID=1196, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3672, selfPID=2152, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5484, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2884, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6128, selfPID=4148, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4168, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... 17:46:19 (2272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:46:20 (2272): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5972, selfPID=2840, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3072, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4548, selfPID=3544, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5004, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5712, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5740, selfPID=1568, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6012, selfPID=2052, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3860, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4012, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5584, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=500, iMonCtr=2 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4032, selfPID=3384, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1436, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2468, selfPID=3464, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1448, selfPID=2992, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2368, selfPID=3304, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3708, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3172, selfPID=3976, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3364, selfPID=3840, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=596, selfPID=3096, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2980, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3456, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4076, selfPID=3532, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2872, selfPID=3484, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1772, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Sep 2012 21:57:56	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	138,336	961,341	6.9493
27 Aug 2012 06:55:58	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	126,817	881,930	6.9544
26 Aug 2012 22:08:44	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	126,816	880,963	6.9468
20 Aug 2012 20:46:49	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	115,296	801,942	6.9555
06 Aug 2012 20:22:01	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	103,778	723,085	6.9676
06 Aug 2012 17:15:24	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	103,776	722,064	6.9579
24 Jul 2012 20:09:15	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	92,257	643,099	6.9707
23 Jul 2012 18:22:31	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	92,256	642,120	6.9602
06 Jul 2012 19:47:21	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	80,737	563,559	6.9802
05 Jul 2012 21:16:58	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	80,736	562,530	6.9675
23 Jun 2012 20:16:07	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	69,216	483,357	6.9833
14 Jun 2012 21:37:24	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	57,696	403,472	6.9931
28 May 2012 18:32:25	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	46,176	323,820	7.0127
16 May 2012 20:01:29	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	34,656	244,239	7.0475
01 May 2012 19:43:26	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	23,137	165,520	7.1539
01 May 2012 15:04:32	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	23,136	164,610	7.1149
21 Apr 2012 07:39:57	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	11,617	86,689	7.4623
20 Apr 2012 23:40:25	1129407	14396779	hadam3p_eu_90e0_1970_1_007869068_0	11,616	85,948	7.3991