Task 18347157

Name	hadam3p_anz_m4l6_2012_1_009781599_0
Workunit	9837563
Created	24 Apr 2015, 16:42:14 UTC
Sent	10 May 2015, 21:28:17 UTC
Report deadline	22 Apr 2016, 2:48:17 UTC
Received	12 Aug 2015, 14:24:52 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1176279
Run time	29 days 14 hours 15 min 22 sec
CPU time	25 days 7 hours 10 min 49 sec
Validate state	Workunit error - check skipped
Credit	5,974.74
Device peak FLOPS	0.80 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.47</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9468, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11092, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8892, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8152, selfPID=8152, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9812, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:35:28 (13628): No heartbeat from core client for 30 sec - exiting 22:35:29 (13628): No heartbeat from core client for 30 sec - exiting 22:35:30 (13628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15868, selfPID=15868, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6800, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:31:52 (6160): Can't acquire lockfile (32) - waiting 35s 11:32:15 (7608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8852, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... GController:: CPDN probal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=832, iMonCtr=2 ocess is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5908, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9796, selfPID=9796, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting,CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:40:40 (1984): No heartbeat from core client for 30 sec - exiting 09:40:41 (1984): No heartbeat from core client for 30 sec - exiting 09:40:42 (1984): No heartbeat from core client for 30 sec - exiting 09:40:43 (1984): No heartbeat from core client for 30 sec - exiting 09:40:45 (1984): No heartbeat from core client for 30 sec - exiting 09:40:46 (1984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4956, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5216, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5048, selfPID=5048, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4780, selfPID=4780, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 09:24:46 (6348): No heartbeat from core client for 30 sec - exiting 09:24:47 (6348): No heartbeat from core client for 30 sec - exiting 09:24:49 (6348): No heartbeat from core client for 30 sec - exiting 09:24:50 (6348): No heartbeat from core client for 30 sec - exiting 09:24:51 (6348): No heartbeat from core client for 30 sec - exiting 09:24:52 (6348): No heartbeat from core client for 30 sec - exiting 09:24:53 (6348): No heartbeat from core client for 30 sec - exiting 09:24:54 (6348): No heartbeat from core client for 30 sec - exiting 09:24:55 (6348): No heartbeat from core client for 30 sec - exiting 09:24:56 (6348): No heartbeat from core client for 30 sec - exiting 09:24:57 (6348): No heartbeat from core client for 30 sec - exiting 09:24:58 (6348): No heartbeat from core client for 30 sec - exiting 09:25:00 (6348): No heartbeat from core client for 30 sec - exiting 09:25:01 (6348): No heartbeat from core client for 30 sec - exiting 09:25:02 (6348): No heartbeat from core client for 30 sec - exiting 09:25:03 (6348): No heartbeat from core client for 30 sec - exiting 09:25:04 (6348): No heartbeat from core client for 30 sec - exiting 09:25:05 (6348): No heartbeat from core client for 30 sec - exiting 09:25:06 (6348): No heartbeat from core client for 30 sec - exiting 09:25:07 (6348): No heartbeat from core client for 30 sec - exiting 09:25:08 (6348): No heartbeat from core client for 30 sec - exiting 09:25:09 (6348): No heartbeat from core client for 30 sec - exiting 09:25:10 (6348): No heartbeat from core client for 30 sec - exiting 09:25:12 (6348): No heartbeat from core client for 30 sec - exiting 09:25:13 (6348): No heartbeat from core client for 30 sec - exiting 09:25:14 (6348): No heartbeat from core client for 30 sec - exiting 09:25:15 (6348): No heartbeat from core client for 30 sec - exiting 09:25:16 (6348): No heartbeat from core client for 30 sec - exiting 09:25:17 (6348): No heartbeat from core client for 30 sec - exiting 09:25:18 (6348): No heartbeat from core client for 30 sec - exiting 09:25:19 (6348): No heartbeat from core client for 30 sec - exiting 09:25:20 (6348): No heartbeat from core client for 30 sec - exiting 09:25:21 (6348): No heartbeat from core client for 30 sec - exiting 09:25:22 (6348): No heartbeat from core client for 30 sec - exiting 09:25:24 (6348): No heartbeat from core client for 30 sec - exiting 09:25:25 (6348): No heartbeat from core client for 30 sec - exiting 09:25:26 (6348): No heartbeat from core client for 30 sec - exiting 09:25:27 (6348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:43:58 (2444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:11:05 (1032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:50:10 (5208): No heartbeat from core client for 30 sec - exiting 09:50:12 (5208): No heartbeat from core client for 30 sec - exiting 09:50:13 (5208): No heartbeat from core client for 30 sec - exiting 09:50:14 (5208): No heartbeat from core client for 30 sec - exiting 09:50:15 (5208): No heartbeat from core client for 30 sec - exiting 09:50:16 (5208): No heartbeat from core client for 30 sec - exiting 09:50:17 (5208): No heartbeat from core client for 30 sec - exiting 09:50:18 (5208): No heartbeat from core client for 30 sec - exiting 09:50:19 (5208): No heartbeat from core client for 30 sec - exiting 09:50:20 (5208): No heartbeat from core client for 30 sec - exiting 09:50:21 (5208): No heartbeat from core client for 30 sec - exiting 09:50:22 (5208): No heartbeat from core client for 30 sec - exiting 09:50:24 (5208): No heartbeat from core client for 30 sec - exiting 09:50:25 (5208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... RCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7748, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bReCPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7036, selfPID=7036, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:27:45 (6968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... RegionalCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:32:16 (6868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11036, selfPID=11064, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6504, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7164, selfPID=3204, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:37:57 (4708): No heartbeat from core client for 30 sec - exiting 09:37:59 (4708): No heartbeat from core client for 30 sec - exiting 09:38:00 (4708): No heartbeat from core client for 30 sec - exiting 09:38:01 (4708): No heartbeat from core client for 30 sec - exiting 09:38:02 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6696, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global WorController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7740, iMonCtr=2 Model crash detected, will try to restart... r:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7020, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4072, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:22:48 (3756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... R9:22:50 (3756): No heartbeat from core client for 30 sec - exiting 09:22:51 (3756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6312, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... RegiSuspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, chCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:27:38 (10008): start_timer_thread(): CreateThread() failed, errno 0 21:27:39 (10224): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:34:46 (6892): start_timer_thread(): CreateThread() failed, errno 0 09:34:47 (3772): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:39:11 (4896): start_timer_thread(): CreateThread() failed, errno 0 14:39:12 (8728): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:40:58 (9700): start_timer_thread(): CreateThread() failed, errno 0 16:41:00 (9868): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:25:50 (7804): start_timer_thread(): CreateThread() failed, errno 0 20:25:52 (9992): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:37:49 (10220): No heartbeat from core client for 30 sec - exiting 09:38:10 (448): start_timer_thread(): CreateThread() failed, errno 0 09:38:11 (6148): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... 09:38:14 (6632): start_timer_thread(): CreateThread() failed, errno 0 09:38:15 (5216): start_timer_thread(): CreateThread() failed, errno 0 14:19:37 (9348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:24 (3652): start_timer_thread(): CreateThread() failed, errno 0 14:25:24 (10932): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 09:23:21 (2192): start_timer_thread(): CreateThread() failed, errno 0 09:23:23 (5144): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:38:14 (12784): No heartbeat from core client for 30 sec - exiting 09:38:15 (12784): No heartbeat from core client for 30 sec - exiting 09:38:16 (12784): No heartbeat from core client for 30 sec - exiting 09:38:17 (12784): No heartbeat from core client for 30 sec - exiting 09:38:19 (12784): No heartbeat from core client for 30 sec - exiting 09:38:20 (12784): No heartbeat from core client for 30 sec - exiting 09:38:21 (12784): No heartbeat from core client for 30 sec - exiting 09:38:22 (12784): No heartbeat from core client for 30 sec - exiting 09:38:23 (12784): No heartbeat from core client for 30 sec - exiting 09:38:24 (12784): No heartbeat from core client for 30 sec - exiting 09:38:25 (12784): No heartbeat from core client for 30 sec - exiting 09:38:26 (12784): No heartbeat from core client for 30 sec - exiting 09:38:27 (12784): No heartbeat from core client for 30 sec - exiting 09:38:39 (6660): start_timer_thread(): CreateThread() failed, errno 0 09:38:40 (11600): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... 09:38:55 (8060): start_timer_thread(): CreateThread() failed, errno 0 09:38:56 (5328): start_timer_thread(): CreateThread() failed, errno 0 16:13:59 (7140): No heartbeat from core client for 30 sec - exiting 16:14:00 (7140): No heartbeat from core client for 30 sec - exiting 16:14:01 (7140): No heartbeat from core client for 30 sec - exiting 16:14:02 (7140): No heartbeat from core client for 30 sec - exiting 16:14:03 (7140): No heartbeat from core client for 30 sec - exiting 16:14:04 (7140): No heartbeat from core client for 30 sec - exiting 16:14:05 (7140): No heartbeat from core client for 30 sec - exiting 16:14:07 (7140): No heartbeat from core client for 30 sec - exiting 16:14:08 (7140): No heartbeat from core client for 30 sec - exiting 16:14:09 (7140): No heartbeat from core client for 30 sec - exiting 16:14:10 (7140): No heartbeat from core client for 30 sec - exiting 16:14:11 (7140): No heartbeat from core client for 30 sec - exiting 16:14:12 (7140): No heartbeat from core client for 30 sec - exiting 16:14:13 (7140): No heartbeat from core client for 30 sec - exiting 16:14:14 (7140): No heartbeat from core client for 30 sec - exiting 16:14:15 (7140): No heartbeat from core client for 30 sec - exiting 16:14:16 (7140): No heartbeat from core client for 30 sec - exiting 16:14:18 (7140): No heartbeat from core client for 30 sec - exiting 16:14:19 (7140): No heartbeat from core client for 30 sec - exiting 16:14:20 (7140): No heartbeat from core client for 30 sec - exiting 16:14:21 (7140): No heartbeat from core client for 30 sec - exiting 16:14:22 (7140): No heartbeat from core client for 30 sec - exiting 16:14:23 (7140): No heartbeat from core client for 30 sec - exiting 16:14:24 (7140): No heartbeat from core client for 30 sec - exiting 16:14:25 (7140): No heartbeat from core client for 30 sec - exiting 16:14:26 (7140): No heartbeat from core client for 30 sec - exiting 16:14:27 (7140): No heartbeat from core client for 30 sec - exiting 16:14:29 (7140): No heartbeat from core client for 30 sec - exiting 16:14:30 (7140): No heartbeat from core client for 30 sec - exiting 16:14:31 (7140): No heartbeat from core client for 30 sec - exiting 16:14:32 (7140): No heartbeat from core client for 30 sec - exiting 16:14:33 (7140): No heartbeat from core client for 30 sec - exiting 16:14:50 (8000): start_timer_thread(): CreateThread() failed, errno 0 16:14:51 (8028): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... 16:15:02 (5184): start_timer_thread(): CreateThread() failed, errno 0 16:15:03 (7896): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:10:12 (11016): start_timer_thread(): CreateThread() failed, errno 0 22:10:13 (9992): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:42:57 (2752): start_timer_thread(): CreateThread() failed, errno 0 09:43:00 (4584): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:13:31 (11084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:51:56 (11056): start_timer_thread(): CreateThread() failed, errno 0 CP12:27:12 (10264): start_timer_thread(): CreateThread() failed, errno 0 12:27:14 (6672): start_timer_thread(): CreateThread() failed, errno 0 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Aug 2015 13:00:14	1176279	18347157	hadam3p_anz_m4l6_2012_1_009781599_0	138,539	2,185,549	15.7757
02 Aug 2015 14:56:27	1176279	18347157	hadam3p_anz_m4l6_2012_1_009781599_0	127,019	2,038,859	16.0516
21 Jul 2015 12:28:00	1176279	18347157	hadam3p_anz_m4l6_2012_1_009781599_0	115,499	1,840,053	15.9313
09 Jul 2015 10:09:44	1176279	18347157	hadam3p_anz_m4l6_2012_1_009781599_0	103,979	1,631,299	15.6887
03 Jul 2015 12:21:11	1176279	18347157	hadam3p_anz_m4l6_2012_1_009781599_0	92,459	1,518,067	16.4188
26 Jun 2015 10:05:42	1176279	18347157	hadam3p_anz_m4l6_2012_1_009781599_0	80,939	1,307,435	16.1533
18 Jun 2015 22:58:05	1176279	18347157	hadam3p_anz_m4l6_2012_1_009781599_0	69,419	1,090,845	15.7139
13 Jun 2015 10:39:49	1176279	18347157	hadam3p_anz_m4l6_2012_1_009781599_0	57,899	879,961	15.1982
04 Jun 2015 21:09:36	1176279	18347157	hadam3p_anz_m4l6_2012_1_009781599_0	46,379	686,650	14.8052
30 May 2015 14:23:14	1176279	18347157	hadam3p_anz_m4l6_2012_1_009781599_0	34,859	510,550	14.6461
23 May 2015 12:35:22	1176279	18347157	hadam3p_anz_m4l6_2012_1_009781599_0	23,339	298,443	12.7873
19 May 2015 13:53:34	1176279	18347157	hadam3p_anz_m4l6_2012_1_009781599_0	11,819	181,404	15.3485