Task 16048494

Name	hadam3p_eu_p0zm_1990_1_008297886_2
Workunit	8449021
Created	28 Sep 2013, 18:50:24 UTC
Sent	28 Sep 2013, 18:50:51 UTC
Report deadline	11 Sep 2014, 0:10:51 UTC
Received	12 Feb 2014, 13:27:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	1 (0x00000001) Unknown error code
Computer ID	1259251
Run time	20 days 16 hours 31 min 22 sec
CPU time	13 days 23 hours 48 min 30 sec
Validate state	Invalid
Credit	1,988.94
Device peak FLOPS	1.10 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.8.44</core_client_version> <![CDATA[ <message> Incorrect function. (0x1) - exit code 1 (0x1) </message> <stderr_txt> 00:09:46 (3224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:09:49 (3224): No heartbeat from core client for 30 sec - exiting 00:09:50 (3224): No heartbeat from core client for 30 sec - exiting 00:09:51 (3224): No heartbeat from core client for 30 sec - exiting 00:09:52 (3224): No heartbeat from core client for 30 sec - exiting 00:12:15 (4548): No heartbeat from core client for 30 sec - exiting 00:12:16 (4548): No heartbeat from core client for 30 sec - exiting 00:12:17 (4548): No heartbeat from core client for 30 sec - exiting 00:12:18 (4548): No heartbeat from core client for 30 sec - exiting 00:12:19 (4548): No heartbeat from core client for 30 sec - exiting 00:12:20 (4548): No heartbeat from core client for 30 sec - exiting 00:12:21 (4548): No heartbeat from core client for 30 sec - exiting 00:12:22 (4548): No heartbeat from core client for 30 sec - exiting 00:12:23 (4548): No heartbeat from core client for 30 sec - exiting 00:12:24 (4548): No heartbeat from core client for 30 sec - exiting 00:12:25 (4548): No heartbeat from core client for 30 sec - exiting 00:12:26 (4548): No heartbeat from core client for 30 sec - exiting 00:12:27 (4548): No heartbeat from core client for 30 sec - exiting 00:12:28 (4548): No heartbeat from core client for 30 sec - exiting 00:12:29 (4548): No heartbeat from core client for 30 sec - exiting 00:12:30 (4548): No heartbeat from core client for 30 sec - exiting 00:12:31 (4548): No heartbeat from core client for 30 sec - exiting 00:12:32 (4548): No heartbeat from core client for 30 sec - exiting 00:12:33 (4548): No heartbeat from core client for 30 sec - exiting 00:12:34 (4548): No heartbeat from core client for 30 sec - exiting 00:12:35 (4548): No heartbeat from core client for 30 sec - exiting 00:12:36 (4548): No heartbeat from core client for 30 sec - exiting 00:12:37 (4548): No heartbeat from core client for 30 sec - exiting 00:12:38 (4548): No heartbeat from core client for 30 sec - exiting 00:12:39 (4548): No heartbeat from core client for 30 sec - exiting 00:12:40 (4548): No heartbeat from core client for 30 sec - exiting 00:12:41 (4548): No heartbeat from core client for 30 sec - exiting 00:12:42 (4548): No heartbeat from core client for 30 sec - exiting 00:12:43 (4548): No heartbeat from core client for 30 sec - exiting 00:12:44 (4548): No heartbeat from core client for 30 sec - exiting 00:12:45 (4548): No heartbeat from core client for 30 sec - exiting 00:12:46 (4548): No heartbeat from core client for 30 sec - exiting 00:12:47 (4548): No heartbeat from core client for 30 sec - exiting 00:12:48 (4548): No heartbeat from core client for 30 sec - exiting 00:12:49 (4548): No heartbeat from core client for 30 sec - exiting 00:12:50 (4548): No heartbeat from core client for 30 sec - exiting 00:12:51 (4548): No heartbeat from core client for 30 sec - exiting 00:12:52 (4548): No heartbeat from core client for 30 sec - exiting 00:12:53 (4548): No heartbeat from core client for 30 sec - exiting 00:12:54 (4548): No heartbeat from core client for 30 sec - exiting 00:12:55 (4548): No heartbeat from core client for 30 sec - exiting 00:12:56 (4548): No heartbeat from core client for 30 sec - exiting 00:12:57 (4548): No heartbeat from core client for 30 sec - exiting 00:12:58 (4548): No heartbeat from core client for 30 sec - exiting 00:12:59 (4548): No heartbeat from core client for 30 sec - exiting 00:13:00 (4548): No heartbeat from core client for 30 sec - exiting 00:13:01 (4548): No heartbeat from core client for 30 sec - exiting 00:13:02 (4548): No heartbeat from core client for 30 sec - exiting 00:13:03 (4548): No heartbeat from core client for 30 sec - exiting 00:13:04 (4548): No heartbeat from core client for 30 sec - exiting 00:13:05 (4548): No heartbeat from core client for 30 sec - exiting 00:13:06 (4548): No heartbeat from core client for 30 sec - exiting 00:13:07 (4548): No heartbeat from core client for 30 sec - exiting 00:13:08 (4548): No heartbeat from core client for 30 sec - exiting 00:13:09 (4548): No heartbeat from core client for 30 sec - exiting 00:13:10 (4548): No heartbeat from core client for 30 sec - exiting 00:13:11 (4548): No heartbeat from core client for 30 sec - exiting 00:13:12 (4548): No heartbeat from core client for 30 sec - exiting 00:13:13 (4548): No heartbeat from core client for 30 sec - exiting 00:13:14 (4548): No heartbeat from core client for 30 sec - exiting 00:13:15 (4548): No heartbeat from core client for 30 sec - exiting 00:13:16 (4548): No heartbeat from core client for 30 sec - exiting 00:13:17 (4548): No heartbeat from core client for 30 sec - exiting 00:13:18 (4548): No heartbeat from core client for 30 sec - exiting 00:13:19 (4548): No heartbeat from core client for 30 sec - exiting 00:13:20 (4548): No heartbeat from core client for 30 sec - exiting 00:13:21 (4548): No heartbeat from core client for 30 sec - exiting 00:13:22 (4548): No heartbeat from core client for 30 sec - exiting 00:13:23 (4548): No heartbeat from core client for 30 sec - exiting 00:13:24 (4548): No heartbeat from core client for 30 sec - exiting 00:13:25 (4548): No heartbeat from core client for 30 sec - exiting 00:13:26 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:13:27 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:48:53 (4308): No heartbeat from core client for 30 sec - exiting 10:48:54 (4308): No heartbeat from core client for 30 sec - exiting 10:48:55 (4308): No heartbeat from core client for 30 sec - exiting 10:48:56 (4308): No heartbeat from core client for 30 sec - exiting 10:48:57 (4308): No heartbeat from core client for 30 sec - exiting 10:48:58 (4308): No heartbeat from core client for 30 sec - exiting 10:48:59 (4308): No heartbeat from core client for 30 sec - exiting 10:49:00 (4308): No heartbeat from core client for 30 sec - exiting 10:49:01 (4308): No heartbeat from core client for 30 sec - exiting 10:49:02 (4308): No heartbeat from core client for 30 sec - exiting 10:49:03 (4308): No heartbeat from core client for 30 sec - exiting 10:49:04 (4308): No heartbeat from core client for 30 sec - exiting 10:49:05 (4308): No heartbeat from core client for 30 sec - exiting 10:49:06 (4308): No heartbeat from core client for 30 sec - exiting 10:49:07 (4308): No heartbeat from core client for 30 sec - exiting 10:49:08 (4308): No heartbeat from core client for 30 sec - exiting 10:49:09 (4308): No heartbeat from core client for 30 sec - exiting 10:49:10 (4308): No heartbeat from core client for 30 sec - exiting 10:49:11 (4308): No heartbeat from core client for 30 sec - exiting 10:49:12 (4308): No heartbeat from core client for 30 sec - exiting 10:49:13 (4308): No heartbeat from core client for 30 sec - exiting 10:49:14 (4308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5284, selfPID=5284, iMonCtr=2 17:11:21 (2548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:26:43 (4816): No heartbeat from core client for 30 sec - exiting 16:26:44 (4816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:09:10 (4256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:21:06 (3832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:07:03 (5156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:08:09 (3160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4428, selfPID=4428, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 20:26:03 (6092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:54:22 (2112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:54:23 (2112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:49:38 (6720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:26:28 (468): No heartbeat from core client for 30 sec - exiting 11:26:29 (468): No heartbeat from core client for 30 sec - exiting 11:26:30 (468): No heartbeat from core client for 30 sec - exiting 11:26:31 (468): No heartbeat from core client for 30 sec - exiting 11:26:32 (468): No heartbeat from core client for 30 sec - exiting 11:26:33 (468): No heartbeat from core client for 30 sec - exiting 11:26:34 (468): No heartbeat from core client for 30 sec - exiting 11:26:36 (468): No heartbeat from core client for 30 sec - exiting 11:26:37 (468): No heartbeat from core client for 30 sec - exiting 11:26:38 (468): No heartbeat from core client for 30 sec - exiting 11:26:39 (468): No heartbeat from core client for 30 sec - exiting 11:26:40 (468): No heartbeat from core client for 30 sec - exiting 11:26:41 (468): No heartbeat from core client for 30 sec - exiting 11:26:42 (468): No heartbeat from core client for 30 sec - exiting 11:26:43 (468): No heartbeat from core client for 30 sec - exiting 11:26:44 (468): No heartbeat from core client for 30 sec - exiting 11:26:45 (468): No heartbeat from core client for 30 sec - exiting 11:26:47 (468): No heartbeat from core client for 30 sec - exiting 11:26:48 (468): No heartbeat from core client for 30 sec - exiting 11:26:49 (468): No heartbeat from core client for 30 sec - exiting 11:26:50 (468): No heartbeat from core client for 30 sec - exiting 11:26:51 (468): No heartbeat from core client for 30 sec - exiting 11:26:52 (468): No heartbeat from core client for 30 sec - exiting 11:26:53 (468): No heartbeat from core client for 30 sec - exiting 11:26:54 (468): No heartbeat from core client for 30 sec - exiting 11:26:55 (468): No heartbeat from core client for 30 sec - exiting 11:26:56 (468): No heartbeat from core client for 30 sec - exiting 11:26:57 (468): No heartbeat from core client for 30 sec - exiting 11:26:59 (468): No heartbeat from core client for 30 sec - exiting 11:27:00 (468): No heartbeat from core client for 30 sec - exiting 11:27:01 (468): No heartbeat from core client for 30 sec - exiting 11:27:02 (468): No heartbeat from core client for 30 sec - exiting 11:27:03 (468): No heartbeat from core client for 30 sec - exiting 11:27:04 (468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:33:08 (1824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:01:13 (1724): No heartbeat from core client for 30 sec - exiting 16:01:14 (1724): No heartbeat from core client for 30 sec - exiting 16:01:15 (1724): No heartbeat from core client for 30 sec - exiting 16:01:16 (1724): No heartbeat from core client for 30 sec - exiting 16:01:17 (1724): No heartbeat from core client for 30 sec - exiting 16:01:18 (1724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:13:15 (2512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:53 (2264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:35 (180): No heartbeat from core client for 30 sec - exiting 20:25:36 (180): No heartbeat from core client for 30 sec - exiting 20:25:37 (180): No heartbeat from core client for 30 sec - exiting 20:25:38 (180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:10:04 (212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:40:57 (3776): No heartbeat from core client for 30 sec - exiting 09:40:58 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:18:07 (2292): No heartbeat from core client for 30 sec - exiting 14:18:08 (2292): No heartbeat from core client for 30 sec - exiting 14:18:09 (2292): No heartbeat from core client for 30 sec - exiting 14:18:10 (2292): No heartbeat from core client for 30 sec - exiting 14:18:11 (2292): No heartbeat from core client for 30 sec - exiting 14:18:12 (2292): No heartbeat from core client for 30 sec - exiting 14:18:13 (2292): No heartbeat from core client for 30 sec - exiting 14:18:14 (2292): No heartbeat from core client for 30 sec - exiting 14:18:15 (2292): No heartbeat from core client for 30 sec - exiting 14:18:16 (2292): No heartbeat from core client for 30 sec - exiting 14:18:17 (2292): No heartbeat from core client for 30 sec - exiting 14:18:18 (2292): No heartbeat from core client for 30 sec - exiting 14:18:19 (2292): No heartbeat from core client for 30 sec - exiting 14:18:20 (2292): No heartbeat from core client for 30 sec - exiting 14:18:21 (2292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:37:24 (2868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:39:07 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:57:54 (5488): No heartbeat from core client for 30 sec - exiting 12:57:55 (5488): No heartbeat from core client for 30 sec - exiting 12:57:56 (5488): No heartbeat from core client for 30 sec - exiting 12:57:57 (5488): No heartbeat from core client for 30 sec - exiting 12:57:58 (5488): No heartbeat from core client for 30 sec - exiting 12:57:59 (5488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, 06:30:43 (5612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:44:36 (5896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1248, selfPID=1248, iMonCtr=2 21:03:26 (5928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:32:28 (2268): No heartbeat from core client for 30 sec - exiting 16:32:29 (2268): No heartbeat from core client for 30 sec - exiting 16:32:30 (2268): No heartbeat from core client for 30 sec - exiting 16:32:31 (2268): No heartbeat from core client for 30 sec - exiting 16:32:32 (2268): No heartbeat from core client for 30 sec - exiting 16:32:33 (2268): No heartbeat from core client for 30 sec - exiting 16:32:34 (2268): No heartbeat from core client for 30 sec - exiting 16:32:35 (2268): No heartbeat from core client for 30 sec - exiting 16:32:36 (2268): No heartbeat from core client for 30 sec - exiting 16:32:37 (2268): No heartbeat from core client for 30 sec - exiting 16:32:38 (2268): No heartbeat from core client for 30 sec - exiting 16:32:39 (2268): No heartbeat from core client for 30 sec - exiting 16:32:40 (2268): No heartbeat from core client for 30 sec - exiting 16:32:41 (2268): No heartbeat from core client for 30 sec - exiting 16:32:42 (2268): No heartbeat from core client for 30 sec - exiting 16:32:43 (2268): No heartbeat from core client for 30 sec - exiting 16:32:44 (2268): No heartbeat from core client for 30 sec - exiting 16:32:45 (2268): No heartbeat from core client for 30 sec - exiting 16:32:46 (2268): No heartbeat from core client for 30 sec - exiting 16:32:48 (2268): No heartbeat from core client for 30 sec - exiting 16:32:49 (2268): No heartbeat from core client for 30 sec - exiting 16:32:50 (2268): No heartbeat from core client for 30 sec - exiting 16:32:51 (2268): No heartbeat from core client for 30 sec - exiting 16:32:52 (2268): No heartbeat from core client for 30 sec - exiting 16:32:53 (2268): No heartbeat from core client for 30 sec - exiting 16:32:54 (2268): No heartbeat from core client for 30 sec - exiting 16:32:55 (2268): No heartbeat from core client for 30 sec - exiting 16:32:56 (2268): No heartbeat from core client for 30 sec - exiting 16:32:57 (2268): No heartbeat from core client for 30 sec - exiting 16:32:59 (2268): No heartbeat from core client for 30 sec - exiting 16:33:00 (2268): No heartbeat from core client for 30 sec - exiting 16:33:01 (2268): No heartbeat from core client for 30 sec - exiting 16:33:02 (2268): No heartbeat from core client for 30 sec - exiting 16:33:03 (2268): No heartbeat from core client for 30 sec - exiting 16:33:04 (2268): No heartbeat from core client for 30 sec - exiting 16:33:05 (2268): No heartbeat from core client for 30 sec - exiting 16:33:06 (2268): No heartbeat from core client for 30 sec - exiting 16:33:07 (2268): No heartbeat from core client for 30 sec - exiting 16:33:08 (2268): No heartbeat from core client for 30 sec - exiting 16:33:09 (2268): No heartbeat from core client for 30 sec - exiting 16:33:11 (2268): No heartbeat from core client for 30 sec - exiting 16:33:12 (2268): No heartbeat from core client for 30 sec - exiting 16:33:13 (2268): No heartbeat from core client for 30 sec - exiting 16:33:14 (2268): No heartbeat from core client for 30 sec - exiting 16:33:15 (2268): No heartbeat from core client for 30 sec - exiting 16:33:16 (2268): No heartbeat from core client for 30 sec - exiting 16:33:17 (2268): No heartbeat from core client for 30 sec - exiting 16:33:18 (2268): No heartbeat from core client for 30 sec - exiting 16:33:19 (2268): No heartbeat from core client for 30 sec - exiting 16:33:20 (2268): No heartbeat from core client for 30 sec - exiting 16:33:21 (2268): No heartbeat from core client for 30 sec - exiting 16:33:23 (2268): No heartbeat from core client for 30 sec - exiting 16:33:24 (2268): No heartbeat from core client for 30 sec - exiting 16:33:25 (2268): No heartbeat from core client for 30 sec - exiting 16:33:26 (2268): No heartbeat from core client for 30 sec - exiting 16:33:27 (2268): No heartbeat from core client for 30 sec - exiting 16:33:28 (2268): No heartbeat from core client for 30 sec - exiting 16:33:29 (2268): No heartbeat from core client for 30 sec - exiting 16:33:30 (2268): No heartbeat from core client for 30 sec - exiting 16:33:31 (2268): No heartbeat from core client for 30 sec - exiting 16:33:32 (2268): No heartbeat from core client for 30 sec - exiting 16:33:34 (2268): No heartbeat from core client for 30 sec - exiting 16:33:35 (2268): No heartbeat from core client for 30 sec - exiting 16:33:36 (2268): No heartbeat from core client for 30 sec - exiting 16:33:37 (2268): No heartbeat from core client for 30 sec - exiting 16:33:38 (2268): No heartbeat from core client for 30 sec - exiting 16:33:39 (2268): No heartbeat from core client for 30 sec - exiting 16:33:40 (2268): No heartbeat from core client for 30 sec - exiting 16:33:41 (2268): No heartbeat from core client for 30 sec - exiting 16:33:42 (2268): No heartbeat from core client for 30 sec - exiting 16:33:43 (2268): No heartbeat from core client for 30 sec - exiting 16:33:44 (2268): No heartbeat from core client for 30 sec - exiting 16:33:46 (2268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:33:47 (2268): No heartbeat from core client for 30 sec - exiting 16:33:48 (2268): No heartbeat from core client for 30 sec - exiting 16:33:49 (2268): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2920, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Oct 2013 07:38:55	1259251	16048494	hadam3p_eu_p0zm_1990_1_008297886_2	115,296	1,169,744	10.1456
16 Oct 2013 23:23:29	1259251	16048494	hadam3p_eu_p0zm_1990_1_008297886_2	103,776	1,038,497	10.0071
14 Oct 2013 08:31:55	1259251	16048494	hadam3p_eu_p0zm_1990_1_008297886_2	92,256	918,126	9.9519
12 Oct 2013 21:29:28	1259251	16048494	hadam3p_eu_p0zm_1990_1_008297886_2	80,736	815,780	10.1043
10 Oct 2013 02:02:26	1259251	16048494	hadam3p_eu_p0zm_1990_1_008297886_2	69,216	679,139	9.8119
07 Oct 2013 22:02:15	1259251	16048494	hadam3p_eu_p0zm_1990_1_008297886_2	57,696	566,248	9.8143
06 Oct 2013 05:58:12	1259251	16048494	hadam3p_eu_p0zm_1990_1_008297886_2	46,176	454,410	9.8408
04 Oct 2013 15:58:33	1259251	16048494	hadam3p_eu_p0zm_1990_1_008297886_2	34,656	334,264	9.6452
02 Oct 2013 21:55:54	1259251	16048494	hadam3p_eu_p0zm_1990_1_008297886_2	23,136	226,777	9.8019
30 Sep 2013 17:53:12	1259251	16048494	hadam3p_eu_p0zm_1990_1_008297886_2	11,616	115,119	9.9104