Task 13699615

Name	hadam3p_saf_7l5r_1999_1_007584360_0
Workunit	7762490
Created	2 Dec 2011, 17:23:44 UTC
Sent	4 Dec 2011, 3:14:27 UTC
Report deadline	15 Nov 2012, 8:34:27 UTC
Received	27 Dec 2011, 9:24:56 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1183113
Run time	5 days 17 hours 47 min 45 sec
CPU time	4 days 0 hours 44 min 55 sec
Validate state	Invalid
Credit	1,496.58
Device peak FLOPS	1.33 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> 04:44:16 (1324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:51:06 (26892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:53:30 (21823): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:06:26 (30345): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:09:21 (8297): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:43:07 (29949): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 16:44:56 (32466): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:45 (6093): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:37:28 (9646): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:38:56 (20497): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:03:11 (25382): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:04:59 (7697): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:07:56 (15979): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:10:36 (25118): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:13:29 (2455): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:41 (8998): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:25:19 (22840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:37:51 (15219): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:15:38 (29986): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:48:53 (19250): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 23:48:55 (19250): No heartbeat from core client for 30 sec - exiting 23:48:56 (19250): No heartbeat from core client for 30 sec - exiting 23:48:57 (19250): No heartbeat from core client for 30 sec - exiting 23:48:58 (19250): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 03:22:24 (16933): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:46:20 (17062): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 07:48:49 (28372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:43 (5579): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:36:44 (11066): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:22 (30540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:36:07 (7610): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:57 (23378): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:29:10 (10175): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:54:05 (18446): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:54:44 (25467): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:58:42 (27585): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:05:33 (9781): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:40:07 (32312): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:53:18 (1245): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:54:57 (30265): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:55:56 (4395): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:56:48 (7797): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:57:53 (11476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:01:55 (17477): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:05:13 (28243): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:13:46 (7823): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:51:28 (3190): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:52:51 (1363): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:20:23 (5930): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:21:41 (29055): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:26:30 (1675): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:40:34 (17481): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:06:46 (787): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:09:41 (704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:12:34 (10479): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:15:30 (20451): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:25:03 (1503): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:39:45 (8849): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:41:45 (4654): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:21:28 (13122): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:23:14 (18890): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:49:59 (25315): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:52:33 (8715): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:20 (16956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:58:36 (8766): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:12:06 (14217): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:17 (17807): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:14:45 (25200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:14:47 (25200): No heartbeat from core client for 30 sec - exiting 14:14:48 (25200): No heartbeat from core client for 30 sec - exiting 14:14:49 (25200): No heartbeat from core client for 30 sec - exiting 14:14:50 (25200): No heartbeat from core client for 30 sec - exiting 14:14:51 (25200): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:31:07 (8689): No heartbeat from core client for 30 sec - exiting 21:31:22 (8689): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 21:31:25 (8689): No heartbeat from core client for 30 sec - exiting 21:31:26 (8689): No heartbeat from core client for 30 sec - exiting 21:31:27 (8689): No heartbeat from core client for 30 sec - exiting 21:31:28 (8689): No heartbeat from core client for 30 sec - exiting 21:31:29 (8689): No heartbeat from core client for 30 sec - exiting 21:31:30 (8689): No heartbeat from core client for 30 sec - exiting 21:31:31 (8689): No heartbeat from core client for 30 sec - exiting 21:31:32 (8689): No heartbeat from core client for 30 sec - exiting 21:31:33 (8689): No heartbeat from core client for 30 sec - exiting 21:31:34 (8689): No heartbeat from core client for 30 sec - exiting 21:31:35 (8689): No heartbeat from core client for 30 sec - exiting 21:31:36 (8689): No heartbeat from core client for 30 sec - exiting 21:31:37 (8689): No heartbeat from core client for 30 sec - exiting 21:31:38 (8689): No heartbeat from core client for 30 sec - exiting 21:31:40 (8689): No heartbeat from core client for 30 sec - exiting 21:31:41 (8689): No heartbeat from core client for 30 sec - exiting 21:31:42 (8689): No heartbeat from core client for 30 sec - exiting 21:31:43 (8689): No heartbeat from core client for 30 sec - exiting 21:31:44 (8689): No heartbeat from core client for 30 sec - exiting 21:31:45 (8689): No heartbeat from core client for 30 sec - exiting 21:31:46 (8689): No heartbeat from core client for 30 sec - exiting 21:31:47 (8689): No heartbeat from core client for 30 sec - exiting 21:31:48 (8689): No heartbeat from core client for 30 sec - exiting 22:02:30 (24633): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:26 (32676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:52:23 (6559): No heartbeat from core client for 30 sec - exiting 23:53:37 (6559): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:03:36 (6944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:13:04 (7631): No heartbeat from core client for 30 sec - exiting 11:13:28 (7631): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:13:30 (7631): No heartbeat from core client for 30 sec - exiting 11:13:31 (7631): No heartbeat from core client for 30 sec - exiting 11:13:32 (7631): No heartbeat from core client for 30 sec - exiting 11:13:33 (7631): No heartbeat from core client for 30 sec - exiting 11:13:36 (7631): No heartbeat from core client for 30 sec - exiting 11:13:37 (7631): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:19:45 (1402): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:26:17 (7374): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:27:06 (7840): No heartbeat from core client for 30 sec - exiting 08:28:18 (7840): No heartbeat from core client for 30 sec - exiting 08:28:19 (7840): No heartbeat from core client for 30 sec - exiting 08:28:20 (7840): No heartbeat from core client for 30 sec - exiting 08:28:21 (7840): No heartbeat from core client for 30 sec - exiting 08:28:22 (7840): No heartbeat from core client for 30 sec - exiting 08:28:23 (7840): No heartbeat from core client for 30 sec - exiting 08:28:24 (7840): No heartbeat from core client for 30 sec - exiting 08:28:25 (7840): No heartbeat from core client for 30 sec - exiting 08:28:26 (7840): No heartbeat from core client for 30 sec - exiting 08:28:27 (7840): No heartbeat from core client for 30 sec - exiting 08:28:28 (7840): No heartbeat from core client for 30 sec - exiting 08:28:29 (7840): No heartbeat from core client for 30 sec - exiting 08:28:30 (7840): No heartbeat from core client for 30 sec - exiting 08:28:31 (7840): No heartbeat from core client for 30 sec - exiting 08:28:32 (7840): No heartbeat from core client for 30 sec - exiting 08:28:33 (7840): No heartbeat from core client for 30 sec - exiting 08:28:34 (7840): No heartbeat from core client for 30 sec - exiting 08:28:35 (7840): No heartbeat from core client for 30 sec - exiting 08:28:36 (7840): No heartbeat from core client for 30 sec - exiting 08:28:37 (7840): No heartbeat from core client for 30 sec - exiting 08:28:38 (7840): No heartbeat from core client for 30 sec - exiting 08:28:39 (7840): No heartbeat from core client for 30 sec - exiting 08:28:40 (7840): No heartbeat from core client for 30 sec - exiting 08:28:41 (7840): No heartbeat from core client for 30 sec - exiting 08:28:42 (7840): No heartbeat from core client for 30 sec - exiting 08:28:43 (7840): No heartbeat from core client for 30 sec - exiting 08:28:44 (7840): No heartbeat from core client for 30 sec - exiting 08:28:45 (7840): No heartbeat from core client for 30 sec - exiting 08:28:46 (7840): No heartbeat from core client for 30 sec - exiting 08:28:47 (7840): No heartbeat from core client for 30 sec - exiting 08:28:48 (7840): No heartbeat from core client for 30 sec - exiting 08:28:49 (7840): No heartbeat from core client for 30 sec - exiting 08:29:27 (7840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:31:34 (8067): No heartbeat from core client for 30 sec - exiting 08:31:35 (8067): No heartbeat from core client for 30 sec - exiting 08:31:36 (8067): No heartbeat from core client for 30 sec - exiting 08:31:37 (8067): No heartbeat from core client for 30 sec - exiting 08:31:38 (8067): No heartbeat from core client for 30 sec - exiting 08:31:39 (8067): No heartbeat from core client for 30 sec - exiting 08:31:40 (8067): No heartbeat from core client for 30 sec - exiting 08:31:41 (8067): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:38:43 (8242): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:39:25 (8687): No heartbeat from core client for 30 sec - exiting 08:40:59 (8687): No heartbeat from core client for 30 sec - exiting 08:41:00 (8687): No heartbeat from core client for 30 sec - exiting 08:41:01 (8687): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:04 (8885): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:22 (9279): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:29 (9487): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:30 (9487): No heartbeat from core client for 30 sec - exiting 09:14:31 (9487): No heartbeat from core client for 30 sec - exiting 09:14:32 (9487): No heartbeat from core client for 30 sec - exiting 09:14:33 (9487): No heartbeat from core client for 30 sec - exiting 09:14:34 (9487): No heartbeat from core client for 30 sec - exiting 09:14:35 (9487): No heartbeat from core client for 30 sec - exiting 09:14:36 (9487): No heartbeat from core client for 30 sec - exiting 09:14:37 (9487): No heartbeat from core client for 30 sec - exiting 09:14:38 (9487): No heartbeat from core client for 30 sec - exiting 09:14:39 (9487): No heartbeat from core client for 30 sec - exiting 09:14:40 (9487): No heartbeat from core client for 30 sec - exiting 09:14:41 (9487): No heartbeat from core client for 30 sec - exiting 09:14:42 (9487): No heartbeat from core client for 30 sec - exiting 09:15:37 (10986): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:29 (11187): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:33 (11497): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:08:15 (1540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:08 (1712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:10:31 (1828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:11:53 (1851): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:13:16 (1885): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadam3p_saf_6.09_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c373f] [0x443400] ../../projects/climateprediction.net/hadam3p_saf_6.09_i686-pc-linux-gnu[0x804d58f] ../../projects/climateprediction.net/hadam3p_saf_6.09_i686-pc-linux-gnu[0x8051223] ../../projects/climateprediction.net/hadam3p_saf_6.09_i686-pc-linux-gnu[0x8051c59] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xdc0bd6] ../../projects/climateprediction.net/hadam3p_saf_6.09_i686-pc-linux-gnu(pthread_cancel+0x71)[0x804d201] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Dec 2011 09:27:45	1183113	13699615	hadam3p_saf_7l5r_1999_1_007584360_0	92,256	326,089	3.5346
27 Dec 2011 09:27:45	1183113	13699615	hadam3p_saf_7l5r_1999_1_007584360_0	80,736	285,714	3.5389
27 Dec 2011 09:27:45	1183113	13699615	hadam3p_saf_7l5r_1999_1_007584360_0	69,216	245,774	3.5508
13 Dec 2011 11:22:14	1183113	13699615	hadam3p_saf_7l5r_1999_1_007584360_0	57,696	205,803	3.5670
11 Dec 2011 22:20:23	1183113	13699615	hadam3p_saf_7l5r_1999_1_007584360_0	46,177	164,946	3.5720
11 Dec 2011 19:18:41	1183113	13699615	hadam3p_saf_7l5r_1999_1_007584360_0	46,176	164,369	3.5596
09 Dec 2011 08:27:32	1183113	13699615	hadam3p_saf_7l5r_1999_1_007584360_0	34,658	123,978	3.5772
09 Dec 2011 08:27:32	1183113	13699615	hadam3p_saf_7l5r_1999_1_007584360_0	34,657	123,405	3.5608
09 Dec 2011 07:22:16	1183113	13699615	hadam3p_saf_7l5r_1999_1_007584360_0	34,656	122,833	3.5444
07 Dec 2011 20:23:29	1183113	13699615	hadam3p_saf_7l5r_1999_1_007584360_0	23,136	82,072	3.5474
06 Dec 2011 21:16:20	1183113	13699615	hadam3p_saf_7l5r_1999_1_007584360_0	11,616	41,339	3.5588