Task 13849716

Name	hadam3p_eu_81di_1998_1_007628591_0
Workunit	7806910
Created	2 Jan 2012, 13:41:55 UTC
Sent	2 Jan 2012, 21:37:14 UTC
Report deadline	15 Dec 2012, 2:57:14 UTC
Received	15 Feb 2012, 23:49:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1188312
Run time	7 days 3 hours 47 min 1 sec
CPU time	3 days 10 hours 17 min 24 sec
Validate state	Invalid
Credit	1,392.75
Device peak FLOPS	2.78 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.2</core_client_version> <![CDATA[ <stderr_txt> Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c354f] [0xf77c0400] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8050e53] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x805197d] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8051c59] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7516e46] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(pthread_cancel+0x71)[0x804d201] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2630, selfPID=2621, iMonCtr=1 Model crash detected, will try to restart... Signal 15 received, exiting... Called boinc_finish Leaving CPDN_Main::Monitor... Called boinc_finish CPDN Monitor - Quit request from BOINC... 13:59:19 (2923): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:52 (3602): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:02:05 (3613): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c354f] [0xf776f400] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8050e53] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x805197d] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8051c59] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf74c5e46] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(pthread_cancel+0x71)[0x804d201] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3597, selfPID=3587, iMonCtr=1 Model crash detected, will try to restart... Signal 15 received, exiting... Called boinc_finish Leaving CPDN_Main::Monitor... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c354f] [0xf77d0400] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8050e53] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x805197d] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8051c59] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7526e46] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(pthread_cancel+0x71)[0x804d201] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c354f] [0xf76f4400] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8050e53] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x805197d] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8051c59] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf744ae46] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(pthread_cancel+0x71)[0x804d201] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2648, selfPID=2630, iMonCtr=1 Model crash detected, will try to restart... Signal 15 received, exiting... Called boinc_finish Leaving CPDN_Main::Monitor... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:39:59 (3278): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish 19:08:12 (2705): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c354f] [0xf77b3400] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8050e53] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x805197d] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8051c59] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7509e46] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(pthread_cancel+0x71)[0x804d201] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c354f] [0xf7705400] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8050e53] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x805197d] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8051c59] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf745be46] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(pthread_cancel+0x71)[0x804d201] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c354f] [0xf778d400] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8050e53] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x805197d] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8051c59] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf74e3e46] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(pthread_cancel+0x71)[0x804d201] Exiting... 19:30:29 (2670): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c354f] [0xf77b1400] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8050e53] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x805197d] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu[0x8051c59] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7507e46] ../../projects/climateprediction.net/hadam3p_eu_6.09_i686-pc-linux-gnu(pthread_cancel+0x71)[0x804d201] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3386, selfPID=3371, iMonCtr=1 Model crash detected, will try to restart... Signal 15 received, exiting... Called boinc_finish Leaving CPDN_Main::Monitor... cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam3p_eu_81di_1998_1_007628591/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam3p_eu_81di_1998_1_007628591/dataout/region_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakg.pipe_dummy 2048 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_81di_1998_1_007628591_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_81di_1998_1_007628591_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_81di_1998_1_007628591_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_81di_1998_1_007628591_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_81di_1998_1_007628591_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_81di_1998_1_007628591_0_13.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Feb 2012 11:24:16	1188312	13849716	hadam3p_eu_81di_1998_1_007628591_0	80,736	273,133	3.3830
13 Feb 2012 11:25:55	1188312	13849716	hadam3p_eu_81di_1998_1_007628591_0	69,217	235,617	3.4040
11 Feb 2012 02:57:44	1188312	13849716	hadam3p_eu_81di_1998_1_007628591_0	69,216	235,047	3.3958
10 Feb 2012 12:37:26	1188312	13849716	hadam3p_eu_81di_1998_1_007628591_0	57,696	196,365	3.4034
09 Feb 2012 13:00:21	1188312	13849716	hadam3p_eu_81di_1998_1_007628591_0	46,176	156,771	3.3951
12 Jan 2012 22:35:20	1188312	13849716	hadam3p_eu_81di_1998_1_007628591_0	34,656	114,236	3.2963
04 Jan 2012 15:12:40	1188312	13849716	hadam3p_eu_81di_1998_1_007628591_0	23,136	75,098	3.2459
03 Jan 2012 19:35:47	1188312	13849716	hadam3p_eu_81di_1998_1_007628591_0	11,616	38,032	3.2741