Task 10957329

Name	hadsm3dhet2_jkhy_006589560_3
Workunit	6792933
Created	15 Mar 2010, 11:52:10 UTC
Sent	23 Oct 2010, 14:43:31 UTC
Report deadline	5 Oct 2011, 20:03:31 UTC
Received	13 Nov 2010, 15:01:18 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1097308
Run time	9 days 9 hours 48 min 46 sec
CPU time	9 days 2 hours 28 min
Validate state	Workunit error - check skipped
Credit	7,145.52
Device peak FLOPS	1.63 GFLOPS
Application version	UK Met Office HadSM3 Slab Model v6.08 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. MainError: 04:13:19 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=8389, selfPID=8389, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: 7R CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. MainError: 02:35:27 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (19 frames): /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b] /lib/libpthread.so.0(+0xead8)[0x40054ad8] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x87c03d8] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86238f0] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x85f94e6] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8640c54] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x862bfd1] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x83e7879] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x850d2fd] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8249fa7] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x85f336b] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x84b44e6] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b273e] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f] /lib/libc.so.6(__libc_start_main+0xe7)[0x40076ce7] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=18888, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (19 frames): /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b] /lib/libpthread.so.0(+0xead8)[0x40054ad8] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x87c03d8] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86238f0] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x85f94e6] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86413f2] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x862bfd1] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x83e7879] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x850d2fd] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8249fa7] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x85f336b] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x84b44e6] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b273e] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f] /lib/libc.so.6(__libc_start_main+0xe7)[0x40076ce7] /home/phaidros/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=22240, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. MainError: 02:02:23 PM No files match the supplied pattern. called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Nov 2010 14:05:41	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	259,248	786,480	1.0112
13 Nov 2010 10:34:23	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	248,446	775,780	1.0115
13 Nov 2010 07:12:49	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	237,644	765,253	1.0121
13 Nov 2010 06:37:03	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	226,842	754,797	1.0127
12 Nov 2010 23:24:29	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	216,040	744,513	1.0136
12 Nov 2010 20:03:48	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	205,238	733,987	1.0142
12 Nov 2010 16:51:28	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	194,436	723,949	1.0155
12 Nov 2010 13:44:58	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	183,634	714,102	1.0171
12 Nov 2010 10:37:14	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	172,832	704,230	1.0187
12 Nov 2010 09:33:09	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	162,030	693,616	1.0192
12 Nov 2010 09:33:09	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	151,228	683,094	1.0200
12 Nov 2010 00:44:17	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	140,426	672,964	1.0213
11 Nov 2010 21:28:51	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	129,624	662,878	1.0228
11 Nov 2010 18:17:05	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	118,822	652,840	1.0244
11 Nov 2010 14:55:13	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	108,020	642,163	1.0250
11 Nov 2010 11:38:19	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	97,218	631,624	1.0258
11 Nov 2010 08:20:27	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	86,416	621,171	1.0269
11 Nov 2010 06:59:46	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	75,614	610,662	1.0279
11 Nov 2010 06:59:46	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	64,812	601,928	1.0319
10 Nov 2010 22:35:03	1097308	10957329	hadsm3dhet2_jkhy_006589560_3	54,010	591,148	1.0326