climateprediction.net home page
Task 11290906

Task 11290906

Name hadsm3dhet2_ka8h_006622915_6
Workunit 6826288
Created 15 Mar 2010, 12:37:02 UTC
Sent 9 Apr 2010, 11:07:05 UTC
Report deadline 22 Mar 2011, 16:27:05 UTC
Received 26 Jun 2010, 17:28:13 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 11 (0x0000000B) Unknown error code
Computer ID 1227722
Run time
CPU time 4 days 8 hours 6 min 26 sec
Validate state Invalid
Credit 2,679.57
Device peak FLOPS 0.00 GFLOPS
Application version ---
Stderr 
<core_client_version>5.10.45</core_client_version>
<![CDATA[
<message>
process got signal 11
</message>
<stderr_txt>
SIGSEGV: segmentation violation
Stack trace (14 frames):
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0xffffe400]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8496338]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x833ce23]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x833b9db]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250189]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8522c92]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x830104e]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86de635]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f77ec]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib32/libc.so.6(__libc_start_main+0xe5)[0x555f8a65]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5095, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (14 frames):
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0xffffe400]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8496338]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x833ce23]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x833b9db]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250189]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8522c92]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x830104e]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86de635]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f77ec]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib32/libc.so.6(__libc_start_main+0xe5)[0x555f8a65]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5095, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (14 frames):
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0xffffe400]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8496338]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x833ce23]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x833b9db]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250189]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8522c92]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x830104e]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86de635]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f77ec]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib32/libc.so.6(__libc_start_main+0xe5)[0x555f8a65]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5095, iMonCtr=1
Model crash detected, will try to restart...

Model crashed: Ҋ
SIGSEGV: segmentation violation
Stack trace (13 frames):
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0xffffe400]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8496338]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x833b838]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250189]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x861a10a]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x80a5d52]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c22cf]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86fd1e3]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib32/libc.so.6(__libc_start_main+0xe5)[0x555f8a65]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5095, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (14 frames):
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0xffffe400]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8496338]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x833ce23]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x833b9db]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250189]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8522c92]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x830104e]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86de635]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f77ec]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib32/libc.so.6(__libc_start_main+0xe5)[0x555f8a65]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5095, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
called boinc_finish

Model crashed: 7R
SIGSEGV: segmentation violation
Stack trace (11 frames):
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0xffffe400]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8496338]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8435fc4]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x85da7ca]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c4f30]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86fd1e3]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib32/libc.so.6(__libc_start_main+0xe5)[0x555f8a65]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5294, iMonCtr=1
Model crash detected, will try to restart...

Model crashed: Ҋ

Model crashed: 7R
SIGSEGV: segmentation violation
Stack trace (13 frames):
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0xffffe400]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8496338]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x833b838]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250189]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x8522c92]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x830104e]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86de635]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f77ec]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib32/libc.so.6(__libc_start_main+0xe5)[0x555f8a65]
/home/desti/BOINC/BOINC/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5294, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=5342, selfPID=5342, iMonCtr=1
CPDN process is not running, exiting, bRetVal = 1, checkPID=4998, selfPID=4998, iMonCtr=1

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 
CPDN Monitor - Quit request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
MainError:	10:43:22 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
26 Jun 2010 11:52:49 850129 11290906 hadsm3dhet2_ka8h_006622915_6 32,406 362,447 1.2427
26 Jun 2010 06:48:20 850129 11290906 hadsm3dhet2_ka8h_006622915_6 21,604 348,936 1.2424
26 Jun 2010 02:49:09 850129 11290906 hadsm3dhet2_ka8h_006622915_6 10,802 335,392 1.2420
25 Jun 2010 22:48:21 850129 11290906 hadsm3dhet2_ka8h_006622915_6 259,248 322,019 1.2421
25 Jun 2010 18:11:17 850129 11290906 hadsm3dhet2_ka8h_006622915_6 248,446 307,975 1.2396
25 Jun 2010 13:51:10 850129 11290906 hadsm3dhet2_ka8h_006622915_6 237,644 294,498 1.2392
25 Jun 2010 09:23:58 850129 11290906 hadsm3dhet2_ka8h_006622915_6 226,842 280,974 1.2386
25 Jun 2010 06:45:01 850129 11290906 hadsm3dhet2_ka8h_006622915_6 216,040 267,486 1.2381
25 Jun 2010 01:04:56 850129 11290906 hadsm3dhet2_ka8h_006622915_6 205,238 254,024 1.2377
24 Jun 2010 20:39:43 850129 11290906 hadsm3dhet2_ka8h_006622915_6 194,436 240,464 1.2367
24 Jun 2010 15:59:26 850129 11290906 hadsm3dhet2_ka8h_006622915_6 183,634 227,077 1.2366
24 Jun 2010 11:46:19 850129 11290906 hadsm3dhet2_ka8h_006622915_6 172,832 213,731 1.2366
24 Jun 2010 07:48:15 850129 11290906 hadsm3dhet2_ka8h_006622915_6 162,030 200,209 1.2356
24 Jun 2010 04:01:39 850129 11290906 hadsm3dhet2_ka8h_006622915_6 151,228 187,022 1.2367
24 Jun 2010 00:07:59 850129 11290906 hadsm3dhet2_ka8h_006622915_6 140,426 173,498 1.2355
23 Jun 2010 19:05:55 850129 11290906 hadsm3dhet2_ka8h_006622915_6 129,624 160,084 1.2350
23 Jun 2010 14:54:48 850129 11290906 hadsm3dhet2_ka8h_006622915_6 118,822 146,610 1.2339
23 Jun 2010 10:49:22 850129 11290906 hadsm3dhet2_ka8h_006622915_6 108,020 133,078 1.2320
23 Jun 2010 06:55:20 850129 11290906 hadsm3dhet2_ka8h_006622915_6 97,218 119,576 1.2300
23 Jun 2010 03:00:25 850129 11290906 hadsm3dhet2_ka8h_006622915_6 86,416 106,101 1.2278


©2024 cpdn.org