climateprediction.net home page
Task 11934676

Task 11934676

Name famous_voih_799_200_006736882_0
Workunit 6940222
Created 10 Oct 2010, 11:16:58 UTC
Sent 10 Oct 2010, 18:05:55 UTC
Report deadline 10 Jan 2011, 1:33:06 UTC
Received 9 Nov 2010, 19:43:22 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 11 (0x0000000B) Unknown error code
Computer ID 1059220
Run time 2 days 12 hours 15 min 28 sec
CPU time 1 days 22 hours 24 min 48 sec
Validate state Invalid
Credit 772.13
Device peak FLOPS 1.44 GFLOPS
Application version UK Met Office FAMOUS v6.11
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process got signal 11
</message>
<stderr_txt>

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  
SIGSEGV: segmentation violation
Stack trace (14 frames):
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400]
[0x444400]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x825a02d]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x808e223]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x80882b1]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8263f78]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81f3f37]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81eeea2]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x831bcec]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832da0f]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x876bd6]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11354, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (17 frames):
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400]
[0x479400]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81a151a]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81a7199]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x82c6758]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x825b165]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x808e223]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x80882b1]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8263f78]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81f3f37]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81eeea2]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x831bcec]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832da0f]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x126bd6]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3545, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400]
[0x691400]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x80601fb]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x82f2d5f]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8056ce0]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x806c39c]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x830cfc3]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x6dcbd6]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1824, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400]
[0xe30400]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81a09b6]

Exiting...
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
 (2057): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
 (2091): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Nov 2010 21:43:33 1059220 11934676 famous_voih_799_200_006736882_0 234,026 165,744 0.7082
07 Nov 2010 00:46:36 1059220 11934676 famous_voih_799_200_006736882_0 224,666 159,178 0.7085
06 Nov 2010 21:37:24 1059220 11934676 famous_voih_799_200_006736882_0 215,306 152,481 0.7082
05 Nov 2010 22:42:42 1059220 11934676 famous_voih_799_200_006736882_0 205,946 145,912 0.7085
05 Nov 2010 20:15:36 1059220 11934676 famous_voih_799_200_006736882_0 196,586 139,328 0.7087
04 Nov 2010 19:59:07 1059220 11934676 famous_voih_799_200_006736882_0 187,226 132,963 0.7102
03 Nov 2010 00:03:15 1059220 11934676 famous_voih_799_200_006736882_0 177,866 126,425 0.7108
02 Nov 2010 21:12:55 1059220 11934676 famous_voih_799_200_006736882_0 168,506 119,818 0.7111
01 Nov 2010 20:30:37 1059220 11934676 famous_voih_799_200_006736882_0 159,146 113,237 0.7115
31 Oct 2010 21:58:52 1059220 11934676 famous_voih_799_200_006736882_0 149,786 106,670 0.7121
31 Oct 2010 19:45:48 1059220 11934676 famous_voih_799_200_006736882_0 140,426 100,121 0.7130
31 Oct 2010 17:16:10 1059220 11934676 famous_voih_799_200_006736882_0 131,066 93,426 0.7128
30 Oct 2010 20:27:21 1059220 11934676 famous_voih_799_200_006736882_0 121,706 86,827 0.7134
30 Oct 2010 15:09:42 1059220 11934676 famous_voih_799_200_006736882_0 112,346 80,283 0.7146
29 Oct 2010 20:35:37 1059220 11934676 famous_voih_799_200_006736882_0 102,986 73,764 0.7163
29 Oct 2010 07:04:44 1059220 11934676 famous_voih_799_200_006736882_0 93,626 67,252 0.7183
28 Oct 2010 17:02:23 1059220 11934676 famous_voih_799_200_006736882_0 84,266 60,468 0.7176
28 Oct 2010 13:51:01 1059220 11934676 famous_voih_799_200_006736882_0 74,906 53,638 0.7161
28 Oct 2010 10:57:52 1059220 11934676 famous_voih_799_200_006736882_0 65,546 46,947 0.7162
27 Oct 2010 21:04:29 1059220 11934676 famous_voih_799_200_006736882_0 56,186 39,888 0.7099


©2024 climateprediction.net