climateprediction.net home page
Task 11502762

Task 11502762

Name famous_udja_1799_200_006650385_4
Workunit 6853757
Created 10 Jun 2010, 13:33:36 UTC
Sent 15 Aug 2010, 19:59:49 UTC
Report deadline 15 Nov 2010, 3:27:00 UTC
Received 19 Aug 2010, 9:11:51 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1054984
Run time 16 hours 53 min 40 sec
CPU time 14 hours 53 min 7 sec
Validate state Invalid
Credit 648.60
Device peak FLOPS 2.46 GFLOPS
Application version UK Met Office FAMOUS v6.11
i686-apple-darwin
Stderr 
<core_client_version>6.10.56</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Tue Aug 17 15:33:20 2010

  0  0x0048fdcf  PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221
  1  0x0049054a  boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474
  2  0x987671fb  0x987671fb
  3  0xffffffff  0xffffffff
  4  0x0134e6b3  0x134e6b3
  5  0x0134d44f  0x134d44f
  6  0x002eeac6  readcntl (in famous_um_6.11_i686-apple-darwin) + 2598
  7  0x003f55ea  um_setup (in famous_um_6.11_i686-apple-darwin) + 458
  8  0x00452abd  um_shell (in famous_um_6.11_i686-apple-darwin) + 11429
  9  0x004698c0  main (in famous_um_6.11_i686-apple-darwin) + 1112
 10  0x000026b6  _start (in famous_um_6.11_i686-apple-darwin) + 216
 11  0x000025dd  start (in famous_um_6.11_i686-apple-darwin) + 41

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3cc edx: 0x987010fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc408 esp: 0xbfffc3cc
   ss: 0x0000001f efl: 0x00000206 eip: 0x987010fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libirc.dylib
0x91865000 - 0x91868fff /usr/lib/system/libmathCommon.A.dylib
0x92ee5000 - 0x92ef3fff /usr/lib/libz.1.dylib
0x98700000 - 0x988a6fff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Wed Aug 18 00:17:00 2010

  0  0x0048fdcf  PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221
  1  0x0049054a  boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474
  2  0x987671fb  0x987671fb
  3  0xffffffff  0xffffffff
  4  0x0134e6b3  0x134e6b3
  5  0x0134d44f  0x134d44f
  6  0x003f5826  um_submodel_init (in famous_um_6.11_i686-apple-darwin) + 406
  7  0x00450bd8  um_shell (in famous_um_6.11_i686-apple-darwin) + 3520
  8  0x004698c0  main (in famous_um_6.11_i686-apple-darwin) + 1112
  9  0x000026b6  _start (in famous_um_6.11_i686-apple-darwin) + 216
 10  0x000025dd  start (in famous_um_6.11_i686-apple-darwin) + 41

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd45c edx: 0x987010fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd498 esp: 0xbfffd45c
   ss: 0x0000001f efl: 0x00000206 eip: 0x987010fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libirc.dylib
0x91865000 - 0x91868fff /usr/lib/system/libmathCommon.A.dylib
0x92ee5000 - 0x92ef3fff /usr/lib/libz.1.dylib
0x98700000 - 0x988a6fff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10531, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Wed Aug 18 01:19:18 2010

  0  0x0048fdcf  PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221
  1  0x0049054a  boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474
  2  0x987671fb  0x987671fb
  3  0xffffffff  0xffffffff
  4  0x0134e6b3  0x134e6b3
  5  0x0134d44f  0x134d44f
  6  0x002eeac6  readcntl (in famous_um_6.11_i686-apple-darwin) + 2598
  7  0x003f55ea  um_setup (in famous_um_6.11_i686-apple-darwin) + 458
  8  0x00452abd  um_shell (in famous_um_6.11_i686-apple-darwin) + 11429
  9  0x004698c0  main (in famous_um_6.11_i686-apple-darwin) + 1112
 10  0x000026b6  _start (in famous_um_6.11_i686-apple-darwin) + 216
 11  0x000025dd  start (in famous_um_6.11_i686-apple-darwin) + 41

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3cc edx: 0x987010fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc408 esp: 0xbfffc3cc
   ss: 0x0000001f efl: 0x00000206 eip: 0x987010fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libirc.dylib
0x91865000 - 0x91868fff /usr/lib/system/libmathCommon.A.dylib
0x92ee5000 - 0x92ef3fff /usr/lib/libz.1.dylib
0x98700000 - 0x988a6fff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11111, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Wed Aug 18 16:12:53 2010

  0  0x0048fdcf  PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221
  1  0x0049054a  boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474
  2  0x987671fb  0x987671fb
  3  0xffffffff  0xffffffff
  4  0x0134e6b3  0x134e6b3
  5  0x0134d44f  0x134d44f
  6  0x002eeac6  readcntl (in famous_um_6.11_i686-apple-darwin) + 2598
  7  0x003f55ea  um_setup (in famous_um_6.11_i686-apple-darwin) + 458
  8  0x00452abd  um_shell (in famous_um_6.11_i686-apple-darwin) + 11429
  9  0x004698c0  main (in famous_um_6.11_i686-apple-darwin) + 1112
 10  0x000026b6  _start (in famous_um_6.11_i686-apple-darwin) + 216
 11  0x000025dd  start (in famous_um_6.11_i686-apple-darwin) + 41

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3cc edx: 0x987010fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc408 esp: 0xbfffc3cc
   ss: 0x0000001f efl: 0x00000206 eip: 0x987010fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libirc.dylib
0x91865000 - 0x91868fff /usr/lib/system/libmathCommon.A.dylib
0x92ee5000 - 0x92ef3fff /usr/lib/libz.1.dylib
0x98700000 - 0x988a6fff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1817, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Wed Aug 18 17:33:19 2010

  0  0x0048fdcf  PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221
  1  0x0049054a  boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474
  2  0x987671fb  0x987671fb
  3  0xffffffff  0xffffffff
  4  0x0134e6b3  0x134e6b3
  5  0x0134d44f  0x134d44f
  6  0x002eeac6  readcntl (in famous_um_6.11_i686-apple-darwin) + 2598
  7  0x003f55ea  um_setup (in famous_um_6.11_i686-apple-darwin) + 458
  8  0x00452abd  um_shell (in famous_um_6.11_i686-apple-darwin) + 11429
  9  0x004698c0  main (in famous_um_6.11_i686-apple-darwin) + 1112
 10  0x000026b6  _start (in famous_um_6.11_i686-apple-darwin) + 216
 11  0x000025dd  start (in famous_um_6.11_i686-apple-darwin) + 41

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3cc edx: 0x987010fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc408 esp: 0xbfffc3cc
   ss: 0x0000001f efl: 0x00000206 eip: 0x987010fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libirc.dylib
0x91865000 - 0x91868fff /usr/lib/system/libmathCommon.A.dylib
0x92ee5000 - 0x92ef3fff /usr/lib/libz.1.dylib
0x98700000 - 0x988a6fff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2979, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Wed Aug 18 17:39:40 2010

  0  0x0048fdcf  PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221
  1  0x0049054a  boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474
  2  0x987671fb  0x987671fb
  3  0xffffffff  0xffffffff
  4  0x0134e6b3  0x134e6b3
  5  0x0134d44f  0x134d44f
  6  0x002eeac6  readcntl (in famous_um_6.11_i686-apple-darwin) + 2598
  7  0x003f55ea  um_setup (in famous_um_6.11_i686-apple-darwin) + 458
  8  0x00452abd  um_shell (in famous_um_6.11_i686-apple-darwin) + 11429
  9  0x004698c0  main (in famous_um_6.11_i686-apple-darwin) + 1112
 10  0x000026b6  _start (in famous_um_6.11_i686-apple-darwin) + 216
 11  0x000025dd  start (in famous_um_6.11_i686-apple-darwin) + 41

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3cc edx: 0x987010fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc408 esp: 0xbfffc3cc
   ss: 0x0000001f efl: 0x00000206 eip: 0x987010fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_udja_1799_200_006650385/lib/libirc.dylib
0x91865000 - 0x91868fff /usr/lib/system/libmathCommon.A.dylib
0x92ee5000 - 0x92ef3fff /usr/lib/libz.1.dylib
0x98700000 - 0x988a6fff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3196, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
 (9576): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
19 Aug 2010 07:46:38 1054984 11502762 famous_udja_1799_200_006650385_4 196,586 51,183 0.2604
19 Aug 2010 06:15:12 1054984 11502762 famous_udja_1799_200_006650385_4 187,226 48,749 0.2604
19 Aug 2010 05:36:48 1054984 11502762 famous_udja_1799_200_006650385_4 177,866 46,314 0.2604
19 Aug 2010 03:10:52 1054984 11502762 famous_udja_1799_200_006650385_4 168,506 43,880 0.2604
19 Aug 2010 01:29:48 1054984 11502762 famous_udja_1799_200_006650385_4 159,146 41,446 0.2604
18 Aug 2010 20:23:37 1054984 11502762 famous_udja_1799_200_006650385_4 149,786 39,009 0.2604
18 Aug 2010 18:50:29 1054984 11502762 famous_udja_1799_200_006650385_4 140,426 36,571 0.2604
18 Aug 2010 17:20:24 1054984 11502762 famous_udja_1799_200_006650385_4 131,066 34,129 0.2604
18 Aug 2010 15:44:41 1054984 11502762 famous_udja_1799_200_006650385_4 121,706 31,689 0.2604
18 Aug 2010 14:16:10 1054984 11502762 famous_udja_1799_200_006650385_4 112,346 29,246 0.2603
18 Aug 2010 12:41:31 1054984 11502762 famous_udja_1799_200_006650385_4 102,986 26,801 0.2602
18 Aug 2010 11:05:48 1054984 11502762 famous_udja_1799_200_006650385_4 93,626 24,361 0.2602
18 Aug 2010 09:31:16 1054984 11502762 famous_udja_1799_200_006650385_4 84,266 21,923 0.2602
18 Aug 2010 08:00:22 1054984 11502762 famous_udja_1799_200_006650385_4 74,906 19,483 0.2601
18 Aug 2010 06:29:05 1054984 11502762 famous_udja_1799_200_006650385_4 65,546 17,042 0.2600
18 Aug 2010 05:33:58 1054984 11502762 famous_udja_1799_200_006650385_4 56,186 14,602 0.2599
18 Aug 2010 04:26:36 1054984 11502762 famous_udja_1799_200_006650385_4 46,826 12,162 0.2597
18 Aug 2010 02:55:40 1054984 11502762 famous_udja_1799_200_006650385_4 37,466 9,713 0.2592
18 Aug 2010 00:15:23 1054984 11502762 famous_udja_1799_200_006650385_4 28,106 7,271 0.2587
17 Aug 2010 19:04:29 1054984 11502762 famous_udja_1799_200_006650385_4 18,746 4,840 0.2582


©2024 climateprediction.net