climateprediction.net home page
Task 11934449

Task 11934449

Name famous_vpjk_1199_200_006736663_0
Workunit 6940003
Created 10 Oct 2010, 10:49:10 UTC
Sent 10 Oct 2010, 22:10:35 UTC
Report deadline 10 Jan 2011, 5:37:46 UTC
Received 12 Nov 2010, 12:21:37 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1059262
Run time 1 days 4 hours 26 min 3 sec
CPU time 21 hours 23 min 42 sec
Validate state Invalid
Credit 1,636.81
Device peak FLOPS 3.42 GFLOPS
Application version UK Met Office FAMOUS v6.11
i686-apple-darwin
Stderr
<core_client_version>6.10.36</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
itor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Fri Nov  5 12:39:00 2010

  0  0x0048fdcf  PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221
  1  0x0049054a  boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474
  2  0x90b4c1fb  0x90b4c1fb
  3  0xffffffff  0xffffffff
  4  0x0134e6b3  0x134e6b3
  5  0x0134d44f  0x134d44f
  6  0x002eeac6  readcntl (in famous_um_6.11_i686-apple-darwin) + 2598
  7  0x003f55ea  um_setup (in famous_um_6.11_i686-apple-darwin) + 458
  8  0x00452abd  um_shell (in famous_um_6.11_i686-apple-darwin) + 11429
  9  0x004698c0  main (in famous_um_6.11_i686-apple-darwin) + 1112
 10  0x000026b6  _start (in famous_um_6.11_i686-apple-darwin) + 216
 11  0x000025dd  start (in famous_um_6.11_i686-apple-darwin) + 41

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc34c edx: 0x90ae60fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc388 esp: 0xbfffc34c
   ss: 0x0000001f efl: 0x00000206 eip: 0x90ae60fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libirc.dylib
0x90ae5000 - 0x90c8bfff /usr/lib/libSystem.B.dylib
0x90ffb000 - 0x90ffefff /usr/lib/system/libmathCommon.A.dylib
0x97cda000 - 0x97ce8fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3544, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001211c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001211c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001211c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001211c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001211c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001211c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001212c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001212c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001212c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001212c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001212c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001212c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001213c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001213c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001213c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001213c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001213c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001213c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001214c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001214c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001214c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001214c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001214c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001214c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001215c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001215c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001215c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001215c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001215c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001215c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Sun Nov  7 20:48:04 2010

  0  0x0048fdcf  PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221
  1  0x0049054a  boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474
  2  0x90b4c1fb  0x90b4c1fb
  3  0xffffffff  0xffffffff
  4  0x0134e6b3  0x134e6b3
  5  0x0134d44f  0x134d44f
  6  0x002eeac6  readcntl (in famous_um_6.11_i686-apple-darwin) + 2598
  7  0x003f55ea  um_setup (in famous_um_6.11_i686-apple-darwin) + 458
  8  0x00452abd  um_shell (in famous_um_6.11_i686-apple-darwin) + 11429
  9  0x004698c0  main (in famous_um_6.11_i686-apple-darwin) + 1112
 10  0x000026b6  _start (in famous_um_6.11_i686-apple-darwin) + 216
 11  0x000025dd  start (in famous_um_6.11_i686-apple-darwin) + 41

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc34c edx: 0x90ae60fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc388 esp: 0xbfffc34c
   ss: 0x0000001f efl: 0x00000206 eip: 0x90ae60fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libirc.dylib
0x90ae5000 - 0x90c8bfff /usr/lib/libSystem.B.dylib
0x90ffb000 - 0x90ffefff /usr/lib/system/libmathCommon.A.dylib
0x97cda000 - 0x97ce8fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=563, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001216c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001216c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001216c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001216c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001216c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001216c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001217c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001217c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001217c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001217c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001217c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001217c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001218c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001218c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001218c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001218c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001218c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001218c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001219c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001219c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001219c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001219c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001219c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001219c1+
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001220c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001220c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001220c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001220c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001220c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001220c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001221c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001221c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001221c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001221c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001221c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001221c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Tue Nov  9 23:01:40 2010

  0  0x0048fdcf  PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221
  1  0x0049054a  boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474
  2  0x90b4c1fb  0x90b4c1fb
  3  0xffffffff  0xffffffff
  4  0x0134e6b3  0x134e6b3
  5  0x0134d44f  0x134d44f
  6  0x002eeac6  readcntl (in famous_um_6.11_i686-apple-darwin) + 2598
  7  0x003f55ea  um_setup (in famous_um_6.11_i686-apple-darwin) + 458
  8  0x00452abd  um_shell (in famous_um_6.11_i686-apple-darwin) + 11429
  9  0x004698c0  main (in famous_um_6.11_i686-apple-darwin) + 1112
 10  0x000026b6  _start (in famous_um_6.11_i686-apple-darwin) + 216
 11  0x000025dd  start (in famous_um_6.11_i686-apple-darwin) + 41

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc34c edx: 0x90ae60fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc388 esp: 0xbfffc34c
   ss: 0x0000001f efl: 0x00000206 eip: 0x90ae60fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libirc.dylib
0x90ae5000 - 0x90c8bfff /usr/lib/libSystem.B.dylib
0x90ffb000 - 0x90ffefff /usr/lib/system/libmathCommon.A.dylib
0x97cda000 - 0x97ce8fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1959, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Tue Nov  9 23:01:42 2010

  0  0x0048fdcf  PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221
  1  0x0049054a  boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474
  2  0x90b4c1fb  0x90b4c1fb
  3  0xffffffff  0xffffffff
  4  0x0134e6b3  0x134e6b3
  5  0x0134d44f  0x134d44f
  6  0x002eeac6  readcntl (in famous_um_6.11_i686-apple-darwin) + 2598
  7  0x003f55ea  um_setup (in famous_um_6.11_i686-apple-darwin) + 458
  8  0x00452abd  um_shell (in famous_um_6.11_i686-apple-darwin) + 11429
  9  0x004698c0  main (in famous_um_6.11_i686-apple-darwin) + 1112
 10  0x000026b6  _start (in famous_um_6.11_i686-apple-darwin) + 216
 11  0x000025dd  start (in famous_um_6.11_i686-apple-darwin) + 41

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc34c edx: 0x90ae60fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc388 esp: 0xbfffc34c
   ss: 0x0000001f efl: 0x00000206 eip: 0x90ae60fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libirc.dylib
0x90ae5000 - 0x90c8bfff /usr/lib/libSystem.B.dylib
0x90ffb000 - 0x90ffefff /usr/lib/system/libmathCommon.A.dylib
0x97cda000 - 0x97ce8fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1959, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Tue Nov  9 23:30:34 2010

  0  0x0048fdcf  PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221
  1  0x0049054a  boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474
  2  0x90b4c1fb  0x90b4c1fb
  3  0xffffffff  0xffffffff
  4  0x0134e6b3  0x134e6b3
  5  0x0134d44f  0x134d44f
  6  0x002eeac6  readcntl (in famous_um_6.11_i686-apple-darwin) + 2598
  7  0x003f55ea  um_setup (in famous_um_6.11_i686-apple-darwin) + 458
  8  0x00452abd  um_shell (in famous_um_6.11_i686-apple-darwin) + 11429
  9  0x004698c0  main (in famous_um_6.11_i686-apple-darwin) + 1112
 10  0x000026b6  _start (in famous_um_6.11_i686-apple-darwin) + 216
 11  0x000025dd  start (in famous_um_6.11_i686-apple-darwin) + 41

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc34c edx: 0x90ae60fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc388 esp: 0xbfffc34c
   ss: 0x0000001f efl: 0x00000206 eip: 0x90ae60fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libirc.dylib
0x90ae5000 - 0x90c8bfff /usr/lib/libSystem.B.dylib
0x90ffb000 - 0x90ffefff /usr/lib/system/libmathCommon.A.dylib
0x97cda000 - 0x97ce8fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2523, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001222c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001222c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001222c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001222c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001222c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001222c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001223c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001223c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001223c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001223c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001223c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001223c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001224c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001224c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001224c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001224c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001224c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001224c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001225c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001225c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001225c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001225c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001225c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001225c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001226c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001226c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001226c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001226c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001226c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001226c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001227c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001227c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001227c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001227c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001227c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001227c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001228c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001228c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001228c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001228c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001228c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001228c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001229c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001229c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001229c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001229c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001229c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001229c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Wed Nov 10 23:20:07 2010

  0  0x0048fdcf  PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221
  1  0x0049054a  boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474
  2  0x90b4c1fb  0x90b4c1fb
  3  0xffffffff  0xffffffff
  4  0x0134e6b3  0x134e6b3
  5  0x0134d44f  0x134d44f
  6  0x002eeac6  readcntl (in famous_um_6.11_i686-apple-darwin) + 2598
  7  0x003f55ea  um_setup (in famous_um_6.11_i686-apple-darwin) + 458
  8  0x00452abd  um_shell (in famous_um_6.11_i686-apple-darwin) + 11429
  9  0x004698c0  main (in famous_um_6.11_i686-apple-darwin) + 1112
 10  0x000026b6  _start (in famous_um_6.11_i686-apple-darwin) + 216
 11  0x000025dd  start (in famous_um_6.11_i686-apple-darwin) + 41

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc34c edx: 0x90ae60fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc388 esp: 0xbfffc34c
   ss: 0x0000001f efl: 0x00000206 eip: 0x90ae60fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/lib/libirc.dylib
0x90ae5000 - 0x90c8bfff /usr/lib/libSystem.B.dylib
0x90ffb000 - 0x90ffefff /usr/lib/system/libmathCommon.A.dylib
0x97cda000 - 0x97ce8fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2052, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001230c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001230c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001230c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001230c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001230c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001230c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001231c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001231c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001231c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001231c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001231c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001231c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001232c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001232c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001232c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001232c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001232c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001232c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001233c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001233c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001233c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001233c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001233c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001233c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001234c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001234c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001234c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001234c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001234c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001234c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001235c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001235c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001235c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001235c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001235c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001235c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001236c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001236c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001236c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001236c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001236c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001236c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001237c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001237c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001237c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001237c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001237c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001237c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001238c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001238c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001238c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001238c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001238c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001238c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001239c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001239c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001239c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001239c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001239c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001239c1+
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001240c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001240c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001240c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001240c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001240c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001240c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001241c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001241c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001241c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001241c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001241c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001241c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001242c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001242c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001242c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001242c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001242c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001242c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001243c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001243c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001243c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001243c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001243c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001243c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001244c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001244c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001244c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001244c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001244c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001244c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001245c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001245c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001245c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001245c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001245c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001245c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001246c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001246c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001246c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001246c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001246c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001246c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001247c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001247c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001247c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001247c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001247c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001247c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001248c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001248c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001248c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001248c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001248c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001248c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001249c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001249c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001249c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001249c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001249c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001249c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001250c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001250c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001250c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001250c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001250c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001250c1+
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001251c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001251c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001251c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001251c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001251c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001251c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001252c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pa000001252c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001252c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjkla#pb000001252c1+
file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001252c1+ does not exist
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vpjk_1199_200_006736663/dataout/vpjklo#pi000001252c1+

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
 (317): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
12 Nov 2010 12:03:15 1059262 11934449 famous_vpjk_1199_200_006736663_0 496,106 75,906 0.1530
12 Nov 2010 11:42:02 1059262 11934449 famous_vpjk_1199_200_006736663_0 486,746 74,552 0.1532
11 Nov 2010 07:32:14 1059262 11934449 famous_vpjk_1199_200_006736663_0 477,386 73,195 0.1533
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 468,026 71,840 0.1535
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 458,666 70,488 0.1537
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 449,306 69,137 0.1539
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 439,946 67,785 0.1541
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 430,586 66,434 0.1543
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 421,226 65,082 0.1545
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 411,866 63,731 0.1547
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 402,506 62,377 0.1550
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 393,146 61,024 0.1552
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 383,786 59,674 0.1555
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 374,426 58,320 0.1558
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 365,066 56,967 0.1560
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 355,706 55,615 0.1564
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 346,346 54,261 0.1567
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 336,986 52,909 0.1570
11 Nov 2010 07:17:47 1059262 11934449 famous_vpjk_1199_200_006736663_0 327,626 51,558 0.1574
11 Nov 2010 01:00:32 1059262 11934449 famous_vpjk_1199_200_006736663_0 318,266 50,205 0.1577


©2024 cpdn.org