climateprediction.net home page
Task 10997782

Task 10997782

Name hadsm3dhet2_jnmb_006593605_5
Workunit 6796978
Created 15 Mar 2010, 11:58:58 UTC
Sent 12 Oct 2010, 17:04:56 UTC
Report deadline 24 Sep 2011, 22:24:56 UTC
Received 6 Nov 2010, 15:32:31 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 21 (0x00000015) Unknown error code
Computer ID 1064771
Run time 10 days 16 hours 36 min 50 sec
CPU time 10 days 5 hours 43 min 19 sec
Validate state Invalid
Credit 7,046.28
Device peak FLOPS 3.23 GFLOPS
Application version UK Met Office HadSM3 Slab Model v6.09
i686-apple-darwin
Stderr
<core_client_version>6.10.21</core_client_version>
<![CDATA[
<message>
process exited with code 21 (0x15, -235)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
MainError:	04:07:02 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
SIGBUS: bus error

Crashed executable name: hadsm3_um_6.09_i686-apple-darwin
built using BOINC library version 6.3.10
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Sun Oct 24 08:12:29 2010


Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbf1cf6ac edx: 0x929500fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbf1cf6e8 esp: 0xbf1cf6ac
   ss: 0x0000001f efl: 0x00000206 eip: 0x929500fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x2e4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3_um_6.09_i686-apple-darwin
  0x835000 -   0x907fff /Library/Application Support/BOINC Data/projects/climateprediction.net/libifcoremt.dylib
  0x932000 -   0xa8afff /Library/Application Support/BOINC Data/projects/climateprediction.net/libimf.dylib
  0xb9b000 -   0xbc8fff /Library/Application Support/BOINC Data/projects/climateprediction.net/libirc.dylib
  0xbda000 -   0xc1dfff /Library/Application Support/BOINC Data/projects/climateprediction.net/libsvml.dylib
  0xcca000 -   0xcf7fff /Library/Application Support/BOINC Data/projects/climateprediction.net/libintlc.dylib
0x90074000 - 0x900defff /usr/lib/libstdc++.6.dylib
0x9294f000 - 0x92af5fff /usr/lib/libSystem.B.dylib
0x9463f000 - 0x94642fff /usr/lib/system/libmathCommon.A.dylib
0x98f01000 - 0x98f0ffff /usr/lib/libz.1.dylib


Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=39011, iMonCtr=1
Model crash detected, will try to restart...
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
MainError:	08:51:47 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: hadsm3_um_6.09_i686-apple-darwin
built using BOINC library version 6.3.10
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Thu Nov  4 19:12:55 2010


Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbf1e84ec edx: 0x929500fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbf1e8528 esp: 0xbf1e84ec
   ss: 0x0000001f efl: 0x00000206 eip: 0x929500fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x2e4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3_um_6.09_i686-apple-darwin
  0x835000 -   0x907fff /Library/Application Support/BOINC Data/projects/climateprediction.net/libifcoremt.dylib
  0x932000 -   0xa8afff /Library/Application Support/BOINC Data/projects/climateprediction.net/libimf.dylib
  0xb9b000 -   0xbc8fff /Library/Application Support/BOINC Data/projects/climateprediction.net/libirc.dylib
  0xbda000 -   0xc1dfff /Library/Application Support/BOINC Data/projects/climateprediction.net/libsvml.dylib
  0xcca000 -   0xcf7fff /Library/Application Support/BOINC Data/projects/climateprediction.net/libintlc.dylib
0x90074000 - 0x900defff /usr/lib/libstdc++.6.dylib
0x9294f000 - 0x92af5fff /usr/lib/libSystem.B.dylib
0x9463f000 - 0x94642fff /usr/lib/system/libmathCommon.A.dylib
0x98f01000 - 0x98f0ffff /usr/lib/libz.1.dylib


Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=93498, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Post-processing failed! :-(
called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 Nov 2010 08:31:15 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 248,446 872,142 1.1372
06 Nov 2010 04:51:17 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 237,644 859,814 1.1371
05 Nov 2010 23:34:09 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 226,842 847,362 1.1369
05 Nov 2010 14:09:36 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 216,040 834,530 1.1361
05 Nov 2010 07:44:03 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 205,238 822,571 1.1366
05 Nov 2010 04:42:32 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 194,436 810,331 1.1366
04 Nov 2010 22:32:31 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 183,634 797,760 1.1362
04 Nov 2010 16:27:41 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 172,832 785,482 1.1362
04 Nov 2010 12:02:49 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 162,030 773,160 1.1361
04 Nov 2010 05:53:22 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 151,228 760,532 1.1356
04 Nov 2010 00:12:44 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 140,426 747,612 1.1346
03 Nov 2010 14:25:24 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 129,624 734,899 1.1339
03 Nov 2010 06:41:05 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 118,822 721,669 1.1324
03 Nov 2010 05:37:15 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 108,020 708,015 1.1301
02 Nov 2010 13:07:38 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 97,218 695,008 1.1288
02 Nov 2010 06:01:20 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 86,416 681,822 1.1271
02 Nov 2010 00:10:25 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 75,614 668,735 1.1256
01 Nov 2010 12:23:53 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 64,812 655,697 1.1241
01 Nov 2010 06:41:49 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 54,010 643,096 1.1233
01 Nov 2010 03:59:57 1064771 10997782 hadsm3dhet2_jnmb_006593605_5 43,208 630,566 1.1226


©2024 cpdn.org