climateprediction.net home page
Task 15594218

Task 15594218

Name hadcm3n_4be4_1940_40_008307637_0
Workunit 8458772
Created 7 Feb 2013, 14:25:52 UTC
Sent 7 Feb 2013, 14:28:10 UTC
Report deadline 9 May 2013, 21:55:21 UTC
Received 28 Feb 2013, 21:33:46 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1054907
Run time 10 days 23 hours 13 min 42 sec
CPU time 9 days 20 hours 30 min 36 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.99 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.0.25</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
14:10:39 (9774): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
14:43:18 (10409): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:43:19 (10409): No heartbeat from core client for 30 sec - exiting
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
18:25:38 (50127): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
19:56:23 (72796): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
20:46:39 (73190): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:46:40 (73190): No heartbeat from core client for 30 sec - exiting
20:46:41 (73190): No heartbeat from core client for 30 sec - exiting
20:46:42 (73190): No heartbeat from core client for 30 sec - exiting
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
20:51:39 (74064): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
22:16:52 (74141): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
19:36:44 (34817): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:36:46 (34817): No heartbeat from core client for 30 sec - exiting
19:36:47 (34817): No heartbeat from core client for 30 sec - exiting
19:36:48 (34817): No heartbeat from core client for 30 sec - exiting
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/9/../../switcher/switcher) is setuid or setgid
hadcm3n_6.07_i686-apple-darwin(90151,0xac1f8a28) malloc: *** error for object 0x70d3a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(90151,0xac1f8a28) malloc: *** error for object 0x68cc404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(90151,0xac1f8a28) malloc: *** error for object 0x68cc400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(90151,0xac1f8a28) malloc: *** error for object 0x68cc404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.8.2 build 12C60
Thu Feb 28 15:13:56 2013

dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
Thread 0 Crashed:

Thread 1:

dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section
atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386.
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa88 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -    0x93fff /Library/Application Support/BOINC Data/slots/9/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin
0x913d0000 - 0x913d3fff /usr/lib/system/libcompiler_rt.dylib
0x916fa000 - 0x917b7fff /usr/lib/system/libsystem_c.dylib
0x91ce6000 - 0x91cedfff /usr/lib/system/libsystem_dnssd.dylib
0x91e26000 - 0x91e28fff /usr/lib/system/libdyld.dylib
0x91e29000 - 0x91e33fff /usr/lib/system/libsystem_notify.dylib
0x91f05000 - 0x91f0cfff /usr/lib/system/liblaunch.dylib
0x92e62000 - 0x92e66fff /usr/lib/system/libmacho.dylib
0x92e67000 - 0x92e68fff /usr/lib/system/libunc.dylib
0x92fe0000 - 0x9300dfff /usr/lib/system/libsystem_m.dylib
0x938df000 - 0x938edfff /usr/lib/system/libsystem_network.dylib
0x93e9d000 - 0x93e9efff /usr/lib/system/libdnsinfo.dylib
0x94875000 - 0x948c1fff /usr/lib/system/libcorecrypto.dylib
0x949d8000 - 0x949e0fff /usr/lib/system/libcopyfile.dylib
0x94b19000 - 0x94b19fff /usr/lib/system/libsystem_blocks.dylib
0x94b37000 - 0x94b9bfff /usr/lib/libstdc++.6.dylib
0x94ff5000 - 0x94ff5fff /usr/lib/libSystem.B.dylib
0x95bb7000 - 0x95bd4fff /usr/lib/system/libxpc.dylib
0x9600e000 - 0x96015fff /usr/lib/system/libunwind.dylib
0x960c2000 - 0x960c3fff /usr/lib/system/libquarantine.dylib
0x96675000 - 0x96676fff /usr/lib/system/libsystem_sandbox.dylib
0x96677000 - 0x966a3fff /usr/lib/system/libsystem_info.dylib
0x9687b000 - 0x96886fff /usr/lib/system/libcommonCrypto.dylib
0x98123000 - 0x98124fff /usr/lib/system/libremovefile.dylib
0x9856c000 - 0x98586fff /usr/lib/system/libsystem_kernel.dylib
0x98f2e000 - 0x98f2efff /usr/lib/system/libkeymgr.dylib
0x9995a000 - 0x9997cfff /usr/lib/libc++abi.dylib
0x9a11d000 - 0x9a12ffff /usr/lib/system/libdispatch.dylib
0x9a657000 - 0x9a65bfff /usr/lib/system/libcache.dylib
0x9a68e000 - 0x9a69cfff /usr/lib/libz.1.dylib


Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
28 Feb 2013 21:34:11 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 518,400 851,431 1.6424
28 Feb 2013 10:08:05 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 492,480 811,587 1.6480
27 Feb 2013 09:42:01 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 466,560 769,792 1.6499
26 Feb 2013 20:22:06 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 440,640 727,126 1.6502
20 Feb 2013 20:51:08 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 414,720 685,285 1.6524
20 Feb 2013 07:57:56 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 388,800 644,608 1.6579
19 Feb 2013 09:13:21 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 362,880 603,039 1.6618
18 Feb 2013 18:10:21 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 336,960 557,235 1.6537
17 Feb 2013 16:30:48 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 311,040 512,794 1.6486
15 Feb 2013 07:41:56 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 285,120 469,983 1.6484
14 Feb 2013 17:41:17 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 259,200 425,561 1.6418
13 Feb 2013 04:00:22 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 233,280 379,997 1.6289
12 Feb 2013 06:14:03 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 207,360 336,061 1.6207
11 Feb 2013 11:56:52 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 181,440 291,659 1.6075
11 Feb 2013 00:04:11 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 155,520 250,508 1.6108
10 Feb 2013 11:17:45 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 129,600 209,106 1.6135
09 Feb 2013 19:07:15 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 103,680 166,104 1.6021
09 Feb 2013 06:06:10 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 77,760 124,652 1.6030
08 Feb 2013 17:21:24 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 51,840 83,462 1.6100
08 Feb 2013 04:30:27 1054907 15594218 hadcm3n_4be4_1940_40_008307637_0 25,920 41,034 1.5831


©2024 cpdn.org