climateprediction.net home page
Task 15673796

Task 15673796

Name hadcm3n_4f5v_1940_40_008302598_3
Workunit 8453733
Created 20 Mar 2013, 11:12:22 UTC
Sent 20 Mar 2013, 11:12:36 UTC
Report deadline 19 Jun 2013, 18:39:47 UTC
Received 17 Jun 2013, 2:12:08 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1272612
Run time 11 days 0 hours 9 min 6 sec
CPU time 9 days 2 hours 25 min 46 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 3.87 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>7.0.65</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
22:45:24 (99817): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
hadcm3n_6.07_i686-apple-darwin(1115,0xac079a28) malloc: *** error for object 0x2191c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1115,0xac079a28) malloc: *** error for object 0x2191c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1115,0xac079a28) malloc: *** error for object 0x3975e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1115,0xac079a28) malloc: *** error for object 0x3991404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1115,0xac079a28) malloc: *** error for object 0x3991400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.8.3 build 12D78
Fri May 31 01:32:29 2013

dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
hadcm3n_6.07_i686-apple-darwin(3418,0xac079a28) malloc: *** error for object 0x1218c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
hadcm3n_6.07_i686-apple-darwin(1141,0xac079a28) malloc: *** error for object 0x31e5e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1141,0xac079a28) malloc: *** error for object 0x21eee04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1141,0xac079a28) malloc: *** error for object 0x1202e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1141,0xac079a28) malloc: *** error for object 0x49e5e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1141,0xac079a28) malloc: *** error for object 0x29ede04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
19:10:37 (1141): No heartbeat from core client for 30 sec - exiting
19:10:38 (1141): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(1141,0xac079a28) malloc: *** error for object 0x9cc400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
19:10:39 (1141): No heartbeat from core client for 30 sec - exiting
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x28dea04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x28dea04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x8e2604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x38d9a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x18dea04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x18dea00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x28b7204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x28b7200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x48b7204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x48b7200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x48d5a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x48d5a00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x28b8004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x28b8000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x28b8004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x28b8000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1822,0xacc6fa28) malloc: *** error for object 0x28b8004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.8.4 build 12E55
Sun Jun 16 19:11:00 2013

dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid
Thread 0 Crashed:

Thread 1:

dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section
atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386.
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd98 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -    0x93fff /Library/Application Support/BOINC Data/slots/0/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin
0x90d8e000 - 0x90dbbfff /usr/lib/system/libsystem_m.dylib
0x90dca000 - 0x90dcbfff /usr/lib/system/libquarantine.dylib
0x90dcd000 - 0x90dcffff /usr/lib/system/libdyld.dylib
0x91cb3000 - 0x91cb4fff /usr/lib/system/libsystem_sandbox.dylib
0x920ae000 - 0x920fafff /usr/lib/system/libcorecrypto.dylib
0x93483000 - 0x93483fff /usr/lib/system/libsystem_blocks.dylib
0x941f1000 - 0x94255fff /usr/lib/libstdc++.6.dylib
0x94b9d000 - 0x94b9dfff /usr/lib/system/libkeymgr.dylib
0x95f78000 - 0x95f95fff /usr/lib/system/libxpc.dylib
0x95fca000 - 0x95fdcfff /usr/lib/system/libdispatch.dylib
0x964e4000 - 0x964ebfff /usr/lib/system/liblaunch.dylib
0x96ef6000 - 0x96efdfff /usr/lib/system/libunwind.dylib
0x9775a000 - 0x97768fff /usr/lib/system/libsystem_network.dylib
0x97776000 - 0x97777fff /usr/lib/system/libunc.dylib
0x97894000 - 0x97895fff /usr/lib/system/libremovefile.dylib
0x979ca000 - 0x979cbfff /usr/lib/system/libdnsinfo.dylib
0x97a49000 - 0x97a53fff /usr/lib/system/libsystem_notify.dylib
0x98111000 - 0x9812bfff /usr/lib/system/libsystem_kernel.dylib
0x98657000 - 0x9865efff /usr/lib/system/libsystem_dnssd.dylib
0x98a3b000 - 0x98af8fff /usr/lib/system/libsystem_c.dylib
0x98bd2000 - 0x98bfefff /usr/lib/system/libsystem_info.dylib
0x99137000 - 0x99142fff /usr/lib/system/libcommonCrypto.dylib
0x992b9000 - 0x992bcfff /usr/lib/system/libcompiler_rt.dylib
0x9979f000 - 0x997a3fff /usr/lib/system/libmacho.dylib
0x997cc000 - 0x997d4fff /usr/lib/system/libcopyfile.dylib
0x9980d000 - 0x9981bfff /usr/lib/libz.1.dylib
0x9981c000 - 0x9981cfff /usr/lib/libSystem.B.dylib
0x9a3f3000 - 0x9a3f7fff /usr/lib/system/libcache.dylib
0x9a5d8000 - 0x9a5fafff /usr/lib/libc++abi.dylib


Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
31 May 2013 08:36:11 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 777,600 785,512 1.0102
22 May 2013 22:18:52 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 751,680 758,617 1.0092
22 May 2013 09:18:34 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 725,760 730,874 1.0070
17 May 2013 15:22:56 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 699,840 703,209 1.0048
17 May 2013 02:12:46 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 673,920 675,820 1.0028
01 Apr 2013 17:26:40 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 648,000 649,334 1.0021
01 Apr 2013 07:59:10 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 622,080 622,646 1.0009
31 Mar 2013 19:12:13 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 596,160 596,391 1.0004
31 Mar 2013 08:13:57 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 570,240 567,353 0.9949
30 Mar 2013 20:59:57 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 544,320 540,996 0.9939
30 Mar 2013 11:55:25 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 518,400 514,635 0.9927
29 Mar 2013 16:25:52 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 492,480 492,603 1.0002
28 Mar 2013 21:44:03 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 466,560 465,718 0.9982
28 Mar 2013 11:50:11 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 440,640 439,004 0.9963
27 Mar 2013 22:29:48 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 414,720 412,463 0.9946
27 Mar 2013 12:53:57 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 388,800 386,660 0.9945
26 Mar 2013 20:33:43 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 362,880 360,078 0.9923
26 Mar 2013 11:17:05 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 336,960 333,898 0.9909
25 Mar 2013 19:48:26 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 311,040 308,522 0.9919
25 Mar 2013 11:28:26 1272612 15673796 hadcm3n_4f5v_1940_40_008302598_3 285,120 282,191 0.9897


©2024 climateprediction.net