climateprediction.net home page
Task 17378693

Task 17378693

Name hadcm3n_xaf6_1940_40_009149800_2
Workunit 9280136
Created 8 Nov 2014, 16:07:14 UTC
Sent 8 Nov 2014, 16:18:22 UTC
Report deadline 7 Feb 2015, 23:45:33 UTC
Received 13 Sep 2016, 20:49:13 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1280414
Run time 14 days 13 hours 13 min 11 sec
CPU time 11 days 2 hours 0 min 16 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 3.38 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Peak working set size 201.16 MB
Peak swap size 1,015.91 MB
Peak disk usage 24.20 MB
Stderr
<core_client_version>7.6.22</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:09:04 (895): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:13:11 (1242): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:13:12 (1242): No heartbeat from core client for 30 sec - exiting
01:13:13 (1242): No heartbeat from core client for 30 sec - exiting
01:13:14 (1242): No heartbeat from core client for 30 sec - exiting
01:13:15 (1242): No heartbeat from core client for 30 sec - exiting
01:13:16 (1242): No heartbeat from core client for 30 sec - exiting
01:13:17 (1242): No heartbeat from core client for 30 sec - exiting
01:13:18 (1242): No heartbeat from core client for 30 sec - exiting
01:13:19 (1242): No heartbeat from core client for 30 sec - exiting
01:13:20 (1242): No heartbeat from core client for 30 sec - exiting
01:14:40 (1312): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:14:41 (1312): No heartbeat from core client for 30 sec - exiting
01:14:42 (1312): No heartbeat from core client for 30 sec - exiting
01:14:43 (1312): No heartbeat from core client for 30 sec - exiting
01:14:44 (1312): No heartbeat from core client for 30 sec - exiting
01:14:45 (1312): No heartbeat from core client for 30 sec - exiting
SIGSEGV: segmentation violation
01:17:01 (1455): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:19:08 (1467): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:24:11 (1508): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:24:12 (1508): No heartbeat from core client for 30 sec - exiting
01:24:13 (1508): No heartbeat from core client for 30 sec - exiting
01:32:29 (1631): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:39:14 (1837): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:39:15 (1837): No heartbeat from core client for 30 sec - exiting
01:39:16 (1837): No heartbeat from core client for 30 sec - exiting
01:39:17 (1837): No heartbeat from core client for 30 sec - exiting
01:39:18 (1837): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:33:41 (2040): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:33:43 (2040): No heartbeat from core client for 30 sec - exiting
23:36:21 (2953): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:01:24 (5584): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:37:25 (6842): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:58:11 (9830): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:29:53 (57155): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:29:54 (57155): No heartbeat from core client for 30 sec - exiting
14:29:55 (57155): No heartbeat from core client for 30 sec - exiting
14:29:56 (57155): No heartbeat from core client for 30 sec - exiting
17:43:42 (58877): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:43:43 (58877): No heartbeat from core client for 30 sec - exiting
17:43:44 (58877): No heartbeat from core client for 30 sec - exiting
17:43:45 (58877): No heartbeat from core client for 30 sec - exiting
17:43:46 (58877): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
20:17:30 (713): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:17:32 (713): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:55:23 (6015): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:55:24 (6015): No heartbeat from core client for 30 sec - exiting
21:55:25 (6015): No heartbeat from core client for 30 sec - exiting
22:15:28 (7292): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:15:30 (7292): No heartbeat from core client for 30 sec - exiting
22:15:31 (7292): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:39:36 (643): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:39:38 (643): No heartbeat from core client for 30 sec - exiting
21:39:39 (643): No heartbeat from core client for 30 sec - exiting
21:39:40 (643): No heartbeat from core client for 30 sec - exiting
21:05:52 (754): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:05:53 (754): No heartbeat from core client for 30 sec - exiting
21:05:54 (754): No heartbeat from core client for 30 sec - exiting
21:05:55 (754): No heartbeat from core client for 30 sec - exiting
21:05:56 (754): No heartbeat from core client for 30 sec - exiting
21:05:57 (754): No heartbeat from core client for 30 sec - exiting
21:05:58 (754): No heartbeat from core client for 30 sec - exiting
21:05:59 (754): No heartbeat from core client for 30 sec - exiting
21:06:00 (754): No heartbeat from core client for 30 sec - exiting
21:06:01 (754): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
20:29:37 (726): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:29:38 (726): No heartbeat from core client for 30 sec - exiting
21:49:38 (571): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:49:39 (571): No heartbeat from core client for 30 sec - exiting
21:49:41 (571): No heartbeat from core client for 30 sec - exiting
23:32:59 (617): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:10:09 (612): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:12:14 (488): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:12:15 (488): No heartbeat from core client for 30 sec - exiting
10:12:16 (488): No heartbeat from core client for 30 sec - exiting
10:12:17 (488): No heartbeat from core client for 30 sec - exiting
10:12:18 (488): No heartbeat from core client for 30 sec - exiting
10:12:19 (488): No heartbeat from core client for 30 sec - exiting
10:12:20 (488): No heartbeat from core client for 30 sec - exiting
10:29:32 (782): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
01:58:57 (515): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:59:02 (515): No heartbeat from core client for 30 sec - exiting
01:59:04 (515): No heartbeat from core client for 30 sec - exiting
01:59:05 (515): No heartbeat from core client for 30 sec - exiting
01:59:06 (515): No heartbeat from core client for 30 sec - exiting
01:59:20 (515): No heartbeat from core client for 30 sec - exiting
01:59:21 (515): No heartbeat from core client for 30 sec - exiting
01:59:22 (515): No heartbeat from core client for 30 sec - exiting
01:59:23 (515): No heartbeat from core client for 30 sec - exiting
01:59:24 (515): No heartbeat from core client for 30 sec - exiting
01:59:26 (515): No heartbeat from core client for 30 sec - exiting
01:59:27 (515): No heartbeat from core client for 30 sec - exiting
01:59:28 (515): No heartbeat from core client for 30 sec - exiting
01:59:29 (515): No heartbeat from core client for 30 sec - exiting
01:59:30 (515): No heartbeat from core client for 30 sec - exiting
01:59:31 (515): No heartbeat from core client for 30 sec - exiting
01:59:32 (515): No heartbeat from core client for 30 sec - exiting
01:59:33 (515): No heartbeat from core client for 30 sec - exiting
01:59:34 (515): No heartbeat from core client for 30 sec - exiting
01:59:35 (515): No heartbeat from core client for 30 sec - exiting
01:59:36 (515): No heartbeat from core client for 30 sec - exiting
01:59:37 (515): No heartbeat from core client for 30 sec - exiting
01:59:38 (515): No heartbeat from core client for 30 sec - exiting
01:59:39 (515): No heartbeat from core client for 30 sec - exiting
01:59:40 (515): No heartbeat from core client for 30 sec - exiting
01:59:42 (515): No heartbeat from core client for 30 sec - exiting
01:59:43 (515): No heartbeat from core client for 30 sec - exiting
01:59:44 (515): No heartbeat from core client for 30 sec - exiting
01:59:45 (515): No heartbeat from core client for 30 sec - exiting
01:59:46 (515): No heartbeat from core client for 30 sec - exiting
01:59:47 (515): No heartbeat from core client for 30 sec - exiting
01:59:48 (515): No heartbeat from core client for 30 sec - exiting
01:59:49 (515): No heartbeat from core client for 30 sec - exiting
01:59:50 (515): No heartbeat from core client for 30 sec - exiting
01:59:51 (515): No heartbeat from core client for 30 sec - exiting
01:59:52 (515): No heartbeat from core client for 30 sec - exiting
01:59:53 (515): No heartbeat from core client for 30 sec - exiting
01:59:54 (515): No heartbeat from core client for 30 sec - exiting
01:59:56 (515): No heartbeat from core client for 30 sec - exiting
01:59:57 (515): No heartbeat from core client for 30 sec - exiting
01:59:58 (515): No heartbeat from core client for 30 sec - exiting
01:59:59 (515): No heartbeat from core client for 30 sec - exiting
02:00:00 (515): No heartbeat from core client for 30 sec - exiting
02:00:01 (515): No heartbeat from core client for 30 sec - exiting
02:00:02 (515): No heartbeat from core client for 30 sec - exiting
02:00:03 (515): No heartbeat from core client for 30 sec - exiting
02:00:04 (515): No heartbeat from core client for 30 sec - exiting
02:00:05 (515): No heartbeat from core client for 30 sec - exiting
02:00:06 (515): No heartbeat from core client for 30 sec - exiting
02:19:37 (10631): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:20:24 (10882): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
21:55:32 (940): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:56:23 (940): No heartbeat from core client for 30 sec - exiting
21:56:24 (940): No heartbeat from core client for 30 sec - exiting
21:56:26 (940): No heartbeat from core client for 30 sec - exiting
21:56:27 (940): No heartbeat from core client for 30 sec - exiting
21:56:28 (940): No heartbeat from core client for 30 sec - exiting
21:56:29 (940): No heartbeat from core client for 30 sec - exiting
21:56:30 (940): No heartbeat from core client for 30 sec - exiting
21:56:31 (940): No heartbeat from core client for 30 sec - exiting
21:56:32 (940): No heartbeat from core client for 30 sec - exiting
21:56:33 (940): No heartbeat from core client for 30 sec - exiting
21:56:34 (940): No heartbeat from core client for 30 sec - exiting
21:56:35 (940): No heartbeat from core client for 30 sec - exiting
21:56:36 (940): No heartbeat from core client for 30 sec - exiting
21:56:37 (940): No heartbeat from core client for 30 sec - exiting
21:56:38 (940): No heartbeat from core client for 30 sec - exiting
21:56:39 (940): No heartbeat from core client for 30 sec - exiting
21:56:40 (940): No heartbeat from core client for 30 sec - exiting
21:56:41 (940): No heartbeat from core client for 30 sec - exiting
21:56:42 (940): No heartbeat from core client for 30 sec - exiting
21:56:44 (940): No heartbeat from core client for 30 sec - exiting
21:56:45 (940): No heartbeat from core client for 30 sec - exiting
21:56:46 (940): No heartbeat from core client for 30 sec - exiting
21:56:47 (940): No heartbeat from core client for 30 sec - exiting
21:56:48 (940): No heartbeat from core client for 30 sec - exiting
21:56:49 (940): No heartbeat from core client for 30 sec - exiting
21:56:50 (940): No heartbeat from core client for 30 sec - exiting
21:56:51 (940): No heartbeat from core client for 30 sec - exiting
21:56:52 (940): No heartbeat from core client for 30 sec - exiting
21:56:53 (940): No heartbeat from core client for 30 sec - exiting
21:56:54 (940): No heartbeat from core client for 30 sec - exiting
21:56:55 (940): No heartbeat from core client for 30 sec - exiting
21:56:56 (940): No heartbeat from core client for 30 sec - exiting
21:56:57 (940): No heartbeat from core client for 30 sec - exiting
21:56:58 (940): No heartbeat from core client for 30 sec - exiting
21:56:59 (940): No heartbeat from core client for 30 sec - exiting
21:57:00 (940): No heartbeat from core client for 30 sec - exiting
21:57:01 (940): No heartbeat from core client for 30 sec - exiting
21:57:03 (940): No heartbeat from core client for 30 sec - exiting
21:57:04 (940): No heartbeat from core client for 30 sec - exiting
21:57:05 (940): No heartbeat from core client for 30 sec - exiting
21:57:06 (940): No heartbeat from core client for 30 sec - exiting
21:57:07 (940): No heartbeat from core client for 30 sec - exiting
21:57:08 (940): No heartbeat from core client for 30 sec - exiting
21:57:09 (940): No heartbeat from core client for 30 sec - exiting
21:57:10 (940): No heartbeat from core client for 30 sec - exiting
21:57:11 (940): No heartbeat from core client for 30 sec - exiting
22:02:02 (3641): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:02:16 (3641): No heartbeat from core client for 30 sec - exiting
22:02:17 (3641): No heartbeat from core client for 30 sec - exiting
22:02:18 (3641): No heartbeat from core client for 30 sec - exiting
22:04:59 (3777): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:05:10 (3777): No heartbeat from core client for 30 sec - exiting
22:21:29 (3861): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:26:15 (4737): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:26:21 (4737): No heartbeat from core client for 30 sec - exiting
23:26:22 (4737): No heartbeat from core client for 30 sec - exiting
23:26:23 (4737): No heartbeat from core client for 30 sec - exiting
23:26:24 (4737): No heartbeat from core client for 30 sec - exiting
23:26:25 (4737): No heartbeat from core client for 30 sec - exiting
23:26:27 (4737): No heartbeat from core client for 30 sec - exiting
23:26:28 (4737): No heartbeat from core client for 30 sec - exiting
23:26:29 (4737): No heartbeat from core client for 30 sec - exiting
23:26:30 (4737): No heartbeat from core client for 30 sec - exiting
05:42:23 (8464): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:42:27 (8464): No heartbeat from core client for 30 sec - exiting
05:42:28 (8464): No heartbeat from core client for 30 sec - exiting
05:42:29 (8464): No heartbeat from core client for 30 sec - exiting
05:42:30 (8464): No heartbeat from core client for 30 sec - exiting
05:42:31 (8464): No heartbeat from core client for 30 sec - exiting
21:16:31 (35369): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
hadcm3n_6.07_i686-apple-darwin(93940,0xa50b91c0) malloc: *** error for object 0x804c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGILL: illegal instruction

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.12 build 16A313a
Wed Sep 14 05:48:15 2016

Thread 0 Crashed:

Thread 1:

atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386.
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f9d8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -    0x93fff /Library/Application Support/BOINC Data/slots/13/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin
  0x1fd000 -   0x24dfff /usr/lib/libstdc++.6.dylib
0x9e288000 - 0x9e289fff /usr/lib/libSystem.B.dylib
0x9e3d2000 - 0x9e3d2fff /usr/lib/libauto.dylib
0x9e3f2000 - 0x9e448fff /usr/lib/libc++.1.dylib
0x9e449000 - 0x9e46cfff /usr/lib/libc++abi.dylib
0x9ecf3000 - 0x9f0b6fff /usr/lib/libobjc.A.dylib
0x9f47d000 - 0x9f48bfff /usr/lib/libz.1.dylib
0x9f49a000 - 0x9f49efff /usr/lib/system/libcache.dylib
0x9f49f000 - 0x9f4a9fff /usr/lib/system/libcommonCrypto.dylib
0x9f4aa000 - 0x9f4affff /usr/lib/system/libcompiler_rt.dylib
0x9f4b0000 - 0x9f4b8fff /usr/lib/system/libcopyfile.dylib
0x9f4b9000 - 0x9f51efff /usr/lib/system/libcorecrypto.dylib
0x9f51f000 - 0x9f54dfff /usr/lib/system/libdispatch.dylib
0x9f54e000 - 0x9f553fff /usr/lib/system/libdyld.dylib
0x9f554000 - 0x9f554fff /usr/lib/system/libkeymgr.dylib
0x9f562000 - 0x9f562fff /usr/lib/system/liblaunch.dylib
0x9f563000 - 0x9f569fff /usr/lib/system/libmacho.dylib
0x9f56a000 - 0x9f56cfff /usr/lib/system/libquarantine.dylib
0x9f56d000 - 0x9f56efff /usr/lib/system/libremovefile.dylib
0x9f56f000 - 0x9f586fff /usr/lib/system/libsystem_asl.dylib
0x9f587000 - 0x9f587fff /usr/lib/system/libsystem_blocks.dylib
0x9f588000 - 0x9f616fff /usr/lib/system/libsystem_c.dylib
0x9f617000 - 0x9f61afff /usr/lib/system/libsystem_configuration.dylib
0x9f61b000 - 0x9f61efff /usr/lib/system/libsystem_coreservices.dylib
0x9f61f000 - 0x9f637fff /usr/lib/system/libsystem_coretls.dylib
0x9f638000 - 0x9f63efff /usr/lib/system/libsystem_dnssd.dylib
0x9f63f000 - 0x9f666fff /usr/lib/system/libsystem_info.dylib
0x9f667000 - 0x9f688fff /usr/lib/system/libsystem_kernel.dylib
0x9f689000 - 0x9f6d5fff /usr/lib/system/libsystem_m.dylib
0x9f6d6000 - 0x9f6f0fff /usr/lib/system/libsystem_malloc.dylib
0x9f6f1000 - 0x9f744fff /usr/lib/system/libsystem_network.dylib
0x9f745000 - 0x9f74efff /usr/lib/system/libsystem_networkextension.dylib
0x9f74f000 - 0x9f757fff /usr/lib/system/libsystem_notify.dylib
0x9f758000 - 0x9f75efff /usr/lib/system/libsystem_platform.dylib
0x9f75f000 - 0x9f768fff /usr/lib/system/libsystem_pthread.dylib
0x9f769000 - 0x9f76cfff /usr/lib/system/libsystem_sandbox.dylib
0x9f76d000 - 0x9f76efff /usr/lib/system/libsystem_secinit.dylib
0x9f76f000 - 0x9f776fff /usr/lib/system/libsystem_symptoms.dylib
0x9f777000 - 0x9f797fff /usr/lib/system/libsystem_trace.dylib
0x9f798000 - 0x9f79efff /usr/lib/system/libunwind.dylib
0x9f79f000 - 0x9f7c5fff /usr/lib/system/libxpc.dylib


Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 Sep 2016 19:53:02 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 777,600 957,580 1.2315
13 Sep 2016 14:31:59 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 751,680 939,633 1.2500
13 Sep 2016 07:05:42 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 725,760 920,359 1.2681
13 Sep 2016 00:29:42 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 699,840 901,518 1.2882
12 Sep 2016 17:23:33 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 673,920 881,207 1.3076
12 Sep 2016 09:52:08 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 648,000 861,280 1.3291
12 Sep 2016 02:05:53 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 622,080 842,745 1.3547
11 Sep 2016 17:59:28 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 596,160 824,153 1.3824
04 Sep 2016 09:15:40 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 570,240 784,078 1.3750
15 Aug 2016 02:45:47 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 544,320 730,579 1.3422
14 Aug 2016 10:54:33 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 518,400 682,078 1.3157
13 Aug 2016 19:08:28 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 492,480 634,136 1.2876
12 Aug 2016 22:01:30 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 466,560 580,436 1.2441
04 Dec 2015 12:14:59 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 440,640 533,097 1.2098
03 Dec 2015 10:55:38 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 414,720 467,817 1.1280
02 Dec 2015 11:53:57 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 388,800 418,021 1.0752
21 Jun 2015 13:56:20 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 362,880 369,289 1.0177
20 Jun 2015 15:15:22 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 336,960 323,705 0.9607
24 May 2015 10:22:03 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 311,040 279,644 0.8991
14 Dec 2014 21:06:41 1280414 17378693 hadcm3n_xaf6_1940_40_009149800_2 285,120 237,997 0.8347


©2024 climateprediction.net