climateprediction.net home page
Task 15701451

Task 15701451

Name hadcm3n_4e8a_1940_40_008305511_1
Workunit 8456646
Created 4 Apr 2013, 1:52:43 UTC
Sent 4 Apr 2013, 1:54:18 UTC
Report deadline 4 Jul 2013, 9:21:29 UTC
Received 22 Jul 2013, 14:36:26 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 1265460
Run time 25 days 10 hours 48 min 43 sec
CPU time 21 days 19 hours 32 min 25 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 1.01 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
aborted by user
</message>
<stderr_txt>
_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09b0b390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x088cf390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08a4c390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09d8b3d8 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08f72390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08929390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0994f390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
20:06:31 (2435): No heartbeat from core client for 30 sec - exiting
20:06:37 (2435): No heartbeat from core client for 30 sec - exiting
20:06:38 (2435): No heartbeat from core client for 30 sec - exiting
20:06:39 (2435): No heartbeat from core client for 30 sec - exiting
20:06:40 (2435): No heartbeat from core client for 30 sec - exiting
20:06:41 (2435): No heartbeat from core client for 30 sec - exiting
20:06:42 (2435): No heartbeat from core client for 30 sec - exiting
20:06:43 (2435): No heartbeat from core client for 30 sec - exiting
20:06:44 (2435): No heartbeat from core client for 30 sec - exiting
20:06:45 (2435): No heartbeat from core client for 30 sec - exiting
20:06:46 (2435): No heartbeat from core client for 30 sec - exiting
20:06:47 (2435): No heartbeat from core client for 30 sec - exiting
20:06:48 (2435): No heartbeat from core client for 30 sec - exiting
20:06:49 (2435): No heartbeat from core client for 30 sec - exiting
20:06:52 (2435): No heartbeat from core client for 30 sec - exiting
20:06:53 (2435): No heartbeat from core client for 30 sec - exiting
20:06:55 (2435): No heartbeat from core client for 30 sec - exiting
20:06:56 (2435): No heartbeat from core client for 30 sec - exiting
20:06:57 (2435): No heartbeat from core client for 30 sec - exiting
20:06:58 (2435): No heartbeat from core client for 30 sec - exiting
20:06:59 (2435): No heartbeat from core client for 30 sec - exiting
20:07:00 (2435): No heartbeat from core client for 30 sec - exiting
20:07:01 (2435): No heartbeat from core client for 30 sec - exiting
20:07:02 (2435): No heartbeat from core client for 30 sec - exiting
20:07:03 (2435): No heartbeat from core client for 30 sec - exiting
20:07:04 (2435): No heartbeat from core client for 30 sec - exiting
20:07:05 (2435): No heartbeat from core client for 30 sec - exiting
20:07:06 (2435): No heartbeat from core client for 30 sec - exiting
20:07:07 (2435): No heartbeat from core client for 30 sec - exiting
20:07:08 (2435): No heartbeat from core client for 30 sec - exiting
20:07:09 (2435): No heartbeat from core client for 30 sec - exiting
20:07:10 (2435): No heartbeat from core client for 30 sec - exiting
20:07:11 (2435): No heartbeat from core client for 30 sec - exiting
20:07:12 (2435): No heartbeat from core client for 30 sec - exiting
20:07:13 (2435): No heartbeat from core client for 30 sec - exiting
20:07:14 (2435): No heartbeat from core client for 30 sec - exiting
20:07:15 (2435): No heartbeat from core client for 30 sec - exiting
20:07:16 (2435): No heartbeat from core client for 30 sec - exiting
20:07:17 (2435): No heartbeat from core client for 30 sec - exiting
20:07:18 (2435): No heartbeat from core client for 30 sec - exiting
20:07:19 (2435): No heartbeat from core client for 30 sec - exiting
20:07:20 (2435): No heartbeat from core client for 30 sec - exiting
20:07:21 (2435): No heartbeat from core client for 30 sec - exiting
20:07:22 (2435): No heartbeat from core client for 30 sec - exiting
20:07:23 (2435): No heartbeat from core client for 30 sec - exiting
20:07:24 (2435): No heartbeat from core client for 30 sec - exiting
20:07:25 (2435): No heartbeat from core client for 30 sec - exiting
20:07:26 (2435): No heartbeat from core client for 30 sec - exiting
20:07:27 (2435): No heartbeat from core client for 30 sec - exiting
20:07:28 (2435): No heartbeat from core client for 30 sec - exiting
20:07:29 (2435): No heartbeat from core client for 30 sec - exiting
20:07:30 (2435): No heartbeat from core client for 30 sec - exiting
20:07:31 (2435): No heartbeat from core client for 30 sec - exiting
20:07:32 (2435): No heartbeat from core client for 30 sec - exiting
20:07:33 (2435): No heartbeat from core client for 30 sec - exiting
20:07:34 (2435): No heartbeat from core client for 30 sec - exiting
20:07:35 (2435): No heartbeat from core client for 30 sec - exiting
20:07:36 (2435): No heartbeat from core client for 30 sec - exiting
20:07:37 (2435): No heartbeat from core client for 30 sec - exiting
20:07:38 (2435): No heartbeat from core client for 30 sec - exiting
20:07:39 (2435): No heartbeat from core client for 30 sec - exiting
20:07:40 (2435): No heartbeat from core client for 30 sec - exiting
20:07:41 (2435): No heartbeat from core client for 30 sec - exiting
20:07:42 (2435): No heartbeat from core client for 30 sec - exiting
20:07:43 (2435): No heartbeat from core client for 30 sec - exiting
20:07:44 (2435): No heartbeat from core client for 30 sec - exiting
20:07:45 (2435): No heartbeat from core client for 30 sec - exiting
20:07:46 (2435): No heartbeat from core client for 30 sec - exiting
20:07:47 (2435): No heartbeat from core client for 30 sec - exiting
20:07:48 (2435): No heartbeat from core client for 30 sec - exiting
20:07:49 (2435): No heartbeat from core client for 30 sec - exiting
20:07:50 (2435): No heartbeat from core client for 30 sec - exiting
20:07:52 (2435): No heartbeat from core client for 30 sec - exiting
20:07:53 (2435): No heartbeat from core client for 30 sec - exiting
20:07:54 (2435): No heartbeat from core client for 30 sec - exiting
20:07:55 (2435): No heartbeat from core client for 30 sec - exiting
20:07:56 (2435): No heartbeat from core client for 30 sec - exiting
20:07:57 (2435): No heartbeat from core client for 30 sec - exiting
20:07:58 (2435): No heartbeat from core client for 30 sec - exiting
20:07:59 (2435): No heartbeat from core client for 30 sec - exiting
20:08:01 (2435): No heartbeat from core client for 30 sec - exiting
20:08:02 (2435): No heartbeat from core client for 30 sec - exiting
20:08:03 (2435): No heartbeat from core client for 30 sec - exiting
20:08:04 (2435): No heartbeat from core client for 30 sec - exiting
20:08:05 (2435): No heartbeat from core client for 30 sec - exiting
20:08:06 (2435): No heartbeat from core client for 30 sec - exiting
21:18:04 (2435): No heartbeat from core client for 30 sec - exiting
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09b13390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09be83a8 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08c12390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x094ff390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x097da390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08b1d390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0a0c4390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09b0e390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09d6a390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0926c390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08d87390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0a152390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0991d390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0928c390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0a093390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0891e390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x084ac390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0962a390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08d05390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x088d1390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
17:07:11 (2259): No heartbeat from core client for 30 sec - exiting
17:07:23 (2259): No heartbeat from core client for 30 sec - exiting
17:07:24 (2259): No heartbeat from core client for 30 sec - exiting
17:07:25 (2259): No heartbeat from core client for 30 sec - exiting
17:07:26 (2259): No heartbeat from core client for 30 sec - exiting
17:07:27 (2259): No heartbeat from core client for 30 sec - exiting
17:07:28 (2259): No heartbeat from core client for 30 sec - exiting
17:07:29 (2259): No heartbeat from core client for 30 sec - exiting
17:07:30 (2259): No heartbeat from core client for 30 sec - exiting
17:07:31 (2259): No heartbeat from core client for 30 sec - exiting
17:07:32 (2259): No heartbeat from core client for 30 sec - exiting
17:07:33 (2259): No heartbeat from core client for 30 sec - exiting
17:07:34 (2259): No heartbeat from core client for 30 sec - exiting
17:07:35 (2259): No heartbeat from core client for 30 sec - exiting
17:07:36 (2259): No heartbeat from core client for 30 sec - exiting
17:07:37 (2259): No heartbeat from core client for 30 sec - exiting
17:07:38 (2259): No heartbeat from core client for 30 sec - exiting
17:07:39 (2259): No heartbeat from core client for 30 sec - exiting
17:07:40 (2259): No heartbeat from core client for 30 sec - exiting
17:07:41 (2259): No heartbeat from core client for 30 sec - exiting
17:07:42 (2259): No heartbeat from core client for 30 sec - exiting
17:07:43 (2259): No heartbeat from core client for 30 sec - exiting
17:07:44 (2259): No heartbeat from core client for 30 sec - exiting
17:07:45 (2259): No heartbeat from core client for 30 sec - exiting
17:07:46 (2259): No heartbeat from core client for 30 sec - exiting
17:07:47 (2259): No heartbeat from core client for 30 sec - exiting
17:07:48 (2259): No heartbeat from core client for 30 sec - exiting
17:07:49 (2259): No heartbeat from core client for 30 sec - exiting
17:07:50 (2259): No heartbeat from core client for 30 sec - exiting
17:07:51 (2259): No heartbeat from core client for 30 sec - exiting
17:07:52 (2259): No heartbeat from core client for 30 sec - exiting
17:07:53 (2259): No heartbeat from core client for 30 sec - exiting
17:07:54 (2259): No heartbeat from core client for 30 sec - exiting
17:07:55 (2259): No heartbeat from core client for 30 sec - exiting
17:07:56 (2259): No heartbeat from core client for 30 sec - exiting
17:07:57 (2259): No heartbeat from core client for 30 sec - exiting
17:07:58 (2259): No heartbeat from core client for 30 sec - exiting
17:07:59 (2259): No heartbeat from core client for 30 sec - exiting
17:08:00 (2259): No heartbeat from core client for 30 sec - exiting
17:08:01 (2259): No heartbeat from core client for 30 sec - exiting
17:08:02 (2259): No heartbeat from core client for 30 sec - exiting
17:08:03 (2259): No heartbeat from core client for 30 sec - exiting
17:08:04 (2259): No heartbeat from core client for 30 sec - exiting
17:08:05 (2259): No heartbeat from core client for 30 sec - exiting
17:08:06 (2259): No heartbeat from core client for 30 sec - exiting
17:08:07 (2259): No heartbeat from core client for 30 sec - exiting
17:08:08 (2259): No heartbeat from core client for 30 sec - exiting
17:08:09 (2259): No heartbeat from core client for 30 sec - exiting
17:08:10 (2259): No heartbeat from core client for 30 sec - exiting
17:08:11 (2259): No heartbeat from core client for 30 sec - exiting
17:08:12 (2259): No heartbeat from core client for 30 sec - exiting
17:08:14 (2259): No heartbeat from core client for 30 sec - exiting
17:08:15 (2259): No heartbeat from core client for 30 sec - exiting
17:08:16 (2259): No heartbeat from core client for 30 sec - exiting
17:08:17 (2259): No heartbeat from core client for 30 sec - exiting
17:08:18 (2259): No heartbeat from core client for 30 sec - exiting
17:08:19 (2259): No heartbeat from core client for 30 sec - exiting
17:08:20 (2259): No heartbeat from core client for 30 sec - exiting
17:13:28 (2259): No heartbeat from core client for 30 sec - exiting
17:13:32 (2259): No heartbeat from core client for 30 sec - exiting
17:13:33 (2259): No heartbeat from core client for 30 sec - exiting
17:13:34 (2259): No heartbeat from core client for 30 sec - exiting
17:13:35 (2259): No heartbeat from core client for 30 sec - exiting
17:13:36 (2259): No heartbeat from core client for 30 sec - exiting
17:13:37 (2259): No heartbeat from core client for 30 sec - exiting
17:13:38 (2259): No heartbeat from core client for 30 sec - exiting
17:13:39 (2259): No heartbeat from core client for 30 sec - exiting
17:13:40 (2259): No heartbeat from core client for 30 sec - exiting
17:13:41 (2259): No heartbeat from core client for 30 sec - exiting
17:13:42 (2259): No heartbeat from core client for 30 sec - exiting
17:13:43 (2259): No heartbeat from core client for 30 sec - exiting
17:13:44 (2259): No heartbeat from core client for 30 sec - exiting
17:13:45 (2259): No heartbeat from core client for 30 sec - exiting
17:13:46 (2259): No heartbeat from core client for 30 sec - exiting
17:13:47 (2259): No heartbeat from core client for 30 sec - exiting
17:13:48 (2259): No heartbeat from core client for 30 sec - exiting
17:13:49 (2259): No heartbeat from core client for 30 sec - exiting
17:13:50 (2259): No heartbeat from core client for 30 sec - exiting
17:13:51 (2259): No heartbeat from core client for 30 sec - exiting
17:13:52 (2259): No heartbeat from core client for 30 sec - exiting
17:13:53 (2259): No heartbeat from core client for 30 sec - exiting
17:13:54 (2259): No heartbeat from core client for 30 sec - exiting
17:13:55 (2259): No heartbeat from core client for 30 sec - exiting
17:13:56 (2259): No heartbeat from core client for 30 sec - exiting
17:13:57 (2259): No heartbeat from core client for 30 sec - exiting
17:13:58 (2259): No heartbeat from core client for 30 sec - exiting
17:13:59 (2259): No heartbeat from core client for 30 sec - exiting
17:14:00 (2259): No heartbeat from core client for 30 sec - exiting
17:14:01 (2259): No heartbeat from core client for 30 sec - exiting
17:14:02 (2259): No heartbeat from core client for 30 sec - exiting
17:14:03 (2259): No heartbeat from core client for 30 sec - exiting
17:14:04 (2259): No heartbeat from core client for 30 sec - exiting
17:14:05 (2259): No heartbeat from core client for 30 sec - exiting
17:14:06 (2259): No heartbeat from core client for 30 sec - exiting
17:14:07 (2259): No heartbeat from core client for 30 sec - exiting
17:14:08 (2259): No heartbeat from core client for 30 sec - exiting
17:14:09 (2259): No heartbeat from core client for 30 sec - exiting
17:14:10 (2259): No heartbeat from core client for 30 sec - exiting
17:14:11 (2259): No heartbeat from core client for 30 sec - exiting
17:14:12 (2259): No heartbeat from core client for 30 sec - exiting
17:14:13 (2259): No heartbeat from core client for 30 sec - exiting
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08af1390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
17:35:14 (2266): No heartbeat from core client for 30 sec - exiting
17:35:16 (2266): No heartbeat from core client for 30 sec - exiting
17:35:17 (2266): No heartbeat from core client for 30 sec - exiting
17:35:18 (2266): No heartbeat from core client for 30 sec - exiting
17:35:19 (2266): No heartbeat from core client for 30 sec - exiting
11:51:35 (2266): No heartbeat from core client for 30 sec - exiting
11:51:42 (2266): No heartbeat from core client for 30 sec - exiting
11:51:43 (2266): No heartbeat from core client for 30 sec - exiting
11:51:44 (2266): No heartbeat from core client for 30 sec - exiting
11:51:45 (2266): No heartbeat from core client for 30 sec - exiting
11:51:46 (2266): No heartbeat from core client for 30 sec - exiting
11:51:47 (2266): No heartbeat from core client for 30 sec - exiting
11:51:48 (2266): No heartbeat from core client for 30 sec - exiting
11:51:49 (2266): No heartbeat from core client for 30 sec - exiting
11:51:50 (2266): No heartbeat from core client for 30 sec - exiting
11:51:51 (2266): No heartbeat from core client for 30 sec - exiting
11:51:52 (2266): No heartbeat from core client for 30 sec - exiting
11:51:53 (2266): No heartbeat from core client for 30 sec - exiting
11:51:54 (2266): No heartbeat from core client for 30 sec - exiting
11:51:55 (2266): No heartbeat from core client for 30 sec - exiting
11:51:56 (2266): No heartbeat from core client for 30 sec - exiting
11:51:57 (2266): No heartbeat from core client for 30 sec - exiting
11:51:58 (2266): No heartbeat from core client for 30 sec - exiting
11:51:59 (2266): No heartbeat from core client for 30 sec - exiting
17:13:45 (2266): No heartbeat from core client for 30 sec - exiting
17:13:50 (2266): No heartbeat from core client for 30 sec - exiting
17:13:51 (2266): No heartbeat from core client for 30 sec - exiting
17:22:12 (2266): No heartbeat from core client for 30 sec - exiting
17:22:19 (2266): No heartbeat from core client for 30 sec - exiting
17:22:20 (2266): No heartbeat from core client for 30 sec - exiting
17:22:21 (2266): No heartbeat from core client for 30 sec - exiting
17:22:22 (2266): No heartbeat from core client for 30 sec - exiting
17:22:23 (2266): No heartbeat from core client for 30 sec - exiting
17:22:24 (2266): No heartbeat from core client for 30 sec - exiting
17:22:25 (2266): No heartbeat from core client for 30 sec - exiting
17:22:26 (2266): No heartbeat from core client for 30 sec - exiting
17:22:27 (2266): No heartbeat from core client for 30 sec - exiting
17:22:28 (2266): No heartbeat from core client for 30 sec - exiting
17:22:29 (2266): No heartbeat from core client for 30 sec - exiting
17:22:30 (2266): No heartbeat from core client for 30 sec - exiting
17:22:31 (2266): No heartbeat from core client for 30 sec - exiting
17:22:32 (2266): No heartbeat from core client for 30 sec - exiting
17:22:33 (2266): No heartbeat from core client for 30 sec - exiting
17:22:34 (2266): No heartbeat from core client for 30 sec - exiting
17:22:35 (2266): No heartbeat from core client for 30 sec - exiting
17:22:36 (2266): No heartbeat from core client for 30 sec - exiting
17:22:37 (2266): No heartbeat from core client for 30 sec - exiting
17:22:38 (2266): No heartbeat from core client for 30 sec - exiting
17:22:39 (2266): No heartbeat from core client for 30 sec - exiting
17:22:40 (2266): No heartbeat from core client for 30 sec - exiting
17:22:41 (2266): No heartbeat from core client for 30 sec - exiting
17:28:43 (2266): No heartbeat from core client for 30 sec - exiting
17:28:48 (2266): No heartbeat from core client for 30 sec - exiting
17:28:49 (2266): No heartbeat from core client for 30 sec - exiting
17:28:50 (2266): No heartbeat from core client for 30 sec - exiting
17:28:51 (2266): No heartbeat from core client for 30 sec - exiting
17:28:52 (2266): No heartbeat from core client for 30 sec - exiting
17:28:53 (2266): No heartbeat from core client for 30 sec - exiting
17:28:54 (2266): No heartbeat from core client for 30 sec - exiting
17:28:55 (2266): No heartbeat from core client for 30 sec - exiting
17:28:56 (2266): No heartbeat from core client for 30 sec - exiting
17:28:57 (2266): No heartbeat from core client for 30 sec - exiting
17:28:58 (2266): No heartbeat from core client for 30 sec - exiting
17:29:01 (2266): No heartbeat from core client for 30 sec - exiting
17:29:02 (2266): No heartbeat from core client for 30 sec - exiting
17:29:03 (2266): No heartbeat from core client for 30 sec - exiting
17:29:04 (2266): No heartbeat from core client for 30 sec - exiting
17:29:05 (2266): No heartbeat from core client for 30 sec - exiting
17:29:06 (2266): No heartbeat from core client for 30 sec - exiting
17:29:07 (2266): No heartbeat from core client for 30 sec - exiting
17:29:08 (2266): No heartbeat from core client for 30 sec - exiting
17:29:09 (2266): No heartbeat from core client for 30 sec - exiting
17:29:10 (2266): No heartbeat from core client for 30 sec - exiting
17:29:11 (2266): No heartbeat from core client for 30 sec - exiting
17:29:12 (2266): No heartbeat from core client for 30 sec - exiting
17:29:13 (2266): No heartbeat from core client for 30 sec - exiting
17:29:14 (2266): No heartbeat from core client for 30 sec - exiting
17:29:15 (2266): No heartbeat from core client for 30 sec - exiting
17:29:16 (2266): No heartbeat from core client for 30 sec - exiting
17:29:17 (2266): No heartbeat from core client for 30 sec - exiting
17:29:18 (2266): No heartbeat from core client for 30 sec - exiting
17:29:19 (2266): No heartbeat from core client for 30 sec - exiting
17:29:20 (2266): No heartbeat from core client for 30 sec - exiting
17:29:21 (2266): No heartbeat from core client for 30 sec - exiting
17:29:22 (2266): No heartbeat from core client for 30 sec - exiting
17:29:23 (2266): No heartbeat from core client for 30 sec - exiting
17:29:24 (2266): No heartbeat from core client for 30 sec - exiting
17:29:26 (2266): No heartbeat from core client for 30 sec - exiting
17:29:27 (2266): No heartbeat from core client for 30 sec - exiting
17:29:28 (2266): No heartbeat from core client for 30 sec - exiting
17:29:29 (2266): No heartbeat from core client for 30 sec - exiting
17:29:30 (2266): No heartbeat from core client for 30 sec - exiting
17:29:31 (2266): No heartbeat from core client for 30 sec - exiting
17:29:32 (2266): No heartbeat from core client for 30 sec - exiting
17:29:33 (2266): No heartbeat from core client for 30 sec - exiting
17:29:34 (2266): No heartbeat from core client for 30 sec - exiting
17:29:35 (2266): No heartbeat from core client for 30 sec - exiting
17:29:36 (2266): No heartbeat from core client for 30 sec - exiting
17:29:37 (2266): No heartbeat from core client for 30 sec - exiting
17:29:38 (2266): No heartbeat from core client for 30 sec - exiting
17:29:39 (2266): No heartbeat from core client for 30 sec - exiting
17:29:40 (2266): No heartbeat from core client for 30 sec - exiting
17:29:41 (2266): No heartbeat from core client for 30 sec - exiting
17:29:42 (2266): No heartbeat from core client for 30 sec - exiting
17:29:43 (2266): No heartbeat from core client for 30 sec - exiting
17:29:44 (2266): No heartbeat from core client for 30 sec - exiting
17:29:45 (2266): No heartbeat from core client for 30 sec - exiting
17:36:16 (2266): No heartbeat from core client for 30 sec - exiting
17:36:20 (2266): No heartbeat from core client for 30 sec - exiting
17:36:21 (2266): No heartbeat from core client for 30 sec - exiting
17:36:22 (2266): No heartbeat from core client for 30 sec - exiting
17:36:23 (2266): No heartbeat from core client for 30 sec - exiting
17:36:24 (2266): No heartbeat from core client for 30 sec - exiting
17:36:25 (2266): No heartbeat from core client for 30 sec - exiting
17:36:26 (2266): No heartbeat from core client for 30 sec - exiting
17:36:27 (2266): No heartbeat from core client for 30 sec - exiting
17:36:28 (2266): No heartbeat from core client for 30 sec - exiting
17:36:29 (2266): No heartbeat from core client for 30 sec - exiting
17:36:30 (2266): No heartbeat from core client for 30 sec - exiting
17:36:31 (2266): No heartbeat from core client for 30 sec - exiting
17:36:32 (2266): No heartbeat from core client for 30 sec - exiting
17:36:33 (2266): No heartbeat from core client for 30 sec - exiting
17:36:34 (2266): No heartbeat from core client for 30 sec - exiting
17:36:35 (2266): No heartbeat from core client for 30 sec - exiting
17:36:36 (2266): No heartbeat from core client for 30 sec - exiting
17:36:37 (2266): No heartbeat from core client for 30 sec - exiting
17:36:38 (2266): No heartbeat from core client for 30 sec - exiting
17:36:39 (2266): No heartbeat from core client for 30 sec - exiting
17:36:40 (2266): No heartbeat from core client for 30 sec - exiting
17:36:41 (2266): No heartbeat from core client for 30 sec - exiting
17:36:42 (2266): No heartbeat from core client for 30 sec - exiting
17:36:43 (2266): No heartbeat from core client for 30 sec - exiting
17:36:44 (2266): No heartbeat from core client for 30 sec - exiting
17:36:45 (2266): No heartbeat from core client for 30 sec - exiting
17:36:46 (2266): No heartbeat from core client for 30 sec - exiting
17:36:47 (2266): No heartbeat from core client for 30 sec - exiting
17:36:48 (2266): No heartbeat from core client for 30 sec - exiting
17:36:49 (2266): No heartbeat from core client for 30 sec - exiting
17:36:50 (2266): No heartbeat from core client for 30 sec - exiting
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x097ec390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08e13390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x088dd390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
13:05:10 (2757): No heartbeat from core client for 30 sec - exiting
13:05:21 (2757): No heartbeat from core client for 30 sec - exiting
13:05:22 (2757): No heartbeat from core client for 30 sec - exiting
13:05:23 (2757): No heartbeat from core client for 30 sec - exiting
13:05:25 (2757): No heartbeat from core client for 30 sec - exiting
13:05:26 (2757): No heartbeat from core client for 30 sec - exiting
13:05:27 (2757): No heartbeat from core client for 30 sec - exiting
13:05:28 (2757): No heartbeat from core client for 30 sec - exiting
13:05:29 (2757): No heartbeat from core client for 30 sec - exiting
13:05:30 (2757): No heartbeat from core client for 30 sec - exiting
13:05:31 (2757): No heartbeat from core client for 30 sec - exiting
13:05:33 (2757): No heartbeat from core client for 30 sec - exiting
13:05:34 (2757): No heartbeat from core client for 30 sec - exiting
13:05:35 (2757): No heartbeat from core client for 30 sec - exiting
13:05:36 (2757): No heartbeat from core client for 30 sec - exiting
13:05:37 (2757): No heartbeat from core client for 30 sec - exiting
13:05:38 (2757): No heartbeat from core client for 30 sec - exiting
13:05:39 (2757): No heartbeat from core client for 30 sec - exiting
13:05:40 (2757): No heartbeat from core client for 30 sec - exiting
13:05:41 (2757): No heartbeat from core client for 30 sec - exiting
13:05:42 (2757): No heartbeat from core client for 30 sec - exiting
13:05:43 (2757): No heartbeat from core client for 30 sec - exiting
13:05:44 (2757): No heartbeat from core client for 30 sec - exiting
13:05:45 (2757): No heartbeat from core client for 30 sec - exiting
13:05:46 (2757): No heartbeat from core client for 30 sec - exiting
13:05:47 (2757): No heartbeat from core client for 30 sec - exiting
13:05:49 (2757): No heartbeat from core client for 30 sec - exiting
13:05:50 (2757): No heartbeat from core client for 30 sec - exiting
13:05:51 (2757): No heartbeat from core client for 30 sec - exiting
13:05:52 (2757): No heartbeat from core client for 30 sec - exiting
13:05:53 (2757): No heartbeat from core client for 30 sec - exiting
13:05:54 (2757): No heartbeat from core client for 30 sec - exiting
13:05:55 (2757): No heartbeat from core client for 30 sec - exiting
13:05:56 (2757): No heartbeat from core client for 30 sec - exiting
13:05:57 (2757): No heartbeat from core client for 30 sec - exiting
13:05:58 (2757): No heartbeat from core client for 30 sec - exiting
13:05:59 (2757): No heartbeat from core client for 30 sec - exiting
13:06:00 (2757): No heartbeat from core client for 30 sec - exiting
13:06:01 (2757): No heartbeat from core client for 30 sec - exiting
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x083f9390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09e57390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
03:12:46 (2367): No heartbeat from core client for 30 sec - exiting
03:12:47 (2367): No heartbeat from core client for 30 sec - exiting
03:12:48 (2367): No heartbeat from core client for 30 sec - exiting
03:12:49 (2367): No heartbeat from core client for 30 sec - exiting
03:12:50 (2367): No heartbeat from core client for 30 sec - exiting
03:12:51 (2367): No heartbeat from core client for 30 sec - exiting
03:12:52 (2367): No heartbeat from core client for 30 sec - exiting
03:12:53 (2367): No heartbeat from core client for 30 sec - exiting
03:12:54 (2367): No heartbeat from core client for 30 sec - exiting
03:12:55 (2367): No heartbeat from core client for 30 sec - exiting
03:12:56 (2367): No heartbeat from core client for 30 sec - exiting
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08bd8390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
CPDN Monitor - Quit request from BOINC...
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08a27390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08577390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08d42390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08b23390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08ae9390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09e62390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09fdf390 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
14:47:14 (2567): No heartbeat from core client for 30 sec - exiting
14:47:19 (2567): No heartbeat from core client for 30 sec - exiting
14:47:20 (2567): No heartbeat from core client for 30 sec - exiting
14:47:21 (2567): No heartbeat from core client for 30 sec - exiting
14:47:22 (2567): No heartbeat from core client for 30 sec - exiting
14:47:23 (2567): No heartbeat from core client for 30 sec - exiting
14:47:24 (2567): No heartbeat from core client for 30 sec - exiting
14:47:25 (2567): No heartbeat from core client for 30 sec - exiting
14:47:26 (2567): No heartbeat from core client for 30 sec - exiting
14:47:27 (2567): No heartbeat from core client for 30 sec - exiting
14:47:28 (2567): No heartbeat from core client for 30 sec - exiting
14:47:29 (2567): No heartbeat from core client for 30 sec - exiting
14:47:30 (2567): No heartbeat from core client for 30 sec - exiting
14:47:31 (2567): No heartbeat from core client for 30 sec - exiting
14:47:32 (2567): No heartbeat from core client for 30 sec - exiting
14:47:33 (2567): No heartbeat from core client for 30 sec - exiting
14:47:34 (2567): No heartbeat from core client for 30 sec - exiting
14:47:35 (2567): No heartbeat from core client for 30 sec - exiting
14:47:36 (2567): No heartbeat from core client for 30 sec - exiting
14:47:37 (2567): No heartbeat from core client for 30 sec - exiting
14:47:38 (2567): No heartbeat from core client for 30 sec - exiting
14:47:39 (2567): No heartbeat from core client for 30 sec - exiting
14:47:40 (2567): No heartbeat from core client for 30 sec - exiting
14:47:41 (2567): No heartbeat from core client for 30 sec - exiting
14:47:42 (2567): No heartbeat from core client for 30 sec - exiting
14:47:43 (2567): No heartbeat from core client for 30 sec - exiting
14:47:44 (2567): No heartbeat from core client for 30 sec - exiting
14:47:45 (2567): No heartbeat from core client for 30 sec - exiting
14:47:46 (2567): No heartbeat from core client for 30 sec - exiting
14:47:47 (2567): No heartbeat from core client for 30 sec - exiting
14:47:48 (2567): No heartbeat from core client for 30 sec - exiting
14:47:49 (2567): No heartbeat from core client for 30 sec - exiting
14:47:50 (2567): No heartbeat from core client for 30 sec - exiting
14:47:51 (2567): No heartbeat from core client for 30 sec - exiting
14:47:52 (2567): No heartbeat from core client for 30 sec - exiting
14:47:53 (2567): No heartbeat from core client for 30 sec - exiting
14:47:54 (2567): No heartbeat from core client for 30 sec - exiting
14:47:55 (2567): No heartbeat from core client for 30 sec - exiting
14:47:56 (2567): No heartbeat from core client for 30 sec - exiting
14:47:57 (2567): No heartbeat from core client for 30 sec - exiting
14:47:58 (2567): No heartbeat from core client for 30 sec - exiting
14:47:59 (2567): No heartbeat from core client for 30 sec - exiting
14:48:00 (2567): No heartbeat from core client for 30 sec - exiting
14:48:01 (2567): No heartbeat from core client for 30 sec - exiting
14:48:02 (2567): No heartbeat from core client for 30 sec - exiting
14:48:03 (2567): No heartbeat from core client for 30 sec - exiting
14:48:04 (2567): No heartbeat from core client for 30 sec - exiting
14:48:05 (2567): No heartbeat from core client for 30 sec - exiting
14:48:06 (2567): No heartbeat from core client for 30 sec - exiting
14:48:09 (2567): No heartbeat from core client for 30 sec - exiting
14:48:10 (2567): No heartbeat from core client for 30 sec - exiting
14:48:11 (2567): No heartbeat from core client for 30 sec - exiting
14:48:12 (2567): No heartbeat from core client for 30 sec - exiting
14:48:13 (2567): No heartbeat from core client for 30 sec - exiting
14:48:14 (2567): No heartbeat from core client for 30 sec - exiting
14:48:15 (2567): No heartbeat from core client for 30 sec - exiting
14:48:16 (2567): No heartbeat from core client for 30 sec - exiting
14:48:17 (2567): No heartbeat from core client for 30 sec - exiting
14:48:18 (2567): No heartbeat from core client for 30 sec - exiting
14:48:19 (2567): No heartbeat from core client for 30 sec - exiting
14:48:20 (2567): No heartbeat from core client for 30 sec - exiting
14:48:21 (2567): No heartbeat from core client for 30 sec - exiting
14:48:22 (2567): No heartbeat from core client for 30 sec - exiting
14:48:23 (2567): No heartbeat from core client for 30 sec - exiting
14:48:24 (2567): No heartbeat from core client for 30 sec - exiting
14:48:25 (2567): No heartbeat from core client for 30 sec - exiting
14:48:26 (2567): No heartbeat from core client for 30 sec - exiting
14:48:27 (2567): No heartbeat from core client for 30 sec - exiting
14:48:28 (2567): No heartbeat from core client for 30 sec - exiting
14:48:29 (2567): No heartbeat from core client for 30 sec - exiting
14:48:30 (2567): No heartbeat from core client for 30 sec - exiting
14:48:31 (2567): No heartbeat from core client for 30 sec - exiting
14:48:32 (2567): No heartbeat from core client for 30 sec - exiting
14:48:33 (2567): No heartbeat from core client for 30 sec - exiting
14:48:34 (2567): No heartbeat from core client for 30 sec - exiting
14:48:35 (2567): No heartbeat from core client for 30 sec - exiting
14:48:36 (2567): No heartbeat from core client for 30 sec - exiting
14:48:37 (2567): No heartbeat from core client for 30 sec - exiting
14:48:38 (2567): No heartbeat from core client for 30 sec - exiting
14:48:40 (2567): No heartbeat from core client for 30 sec - exiting
14:48:41 (2567): No heartbeat from core client for 30 sec - exiting
14:48:42 (2567): No heartbeat from core client for 30 sec - exiting
14:48:43 (2567): No heartbeat from core client for 30 sec - exiting
14:48:45 (2567): No heartbeat from core client for 30 sec - exiting
14:48:46 (2567): No heartbeat from core client for 30 sec - exiting
14:48:47 (2567): No heartbeat from core client for 30 sec - exiting
14:48:48 (2567): No heartbeat from core client for 30 sec - exiting
14:48:49 (2567): No heartbeat from core client for 30 sec - exiting
14:48:50 (2567): No heartbeat from core client for 30 sec - exiting
14:48:51 (2567): No heartbeat from core client for 30 sec - exiting
14:48:52 (2567): No heartbeat from core client for 30 sec - exiting
14:48:53 (2567): No heartbeat from core client for 30 sec - exiting
14:48:54 (2567): No heartbeat from core client for 30 sec - exiting
14:48:55 (2567): No heartbeat from core client for 30 sec - exiting
14:48:56 (2567): No heartbeat from core client for 30 sec - exiting
14:48:57 (2567): No heartbeat from core client for 30 sec - exiting
14:48:58 (2567): No heartbeat from core client for 30 sec - exiting
14:48:59 (2567): No heartbeat from core client for 30 sec - exiting
14:49:00 (2567): No heartbeat from core client for 30 sec - exiting
14:49:01 (2567): No heartbeat from core client for 30 sec - exiting
14:49:02 (2567): No heartbeat from core client for 30 sec - exiting
14:49:03 (2567): No heartbeat from core client for 30 sec - exiting
14:49:04 (2567): No heartbeat from core client for 30 sec - exiting
14:49:05 (2567): No heartbeat from core client for 30 sec - exiting
14:49:06 (2567): No heartbeat from core client for 30 sec - exiting
14:49:07 (2567): No heartbeat from core client for 30 sec - exiting
14:49:08 (2567): No heartbeat from core client for 30 sec - exiting
14:49:09 (2567): No heartbeat from core client for 30 sec - exiting
14:49:10 (2567): No heartbeat from core client for 30 sec - exiting
14:49:11 (2567): No heartbeat from core client for 30 sec - exiting
14:49:12 (2567): No heartbeat from core client for 30 sec - exiting
14:49:13 (2567): No heartbeat from core client for 30 sec - exiting
14:49:14 (2567): No heartbeat from core client for 30 sec - exiting
14:49:16 (2567): No heartbeat from core client for 30 sec - exiting
14:49:17 (2567): No heartbeat from core client for 30 sec - exiting
14:49:18 (2567): No heartbeat from core client for 30 sec - exiting
14:49:19 (2567): No heartbeat from core client for 30 sec - exiting
14:49:21 (2567): No heartbeat from core client for 30 sec - exiting
14:49:22 (2567): No heartbeat from core client for 30 sec - exiting
14:49:23 (2567): No heartbeat from core client for 30 sec - exiting
14:49:24 (2567): No heartbeat from core client for 30 sec - exiting
14:49:25 (2567): No heartbeat from core client for 30 sec - exiting
14:49:26 (2567): No heartbeat from core client for 30 sec - exiting
14:49:27 (2567): No heartbeat from core client for 30 sec - exiting
14:49:28 (2567): No heartbeat from core client for 30 sec - exiting
14:49:29 (2567): No heartbeat from core client for 30 sec - exiting
14:49:30 (2567): No heartbeat from core client for 30 sec - exiting
14:49:31 (2567): No heartbeat from core client for 30 sec - exiting
14:49:32 (2567): No heartbeat from core client for 30 sec - exiting
14:49:33 (2567): No heartbeat from core client for 30 sec - exiting
14:49:34 (2567): No heartbeat from core client for 30 sec - exiting
14:49:35 (2567): No heartbeat from core client for 30 sec - exiting
14:49:36 (2567): No heartbeat from core client for 30 sec - exiting
14:49:37 (2567): No heartbeat from core client for 30 sec - exiting
14:49:38 (2567): No heartbeat from core client for 30 sec - exiting
14:49:39 (2567): No heartbeat from core client for 30 sec - exiting
14:49:40 (2567): No heartbeat from core client for 30 sec - exiting
14:49:41 (2567): No heartbeat from core client for 30 sec - exiting
14:49:42 (2567): No heartbeat from core client for 30 sec - exiting
14:49:43 (2567): No heartbeat from core client for 30 sec - exiting
14:49:44 (2567): No heartbeat from core client for 30 sec - exiting
14:49:45 (2567): No heartbeat from core client for 30 sec - exiting
14:49:46 (2567): No heartbeat from core client for 30 sec - exiting
14:49:47 (2567): No heartbeat from core client for 30 sec - exiting
14:49:48 (2567): No heartbeat from core client for 30 sec - exiting
14:49:49 (2567): No heartbeat from core client for 30 sec - exiting
14:49:50 (2567): No heartbeat from core client for 30 sec - exiting
14:49:51 (2567): No heartbeat from core client for 30 sec - exiting
14:49:52 (2567): No heartbeat from core client for 30 sec - exiting
14:49:53 (2567): No heartbeat from core client for 30 sec - exiting
14:49:54 (2567): No heartbeat from core client for 30 sec - exiting
14:49:55 (2567): No heartbeat from core client for 30 sec - exiting
14:49:56 (2567): No heartbeat from core client for 30 sec - exiting
14:49:57 (2567): No heartbeat from core client for 30 sec - exiting
14:49:58 (2567): No heartbeat from core client for 30 sec - exiting
14:49:59 (2567): No heartbeat from core client for 30 sec - exiting
14:50:00 (2567): No heartbeat from core client for 30 sec - exiting
14:50:01 (2567): No heartbeat from core client for 30 sec - exiting
14:50:02 (2567): No heartbeat from core client for 30 sec - exiting
14:50:03 (2567): No heartbeat from core client for 30 sec - exiting
14:50:04 (2567): No heartbeat from core client for 30 sec - exiting
14:50:05 (2567): No heartbeat from core client for 30 sec - exiting
14:50:06 (2567): No heartbeat from core client for 30 sec - exiting
14:50:07 (2567): No heartbeat from core client for 30 sec - exiting
14:50:08 (2567): No heartbeat from core client for 30 sec - exiting
14:50:09 (2567): No heartbeat from core client for 30 sec - exiting
14:50:10 (2567): No heartbeat from core client for 30 sec - exiting
14:50:11 (2567): No heartbeat from core client for 30 sec - exiting
14:50:12 (2567): No heartbeat from core client for 30 sec - exiting
14:50:13 (2567): No heartbeat from core client for 30 sec - exiting
14:50:14 (2567): No heartbeat from core client for 30 sec - exiting
14:50:15 (2567): No heartbeat from core client for 30 sec - exiting

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 May 2013 12:01:41 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 777,600 1,881,995 2.4203
14 May 2013 09:49:09 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 751,680 1,816,583 2.4167
11 May 2013 04:46:17 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 725,760 1,753,381 2.4159
09 May 2013 10:51:50 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 699,840 1,690,330 2.4153
08 May 2013 13:50:01 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 673,920 1,626,647 2.4137
06 May 2013 18:44:44 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 648,000 1,563,539 2.4129
05 May 2013 14:40:23 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 622,080 1,500,415 2.4119
01 May 2013 17:31:53 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 596,160 1,436,926 2.4103
29 Apr 2013 19:14:16 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 570,240 1,374,054 2.4096
28 Apr 2013 15:20:53 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 544,320 1,311,161 2.4088
27 Apr 2013 07:52:44 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 518,400 1,248,281 2.4079
26 Apr 2013 08:58:02 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 492,480 1,185,624 2.4075
24 Apr 2013 19:04:47 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 466,560 1,122,605 2.4061
23 Apr 2013 15:30:43 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 440,640 1,059,252 2.4039
22 Apr 2013 11:44:53 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 414,720 996,295 2.4023
21 Apr 2013 11:37:56 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 388,800 933,437 2.4008
19 Apr 2013 18:40:41 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 362,880 870,563 2.3990
18 Apr 2013 14:25:35 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 336,960 807,998 2.3979
17 Apr 2013 17:22:42 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 311,040 745,240 2.3960
16 Apr 2013 12:05:48 1265460 15701451 hadcm3n_4e8a_1940_40_008305511_1 285,120 682,270 2.3929


©2024 climateprediction.net