climateprediction.net home page
Task 15702519

Task 15702519

Name hadcm3n_zjp7_1920_40_008256875_4
Workunit 8411999
Created 5 Apr 2013, 6:58:28 UTC
Sent 5 Apr 2013, 6:58:32 UTC
Report deadline 5 Jul 2013, 14:25:43 UTC
Received 21 Nov 2013, 10:45:02 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 1260095
Run time 10 days 5 hours 1 min 57 sec
CPU time 10 days 5 hours 1 min 57 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 3.04 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
aborted by user
</message>
<stderr_txt>
xiting
13:27:05 (3520): No heartbeat from core client for 30 sec - exiting
13:27:06 (3520): No heartbeat from core client for 30 sec - exiting
13:27:07 (3520): No heartbeat from core client for 30 sec - exiting
13:27:08 (3520): No heartbeat from core client for 30 sec - exiting
13:27:09 (3520): No heartbeat from core client for 30 sec - exiting
13:27:10 (3520): No heartbeat from core client for 30 sec - exiting
13:27:11 (3520): No heartbeat from core client for 30 sec - exiting
13:27:12 (3520): No heartbeat from core client for 30 sec - exiting
13:27:13 (3520): No heartbeat from core client for 30 sec - exiting
13:27:14 (3520): No heartbeat from core client for 30 sec - exiting
13:27:15 (3520): No heartbeat from core client for 30 sec - exiting
13:27:16 (3520): No heartbeat from core client for 30 sec - exiting
13:27:17 (3520): No heartbeat from core client for 30 sec - exiting
13:27:18 (3520): No heartbeat from core client for 30 sec - exiting
13:27:19 (3520): No heartbeat from core client for 30 sec - exiting
13:27:20 (3520): No heartbeat from core client for 30 sec - exiting
13:27:21 (3520): No heartbeat from core client for 30 sec - exiting
13:27:22 (3520): No heartbeat from core client for 30 sec - exiting
13:27:23 (3520): No heartbeat from core client for 30 sec - exiting
13:27:24 (3520): No heartbeat from core client for 30 sec - exiting
13:27:25 (3520): No heartbeat from core client for 30 sec - exiting
13:27:26 (3520): No heartbeat from core client for 30 sec - exiting
13:27:27 (3520): No heartbeat from core client for 30 sec - exiting
13:27:28 (3520): No heartbeat from core client for 30 sec - exiting
13:27:29 (3520): No heartbeat from core client for 30 sec - exiting
13:27:30 (3520): No heartbeat from core client for 30 sec - exiting
13:27:31 (3520): No heartbeat from core client for 30 sec - exiting
13:27:32 (3520): No heartbeat from core client for 30 sec - exiting
13:27:33 (3520): No heartbeat from core client for 30 sec - exiting
13:27:34 (3520): No heartbeat from core client for 30 sec - exiting
13:27:35 (3520): No heartbeat from core client for 30 sec - exiting
13:27:36 (3520): No heartbeat from core client for 30 sec - exiting
13:28:07 (3520): No heartbeat from core client for 30 sec - exiting
13:28:08 (3520): No heartbeat from core client for 30 sec - exiting
13:28:09 (3520): No heartbeat from core client for 30 sec - exiting
13:28:10 (3520): No heartbeat from core client for 30 sec - exiting
13:28:11 (3520): No heartbeat from core client for 30 sec - exiting
13:28:12 (3520): No heartbeat from core client for 30 sec - exiting
13:28:13 (3520): No heartbeat from core client for 30 sec - exiting
13:28:14 (3520): No heartbeat from core client for 30 sec - exiting
13:28:15 (3520): No heartbeat from core client for 30 sec - exiting
13:28:16 (3520): No heartbeat from core client for 30 sec - exiting
13:28:17 (3520): No heartbeat from core client for 30 sec - exiting
13:28:18 (3520): No heartbeat from core client for 30 sec - exiting
13:28:19 (3520): No heartbeat from core client for 30 sec - exiting
13:28:20 (3520): No heartbeat from core client for 30 sec - exiting
13:28:21 (3520): No heartbeat from core client for 30 sec - exiting
13:28:22 (3520): No heartbeat from core client for 30 sec - exiting
13:28:23 (3520): No heartbeat from core client for 30 sec - exiting
13:28:24 (3520): No heartbeat from core client for 30 sec - exiting
13:28:25 (3520): No heartbeat from core client for 30 sec - exiting
13:28:26 (3520): No heartbeat from core client for 30 sec - exiting
13:28:27 (3520): No heartbeat from core client for 30 sec - exiting
13:28:28 (3520): No heartbeat from core client for 30 sec - exiting
13:28:29 (3520): No heartbeat from core client for 30 sec - exiting
13:28:30 (3520): No heartbeat from core client for 30 sec - exiting
13:28:31 (3520): No heartbeat from core client for 30 sec - exiting
13:28:32 (3520): No heartbeat from core client for 30 sec - exiting
13:28:33 (3520): No heartbeat from core client for 30 sec - exiting
13:28:34 (3520): No heartbeat from core client for 30 sec - exiting
13:28:35 (3520): No heartbeat from core client for 30 sec - exiting
13:28:36 (3520): No heartbeat from core client for 30 sec - exiting
13:28:37 (3520): No heartbeat from core client for 30 sec - exiting
13:28:38 (3520): No heartbeat from core client for 30 sec - exiting
13:28:39 (3520): No heartbeat from core client for 30 sec - exiting
13:28:40 (3520): No heartbeat from core client for 30 sec - exiting
13:28:41 (3520): No heartbeat from core client for 30 sec - exiting
13:28:42 (3520): No heartbeat from core client for 30 sec - exiting
13:28:43 (3520): No heartbeat from core client for 30 sec - exiting
13:28:44 (3520): No heartbeat from core client for 30 sec - exiting
13:28:45 (3520): No heartbeat from core client for 30 sec - exiting
13:28:46 (3520): No heartbeat from core client for 30 sec - exiting
13:28:47 (3520): No heartbeat from core client for 30 sec - exiting
13:28:48 (3520): No heartbeat from core client for 30 sec - exiting
13:28:49 (3520): No heartbeat from core client for 30 sec - exiting
13:28:50 (3520): No heartbeat from core client for 30 sec - exiting
13:28:51 (3520): No heartbeat from core client for 30 sec - exiting
13:28:52 (3520): No heartbeat from core client for 30 sec - exiting
13:28:53 (3520): No heartbeat from core client for 30 sec - exiting
13:28:54 (3520): No heartbeat from core client for 30 sec - exiting
13:28:55 (3520): No heartbeat from core client for 30 sec - exiting
13:28:56 (3520): No heartbeat from core client for 30 sec - exiting
13:28:57 (3520): No heartbeat from core client for 30 sec - exiting
13:30:39 (3520): No heartbeat from core client for 30 sec - exiting
13:30:40 (3520): No heartbeat from core client for 30 sec - exiting
13:30:41 (3520): No heartbeat from core client for 30 sec - exiting
13:30:42 (3520): No heartbeat from core client for 30 sec - exiting
13:30:43 (3520): No heartbeat from core client for 30 sec - exiting
13:30:44 (3520): No heartbeat from core client for 30 sec - exiting
13:30:45 (3520): No heartbeat from core client for 30 sec - exiting
13:30:46 (3520): No heartbeat from core client for 30 sec - exiting
13:30:47 (3520): No heartbeat from core client for 30 sec - exiting
13:30:48 (3520): No heartbeat from core client for 30 sec - exiting
13:30:49 (3520): No heartbeat from core client for 30 sec - exiting
13:30:50 (3520): No heartbeat from core client for 30 sec - exiting
13:30:51 (3520): No heartbeat from core client for 30 sec - exiting
13:30:52 (3520): No heartbeat from core client for 30 sec - exiting
13:30:53 (3520): No heartbeat from core client for 30 sec - exiting
13:30:54 (3520): No heartbeat from core client for 30 sec - exiting
13:30:55 (3520): No heartbeat from core client for 30 sec - exiting
13:30:56 (3520): No heartbeat from core client for 30 sec - exiting
13:30:57 (3520): No heartbeat from core client for 30 sec - exiting
13:30:58 (3520): No heartbeat from core client for 30 sec - exiting
13:30:59 (3520): No heartbeat from core client for 30 sec - exiting
13:31:00 (3520): No heartbeat from core client for 30 sec - exiting
13:31:01 (3520): No heartbeat from core client for 30 sec - exiting
13:31:02 (3520): No heartbeat from core client for 30 sec - exiting
13:31:03 (3520): No heartbeat from core client for 30 sec - exiting
13:31:04 (3520): No heartbeat from core client for 30 sec - exiting
13:31:05 (3520): No heartbeat from core client for 30 sec - exiting
13:31:06 (3520): No heartbeat from core client for 30 sec - exiting
13:31:07 (3520): No heartbeat from core client for 30 sec - exiting
13:31:08 (3520): No heartbeat from core client for 30 sec - exiting
13:31:09 (3520): No heartbeat from core client for 30 sec - exiting
13:31:10 (3520): No heartbeat from core client for 30 sec - exiting
13:31:11 (3520): No heartbeat from core client for 30 sec - exiting
13:31:12 (3520): No heartbeat from core client for 30 sec - exiting
13:31:13 (3520): No heartbeat from core client for 30 sec - exiting
13:31:14 (3520): No heartbeat from core client for 30 sec - exiting
13:31:15 (3520): No heartbeat from core client for 30 sec - exiting
13:31:16 (3520): No heartbeat from core client for 30 sec - exiting
13:31:17 (3520): No heartbeat from core client for 30 sec - exiting
13:31:18 (3520): No heartbeat from core client for 30 sec - exiting
13:31:19 (3520): No heartbeat from core client for 30 sec - exiting
13:31:20 (3520): No heartbeat from core client for 30 sec - exiting
13:31:21 (3520): No heartbeat from core client for 30 sec - exiting
13:31:22 (3520): No heartbeat from core client for 30 sec - exiting
13:31:23 (3520): No heartbeat from core client for 30 sec - exiting
13:31:24 (3520): No heartbeat from core client for 30 sec - exiting
13:31:25 (3520): No heartbeat from core client for 30 sec - exiting
13:31:26 (3520): No heartbeat from core client for 30 sec - exiting
13:31:27 (3520): No heartbeat from core client for 30 sec - exiting
13:31:28 (3520): No heartbeat from core client for 30 sec - exiting
13:31:29 (3520): No heartbeat from core client for 30 sec - exiting
13:54:35 (3520): No heartbeat from core client for 30 sec - exiting
13:54:36 (3520): No heartbeat from core client for 30 sec - exiting
13:54:37 (3520): No heartbeat from core client for 30 sec - exiting
13:54:38 (3520): No heartbeat from core client for 30 sec - exiting
13:54:39 (3520): No heartbeat from core client for 30 sec - exiting
13:54:40 (3520): No heartbeat from core client for 30 sec - exiting
13:54:41 (3520): No heartbeat from core client for 30 sec - exiting
13:54:42 (3520): No heartbeat from core client for 30 sec - exiting
13:54:43 (3520): No heartbeat from core client for 30 sec - exiting
13:54:44 (3520): No heartbeat from core client for 30 sec - exiting
13:54:45 (3520): No heartbeat from core client for 30 sec - exiting
13:54:46 (3520): No heartbeat from core client for 30 sec - exiting
13:54:47 (3520): No heartbeat from core client for 30 sec - exiting
13:54:48 (3520): No heartbeat from core client for 30 sec - exiting
13:54:49 (3520): No heartbeat from core client for 30 sec - exiting
13:54:50 (3520): No heartbeat from core client for 30 sec - exiting
13:54:51 (3520): No heartbeat from core client for 30 sec - exiting
13:54:52 (3520): No heartbeat from core client for 30 sec - exiting
13:54:53 (3520): No heartbeat from core client for 30 sec - exiting
13:54:54 (3520): No heartbeat from core client for 30 sec - exiting
13:54:55 (3520): No heartbeat from core client for 30 sec - exiting
13:54:56 (3520): No heartbeat from core client for 30 sec - exiting
13:54:57 (3520): No heartbeat from core client for 30 sec - exiting
13:54:58 (3520): No heartbeat from core client for 30 sec - exiting
13:54:59 (3520): No heartbeat from core client for 30 sec - exiting
13:55:00 (3520): No heartbeat from core client for 30 sec - exiting
13:55:01 (3520): No heartbeat from core client for 30 sec - exiting
13:55:02 (3520): No heartbeat from core client for 30 sec - exiting
13:55:03 (3520): No heartbeat from core client for 30 sec - exiting
13:55:04 (3520): No heartbeat from core client for 30 sec - exiting
13:55:05 (3520): No heartbeat from core client for 30 sec - exiting
13:55:06 (3520): No heartbeat from core client for 30 sec - exiting
13:55:07 (3520): No heartbeat from core client for 30 sec - exiting
13:55:08 (3520): No heartbeat from core client for 30 sec - exiting
13:55:09 (3520): No heartbeat from core client for 30 sec - exiting
13:55:10 (3520): No heartbeat from core client for 30 sec - exiting
13:55:11 (3520): No heartbeat from core client for 30 sec - exiting
13:55:12 (3520): No heartbeat from core client for 30 sec - exiting
13:55:13 (3520): No heartbeat from core client for 30 sec - exiting
13:55:14 (3520): No heartbeat from core client for 30 sec - exiting
13:55:15 (3520): No heartbeat from core client for 30 sec - exiting
13:55:16 (3520): No heartbeat from core client for 30 sec - exiting
13:55:17 (3520): No heartbeat from core client for 30 sec - exiting
13:55:18 (3520): No heartbeat from core client for 30 sec - exiting
13:55:19 (3520): No heartbeat from core client for 30 sec - exiting
13:55:20 (3520): No heartbeat from core client for 30 sec - exiting
13:55:21 (3520): No heartbeat from core client for 30 sec - exiting
13:55:22 (3520): No heartbeat from core client for 30 sec - exiting
13:55:23 (3520): No heartbeat from core client for 30 sec - exiting
13:55:24 (3520): No heartbeat from core client for 30 sec - exiting
13:55:55 (3520): No heartbeat from core client for 30 sec - exiting
13:55:56 (3520): No heartbeat from core client for 30 sec - exiting
13:55:57 (3520): No heartbeat from core client for 30 sec - exiting
13:55:58 (3520): No heartbeat from core client for 30 sec - exiting
13:55:59 (3520): No heartbeat from core client for 30 sec - exiting
13:56:00 (3520): No heartbeat from core client for 30 sec - exiting
13:56:01 (3520): No heartbeat from core client for 30 sec - exiting
13:56:02 (3520): No heartbeat from core client for 30 sec - exiting
13:56:03 (3520): No heartbeat from core client for 30 sec - exiting
13:56:04 (3520): No heartbeat from core client for 30 sec - exiting
13:56:05 (3520): No heartbeat from core client for 30 sec - exiting
13:56:06 (3520): No heartbeat from core client for 30 sec - exiting
13:56:07 (3520): No heartbeat from core client for 30 sec - exiting
13:56:08 (3520): No heartbeat from core client for 30 sec - exiting
13:56:09 (3520): No heartbeat from core client for 30 sec - exiting
13:56:10 (3520): No heartbeat from core client for 30 sec - exiting
13:56:11 (3520): No heartbeat from core client for 30 sec - exiting
13:56:12 (3520): No heartbeat from core client for 30 sec - exiting
13:56:13 (3520): No heartbeat from core client for 30 sec - exiting
13:56:14 (3520): No heartbeat from core client for 30 sec - exiting
13:56:15 (3520): No heartbeat from core client for 30 sec - exiting
13:56:16 (3520): No heartbeat from core client for 30 sec - exiting
13:56:17 (3520): No heartbeat from core client for 30 sec - exiting
13:56:18 (3520): No heartbeat from core client for 30 sec - exiting
13:56:19 (3520): No heartbeat from core client for 30 sec - exiting
13:56:20 (3520): No heartbeat from core client for 30 sec - exiting
13:56:21 (3520): No heartbeat from core client for 30 sec - exiting
13:56:22 (3520): No heartbeat from core client for 30 sec - exiting
13:56:23 (3520): No heartbeat from core client for 30 sec - exiting
13:56:24 (3520): No heartbeat from core client for 30 sec - exiting
13:56:25 (3520): No heartbeat from core client for 30 sec - exiting
13:56:26 (3520): No heartbeat from core client for 30 sec - exiting
13:56:27 (3520): No heartbeat from core client for 30 sec - exiting
13:56:28 (3520): No heartbeat from core client for 30 sec - exiting
13:56:29 (3520): No heartbeat from core client for 30 sec - exiting
13:56:30 (3520): No heartbeat from core client for 30 sec - exiting
13:56:31 (3520): No heartbeat from core client for 30 sec - exiting
13:56:32 (3520): No heartbeat from core client for 30 sec - exiting
13:56:33 (3520): No heartbeat from core client for 30 sec - exiting
13:56:34 (3520): No heartbeat from core client for 30 sec - exiting
13:56:35 (3520): No heartbeat from core client for 30 sec - exiting
13:56:36 (3520): No heartbeat from core client for 30 sec - exiting
13:56:37 (3520): No heartbeat from core client for 30 sec - exiting
13:56:38 (3520): No heartbeat from core client for 30 sec - exiting
13:56:39 (3520): No heartbeat from core client for 30 sec - exiting
13:56:40 (3520): No heartbeat from core client for 30 sec - exiting
13:56:41 (3520): No heartbeat from core client for 30 sec - exiting
13:56:42 (3520): No heartbeat from core client for 30 sec - exiting
13:56:43 (3520): No heartbeat from core client for 30 sec - exiting
13:56:44 (3520): No heartbeat from core client for 30 sec - exiting
13:56:45 (3520): No heartbeat from core client for 30 sec - exiting
14:25:25 (3584): No heartbeat from core client for 30 sec - exiting
14:25:27 (3584): No heartbeat from core client for 30 sec - exiting
14:25:28 (3584): No heartbeat from core client for 30 sec - exiting
14:25:29 (3584): No heartbeat from core client for 30 sec - exiting
14:25:30 (3584): No heartbeat from core client for 30 sec - exiting
14:25:31 (3584): No heartbeat from core client for 30 sec - exiting
14:25:32 (3584): No heartbeat from core client for 30 sec - exiting
14:25:33 (3584): No heartbeat from core client for 30 sec - exiting
14:25:34 (3584): No heartbeat from core client for 30 sec - exiting
14:25:35 (3584): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08feb860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
08:54:55 (3751): No heartbeat from core client for 30 sec - exiting
08:54:56 (3751): No heartbeat from core client for 30 sec - exiting
08:54:57 (3751): No heartbeat from core client for 30 sec - exiting
08:54:58 (3751): No heartbeat from core client for 30 sec - exiting
08:54:59 (3751): No heartbeat from core client for 30 sec - exiting
08:55:00 (3751): No heartbeat from core client for 30 sec - exiting
08:55:01 (3751): No heartbeat from core client for 30 sec - exiting
08:55:02 (3751): No heartbeat from core client for 30 sec - exiting
08:55:03 (3751): No heartbeat from core client for 30 sec - exiting
08:55:04 (3751): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09486860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08e9e860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08399860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09df4860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x092a0860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
08:49:40 (3701): No heartbeat from core client for 30 sec - exiting
08:49:41 (3701): No heartbeat from core client for 30 sec - exiting
08:49:42 (3701): No heartbeat from core client for 30 sec - exiting
08:49:43 (3701): No heartbeat from core client for 30 sec - exiting
08:49:44 (3701): No heartbeat from core client for 30 sec - exiting
08:49:45 (3701): No heartbeat from core client for 30 sec - exiting
08:49:46 (3701): No heartbeat from core client for 30 sec - exiting
08:49:47 (3701): No heartbeat from core client for 30 sec - exiting
08:49:48 (3701): No heartbeat from core client for 30 sec - exiting
08:49:49 (3701): No heartbeat from core client for 30 sec - exiting
08:49:50 (3701): No heartbeat from core client for 30 sec - exiting
08:51:40 (3714): No heartbeat from core client for 30 sec - exiting
08:51:42 (3714): No heartbeat from core client for 30 sec - exiting
08:51:43 (3714): No heartbeat from core client for 30 sec - exiting
08:51:44 (3714): No heartbeat from core client for 30 sec - exiting
08:51:45 (3714): No heartbeat from core client for 30 sec - exiting
08:51:46 (3714): No heartbeat from core client for 30 sec - exiting
08:51:47 (3714): No heartbeat from core client for 30 sec - exiting
08:51:48 (3714): No heartbeat from core client for 30 sec - exiting
08:51:49 (3714): No heartbeat from core client for 30 sec - exiting
08:51:50 (3714): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08fdd860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
08:51:51 (3714): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09abc860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
12:42:24 (3655): No heartbeat from core client for 30 sec - exiting
12:42:25 (3655): No heartbeat from core client for 30 sec - exiting
12:42:26 (3655): No heartbeat from core client for 30 sec - exiting
12:42:27 (3655): No heartbeat from core client for 30 sec - exiting
12:42:28 (3655): No heartbeat from core client for 30 sec - exiting
12:42:29 (3655): No heartbeat from core client for 30 sec - exiting
12:42:30 (3655): No heartbeat from core client for 30 sec - exiting
12:42:31 (3655): No heartbeat from core client for 30 sec - exiting
12:42:32 (3655): No heartbeat from core client for 30 sec - exiting
12:42:33 (3655): No heartbeat from core client for 30 sec - exiting
12:42:34 (3655): No heartbeat from core client for 30 sec - exiting
12:42:35 (3655): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x086eb860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
12:42:36 (3655): No heartbeat from core client for 30 sec - exiting
12:42:37 (3655): No heartbeat from core client for 30 sec - exiting
12:42:38 (3655): No heartbeat from core client for 30 sec - exiting
12:42:39 (3655): No heartbeat from core client for 30 sec - exiting
12:42:40 (3655): No heartbeat from core client for 30 sec - exiting
12:42:41 (3655): No heartbeat from core client for 30 sec - exiting
12:42:42 (3655): No heartbeat from core client for 30 sec - exiting
12:42:43 (3655): No heartbeat from core client for 30 sec - exiting
12:42:44 (3655): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08af5860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08cd8860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x082c4860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08200860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
08:47:39 (3956): No heartbeat from core client for 30 sec - exiting
08:47:40 (3956): No heartbeat from core client for 30 sec - exiting
08:47:41 (3956): No heartbeat from core client for 30 sec - exiting
08:47:42 (3956): No heartbeat from core client for 30 sec - exiting
08:47:43 (3956): No heartbeat from core client for 30 sec - exiting
08:47:44 (3956): No heartbeat from core client for 30 sec - exiting
08:47:45 (3956): No heartbeat from core client for 30 sec - exiting
08:47:48 (3956): No heartbeat from core client for 30 sec - exiting
08:47:49 (3956): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x084d3860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09a58860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08638860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09fba860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
15:33:55 (3496): No heartbeat from core client for 30 sec - exiting
15:33:56 (3496): No heartbeat from core client for 30 sec - exiting
15:33:57 (3496): No heartbeat from core client for 30 sec - exiting
15:33:58 (3496): No heartbeat from core client for 30 sec - exiting
15:33:59 (3496): No heartbeat from core client for 30 sec - exiting
15:34:00 (3496): No heartbeat from core client for 30 sec - exiting
15:34:01 (3496): No heartbeat from core client for 30 sec - exiting
15:34:02 (3496): No heartbeat from core client for 30 sec - exiting
15:34:03 (3496): No heartbeat from core client for 30 sec - exiting
15:34:04 (3496): No heartbeat from core client for 30 sec - exiting
15:34:05 (3496): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x092e5860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
08:51:45 (3521): No heartbeat from core client for 30 sec - exiting
08:51:48 (3521): No heartbeat from core client for 30 sec - exiting
08:51:49 (3521): No heartbeat from core client for 30 sec - exiting
08:51:50 (3521): No heartbeat from core client for 30 sec - exiting
08:51:51 (3521): No heartbeat from core client for 30 sec - exiting
08:51:52 (3521): No heartbeat from core client for 30 sec - exiting
08:51:53 (3521): No heartbeat from core client for 30 sec - exiting
08:51:54 (3521): No heartbeat from core client for 30 sec - exiting
08:51:55 (3521): No heartbeat from core client for 30 sec - exiting
08:51:56 (3521): No heartbeat from core client for 30 sec - exiting
08:51:57 (3521): No heartbeat from core client for 30 sec - exiting
08:51:58 (3521): No heartbeat from core client for 30 sec - exiting
08:51:59 (3521): No heartbeat from core client for 30 sec - exiting
08:52:00 (3521): No heartbeat from core client for 30 sec - exiting
08:52:01 (3521): No heartbeat from core client for 30 sec - exiting
08:52:02 (3521): No heartbeat from core client for 30 sec - exiting
08:52:03 (3521): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08206860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
08:52:04 (3521): No heartbeat from core client for 30 sec - exiting
08:52:05 (3521): No heartbeat from core client for 30 sec - exiting
08:52:06 (3521): No heartbeat from core client for 30 sec - exiting
08:52:07 (3521): No heartbeat from core client for 30 sec - exiting
08:52:08 (3521): No heartbeat from core client for 30 sec - exiting
08:52:09 (3521): No heartbeat from core client for 30 sec - exiting
08:52:10 (3521): No heartbeat from core client for 30 sec - exiting
08:52:11 (3521): No heartbeat from core client for 30 sec - exiting
08:52:12 (3521): No heartbeat from core client for 30 sec - exiting
08:52:13 (3521): No heartbeat from core client for 30 sec - exiting
08:52:14 (3521): No heartbeat from core client for 30 sec - exiting
08:52:15 (3521): No heartbeat from core client for 30 sec - exiting
08:52:16 (3521): No heartbeat from core client for 30 sec - exiting
08:52:17 (3521): No heartbeat from core client for 30 sec - exiting
08:52:18 (3521): No heartbeat from core client for 30 sec - exiting
08:52:19 (3521): No heartbeat from core client for 30 sec - exiting
08:52:20 (3521): No heartbeat from core client for 30 sec - exiting
08:52:21 (3521): No heartbeat from core client for 30 sec - exiting
08:52:22 (3521): No heartbeat from core client for 30 sec - exiting
08:52:23 (3521): No heartbeat from core client for 30 sec - exiting
08:52:24 (3521): No heartbeat from core client for 30 sec - exiting
08:52:25 (3521): No heartbeat from core client for 30 sec - exiting
08:52:26 (3521): No heartbeat from core client for 30 sec - exiting
08:52:27 (3521): No heartbeat from core client for 30 sec - exiting
08:52:28 (3521): No heartbeat from core client for 30 sec - exiting
08:52:29 (3521): No heartbeat from core client for 30 sec - exiting
08:52:30 (3521): No heartbeat from core client for 30 sec - exiting
08:52:31 (3521): No heartbeat from core client for 30 sec - exiting
08:52:32 (3521): No heartbeat from core client for 30 sec - exiting
08:52:33 (3521): No heartbeat from core client for 30 sec - exiting
08:52:34 (3521): No heartbeat from core client for 30 sec - exiting
08:52:35 (3521): No heartbeat from core client for 30 sec - exiting
08:52:36 (3521): No heartbeat from core client for 30 sec - exiting
08:52:37 (3521): No heartbeat from core client for 30 sec - exiting
08:52:38 (3521): No heartbeat from core client for 30 sec - exiting
08:52:39 (3521): No heartbeat from core client for 30 sec - exiting
08:52:40 (3521): No heartbeat from core client for 30 sec - exiting
08:52:41 (3521): No heartbeat from core client for 30 sec - exiting
08:52:42 (3521): No heartbeat from core client for 30 sec - exiting
08:52:43 (3521): No heartbeat from core client for 30 sec - exiting
08:52:44 (3521): No heartbeat from core client for 30 sec - exiting
08:52:45 (3521): No heartbeat from core client for 30 sec - exiting
08:52:46 (3521): No heartbeat from core client for 30 sec - exiting
08:52:47 (3521): No heartbeat from core client for 30 sec - exiting
08:52:48 (3521): No heartbeat from core client for 30 sec - exiting
08:52:49 (3521): No heartbeat from core client for 30 sec - exiting
08:52:50 (3521): No heartbeat from core client for 30 sec - exiting
08:52:51 (3521): No heartbeat from core client for 30 sec - exiting
08:52:52 (3521): No heartbeat from core client for 30 sec - exiting
08:52:53 (3521): No heartbeat from core client for 30 sec - exiting
08:52:54 (3521): No heartbeat from core client for 30 sec - exiting
08:52:55 (3521): No heartbeat from core client for 30 sec - exiting
08:52:56 (3521): No heartbeat from core client for 30 sec - exiting
08:52:57 (3521): No heartbeat from core client for 30 sec - exiting
08:52:58 (3521): No heartbeat from core client for 30 sec - exiting
08:52:59 (3521): No heartbeat from core client for 30 sec - exiting
08:53:00 (3521): No heartbeat from core client for 30 sec - exiting
08:53:01 (3521): No heartbeat from core client for 30 sec - exiting
08:53:02 (3521): No heartbeat from core client for 30 sec - exiting
08:53:03 (3521): No heartbeat from core client for 30 sec - exiting
08:53:04 (3521): No heartbeat from core client for 30 sec - exiting
08:53:05 (3521): No heartbeat from core client for 30 sec - exiting
08:53:06 (3521): No heartbeat from core client for 30 sec - exiting
08:53:07 (3521): No heartbeat from core client for 30 sec - exiting
08:53:08 (3521): No heartbeat from core client for 30 sec - exiting
08:53:09 (3521): No heartbeat from core client for 30 sec - exiting
08:53:10 (3521): No heartbeat from core client for 30 sec - exiting
08:53:11 (3521): No heartbeat from core client for 30 sec - exiting
08:53:12 (3521): No heartbeat from core client for 30 sec - exiting
08:53:13 (3521): No heartbeat from core client for 30 sec - exiting
08:53:14 (3521): No heartbeat from core client for 30 sec - exiting
08:53:15 (3521): No heartbeat from core client for 30 sec - exiting
08:53:16 (3521): No heartbeat from core client for 30 sec - exiting
08:53:17 (3521): No heartbeat from core client for 30 sec - exiting
08:53:18 (3521): No heartbeat from core client for 30 sec - exiting
08:53:19 (3521): No heartbeat from core client for 30 sec - exiting
08:53:20 (3521): No heartbeat from core client for 30 sec - exiting
08:53:21 (3521): No heartbeat from core client for 30 sec - exiting
08:53:22 (3521): No heartbeat from core client for 30 sec - exiting
08:53:23 (3521): No heartbeat from core client for 30 sec - exiting
08:53:24 (3521): No heartbeat from core client for 30 sec - exiting
08:53:25 (3521): No heartbeat from core client for 30 sec - exiting
08:53:26 (3521): No heartbeat from core client for 30 sec - exiting
08:53:27 (3521): No heartbeat from core client for 30 sec - exiting
08:53:28 (3521): No heartbeat from core client for 30 sec - exiting
08:53:29 (3521): No heartbeat from core client for 30 sec - exiting
08:53:30 (3521): No heartbeat from core client for 30 sec - exiting
08:53:31 (3521): No heartbeat from core client for 30 sec - exiting
08:53:32 (3521): No heartbeat from core client for 30 sec - exiting
08:53:33 (3521): No heartbeat from core client for 30 sec - exiting
08:53:35 (3521): No heartbeat from core client for 30 sec - exiting
08:53:36 (3521): No heartbeat from core client for 30 sec - exiting
08:53:37 (3521): No heartbeat from core client for 30 sec - exiting
08:53:38 (3521): No heartbeat from core client for 30 sec - exiting
08:53:39 (3521): No heartbeat from core client for 30 sec - exiting
08:52:52 (3524): No heartbeat from core client for 30 sec - exiting
08:52:53 (3524): No heartbeat from core client for 30 sec - exiting
08:52:54 (3524): No heartbeat from core client for 30 sec - exiting
08:52:55 (3524): No heartbeat from core client for 30 sec - exiting
08:52:56 (3524): No heartbeat from core client for 30 sec - exiting
08:52:57 (3524): No heartbeat from core client for 30 sec - exiting
08:52:58 (3524): No heartbeat from core client for 30 sec - exiting
08:52:59 (3524): No heartbeat from core client for 30 sec - exiting
08:53:00 (3524): No heartbeat from core client for 30 sec - exiting
08:53:01 (3524): No heartbeat from core client for 30 sec - exiting
08:53:02 (3524): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09bad860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
08:51:52 (3475): No heartbeat from core client for 30 sec - exiting
08:51:54 (3475): No heartbeat from core client for 30 sec - exiting
08:51:55 (3475): No heartbeat from core client for 30 sec - exiting
08:51:56 (3475): No heartbeat from core client for 30 sec - exiting
08:51:57 (3475): No heartbeat from core client for 30 sec - exiting
08:51:58 (3475): No heartbeat from core client for 30 sec - exiting
08:51:59 (3475): No heartbeat from core client for 30 sec - exiting
08:52:00 (3475): No heartbeat from core client for 30 sec - exiting
08:52:01 (3475): No heartbeat from core client for 30 sec - exiting
08:52:02 (3475): No heartbeat from core client for 30 sec - exiting
08:52:03 (3475): No heartbeat from core client for 30 sec - exiting
08:52:04 (3475): No heartbeat from core client for 30 sec - exiting
08:52:05 (3475): No heartbeat from core client for 30 sec - exiting
08:52:06 (3475): No heartbeat from core client for 30 sec - exiting
08:52:07 (3475): No heartbeat from core client for 30 sec - exiting
08:52:08 (3475): No heartbeat from core client for 30 sec - exiting
08:52:09 (3475): No heartbeat from core client for 30 sec - exiting
08:52:10 (3475): No heartbeat from core client for 30 sec - exiting
08:52:11 (3475): No heartbeat from core client for 30 sec - exiting
08:52:12 (3475): No heartbeat from core client for 30 sec - exiting
08:52:13 (3475): No heartbeat from core client for 30 sec - exiting
08:52:14 (3475): No heartbeat from core client for 30 sec - exiting
08:52:15 (3475): No heartbeat from core client for 30 sec - exiting
08:52:16 (3475): No heartbeat from core client for 30 sec - exiting
08:52:17 (3475): No heartbeat from core client for 30 sec - exiting
08:52:18 (3475): No heartbeat from core client for 30 sec - exiting
08:52:19 (3475): No heartbeat from core client for 30 sec - exiting
08:52:20 (3475): No heartbeat from core client for 30 sec - exiting
08:52:21 (3475): No heartbeat from core client for 30 sec - exiting
08:52:22 (3475): No heartbeat from core client for 30 sec - exiting
08:52:23 (3475): No heartbeat from core client for 30 sec - exiting
08:52:24 (3475): No heartbeat from core client for 30 sec - exiting
08:52:25 (3475): No heartbeat from core client for 30 sec - exiting
08:52:26 (3475): No heartbeat from core client for 30 sec - exiting
08:52:27 (3475): No heartbeat from core client for 30 sec - exiting
08:52:28 (3475): No heartbeat from core client for 30 sec - exiting
08:52:29 (3475): No heartbeat from core client for 30 sec - exiting
08:52:30 (3475): No heartbeat from core client for 30 sec - exiting
08:52:31 (3475): No heartbeat from core client for 30 sec - exiting
08:52:32 (3475): No heartbeat from core client for 30 sec - exiting
08:52:33 (3475): No heartbeat from core client for 30 sec - exiting
08:52:34 (3475): No heartbeat from core client for 30 sec - exiting
08:52:35 (3475): No heartbeat from core client for 30 sec - exiting
08:52:36 (3475): No heartbeat from core client for 30 sec - exiting
08:52:37 (3475): No heartbeat from core client for 30 sec - exiting
08:52:38 (3475): No heartbeat from core client for 30 sec - exiting
08:52:39 (3475): No heartbeat from core client for 30 sec - exiting
08:52:40 (3475): No heartbeat from core client for 30 sec - exiting
08:52:41 (3475): No heartbeat from core client for 30 sec - exiting
08:52:42 (3475): No heartbeat from core client for 30 sec - exiting
08:52:43 (3475): No heartbeat from core client for 30 sec - exiting
08:52:44 (3475): No heartbeat from core client for 30 sec - exiting
08:52:45 (3475): No heartbeat from core client for 30 sec - exiting
08:52:46 (3475): No heartbeat from core client for 30 sec - exiting
08:52:47 (3475): No heartbeat from core client for 30 sec - exiting
08:52:48 (3475): No heartbeat from core client for 30 sec - exiting
08:52:49 (3475): No heartbeat from core client for 30 sec - exiting
08:52:50 (3475): No heartbeat from core client for 30 sec - exiting
08:52:51 (3475): No heartbeat from core client for 30 sec - exiting
08:52:52 (3475): No heartbeat from core client for 30 sec - exiting
08:52:53 (3475): No heartbeat from core client for 30 sec - exiting
08:52:54 (3475): No heartbeat from core client for 30 sec - exiting
08:52:55 (3475): No heartbeat from core client for 30 sec - exiting
08:52:56 (3475): No heartbeat from core client for 30 sec - exiting
08:52:57 (3475): No heartbeat from core client for 30 sec - exiting
08:52:58 (3475): No heartbeat from core client for 30 sec - exiting
08:52:59 (3475): No heartbeat from core client for 30 sec - exiting
08:53:00 (3475): No heartbeat from core client for 30 sec - exiting
08:53:01 (3475): No heartbeat from core client for 30 sec - exiting
08:53:02 (3475): No heartbeat from core client for 30 sec - exiting
08:53:03 (3475): No heartbeat from core client for 30 sec - exiting
08:53:04 (3475): No heartbeat from core client for 30 sec - exiting
08:53:05 (3475): No heartbeat from core client for 30 sec - exiting
08:53:06 (3475): No heartbeat from core client for 30 sec - exiting
08:53:07 (3475): No heartbeat from core client for 30 sec - exiting
08:53:08 (3475): No heartbeat from core client for 30 sec - exiting
08:53:09 (3475): No heartbeat from core client for 30 sec - exiting
08:53:10 (3475): No heartbeat from core client for 30 sec - exiting
08:53:11 (3475): No heartbeat from core client for 30 sec - exiting
08:53:12 (3475): No heartbeat from core client for 30 sec - exiting
08:53:13 (3475): No heartbeat from core client for 30 sec - exiting
08:53:14 (3475): No heartbeat from core client for 30 sec - exiting
08:53:15 (3475): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x093a3860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
08:53:16 (3475): No heartbeat from core client for 30 sec - exiting
08:53:17 (3475): No heartbeat from core client for 30 sec - exiting
08:53:18 (3475): No heartbeat from core client for 30 sec - exiting
08:53:19 (3475): No heartbeat from core client for 30 sec - exiting
08:53:20 (3475): No heartbeat from core client for 30 sec - exiting
08:53:21 (3475): No heartbeat from core client for 30 sec - exiting
08:53:22 (3475): No heartbeat from core client for 30 sec - exiting
08:53:23 (3475): No heartbeat from core client for 30 sec - exiting
08:53:24 (3475): No heartbeat from core client for 30 sec - exiting
08:53:25 (3475): No heartbeat from core client for 30 sec - exiting
08:53:26 (3475): No heartbeat from core client for 30 sec - exiting
08:53:27 (3475): No heartbeat from core client for 30 sec - exiting
08:53:28 (3475): No heartbeat from core client for 30 sec - exiting
08:53:29 (3475): No heartbeat from core client for 30 sec - exiting
08:53:31 (3475): No heartbeat from core client for 30 sec - exiting
08:53:32 (3475): No heartbeat from core client for 30 sec - exiting
08:53:33 (3475): No heartbeat from core client for 30 sec - exiting
08:53:34 (3475): No heartbeat from core client for 30 sec - exiting
08:53:35 (3475): No heartbeat from core client for 30 sec - exiting
08:53:37 (3475): No heartbeat from core client for 30 sec - exiting
08:53:38 (3475): No heartbeat from core client for 30 sec - exiting
08:53:39 (3475): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09b6e860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
07:54:07 (3920): No heartbeat from core client for 30 sec - exiting
07:54:08 (3920): No heartbeat from core client for 30 sec - exiting
07:54:09 (3920): No heartbeat from core client for 30 sec - exiting
07:54:10 (3920): No heartbeat from core client for 30 sec - exiting
07:54:11 (3920): No heartbeat from core client for 30 sec - exiting
07:54:12 (3920): No heartbeat from core client for 30 sec - exiting
07:54:13 (3920): No heartbeat from core client for 30 sec - exiting
07:54:14 (3920): No heartbeat from core client for 30 sec - exiting
07:54:15 (3920): No heartbeat from core client for 30 sec - exiting
07:54:16 (3920): No heartbeat from core client for 30 sec - exiting
07:54:17 (3920): No heartbeat from core client for 30 sec - exiting
07:54:18 (3920): No heartbeat from core client for 30 sec - exiting
07:54:19 (3920): No heartbeat from core client for 30 sec - exiting
07:54:20 (3920): No heartbeat from core client for 30 sec - exiting
07:54:21 (3920): No heartbeat from core client for 30 sec - exiting
07:54:22 (3920): No heartbeat from core client for 30 sec - exiting
07:54:23 (3920): No heartbeat from core client for 30 sec - exiting
07:54:24 (3920): No heartbeat from core client for 30 sec - exiting
07:54:25 (3920): No heartbeat from core client for 30 sec - exiting
07:54:26 (3920): No heartbeat from core client for 30 sec - exiting
07:54:27 (3920): No heartbeat from core client for 30 sec - exiting
07:54:28 (3920): No heartbeat from core client for 30 sec - exiting
07:54:29 (3920): No heartbeat from core client for 30 sec - exiting
07:54:30 (3920): No heartbeat from core client for 30 sec - exiting
07:54:31 (3920): No heartbeat from core client for 30 sec - exiting
07:54:32 (3920): No heartbeat from core client for 30 sec - exiting
07:54:33 (3920): No heartbeat from core client for 30 sec - exiting
07:54:34 (3920): No heartbeat from core client for 30 sec - exiting
07:54:35 (3920): No heartbeat from core client for 30 sec - exiting
07:54:36 (3920): No heartbeat from core client for 30 sec - exiting
07:54:37 (3920): No heartbeat from core client for 30 sec - exiting
07:54:38 (3920): No heartbeat from core client for 30 sec - exiting
07:54:39 (3920): No heartbeat from core client for 30 sec - exiting
07:54:40 (3920): No heartbeat from core client for 30 sec - exiting
07:54:41 (3920): No heartbeat from core client for 30 sec - exiting
07:54:42 (3920): No heartbeat from core client for 30 sec - exiting
07:54:44 (3920): No heartbeat from core client for 30 sec - exiting
07:54:45 (3920): No heartbeat from core client for 30 sec - exiting
07:54:46 (3920): No heartbeat from core client for 30 sec - exiting
07:54:47 (3920): No heartbeat from core client for 30 sec - exiting
07:54:48 (3920): No heartbeat from core client for 30 sec - exiting
07:54:49 (3920): No heartbeat from core client for 30 sec - exiting
07:54:50 (3920): No heartbeat from core client for 30 sec - exiting
07:54:51 (3920): No heartbeat from core client for 30 sec - exiting
07:54:52 (3920): No heartbeat from core client for 30 sec - exiting
07:54:53 (3920): No heartbeat from core client for 30 sec - exiting
07:54:54 (3920): No heartbeat from core client for 30 sec - exiting
07:54:55 (3920): No heartbeat from core client for 30 sec - exiting
07:54:56 (3920): No heartbeat from core client for 30 sec - exiting
07:54:57 (3920): No heartbeat from core client for 30 sec - exiting
07:54:58 (3920): No heartbeat from core client for 30 sec - exiting
07:54:59 (3920): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08e88860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
09:49:11 (3466): No heartbeat from core client for 30 sec - exiting
09:49:13 (3466): No heartbeat from core client for 30 sec - exiting
09:49:14 (3466): No heartbeat from core client for 30 sec - exiting
09:49:15 (3466): No heartbeat from core client for 30 sec - exiting
09:49:16 (3466): No heartbeat from core client for 30 sec - exiting
09:49:17 (3466): No heartbeat from core client for 30 sec - exiting
09:49:18 (3466): No heartbeat from core client for 30 sec - exiting
09:49:19 (3466): No heartbeat from core client for 30 sec - exiting
09:49:20 (3466): No heartbeat from core client for 30 sec - exiting
09:49:21 (3466): No heartbeat from core client for 30 sec - exiting
09:49:22 (3466): No heartbeat from core client for 30 sec - exiting
09:49:23 (3466): No heartbeat from core client for 30 sec - exiting
09:49:24 (3466): No heartbeat from core client for 30 sec - exiting
09:49:25 (3466): No heartbeat from core client for 30 sec - exiting
09:49:26 (3466): No heartbeat from core client for 30 sec - exiting
09:49:27 (3466): No heartbeat from core client for 30 sec - exiting
09:49:28 (3466): No heartbeat from core client for 30 sec - exiting
09:49:29 (3466): No heartbeat from core client for 30 sec - exiting
09:49:30 (3466): No heartbeat from core client for 30 sec - exiting
09:49:31 (3466): No heartbeat from core client for 30 sec - exiting
09:49:32 (3466): No heartbeat from core client for 30 sec - exiting
09:49:33 (3466): No heartbeat from core client for 30 sec - exiting
09:49:34 (3466): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09a43860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
09:49:35 (3466): No heartbeat from core client for 30 sec - exiting
09:49:36 (3466): No heartbeat from core client for 30 sec - exiting
09:49:37 (3466): No heartbeat from core client for 30 sec - exiting
09:49:38 (3466): No heartbeat from core client for 30 sec - exiting
09:49:39 (3466): No heartbeat from core client for 30 sec - exiting
09:49:40 (3466): No heartbeat from core client for 30 sec - exiting
09:49:41 (3466): No heartbeat from core client for 30 sec - exiting
09:50:12 (3466): No heartbeat from core client for 30 sec - exiting
09:50:13 (3466): No heartbeat from core client for 30 sec - exiting
09:50:14 (3466): No heartbeat from core client for 30 sec - exiting
09:50:15 (3466): No heartbeat from core client for 30 sec - exiting
09:50:16 (3466): No heartbeat from core client for 30 sec - exiting
09:50:17 (3466): No heartbeat from core client for 30 sec - exiting
09:50:18 (3466): No heartbeat from core client for 30 sec - exiting
09:50:19 (3466): No heartbeat from core client for 30 sec - exiting
09:50:20 (3466): No heartbeat from core client for 30 sec - exiting
09:50:21 (3466): No heartbeat from core client for 30 sec - exiting
09:50:22 (3466): No heartbeat from core client for 30 sec - exiting
09:50:23 (3466): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x099f3860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
08:52:08 (3675): No heartbeat from core client for 30 sec - exiting
08:52:09 (3675): No heartbeat from core client for 30 sec - exiting
08:52:10 (3675): No heartbeat from core client for 30 sec - exiting
08:52:11 (3675): No heartbeat from core client for 30 sec - exiting
08:52:12 (3675): No heartbeat from core client for 30 sec - exiting
08:52:13 (3675): No heartbeat from core client for 30 sec - exiting
08:52:14 (3675): No heartbeat from core client for 30 sec - exiting
08:52:15 (3675): No heartbeat from core client for 30 sec - exiting
08:52:16 (3675): No heartbeat from core client for 30 sec - exiting
08:52:17 (3675): No heartbeat from core client for 30 sec - exiting
08:52:18 (3675): No heartbeat from core client for 30 sec - exiting
08:58:50 (3616): No heartbeat from core client for 30 sec - exiting
08:58:51 (3616): No heartbeat from core client for 30 sec - exiting
08:58:52 (3616): No heartbeat from core client for 30 sec - exiting
08:58:53 (3616): No heartbeat from core client for 30 sec - exiting
08:58:54 (3616): No heartbeat from core client for 30 sec - exiting
08:58:55 (3616): No heartbeat from core client for 30 sec - exiting
08:58:56 (3616): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0900c860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
08:58:57 (3616): No heartbeat from core client for 30 sec - exiting
08:58:58 (3616): No heartbeat from core client for 30 sec - exiting
08:58:59 (3616): No heartbeat from core client for 30 sec - exiting
08:50:08 (3469): No heartbeat from core client for 30 sec - exiting
08:50:09 (3469): No heartbeat from core client for 30 sec - exiting
08:50:10 (3469): No heartbeat from core client for 30 sec - exiting
08:50:11 (3469): No heartbeat from core client for 30 sec - exiting
08:50:12 (3469): No heartbeat from core client for 30 sec - exiting
08:50:13 (3469): No heartbeat from core client for 30 sec - exiting
08:50:14 (3469): No heartbeat from core client for 30 sec - exiting
08:50:15 (3469): No heartbeat from core client for 30 sec - exiting
08:50:16 (3469): No heartbeat from core client for 30 sec - exiting
08:50:17 (3469): No heartbeat from core client for 30 sec - exiting
08:50:18 (3469): No heartbeat from core client for 30 sec - exiting
08:50:19 (3469): No heartbeat from core client for 30 sec - exiting
08:50:20 (3469): No heartbeat from core client for 30 sec - exiting
08:50:21 (3469): No heartbeat from core client for 30 sec - exiting
08:50:22 (3469): No heartbeat from core client for 30 sec - exiting
08:50:23 (3469): No heartbeat from core client for 30 sec - exiting
08:50:24 (3469): No heartbeat from core client for 30 sec - exiting
08:50:25 (3469): No heartbeat from core client for 30 sec - exiting
08:50:26 (3469): No heartbeat from core client for 30 sec - exiting
08:50:27 (3469): No heartbeat from core client for 30 sec - exiting
08:50:28 (3469): No heartbeat from core client for 30 sec - exiting
08:50:29 (3469): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09408860 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
08:50:30 (3469): No heartbeat from core client for 30 sec - exiting
08:50:31 (3469): No heartbeat from core client for 30 sec - exiting
08:50:32 (3469): No heartbeat from core client for 30 sec - exiting
08:50:33 (3469): No heartbeat from core client for 30 sec - exiting
08:50:34 (3469): No heartbeat from core client for 30 sec - exiting
08:50:35 (3469): No heartbeat from core client for 30 sec - exiting
08:50:36 (3469): No heartbeat from core client for 30 sec - exiting
08:50:37 (3469): No heartbeat from core client for 30 sec - exiting
08:51:08 (3469): No heartbeat from core client for 30 sec - exiting
08:51:09 (3469): No heartbeat from core client for 30 sec - exiting
08:51:10 (3469): No heartbeat from core client for 30 sec - exiting
08:51:11 (3469): No heartbeat from core client for 30 sec - exiting
08:51:12 (3469): No heartbeat from core client for 30 sec - exiting
08:51:13 (3469): No heartbeat from core client for 30 sec - exiting
08:51:14 (3469): No heartbeat from core client for 30 sec - exiting
08:51:15 (3469): No heartbeat from core client for 30 sec - exiting
08:51:16 (3469): No heartbeat from core client for 30 sec - exiting
08:51:17 (3469): No heartbeat from core client for 30 sec - exiting
08:51:18 (3469): No heartbeat from core client for 30 sec - exiting

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Jul 2013 14:36:28 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 777,600 857,438 1.1027
23 Jul 2013 14:36:28 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 751,680 828,273 1.1019
10 Jul 2013 06:40:27 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 725,760 799,396 1.1015
06 Jul 2013 05:07:36 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 699,840 770,448 1.1009
03 Jul 2013 12:57:27 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 673,920 741,528 1.1003
02 Jul 2013 11:25:48 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 648,000 712,715 1.0999
26 Jun 2013 14:47:26 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 622,080 683,918 1.0994
24 Jun 2013 14:07:19 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 596,160 655,733 1.0999
20 Jun 2013 13:09:52 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 570,240 627,319 1.1001
17 Jun 2013 13:52:58 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 544,320 599,137 1.1007
13 Jun 2013 14:41:31 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 518,400 570,738 1.1010
11 Jun 2013 13:30:14 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 492,480 542,456 1.1015
07 Jun 2013 11:46:44 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 466,560 514,290 1.1023
05 Jun 2013 10:36:09 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 440,640 485,873 1.1027
03 Jun 2013 08:53:42 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 414,720 457,648 1.1035
28 May 2013 15:56:28 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 388,800 429,339 1.1043
24 May 2013 11:18:42 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 362,880 400,951 1.1049
22 May 2013 11:29:18 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 336,960 372,630 1.1059
17 May 2013 08:35:23 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 311,040 344,455 1.1074
14 May 2013 15:56:22 1260095 15702519 hadcm3n_zjp7_1920_40_008256875_4 285,120 316,153 1.1088


©2024 climateprediction.net