climateprediction.net home page
Task 15894288

Task 15894288

Name hadcm3n_o3sl_1940_40_008381249_3
Workunit 8532108
Created 18 Jul 2013, 11:05:02 UTC
Sent 18 Jul 2013, 19:50:49 UTC
Report deadline 18 Oct 2013, 3:18:00 UTC
Received 8 Sep 2013, 4:49:09 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 1215191
Run time 12 days 13 hours 47 min 44 sec
CPU time 11 days 22 hours 4 min 32 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.68 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
aborted by user
</message>
<stderr_txt>
INC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08f5c798 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09a3ffc8 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0a141fc8 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
12:20:26 (27041): No heartbeat from core client for 30 sec - exiting
12:20:28 (27041): No heartbeat from core client for 30 sec - exiting
12:20:29 (27041): No heartbeat from core client for 30 sec - exiting
12:20:30 (27041): No heartbeat from core client for 30 sec - exiting
12:20:31 (27041): No heartbeat from core client for 30 sec - exiting
12:20:32 (27041): No heartbeat from core client for 30 sec - exiting
12:20:33 (27041): No heartbeat from core client for 30 sec - exiting
12:20:34 (27041): No heartbeat from core client for 30 sec - exiting
12:20:35 (27041): No heartbeat from core client for 30 sec - exiting
12:20:36 (27041): No heartbeat from core client for 30 sec - exiting
12:20:37 (27041): No heartbeat from core client for 30 sec - exiting
12:20:38 (27041): No heartbeat from core client for 30 sec - exiting
12:20:39 (27041): No heartbeat from core client for 30 sec - exiting
12:20:40 (27041): No heartbeat from core client for 30 sec - exiting
12:20:41 (27041): No heartbeat from core client for 30 sec - exiting
12:20:42 (27041): No heartbeat from core client for 30 sec - exiting
12:20:43 (27041): No heartbeat from core client for 30 sec - exiting
12:20:44 (27041): No heartbeat from core client for 30 sec - exiting
12:20:45 (27041): No heartbeat from core client for 30 sec - exiting
12:20:46 (27041): No heartbeat from core client for 30 sec - exiting
12:20:47 (27041): No heartbeat from core client for 30 sec - exiting
12:20:48 (27041): No heartbeat from core client for 30 sec - exiting
12:20:49 (27041): No heartbeat from core client for 30 sec - exiting
12:20:50 (27041): No heartbeat from core client for 30 sec - exiting
12:20:51 (27041): No heartbeat from core client for 30 sec - exiting
12:20:52 (27041): No heartbeat from core client for 30 sec - exiting
12:20:53 (27041): No heartbeat from core client for 30 sec - exiting
12:20:54 (27041): No heartbeat from core client for 30 sec - exiting
12:20:55 (27041): No heartbeat from core client for 30 sec - exiting
12:20:56 (27041): No heartbeat from core client for 30 sec - exiting
12:20:57 (27041): No heartbeat from core client for 30 sec - exiting
12:20:58 (27041): No heartbeat from core client for 30 sec - exiting
12:20:59 (27041): No heartbeat from core client for 30 sec - exiting
12:21:00 (27041): No heartbeat from core client for 30 sec - exiting
12:21:01 (27041): No heartbeat from core client for 30 sec - exiting
12:21:02 (27041): No heartbeat from core client for 30 sec - exiting
12:21:03 (27041): No heartbeat from core client for 30 sec - exiting
12:21:04 (27041): No heartbeat from core client for 30 sec - exiting
12:21:05 (27041): No heartbeat from core client for 30 sec - exiting
12:21:06 (27041): No heartbeat from core client for 30 sec - exiting
12:21:07 (27041): No heartbeat from core client for 30 sec - exiting
12:21:08 (27041): No heartbeat from core client for 30 sec - exiting
12:21:09 (27041): No heartbeat from core client for 30 sec - exiting
12:21:10 (27041): No heartbeat from core client for 30 sec - exiting
12:21:11 (27041): No heartbeat from core client for 30 sec - exiting
12:21:12 (27041): No heartbeat from core client for 30 sec - exiting
12:21:13 (27041): No heartbeat from core client for 30 sec - exiting
12:21:14 (27041): No heartbeat from core client for 30 sec - exiting
12:21:15 (27041): No heartbeat from core client for 30 sec - exiting
12:21:16 (27041): No heartbeat from core client for 30 sec - exiting
12:21:17 (27041): No heartbeat from core client for 30 sec - exiting
12:21:18 (27041): No heartbeat from core client for 30 sec - exiting
12:21:19 (27041): No heartbeat from core client for 30 sec - exiting
12:21:20 (27041): No heartbeat from core client for 30 sec - exiting
12:21:21 (27041): No heartbeat from core client for 30 sec - exiting
12:21:22 (27041): No heartbeat from core client for 30 sec - exiting
12:21:23 (27041): No heartbeat from core client for 30 sec - exiting
12:21:24 (27041): No heartbeat from core client for 30 sec - exiting
12:21:25 (27041): No heartbeat from core client for 30 sec - exiting
12:21:26 (27041): No heartbeat from core client for 30 sec - exiting
12:21:27 (27041): No heartbeat from core client for 30 sec - exiting
12:21:28 (27041): No heartbeat from core client for 30 sec - exiting
12:21:29 (27041): No heartbeat from core client for 30 sec - exiting
12:21:30 (27041): No heartbeat from core client for 30 sec - exiting
12:21:31 (27041): No heartbeat from core client for 30 sec - exiting
12:21:32 (27041): No heartbeat from core client for 30 sec - exiting
12:21:33 (27041): No heartbeat from core client for 30 sec - exiting
12:21:34 (27041): No heartbeat from core client for 30 sec - exiting
12:21:35 (27041): No heartbeat from core client for 30 sec - exiting
12:21:36 (27041): No heartbeat from core client for 30 sec - exiting
12:21:37 (27041): No heartbeat from core client for 30 sec - exiting
12:21:38 (27041): No heartbeat from core client for 30 sec - exiting
12:21:39 (27041): No heartbeat from core client for 30 sec - exiting
12:21:40 (27041): No heartbeat from core client for 30 sec - exiting
12:21:41 (27041): No heartbeat from core client for 30 sec - exiting
12:21:42 (27041): No heartbeat from core client for 30 sec - exiting
12:21:43 (27041): No heartbeat from core client for 30 sec - exiting
12:21:44 (27041): No heartbeat from core client for 30 sec - exiting
12:21:45 (27041): No heartbeat from core client for 30 sec - exiting
12:21:46 (27041): No heartbeat from core client for 30 sec - exiting
12:21:47 (27041): No heartbeat from core client for 30 sec - exiting
12:21:48 (27041): No heartbeat from core client for 30 sec - exiting
12:21:49 (27041): No heartbeat from core client for 30 sec - exiting
12:21:50 (27041): No heartbeat from core client for 30 sec - exiting
12:21:51 (27041): No heartbeat from core client for 30 sec - exiting
12:21:52 (27041): No heartbeat from core client for 30 sec - exiting
12:21:53 (27041): No heartbeat from core client for 30 sec - exiting
12:21:54 (27041): No heartbeat from core client for 30 sec - exiting
12:21:55 (27041): No heartbeat from core client for 30 sec - exiting
12:21:56 (27041): No heartbeat from core client for 30 sec - exiting
12:21:57 (27041): No heartbeat from core client for 30 sec - exiting
12:21:58 (27041): No heartbeat from core client for 30 sec - exiting
12:21:59 (27041): No heartbeat from core client for 30 sec - exiting
12:22:00 (27041): No heartbeat from core client for 30 sec - exiting
12:22:01 (27041): No heartbeat from core client for 30 sec - exiting
12:22:02 (27041): No heartbeat from core client for 30 sec - exiting
12:22:03 (27041): No heartbeat from core client for 30 sec - exiting
12:22:04 (27041): No heartbeat from core client for 30 sec - exiting
12:22:05 (27041): No heartbeat from core client for 30 sec - exiting
12:22:06 (27041): No heartbeat from core client for 30 sec - exiting
12:22:07 (27041): No heartbeat from core client for 30 sec - exiting
12:22:08 (27041): No heartbeat from core client for 30 sec - exiting
12:22:09 (27041): No heartbeat from core client for 30 sec - exiting
12:22:10 (27041): No heartbeat from core client for 30 sec - exiting
12:22:11 (27041): No heartbeat from core client for 30 sec - exiting
12:22:12 (27041): No heartbeat from core client for 30 sec - exiting
12:22:13 (27041): No heartbeat from core client for 30 sec - exiting
12:22:14 (27041): No heartbeat from core client for 30 sec - exiting
12:22:15 (27041): No heartbeat from core client for 30 sec - exiting
12:22:16 (27041): No heartbeat from core client for 30 sec - exiting
12:22:17 (27041): No heartbeat from core client for 30 sec - exiting
12:22:18 (27041): No heartbeat from core client for 30 sec - exiting
12:22:19 (27041): No heartbeat from core client for 30 sec - exiting
12:22:20 (27041): No heartbeat from core client for 30 sec - exiting
12:22:21 (27041): No heartbeat from core client for 30 sec - exiting
12:22:22 (27041): No heartbeat from core client for 30 sec - exiting
12:22:23 (27041): No heartbeat from core client for 30 sec - exiting
12:22:24 (27041): No heartbeat from core client for 30 sec - exiting
12:22:25 (27041): No heartbeat from core client for 30 sec - exiting
12:22:26 (27041): No heartbeat from core client for 30 sec - exiting
12:22:27 (27041): No heartbeat from core client for 30 sec - exiting
12:22:28 (27041): No heartbeat from core client for 30 sec - exiting
12:22:29 (27041): No heartbeat from core client for 30 sec - exiting
12:22:30 (27041): No heartbeat from core client for 30 sec - exiting
12:22:31 (27041): No heartbeat from core client for 30 sec - exiting
12:22:32 (27041): No heartbeat from core client for 30 sec - exiting
12:22:33 (27041): No heartbeat from core client for 30 sec - exiting
12:22:34 (27041): No heartbeat from core client for 30 sec - exiting
12:22:35 (27041): No heartbeat from core client for 30 sec - exiting
12:22:36 (27041): No heartbeat from core client for 30 sec - exiting
12:22:37 (27041): No heartbeat from core client for 30 sec - exiting
12:22:38 (27041): No heartbeat from core client for 30 sec - exiting
12:22:39 (27041): No heartbeat from core client for 30 sec - exiting
12:22:40 (27041): No heartbeat from core client for 30 sec - exiting
12:22:41 (27041): No heartbeat from core client for 30 sec - exiting
12:22:42 (27041): No heartbeat from core client for 30 sec - exiting
12:22:43 (27041): No heartbeat from core client for 30 sec - exiting
12:22:44 (27041): No heartbeat from core client for 30 sec - exiting
12:22:45 (27041): No heartbeat from core client for 30 sec - exiting
12:22:46 (27041): No heartbeat from core client for 30 sec - exiting
12:22:47 (27041): No heartbeat from core client for 30 sec - exiting
12:22:48 (27041): No heartbeat from core client for 30 sec - exiting
12:22:49 (27041): No heartbeat from core client for 30 sec - exiting
12:22:50 (27041): No heartbeat from core client for 30 sec - exiting
12:22:51 (27041): No heartbeat from core client for 30 sec - exiting
12:22:52 (27041): No heartbeat from core client for 30 sec - exiting
12:22:53 (27041): No heartbeat from core client for 30 sec - exiting
12:22:54 (27041): No heartbeat from core client for 30 sec - exiting
12:22:55 (27041): No heartbeat from core client for 30 sec - exiting
12:22:56 (27041): No heartbeat from core client for 30 sec - exiting
12:22:57 (27041): No heartbeat from core client for 30 sec - exiting
12:22:58 (27041): No heartbeat from core client for 30 sec - exiting
12:22:59 (27041): No heartbeat from core client for 30 sec - exiting
12:23:00 (27041): No heartbeat from core client for 30 sec - exiting
12:23:01 (27041): No heartbeat from core client for 30 sec - exiting
12:23:02 (27041): No heartbeat from core client for 30 sec - exiting
12:23:03 (27041): No heartbeat from core client for 30 sec - exiting
12:23:04 (27041): No heartbeat from core client for 30 sec - exiting
12:23:05 (27041): No heartbeat from core client for 30 sec - exiting
12:23:06 (27041): No heartbeat from core client for 30 sec - exiting
12:23:07 (27041): No heartbeat from core client for 30 sec - exiting
12:23:08 (27041): No heartbeat from core client for 30 sec - exiting
12:23:09 (27041): No heartbeat from core client for 30 sec - exiting
12:23:10 (27041): No heartbeat from core client for 30 sec - exiting
12:23:11 (27041): No heartbeat from core client for 30 sec - exiting
12:23:12 (27041): No heartbeat from core client for 30 sec - exiting
12:23:13 (27041): No heartbeat from core client for 30 sec - exiting
12:23:14 (27041): No heartbeat from core client for 30 sec - exiting
12:23:15 (27041): No heartbeat from core client for 30 sec - exiting
12:23:16 (27041): No heartbeat from core client for 30 sec - exiting
12:23:17 (27041): No heartbeat from core client for 30 sec - exiting
12:23:18 (27041): No heartbeat from core client for 30 sec - exiting
12:23:19 (27041): No heartbeat from core client for 30 sec - exiting
12:23:20 (27041): No heartbeat from core client for 30 sec - exiting
12:23:21 (27041): No heartbeat from core client for 30 sec - exiting
12:23:22 (27041): No heartbeat from core client for 30 sec - exiting
12:23:23 (27041): No heartbeat from core client for 30 sec - exiting
12:23:24 (27041): No heartbeat from core client for 30 sec - exiting
12:23:25 (27041): No heartbeat from core client for 30 sec - exiting
12:23:26 (27041): No heartbeat from core client for 30 sec - exiting
12:23:27 (27041): No heartbeat from core client for 30 sec - exiting
12:23:28 (27041): No heartbeat from core client for 30 sec - exiting
12:23:29 (27041): No heartbeat from core client for 30 sec - exiting
12:23:30 (27041): No heartbeat from core client for 30 sec - exiting
12:23:31 (27041): No heartbeat from core client for 30 sec - exiting
12:23:32 (27041): No heartbeat from core client for 30 sec - exiting
12:23:33 (27041): No heartbeat from core client for 30 sec - exiting
12:23:34 (27041): No heartbeat from core client for 30 sec - exiting
12:23:35 (27041): No heartbeat from core client for 30 sec - exiting
12:23:36 (27041): No heartbeat from core client for 30 sec - exiting
12:23:37 (27041): No heartbeat from core client for 30 sec - exiting
12:23:38 (27041): No heartbeat from core client for 30 sec - exiting
12:23:39 (27041): No heartbeat from core client for 30 sec - exiting
12:23:40 (27041): No heartbeat from core client for 30 sec - exiting
12:23:41 (27041): No heartbeat from core client for 30 sec - exiting
12:23:42 (27041): No heartbeat from core client for 30 sec - exiting
12:23:43 (27041): No heartbeat from core client for 30 sec - exiting
12:23:44 (27041): No heartbeat from core client for 30 sec - exiting
12:23:45 (27041): No heartbeat from core client for 30 sec - exiting
12:23:46 (27041): No heartbeat from core client for 30 sec - exiting
12:23:47 (27041): No heartbeat from core client for 30 sec - exiting
12:23:48 (27041): No heartbeat from core client for 30 sec - exiting
12:23:49 (27041): No heartbeat from core client for 30 sec - exiting
12:23:50 (27041): No heartbeat from core client for 30 sec - exiting
12:23:51 (27041): No heartbeat from core client for 30 sec - exiting
12:23:52 (27041): No heartbeat from core client for 30 sec - exiting
12:23:53 (27041): No heartbeat from core client for 30 sec - exiting
12:23:54 (27041): No heartbeat from core client for 30 sec - exiting
12:23:55 (27041): No heartbeat from core client for 30 sec - exiting
12:23:56 (27041): No heartbeat from core client for 30 sec - exiting
12:23:57 (27041): No heartbeat from core client for 30 sec - exiting
12:23:58 (27041): No heartbeat from core client for 30 sec - exiting
12:23:59 (27041): No heartbeat from core client for 30 sec - exiting
12:24:00 (27041): No heartbeat from core client for 30 sec - exiting
12:24:01 (27041): No heartbeat from core client for 30 sec - exiting
12:24:02 (27041): No heartbeat from core client for 30 sec - exiting
12:24:03 (27041): No heartbeat from core client for 30 sec - exiting
12:24:04 (27041): No heartbeat from core client for 30 sec - exiting
12:24:05 (27041): No heartbeat from core client for 30 sec - exiting
12:24:06 (27041): No heartbeat from core client for 30 sec - exiting
12:24:07 (27041): No heartbeat from core client for 30 sec - exiting
12:24:08 (27041): No heartbeat from core client for 30 sec - exiting
12:24:09 (27041): No heartbeat from core client for 30 sec - exiting
12:24:10 (27041): No heartbeat from core client for 30 sec - exiting
12:24:11 (27041): No heartbeat from core client for 30 sec - exiting
12:24:12 (27041): No heartbeat from core client for 30 sec - exiting
12:24:13 (27041): No heartbeat from core client for 30 sec - exiting
12:24:14 (27041): No heartbeat from core client for 30 sec - exiting
12:24:15 (27041): No heartbeat from core client for 30 sec - exiting
12:24:16 (27041): No heartbeat from core client for 30 sec - exiting
12:24:17 (27041): No heartbeat from core client for 30 sec - exiting
12:24:18 (27041): No heartbeat from core client for 30 sec - exiting
12:24:19 (27041): No heartbeat from core client for 30 sec - exiting
12:24:20 (27041): No heartbeat from core client for 30 sec - exiting
12:24:21 (27041): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x090fffc8 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
13:36:11 (28914): No heartbeat from core client for 30 sec - exiting
13:36:12 (28914): No heartbeat from core client for 30 sec - exiting
13:36:13 (28914): No heartbeat from core client for 30 sec - exiting
13:36:14 (28914): No heartbeat from core client for 30 sec - exiting
13:36:15 (28914): No heartbeat from core client for 30 sec - exiting
13:36:16 (28914): No heartbeat from core client for 30 sec - exiting
13:36:17 (28914): No heartbeat from core client for 30 sec - exiting
13:36:18 (28914): No heartbeat from core client for 30 sec - exiting
13:36:19 (28914): No heartbeat from core client for 30 sec - exiting
13:36:20 (28914): No heartbeat from core client for 30 sec - exiting
13:36:21 (28914): No heartbeat from core client for 30 sec - exiting
13:36:22 (28914): No heartbeat from core client for 30 sec - exiting
13:36:23 (28914): No heartbeat from core client for 30 sec - exiting
13:36:24 (28914): No heartbeat from core client for 30 sec - exiting
13:36:25 (28914): No heartbeat from core client for 30 sec - exiting
13:36:26 (28914): No heartbeat from core client for 30 sec - exiting
13:36:27 (28914): No heartbeat from core client for 30 sec - exiting
13:36:28 (28914): No heartbeat from core client for 30 sec - exiting
13:36:29 (28914): No heartbeat from core client for 30 sec - exiting
13:36:30 (28914): No heartbeat from core client for 30 sec - exiting
13:36:31 (28914): No heartbeat from core client for 30 sec - exiting
13:36:32 (28914): No heartbeat from core client for 30 sec - exiting
13:36:33 (28914): No heartbeat from core client for 30 sec - exiting
13:36:34 (28914): No heartbeat from core client for 30 sec - exiting
13:36:35 (28914): No heartbeat from core client for 30 sec - exiting
13:36:36 (28914): No heartbeat from core client for 30 sec - exiting
13:36:37 (28914): No heartbeat from core client for 30 sec - exiting
13:36:38 (28914): No heartbeat from core client for 30 sec - exiting
13:36:39 (28914): No heartbeat from core client for 30 sec - exiting
13:36:40 (28914): No heartbeat from core client for 30 sec - exiting
13:36:41 (28914): No heartbeat from core client for 30 sec - exiting
13:36:42 (28914): No heartbeat from core client for 30 sec - exiting
13:36:43 (28914): No heartbeat from core client for 30 sec - exiting
13:36:44 (28914): No heartbeat from core client for 30 sec - exiting
13:36:45 (28914): No heartbeat from core client for 30 sec - exiting
13:36:46 (28914): No heartbeat from core client for 30 sec - exiting
13:36:47 (28914): No heartbeat from core client for 30 sec - exiting
13:36:48 (28914): No heartbeat from core client for 30 sec - exiting
13:36:49 (28914): No heartbeat from core client for 30 sec - exiting
13:36:50 (28914): No heartbeat from core client for 30 sec - exiting
13:36:51 (28914): No heartbeat from core client for 30 sec - exiting
13:36:52 (28914): No heartbeat from core client for 30 sec - exiting
13:36:53 (28914): No heartbeat from core client for 30 sec - exiting
13:36:54 (28914): No heartbeat from core client for 30 sec - exiting
13:36:55 (28914): No heartbeat from core client for 30 sec - exiting
13:36:56 (28914): No heartbeat from core client for 30 sec - exiting
13:36:57 (28914): No heartbeat from core client for 30 sec - exiting
13:36:58 (28914): No heartbeat from core client for 30 sec - exiting
13:36:59 (28914): No heartbeat from core client for 30 sec - exiting
13:37:00 (28914): No heartbeat from core client for 30 sec - exiting
13:37:01 (28914): No heartbeat from core client for 30 sec - exiting
13:37:02 (28914): No heartbeat from core client for 30 sec - exiting
13:37:03 (28914): No heartbeat from core client for 30 sec - exiting
13:37:04 (28914): No heartbeat from core client for 30 sec - exiting
13:37:05 (28914): No heartbeat from core client for 30 sec - exiting
13:37:06 (28914): No heartbeat from core client for 30 sec - exiting
13:37:07 (28914): No heartbeat from core client for 30 sec - exiting
13:37:08 (28914): No heartbeat from core client for 30 sec - exiting
13:37:09 (28914): No heartbeat from core client for 30 sec - exiting
13:37:10 (28914): No heartbeat from core client for 30 sec - exiting
13:37:11 (28914): No heartbeat from core client for 30 sec - exiting
13:37:12 (28914): No heartbeat from core client for 30 sec - exiting
13:37:13 (28914): No heartbeat from core client for 30 sec - exiting
13:37:14 (28914): No heartbeat from core client for 30 sec - exiting
13:37:15 (28914): No heartbeat from core client for 30 sec - exiting
13:37:16 (28914): No heartbeat from core client for 30 sec - exiting
13:37:17 (28914): No heartbeat from core client for 30 sec - exiting
13:37:18 (28914): No heartbeat from core client for 30 sec - exiting
13:37:19 (28914): No heartbeat from core client for 30 sec - exiting
13:37:20 (28914): No heartbeat from core client for 30 sec - exiting
13:37:21 (28914): No heartbeat from core client for 30 sec - exiting
13:37:22 (28914): No heartbeat from core client for 30 sec - exiting
13:37:23 (28914): No heartbeat from core client for 30 sec - exiting
13:37:24 (28914): No heartbeat from core client for 30 sec - exiting
13:37:25 (28914): No heartbeat from core client for 30 sec - exiting
13:37:26 (28914): No heartbeat from core client for 30 sec - exiting
13:37:27 (28914): No heartbeat from core client for 30 sec - exiting
13:37:28 (28914): No heartbeat from core client for 30 sec - exiting
13:37:29 (28914): No heartbeat from core client for 30 sec - exiting
13:37:30 (28914): No heartbeat from core client for 30 sec - exiting
13:37:31 (28914): No heartbeat from core client for 30 sec - exiting
13:37:32 (28914): No heartbeat from core client for 30 sec - exiting
13:37:33 (28914): No heartbeat from core client for 30 sec - exiting
13:37:34 (28914): No heartbeat from core client for 30 sec - exiting
13:37:35 (28914): No heartbeat from core client for 30 sec - exiting
13:37:36 (28914): No heartbeat from core client for 30 sec - exiting
13:37:37 (28914): No heartbeat from core client for 30 sec - exiting
13:37:38 (28914): No heartbeat from core client for 30 sec - exiting
13:37:39 (28914): No heartbeat from core client for 30 sec - exiting
13:37:40 (28914): No heartbeat from core client for 30 sec - exiting
13:37:41 (28914): No heartbeat from core client for 30 sec - exiting
13:37:42 (28914): No heartbeat from core client for 30 sec - exiting
13:37:43 (28914): No heartbeat from core client for 30 sec - exiting
13:37:44 (28914): No heartbeat from core client for 30 sec - exiting
13:37:45 (28914): No heartbeat from core client for 30 sec - exiting
13:37:46 (28914): No heartbeat from core client for 30 sec - exiting
13:37:47 (28914): No heartbeat from core client for 30 sec - exiting
13:37:48 (28914): No heartbeat from core client for 30 sec - exiting
13:37:49 (28914): No heartbeat from core client for 30 sec - exiting
13:37:50 (28914): No heartbeat from core client for 30 sec - exiting
13:37:51 (28914): No heartbeat from core client for 30 sec - exiting
13:37:52 (28914): No heartbeat from core client for 30 sec - exiting
13:37:53 (28914): No heartbeat from core client for 30 sec - exiting
13:37:54 (28914): No heartbeat from core client for 30 sec - exiting
13:37:55 (28914): No heartbeat from core client for 30 sec - exiting
13:37:56 (28914): No heartbeat from core client for 30 sec - exiting
13:37:57 (28914): No heartbeat from core client for 30 sec - exiting
13:37:58 (28914): No heartbeat from core client for 30 sec - exiting
13:37:59 (28914): No heartbeat from core client for 30 sec - exiting
13:38:00 (28914): No heartbeat from core client for 30 sec - exiting
13:38:01 (28914): No heartbeat from core client for 30 sec - exiting
13:38:02 (28914): No heartbeat from core client for 30 sec - exiting
13:38:03 (28914): No heartbeat from core client for 30 sec - exiting
13:38:04 (28914): No heartbeat from core client for 30 sec - exiting
13:38:05 (28914): No heartbeat from core client for 30 sec - exiting
13:38:06 (28914): No heartbeat from core client for 30 sec - exiting
13:38:07 (28914): No heartbeat from core client for 30 sec - exiting
13:38:08 (28914): No heartbeat from core client for 30 sec - exiting
13:38:09 (28914): No heartbeat from core client for 30 sec - exiting
13:38:10 (28914): No heartbeat from core client for 30 sec - exiting
13:38:11 (28914): No heartbeat from core client for 30 sec - exiting
13:38:12 (28914): No heartbeat from core client for 30 sec - exiting
13:38:13 (28914): No heartbeat from core client for 30 sec - exiting
13:38:14 (28914): No heartbeat from core client for 30 sec - exiting
13:38:15 (28914): No heartbeat from core client for 30 sec - exiting
13:38:16 (28914): No heartbeat from core client for 30 sec - exiting
13:38:17 (28914): No heartbeat from core client for 30 sec - exiting
13:38:18 (28914): No heartbeat from core client for 30 sec - exiting
13:38:19 (28914): No heartbeat from core client for 30 sec - exiting
13:38:20 (28914): No heartbeat from core client for 30 sec - exiting
13:38:21 (28914): No heartbeat from core client for 30 sec - exiting
13:38:22 (28914): No heartbeat from core client for 30 sec - exiting
13:38:23 (28914): No heartbeat from core client for 30 sec - exiting
13:38:24 (28914): No heartbeat from core client for 30 sec - exiting
13:38:25 (28914): No heartbeat from core client for 30 sec - exiting
13:38:26 (28914): No heartbeat from core client for 30 sec - exiting
13:38:27 (28914): No heartbeat from core client for 30 sec - exiting
13:38:28 (28914): No heartbeat from core client for 30 sec - exiting
13:38:29 (28914): No heartbeat from core client for 30 sec - exiting
13:38:30 (28914): No heartbeat from core client for 30 sec - exiting
13:38:31 (28914): No heartbeat from core client for 30 sec - exiting
13:38:32 (28914): No heartbeat from core client for 30 sec - exiting
13:38:33 (28914): No heartbeat from core client for 30 sec - exiting
13:38:34 (28914): No heartbeat from core client for 30 sec - exiting
13:38:35 (28914): No heartbeat from core client for 30 sec - exiting
13:38:36 (28914): No heartbeat from core client for 30 sec - exiting
13:38:37 (28914): No heartbeat from core client for 30 sec - exiting
13:38:38 (28914): No heartbeat from core client for 30 sec - exiting
13:38:39 (28914): No heartbeat from core client for 30 sec - exiting
13:38:40 (28914): No heartbeat from core client for 30 sec - exiting
13:38:41 (28914): No heartbeat from core client for 30 sec - exiting
13:38:42 (28914): No heartbeat from core client for 30 sec - exiting
13:38:43 (28914): No heartbeat from core client for 30 sec - exiting
13:38:44 (28914): No heartbeat from core client for 30 sec - exiting
13:38:45 (28914): No heartbeat from core client for 30 sec - exiting
13:38:46 (28914): No heartbeat from core client for 30 sec - exiting
13:38:47 (28914): No heartbeat from core client for 30 sec - exiting
13:38:48 (28914): No heartbeat from core client for 30 sec - exiting
13:38:49 (28914): No heartbeat from core client for 30 sec - exiting
13:38:50 (28914): No heartbeat from core client for 30 sec - exiting
13:38:51 (28914): No heartbeat from core client for 30 sec - exiting
13:38:52 (28914): No heartbeat from core client for 30 sec - exiting
13:38:53 (28914): No heartbeat from core client for 30 sec - exiting
13:38:54 (28914): No heartbeat from core client for 30 sec - exiting
13:38:55 (28914): No heartbeat from core client for 30 sec - exiting
13:38:56 (28914): No heartbeat from core client for 30 sec - exiting
13:38:57 (28914): No heartbeat from core client for 30 sec - exiting
13:38:58 (28914): No heartbeat from core client for 30 sec - exiting
13:38:59 (28914): No heartbeat from core client for 30 sec - exiting
13:39:00 (28914): No heartbeat from core client for 30 sec - exiting
13:39:01 (28914): No heartbeat from core client for 30 sec - exiting
13:39:02 (28914): No heartbeat from core client for 30 sec - exiting
13:39:03 (28914): No heartbeat from core client for 30 sec - exiting
13:39:04 (28914): No heartbeat from core client for 30 sec - exiting
13:39:05 (28914): No heartbeat from core client for 30 sec - exiting
13:39:06 (28914): No heartbeat from core client for 30 sec - exiting
13:39:07 (28914): No heartbeat from core client for 30 sec - exiting
13:39:08 (28914): No heartbeat from core client for 30 sec - exiting
13:39:09 (28914): No heartbeat from core client for 30 sec - exiting
13:39:10 (28914): No heartbeat from core client for 30 sec - exiting
13:39:11 (28914): No heartbeat from core client for 30 sec - exiting
13:39:12 (28914): No heartbeat from core client for 30 sec - exiting
13:39:13 (28914): No heartbeat from core client for 30 sec - exiting
13:39:14 (28914): No heartbeat from core client for 30 sec - exiting
13:39:15 (28914): No heartbeat from core client for 30 sec - exiting
13:39:16 (28914): No heartbeat from core client for 30 sec - exiting
13:39:17 (28914): No heartbeat from core client for 30 sec - exiting
13:39:18 (28914): No heartbeat from core client for 30 sec - exiting
13:39:19 (28914): No heartbeat from core client for 30 sec - exiting
13:39:20 (28914): No heartbeat from core client for 30 sec - exiting
13:39:21 (28914): No heartbeat from core client for 30 sec - exiting
13:39:22 (28914): No heartbeat from core client for 30 sec - exiting
13:39:23 (28914): No heartbeat from core client for 30 sec - exiting
13:39:24 (28914): No heartbeat from core client for 30 sec - exiting
13:39:25 (28914): No heartbeat from core client for 30 sec - exiting
13:39:26 (28914): No heartbeat from core client for 30 sec - exiting
13:39:27 (28914): No heartbeat from core client for 30 sec - exiting
13:39:28 (28914): No heartbeat from core client for 30 sec - exiting
13:39:29 (28914): No heartbeat from core client for 30 sec - exiting
13:39:30 (28914): No heartbeat from core client for 30 sec - exiting
13:39:31 (28914): No heartbeat from core client for 30 sec - exiting
13:39:32 (28914): No heartbeat from core client for 30 sec - exiting
13:39:33 (28914): No heartbeat from core client for 30 sec - exiting
13:39:34 (28914): No heartbeat from core client for 30 sec - exiting
13:39:35 (28914): No heartbeat from core client for 30 sec - exiting
13:39:36 (28914): No heartbeat from core client for 30 sec - exiting
13:39:37 (28914): No heartbeat from core client for 30 sec - exiting
13:39:38 (28914): No heartbeat from core client for 30 sec - exiting
13:39:39 (28914): No heartbeat from core client for 30 sec - exiting
13:39:40 (28914): No heartbeat from core client for 30 sec - exiting
13:39:41 (28914): No heartbeat from core client for 30 sec - exiting
13:39:42 (28914): No heartbeat from core client for 30 sec - exiting
13:39:43 (28914): No heartbeat from core client for 30 sec - exiting
13:39:44 (28914): No heartbeat from core client for 30 sec - exiting
13:39:45 (28914): No heartbeat from core client for 30 sec - exiting
13:39:46 (28914): No heartbeat from core client for 30 sec - exiting
13:39:47 (28914): No heartbeat from core client for 30 sec - exiting
13:39:48 (28914): No heartbeat from core client for 30 sec - exiting
13:39:49 (28914): No heartbeat from core client for 30 sec - exiting
13:39:50 (28914): No heartbeat from core client for 30 sec - exiting
13:39:51 (28914): No heartbeat from core client for 30 sec - exiting
13:39:52 (28914): No heartbeat from core client for 30 sec - exiting
13:39:53 (28914): No heartbeat from core client for 30 sec - exiting
13:39:54 (28914): No heartbeat from core client for 30 sec - exiting
13:39:55 (28914): No heartbeat from core client for 30 sec - exiting
13:39:56 (28914): No heartbeat from core client for 30 sec - exiting
13:39:57 (28914): No heartbeat from core client for 30 sec - exiting
13:39:58 (28914): No heartbeat from core client for 30 sec - exiting
13:39:59 (28914): No heartbeat from core client for 30 sec - exiting
13:40:00 (28914): No heartbeat from core client for 30 sec - exiting
13:40:01 (28914): No heartbeat from core client for 30 sec - exiting
13:40:02 (28914): No heartbeat from core client for 30 sec - exiting
13:40:03 (28914): No heartbeat from core client for 30 sec - exiting
13:40:04 (28914): No heartbeat from core client for 30 sec - exiting
13:40:05 (28914): No heartbeat from core client for 30 sec - exiting
13:40:06 (28914): No heartbeat from core client for 30 sec - exiting
13:40:07 (28914): No heartbeat from core client for 30 sec - exiting
13:40:08 (28914): No heartbeat from core client for 30 sec - exiting
13:40:09 (28914): No heartbeat from core client for 30 sec - exiting
13:40:10 (28914): No heartbeat from core client for 30 sec - exiting
13:40:11 (28914): No heartbeat from core client for 30 sec - exiting
13:40:12 (28914): No heartbeat from core client for 30 sec - exiting
13:40:13 (28914): No heartbeat from core client for 30 sec - exiting
13:40:14 (28914): No heartbeat from core client for 30 sec - exiting
13:40:15 (28914): No heartbeat from core client for 30 sec - exiting
13:40:16 (28914): No heartbeat from core client for 30 sec - exiting
13:40:17 (28914): No heartbeat from core client for 30 sec - exiting
13:40:18 (28914): No heartbeat from core client for 30 sec - exiting
13:40:19 (28914): No heartbeat from core client for 30 sec - exiting
13:40:20 (28914): No heartbeat from core client for 30 sec - exiting
13:40:21 (28914): No heartbeat from core client for 30 sec - exiting
13:40:22 (28914): No heartbeat from core client for 30 sec - exiting
13:40:23 (28914): No heartbeat from core client for 30 sec - exiting
13:40:24 (28914): No heartbeat from core client for 30 sec - exiting
13:40:25 (28914): No heartbeat from core client for 30 sec - exiting
13:40:26 (28914): No heartbeat from core client for 30 sec - exiting
13:40:27 (28914): No heartbeat from core client for 30 sec - exiting
13:40:28 (28914): No heartbeat from core client for 30 sec - exiting
13:40:29 (28914): No heartbeat from core client for 30 sec - exiting
13:40:30 (28914): No heartbeat from core client for 30 sec - exiting
13:40:31 (28914): No heartbeat from core client for 30 sec - exiting
13:40:32 (28914): No heartbeat from core client for 30 sec - exiting
13:40:33 (28914): No heartbeat from core client for 30 sec - exiting
13:40:34 (28914): No heartbeat from core client for 30 sec - exiting
13:40:35 (28914): No heartbeat from core client for 30 sec - exiting
13:40:36 (28914): No heartbeat from core client for 30 sec - exiting
13:40:37 (28914): No heartbeat from core client for 30 sec - exiting
13:40:38 (28914): No heartbeat from core client for 30 sec - exiting
13:40:39 (28914): No heartbeat from core client for 30 sec - exiting
13:40:40 (28914): No heartbeat from core client for 30 sec - exiting
13:40:41 (28914): No heartbeat from core client for 30 sec - exiting
13:40:42 (28914): No heartbeat from core client for 30 sec - exiting
13:40:43 (28914): No heartbeat from core client for 30 sec - exiting
13:40:44 (28914): No heartbeat from core client for 30 sec - exiting
13:40:45 (28914): No heartbeat from core client for 30 sec - exiting
13:40:46 (28914): No heartbeat from core client for 30 sec - exiting
13:40:47 (28914): No heartbeat from core client for 30 sec - exiting
13:40:48 (28914): No heartbeat from core client for 30 sec - exiting
13:40:49 (28914): No heartbeat from core client for 30 sec - exiting
13:40:50 (28914): No heartbeat from core client for 30 sec - exiting
13:40:51 (28914): No heartbeat from core client for 30 sec - exiting
13:40:52 (28914): No heartbeat from core client for 30 sec - exiting
13:40:53 (28914): No heartbeat from core client for 30 sec - exiting
13:40:54 (28914): No heartbeat from core client for 30 sec - exiting
13:40:55 (28914): No heartbeat from core client for 30 sec - exiting
13:40:56 (28914): No heartbeat from core client for 30 sec - exiting
13:40:57 (28914): No heartbeat from core client for 30 sec - exiting
13:40:58 (28914): No heartbeat from core client for 30 sec - exiting
13:40:59 (28914): No heartbeat from core client for 30 sec - exiting
13:41:00 (28914): No heartbeat from core client for 30 sec - exiting
13:41:01 (28914): No heartbeat from core client for 30 sec - exiting
13:41:02 (28914): No heartbeat from core client for 30 sec - exiting
13:41:03 (28914): No heartbeat from core client for 30 sec - exiting
13:41:04 (28914): No heartbeat from core client for 30 sec - exiting
13:41:05 (28914): No heartbeat from core client for 30 sec - exiting
13:41:06 (28914): No heartbeat from core client for 30 sec - exiting
13:41:07 (28914): No heartbeat from core client for 30 sec - exiting
13:41:08 (28914): No heartbeat from core client for 30 sec - exiting
13:41:09 (28914): No heartbeat from core client for 30 sec - exiting
13:41:10 (28914): No heartbeat from core client for 30 sec - exiting
13:41:11 (28914): No heartbeat from core client for 30 sec - exiting
13:41:12 (28914): No heartbeat from core client for 30 sec - exiting
13:41:13 (28914): No heartbeat from core client for 30 sec - exiting
13:41:14 (28914): No heartbeat from core client for 30 sec - exiting
13:41:15 (28914): No heartbeat from core client for 30 sec - exiting
13:41:16 (28914): No heartbeat from core client for 30 sec - exiting
13:41:17 (28914): No heartbeat from core client for 30 sec - exiting
13:41:18 (28914): No heartbeat from core client for 30 sec - exiting
13:41:19 (28914): No heartbeat from core client for 30 sec - exiting
13:41:20 (28914): No heartbeat from core client for 30 sec - exiting
13:41:21 (28914): No heartbeat from core client for 30 sec - exiting
13:41:22 (28914): No heartbeat from core client for 30 sec - exiting
13:41:23 (28914): No heartbeat from core client for 30 sec - exiting
13:41:24 (28914): No heartbeat from core client for 30 sec - exiting
13:41:25 (28914): No heartbeat from core client for 30 sec - exiting
13:41:26 (28914): No heartbeat from core client for 30 sec - exiting
13:41:27 (28914): No heartbeat from core client for 30 sec - exiting
13:41:28 (28914): No heartbeat from core client for 30 sec - exiting
13:41:29 (28914): No heartbeat from core client for 30 sec - exiting
13:41:30 (28914): No heartbeat from core client for 30 sec - exiting
13:41:31 (28914): No heartbeat from core client for 30 sec - exiting
13:41:32 (28914): No heartbeat from core client for 30 sec - exiting
13:41:33 (28914): No heartbeat from core client for 30 sec - exiting
13:41:34 (28914): No heartbeat from core client for 30 sec - exiting
13:41:35 (28914): No heartbeat from core client for 30 sec - exiting
13:41:36 (28914): No heartbeat from core client for 30 sec - exiting
13:41:37 (28914): No heartbeat from core client for 30 sec - exiting
13:41:38 (28914): No heartbeat from core client for 30 sec - exiting
13:41:39 (28914): No heartbeat from core client for 30 sec - exiting
13:41:40 (28914): No heartbeat from core client for 30 sec - exiting
13:41:41 (28914): No heartbeat from core client for 30 sec - exiting
13:41:42 (28914): No heartbeat from core client for 30 sec - exiting
13:41:43 (28914): No heartbeat from core client for 30 sec - exiting
13:41:44 (28914): No heartbeat from core client for 30 sec - exiting
13:41:45 (28914): No heartbeat from core client for 30 sec - exiting
13:41:46 (28914): No heartbeat from core client for 30 sec - exiting
13:41:47 (28914): No heartbeat from core client for 30 sec - exiting
13:41:48 (28914): No heartbeat from core client for 30 sec - exiting
13:41:49 (28914): No heartbeat from core client for 30 sec - exiting
13:41:50 (28914): No heartbeat from core client for 30 sec - exiting
13:41:51 (28914): No heartbeat from core client for 30 sec - exiting
13:41:52 (28914): No heartbeat from core client for 30 sec - exiting
13:41:53 (28914): No heartbeat from core client for 30 sec - exiting
13:41:54 (28914): No heartbeat from core client for 30 sec - exiting
13:41:55 (28914): No heartbeat from core client for 30 sec - exiting
13:41:56 (28914): No heartbeat from core client for 30 sec - exiting
13:41:57 (28914): No heartbeat from core client for 30 sec - exiting
13:41:58 (28914): No heartbeat from core client for 30 sec - exiting
13:41:59 (28914): No heartbeat from core client for 30 sec - exiting
13:42:00 (28914): No heartbeat from core client for 30 sec - exiting
13:42:01 (28914): No heartbeat from core client for 30 sec - exiting
13:42:02 (28914): No heartbeat from core client for 30 sec - exiting
13:42:03 (28914): No heartbeat from core client for 30 sec - exiting
13:42:04 (28914): No heartbeat from core client for 30 sec - exiting
13:42:05 (28914): No heartbeat from core client for 30 sec - exiting
13:42:06 (28914): No heartbeat from core client for 30 sec - exiting
13:42:07 (28914): No heartbeat from core client for 30 sec - exiting
13:42:08 (28914): No heartbeat from core client for 30 sec - exiting
13:42:09 (28914): No heartbeat from core client for 30 sec - exiting
13:42:10 (28914): No heartbeat from core client for 30 sec - exiting
13:42:11 (28914): No heartbeat from core client for 30 sec - exiting
13:42:12 (28914): No heartbeat from core client for 30 sec - exiting
13:42:13 (28914): No heartbeat from core client for 30 sec - exiting
13:42:14 (28914): No heartbeat from core client for 30 sec - exiting
13:42:15 (28914): No heartbeat from core client for 30 sec - exiting
13:42:16 (28914): No heartbeat from core client for 30 sec - exiting
13:42:17 (28914): No heartbeat from core client for 30 sec - exiting
13:42:18 (28914): No heartbeat from core client for 30 sec - exiting
13:42:19 (28914): No heartbeat from core client for 30 sec - exiting
13:42:20 (28914): No heartbeat from core client for 30 sec - exiting
13:42:21 (28914): No heartbeat from core client for 30 sec - exiting
13:42:22 (28914): No heartbeat from core client for 30 sec - exiting
13:42:23 (28914): No heartbeat from core client for 30 sec - exiting
13:42:24 (28914): No heartbeat from core client for 30 sec - exiting
13:42:25 (28914): No heartbeat from core client for 30 sec - exiting
13:42:26 (28914): No heartbeat from core client for 30 sec - exiting
13:42:27 (28914): No heartbeat from core client for 30 sec - exiting
13:42:28 (28914): No heartbeat from core client for 30 sec - exiting
13:42:29 (28914): No heartbeat from core client for 30 sec - exiting
13:42:30 (28914): No heartbeat from core client for 30 sec - exiting
13:42:31 (28914): No heartbeat from core client for 30 sec - exiting
13:42:32 (28914): No heartbeat from core client for 30 sec - exiting
13:42:33 (28914): No heartbeat from core client for 30 sec - exiting
13:42:34 (28914): No heartbeat from core client for 30 sec - exiting
13:42:35 (28914): No heartbeat from core client for 30 sec - exiting
13:42:37 (28914): No heartbeat from core client for 30 sec - exiting
13:42:38 (28914): No heartbeat from core client for 30 sec - exiting
13:42:39 (28914): No heartbeat from core client for 30 sec - exiting
13:42:40 (28914): No heartbeat from core client for 30 sec - exiting
13:42:41 (28914): No heartbeat from core client for 30 sec - exiting
13:42:42 (28914): No heartbeat from core client for 30 sec - exiting
13:42:43 (28914): No heartbeat from core client for 30 sec - exiting
13:42:44 (28914): No heartbeat from core client for 30 sec - exiting
13:42:45 (28914): No heartbeat from core client for 30 sec - exiting
13:42:46 (28914): No heartbeat from core client for 30 sec - exiting
13:42:47 (28914): No heartbeat from core client for 30 sec - exiting
13:42:48 (28914): No heartbeat from core client for 30 sec - exiting
13:42:49 (28914): No heartbeat from core client for 30 sec - exiting
13:42:50 (28914): No heartbeat from core client for 30 sec - exiting
13:42:51 (28914): No heartbeat from core client for 30 sec - exiting
13:42:52 (28914): No heartbeat from core client for 30 sec - exiting
13:42:53 (28914): No heartbeat from core client for 30 sec - exiting
13:42:54 (28914): No heartbeat from core client for 30 sec - exiting
13:42:55 (28914): No heartbeat from core client for 30 sec - exiting
13:42:56 (28914): No heartbeat from core client for 30 sec - exiting
13:42:57 (28914): No heartbeat from core client for 30 sec - exiting
13:42:58 (28914): No heartbeat from core client for 30 sec - exiting
13:42:59 (28914): No heartbeat from core client for 30 sec - exiting
13:43:00 (28914): No heartbeat from core client for 30 sec - exiting
13:43:01 (28914): No heartbeat from core client for 30 sec - exiting
13:43:02 (28914): No heartbeat from core client for 30 sec - exiting
13:43:03 (28914): No heartbeat from core client for 30 sec - exiting
13:43:04 (28914): No heartbeat from core client for 30 sec - exiting
13:43:05 (28914): No heartbeat from core client for 30 sec - exiting
13:43:06 (28914): No heartbeat from core client for 30 sec - exiting
13:43:07 (28914): No heartbeat from core client for 30 sec - exiting
13:43:08 (28914): No heartbeat from core client for 30 sec - exiting
13:43:09 (28914): No heartbeat from core client for 30 sec - exiting
13:43:10 (28914): No heartbeat from core client for 30 sec - exiting
13:43:11 (28914): No heartbeat from core client for 30 sec - exiting
13:43:12 (28914): No heartbeat from core client for 30 sec - exiting
13:43:13 (28914): No heartbeat from core client for 30 sec - exiting
13:43:14 (28914): No heartbeat from core client for 30 sec - exiting
13:43:15 (28914): No heartbeat from core client for 30 sec - exiting
13:43:16 (28914): No heartbeat from core client for 30 sec - exiting
13:43:17 (28914): No heartbeat from core client for 30 sec - exiting
13:43:18 (28914): No heartbeat from core client for 30 sec - exiting
13:43:19 (28914): No heartbeat from core client for 30 sec - exiting
13:43:20 (28914): No heartbeat from core client for 30 sec - exiting
13:43:21 (28914): No heartbeat from core client for 30 sec - exiting
13:43:22 (28914): No heartbeat from core client for 30 sec - exiting
13:43:23 (28914): No heartbeat from core client for 30 sec - exiting
13:43:24 (28914): No heartbeat from core client for 30 sec - exiting
13:43:25 (28914): No heartbeat from core client for 30 sec - exiting
13:43:26 (28914): No heartbeat from core client for 30 sec - exiting
13:43:27 (28914): No heartbeat from core client for 30 sec - exiting
13:43:28 (28914): No heartbeat from core client for 30 sec - exiting
13:43:29 (28914): No heartbeat from core client for 30 sec - exiting
13:43:30 (28914): No heartbeat from core client for 30 sec - exiting
13:43:31 (28914): No heartbeat from core client for 30 sec - exiting
13:43:32 (28914): No heartbeat from core client for 30 sec - exiting
13:43:33 (28914): No heartbeat from core client for 30 sec - exiting
13:43:34 (28914): No heartbeat from core client for 30 sec - exiting
13:43:35 (28914): No heartbeat from core client for 30 sec - exiting
13:43:36 (28914): No heartbeat from core client for 30 sec - exiting
13:43:37 (28914): No heartbeat from core client for 30 sec - exiting
13:43:38 (28914): No heartbeat from core client for 30 sec - exiting
13:43:39 (28914): No heartbeat from core client for 30 sec - exiting
13:43:40 (28914): No heartbeat from core client for 30 sec - exiting
13:43:41 (28914): No heartbeat from core client for 30 sec - exiting
13:43:42 (28914): No heartbeat from core client for 30 sec - exiting
13:43:43 (28914): No heartbeat from core client for 30 sec - exiting
13:43:45 (28914): No heartbeat from core client for 30 sec - exiting
13:43:48 (28914): No heartbeat from core client for 30 sec - exiting
13:43:49 (28914): No heartbeat from core client for 30 sec - exiting
13:43:50 (28914): No heartbeat from core client for 30 sec - exiting
13:43:51 (28914): No heartbeat from core client for 30 sec - exiting
13:43:52 (28914): No heartbeat from core client for 30 sec - exiting
13:43:53 (28914): No heartbeat from core client for 30 sec - exiting
13:43:54 (28914): No heartbeat from core client for 30 sec - exiting
13:43:55 (28914): No heartbeat from core client for 30 sec - exiting
13:43:56 (28914): No heartbeat from core client for 30 sec - exiting
13:43:57 (28914): No heartbeat from core client for 30 sec - exiting
13:43:58 (28914): No heartbeat from core client for 30 sec - exiting
13:43:59 (28914): No heartbeat from core client for 30 sec - exiting
13:44:00 (28914): No heartbeat from core client for 30 sec - exiting
13:44:01 (28914): No heartbeat from core client for 30 sec - exiting
13:44:02 (28914): No heartbeat from core client for 30 sec - exiting
13:44:03 (28914): No heartbeat from core client for 30 sec - exiting
13:44:04 (28914): No heartbeat from core client for 30 sec - exiting
13:44:05 (28914): No heartbeat from core client for 30 sec - exiting
13:44:06 (28914): No heartbeat from core client for 30 sec - exiting
13:44:07 (28914): No heartbeat from core client for 30 sec - exiting
13:44:08 (28914): No heartbeat from core client for 30 sec - exiting
13:44:09 (28914): No heartbeat from core client for 30 sec - exiting
13:44:10 (28914): No heartbeat from core client for 30 sec - exiting
13:44:11 (28914): No heartbeat from core client for 30 sec - exiting
13:44:12 (28914): No heartbeat from core client for 30 sec - exiting
13:44:13 (28914): No heartbeat from core client for 30 sec - exiting
13:44:14 (28914): No heartbeat from core client for 30 sec - exiting
13:44:15 (28914): No heartbeat from core client for 30 sec - exiting
13:44:16 (28914): No heartbeat from core client for 30 sec - exiting
13:44:17 (28914): No heartbeat from core client for 30 sec - exiting
13:44:18 (28914): No heartbeat from core client for 30 sec - exiting
13:44:20 (28914): No heartbeat from core client for 30 sec - exiting
13:44:21 (28914): No heartbeat from core client for 30 sec - exiting
13:44:22 (28914): No heartbeat from core client for 30 sec - exiting
13:44:23 (28914): No heartbeat from core client for 30 sec - exiting
13:44:24 (28914): No heartbeat from core client for 30 sec - exiting
13:44:25 (28914): No heartbeat from core client for 30 sec - exiting
13:44:26 (28914): No heartbeat from core client for 30 sec - exiting
13:44:27 (28914): No heartbeat from core client for 30 sec - exiting
13:44:28 (28914): No heartbeat from core client for 30 sec - exiting
13:44:29 (28914): No heartbeat from core client for 30 sec - exiting
13:44:30 (28914): No heartbeat from core client for 30 sec - exiting
13:44:31 (28914): No heartbeat from core client for 30 sec - exiting
13:44:32 (28914): No heartbeat from core client for 30 sec - exiting
13:44:33 (28914): No heartbeat from core client for 30 sec - exiting
13:44:34 (28914): No heartbeat from core client for 30 sec - exiting
13:44:35 (28914): No heartbeat from core client for 30 sec - exiting
13:44:36 (28914): No heartbeat from core client for 30 sec - exiting
13:44:37 (28914): No heartbeat from core client for 30 sec - exiting
13:44:38 (28914): No heartbeat from core client for 30 sec - exiting
13:44:39 (28914): No heartbeat from core client for 30 sec - exiting
13:44:40 (28914): No heartbeat from core client for 30 sec - exiting
13:44:41 (28914): No heartbeat from core client for 30 sec - exiting
13:44:42 (28914): No heartbeat from core client for 30 sec - exiting
13:44:43 (28914): No heartbeat from core client for 30 sec - exiting
13:44:44 (28914): No heartbeat from core client for 30 sec - exiting
13:44:45 (28914): No heartbeat from core client for 30 sec - exiting
13:44:46 (28914): No heartbeat from core client for 30 sec - exiting
13:44:47 (28914): No heartbeat from core client for 30 sec - exiting
13:44:48 (28914): No heartbeat from core client for 30 sec - exiting
13:44:49 (28914): No heartbeat from core client for 30 sec - exiting
13:44:50 (28914): No heartbeat from core client for 30 sec - exiting
13:44:51 (28914): No heartbeat from core client for 30 sec - exiting
13:44:52 (28914): No heartbeat from core client for 30 sec - exiting
13:44:53 (28914): No heartbeat from core client for 30 sec - exiting
13:44:54 (28914): No heartbeat from core client for 30 sec - exiting
13:44:55 (28914): No heartbeat from core client for 30 sec - exiting
13:44:56 (28914): No heartbeat from core client for 30 sec - exiting
13:44:57 (28914): No heartbeat from core client for 30 sec - exiting
13:44:58 (28914): No heartbeat from core client for 30 sec - exiting
13:44:59 (28914): No heartbeat from core client for 30 sec - exiting
13:45:00 (28914): No heartbeat from core client for 30 sec - exiting
13:45:01 (28914): No heartbeat from core client for 30 sec - exiting
13:45:02 (28914): No heartbeat from core client for 30 sec - exiting
13:45:03 (28914): No heartbeat from core client for 30 sec - exiting
13:45:04 (28914): No heartbeat from core client for 30 sec - exiting
13:45:05 (28914): No heartbeat from core client for 30 sec - exiting
13:45:06 (28914): No heartbeat from core client for 30 sec - exiting
13:45:07 (28914): No heartbeat from core client for 30 sec - exiting
13:45:08 (28914): No heartbeat from core client for 30 sec - exiting
13:45:09 (28914): No heartbeat from core client for 30 sec - exiting
13:45:10 (28914): No heartbeat from core client for 30 sec - exiting
13:45:11 (28914): No heartbeat from core client for 30 sec - exiting
13:45:12 (28914): No heartbeat from core client for 30 sec - exiting
13:45:13 (28914): No heartbeat from core client for 30 sec - exiting
13:45:14 (28914): No heartbeat from core client for 30 sec - exiting
13:45:15 (28914): No heartbeat from core client for 30 sec - exiting
13:45:16 (28914): No heartbeat from core client for 30 sec - exiting
13:45:17 (28914): No heartbeat from core client for 30 sec - exiting
13:45:18 (28914): No heartbeat from core client for 30 sec - exiting
13:45:19 (28914): No heartbeat from core client for 30 sec - exiting
13:45:20 (28914): No heartbeat from core client for 30 sec - exiting
13:45:21 (28914): No heartbeat from core client for 30 sec - exiting
Signal 15 received, exiting...
Called boinc_finish
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08b87fa0 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 Sep 2013 08:47:08 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 518,400 1,025,182 1.9776
05 Sep 2013 04:07:03 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 492,480 970,776 1.9712
04 Sep 2013 00:48:09 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 466,560 916,600 1.9646
02 Sep 2013 01:16:12 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 440,640 877,427 1.9913
01 Sep 2013 10:39:48 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 414,720 826,807 1.9937
31 Aug 2013 20:25:04 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 388,800 776,993 1.9984
31 Aug 2013 04:17:52 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 362,880 723,833 1.9947
30 Aug 2013 00:12:29 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 336,960 669,566 1.9871
29 Aug 2013 00:42:29 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 311,040 615,826 1.9799
27 Aug 2013 18:13:49 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 285,120 562,040 1.9712
26 Aug 2013 21:17:14 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 259,200 509,914 1.9673
25 Aug 2013 23:41:11 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 233,280 458,312 1.9646
24 Aug 2013 23:36:23 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 207,360 403,694 1.9468
23 Jul 2013 21:55:37 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 181,440 352,033 1.9402
23 Jul 2013 21:38:28 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 155,520 303,441 1.9511
23 Jul 2013 21:22:15 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 129,600 254,353 1.9626
23 Jul 2013 20:51:22 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 103,680 202,906 1.9570
23 Jul 2013 20:30:09 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 77,760 150,692 1.9379
23 Jul 2013 20:09:22 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 51,840 101,296 1.9540
23 Jul 2013 19:43:23 1215191 15894288 hadcm3n_o3sl_1940_40_008381249_3 25,920 50,386 1.9439


©2024 climateprediction.net