climateprediction.net home page
Task 16635379

Task 16635379

Name hadcm3n_8dno_1980_40_008727119_2
Workunit 8873097
Created 11 May 2014, 15:16:29 UTC
Sent 11 May 2014, 15:22:56 UTC
Report deadline 10 Aug 2014, 22:50:07 UTC
Received 30 Nov 2015, 18:52:10 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1172397
Run time 8 days 7 hours 5 min 48 sec
CPU time 5 days 4 hours 22 min 53 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 3.65 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.6.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Signal 15 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09def550 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08b49b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08c1ab80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08a08b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0866cb80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09206b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08c29b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09b40b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09dcbb80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08c85b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09902b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09c35b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0a0aeb80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0958eb80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x089b7b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x086b2b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09a6cb80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x094c5b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
11:05:21 (6006): No heartbeat from core client for 30 sec - exiting
11:05:22 (6006): No heartbeat from core client for 30 sec - exiting
11:05:23 (6006): No heartbeat from core client for 30 sec - exiting
11:05:24 (6006): No heartbeat from core client for 30 sec - exiting
11:05:25 (6006): No heartbeat from core client for 30 sec - exiting
11:05:26 (6006): No heartbeat from core client for 30 sec - exiting
11:05:27 (6006): No heartbeat from core client for 30 sec - exiting
11:05:28 (6006): No heartbeat from core client for 30 sec - exiting
11:05:29 (6006): No heartbeat from core client for 30 sec - exiting
11:05:30 (6006): No heartbeat from core client for 30 sec - exiting
11:05:31 (6006): No heartbeat from core client for 30 sec - exiting
11:05:32 (6006): No heartbeat from core client for 30 sec - exiting
11:05:33 (6006): No heartbeat from core client for 30 sec - exiting
11:05:34 (6006): No heartbeat from core client for 30 sec - exiting
11:05:35 (6006): No heartbeat from core client for 30 sec - exiting
11:05:36 (6006): No heartbeat from core client for 30 sec - exiting
11:05:37 (6006): No heartbeat from core client for 30 sec - exiting
11:05:38 (6006): No heartbeat from core client for 30 sec - exiting
11:05:39 (6006): No heartbeat from core client for 30 sec - exiting
11:05:40 (6006): No heartbeat from core client for 30 sec - exiting
11:05:41 (6006): No heartbeat from core client for 30 sec - exiting
11:05:42 (6006): No heartbeat from core client for 30 sec - exiting
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08c71b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
11:09:15 (6030): No heartbeat from core client for 30 sec - exiting
11:09:16 (6030): No heartbeat from core client for 30 sec - exiting
11:09:17 (6030): No heartbeat from core client for 30 sec - exiting
11:09:18 (6030): No heartbeat from core client for 30 sec - exiting
11:09:19 (6030): No heartbeat from core client for 30 sec - exiting
11:09:20 (6030): No heartbeat from core client for 30 sec - exiting
11:09:21 (6030): No heartbeat from core client for 30 sec - exiting
11:09:22 (6030): No heartbeat from core client for 30 sec - exiting
11:09:23 (6030): No heartbeat from core client for 30 sec - exiting
11:09:24 (6030): No heartbeat from core client for 30 sec - exiting
11:09:25 (6030): No heartbeat from core client for 30 sec - exiting
11:09:26 (6030): No heartbeat from core client for 30 sec - exiting
11:09:27 (6030): No heartbeat from core client for 30 sec - exiting
11:09:28 (6030): No heartbeat from core client for 30 sec - exiting
11:09:29 (6030): No heartbeat from core client for 30 sec - exiting
11:09:30 (6030): No heartbeat from core client for 30 sec - exiting
11:09:31 (6030): No heartbeat from core client for 30 sec - exiting
11:09:32 (6030): No heartbeat from core client for 30 sec - exiting
11:09:33 (6030): No heartbeat from core client for 30 sec - exiting
11:09:34 (6030): No heartbeat from core client for 30 sec - exiting
11:09:35 (6030): No heartbeat from core client for 30 sec - exiting
11:09:36 (6030): No heartbeat from core client for 30 sec - exiting
11:09:37 (6030): No heartbeat from core client for 30 sec - exiting
11:09:38 (6030): No heartbeat from core client for 30 sec - exiting
11:09:39 (6030): No heartbeat from core client for 30 sec - exiting
11:09:40 (6030): No heartbeat from core client for 30 sec - exiting
11:09:41 (6030): No heartbeat from core client for 30 sec - exiting
11:09:42 (6030): No heartbeat from core client for 30 sec - exiting
11:09:43 (6030): No heartbeat from core client for 30 sec - exiting
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09e3db80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08d2ab80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08258b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08439b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08326b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x094c5b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09f3fb80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09cb1b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09868b80 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09c91b90 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2370: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x087fbb90 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2370: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
10:14:36 (6344): No heartbeat from core client for 30 sec - exiting
10:14:37 (6344): No heartbeat from core client for 30 sec - exiting
10:14:38 (6344): No heartbeat from core client for 30 sec - exiting
10:14:39 (6344): No heartbeat from core client for 30 sec - exiting
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x081b7b90 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2370: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x082a1b90 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2370: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x082f0b90 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2370: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09cf8598 ***
======= Backtrace: =========
/usr/lib32/libc.so.6(+0x69933)[0xf73cc933]
/usr/lib32/libc.so.6(+0x6fc57)[0xf73d2c57]
/usr/lib32/libc.so.6(+0x70411)[0xf73d3411]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x18)[0xf75f3ef8]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x18)[0xf75f3f58]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80510cc]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/usr/lib32/libc.so.6(__libc_start_main+0xf7)[0xf737b497]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:04 20971587                           /home/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:04 20971587                           /home/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09ca5000-09d15000 rw-p 00000000 00:00 0                                  [heap]
f6d00000-f6d21000 rw-p 00000000 00:00 0 
f6d21000-f6e00000 ---p 00000000 00:00 0 
f6ee5000-f7360000 rw-s 00000000 08:04 20981160                           /home/boinc/slots/3/137625
f7360000-f7363000 rw-p 00000000 00:00 0 
f7363000-f7516000 r-xp 00000000 08:03 1047104                            /usr/lib32/libc-2.22.so
f7516000-f7517000 ---p 001b3000 08:03 1047104                            /usr/lib32/libc-2.22.so
f7517000-f7519000 r--p 001b3000 08:03 1047104                            /usr/lib32/libc-2.22.so
f7519000-f751a000 rw-p 001b5000 08:03 1047104                            /usr/lib32/libc-2.22.so
f751a000-f751d000 rw-p 00000000 00:00 0 
f751d000-f7536000 r-xp 00000000 08:03 1046532                            /usr/lib32/libgcc_s.so.1
f7536000-f7537000 rw-p 00018000 08:03 1046532                            /usr/lib32/libgcc_s.so.1
f7537000-f7538000 rw-p 00000000 00:00 0 
f7538000-f7583000 r-xp 00000000 08:03 1049434                            /usr/lib32/libm-2.22.so
f7583000-f7584000 r--p 0004a000 08:03 1049434                            /usr/lib32/libm-2.22.so
f7584000-f7585000 rw-p 0004b000 08:03 1049434                            /usr/lib32/libm-2.22.so
f7585000-f76f1000 r-xp 00000000 08:03 1048555                            /usr/lib32/libstdc++.so.6.0.21
f76f1000-f76f2000 ---p 0016c000 08:03 1048555                            /usr/lib32/libstdc++.so.6.0.21
f76f2000-f76f7000 r--p 0016c000 08:03 1048555                            /usr/lib32/libstdc++.so.6.0.21
f76f7000-f76f8000 rw-p 00171000 08:03 1048555                            /usr/lib32/libstdc++.so.6.0.21
f76f8000-f76fb000 rw-p 00000000 00:00 0 
f76fb000-f76fe000 r-xp 00000000 08:03 1049433                            /usr/lib32/libdl-2.22.so
f76fe000-f76ff000 r--p 00002000 08:03 1049433                            /usr/lib32/libdl-2.22.so
f76ff000-f7700000 rw-p 00003000 08:03 1049433                            /usr/lib32/libdl-2.22.so
f7700000-f7719000 r-xp 00000000 08:03 1046688                            /usr/lib32/libpthread-2.22.so
f7719000-f771a000 ---p 00019000 08:03 1046688                            /usr/lib32/libpthread-2.22.so
f771a000-f771b000 r--p 00019000 08:03 1046688                            /usr/lib32/libpthread-2.22.so
f771b000-f771c000 rw-p 0001a000 08:03 1046688                            /usr/lib32/libpthread-2.22.so
f771c000-f771e000 rw-p 00000000 00:00 0 
f776c000-f776e000 rw-p 00000000 00:00 0 
f776e000-f776f000 ---p 00000000 00:00 0 
f776f000-f7772000 rw-p 00000000 00:00 0                                  [stack:14503]
f7772000-f7774000 rw-s 00000000 08:04 20981081                           /home/boinc/slots/3/boinc_mmap_file
f7774000-f7775000 rw-p 00000000 00:00 0 
f7775000-f7777000 r--p 00000000 00:00 0                                  [vvar]
f7777000-f7778000 r-xp 00000000 00:00 0                                  [vdso]
f7778000-f779a000 r-xp 00000000 08:03 1047105                            /usr/lib32/ld-2.22.so
f779a000-f779b000 r--p 00021000 08:03 1047105                            /usr/lib32/ld-2.22.so
f779b000-f779c000 rw-p 00022000 08:03 1047105                            /usr/lib32/ld-2.22.so
ffb7d000-ffbee000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (17 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7777b70]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7777ba0]
/usr/lib32/libc.so.6(gsignal+0x46)[0xf738ee66]
/usr/lib32/libc.so.6(abort+0x157)[0xf73904e7]
/usr/lib32/libc.so.6(+0x69938)[0xf73cc938]
/usr/lib32/libc.so.6(+0x6fc57)[0xf73d2c57]
/usr/lib32/libc.so.6(+0x70411)[0xf73d3411]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x18)[0xf75f3ef8]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x18)[0xf75f3f58]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80510cc]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/usr/lib32/libc.so.6(__libc_start_main+0xf7)[0xf737b497]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
10 Jun 2014 17:35:29 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 777,600 445,746 0.5732
21 May 2014 20:04:45 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 751,680 421,918 0.5613
21 May 2014 10:41:30 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 725,760 398,181 0.5486
20 May 2014 21:46:09 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 699,840 374,746 0.5355
20 May 2014 04:40:54 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 673,920 351,126 0.5210
19 May 2014 02:26:59 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 648,000 327,832 0.5059
18 May 2014 19:54:15 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 622,080 304,570 0.4896
18 May 2014 13:22:56 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 596,160 281,309 0.4719
18 May 2014 06:54:07 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 570,240 257,994 0.4524
18 May 2014 00:17:38 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 544,320 234,677 0.4311
17 May 2014 17:45:21 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 518,400 211,301 0.4076
17 May 2014 11:14:34 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 492,480 187,858 0.3815
17 May 2014 04:40:39 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 466,560 164,487 0.3526
16 May 2014 22:04:58 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 440,640 141,166 0.3204
16 May 2014 15:11:01 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 414,720 117,196 0.2826
16 May 2014 08:36:49 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 388,800 131,264 0.3376
16 May 2014 00:03:05 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 362,880 107,911 0.2974
15 May 2014 17:15:41 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 336,960 83,955 0.2492
15 May 2014 10:40:32 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 311,040 128,133 0.4120
15 May 2014 04:07:34 1172397 16635379 hadcm3n_8dno_1980_40_008727119_2 285,120 104,759 0.3674


©2024 climateprediction.net