Task 16295369

Name	hadcm3n_86n9_1980_40_008515116_0
Workunit	8662628
Created	26 Feb 2014, 16:08:32 UTC
Sent	26 Feb 2014, 17:05:02 UTC
Report deadline	29 May 2014, 0:32:13 UTC
Received	17 Mar 2014, 12:13:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	139 (0x0000008B) Unknown error code
Computer ID	1312293
Run time	12 days 17 hours 48 min 43 sec
CPU time	12 days 8 hours 36 min 13 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.79 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process got signal 11 </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09a8a500 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09b6fb58 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09d83b58 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09d56b58 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x092eeb58 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0944fb58 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09dc7b58 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Mar 2014 07:33:45	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	777,600	1,058,517	1.3613
13 Mar 2014 23:22:10	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	751,680	1,031,620	1.3724
13 Mar 2014 16:18:00	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	725,760	1,004,196	1.3836
12 Mar 2014 20:30:09	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	699,840	973,254	1.3907
12 Mar 2014 11:08:20	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	673,920	940,770	1.3960
11 Mar 2014 11:40:42	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	648,000	905,221	1.3969
10 Mar 2014 16:01:21	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	622,080	869,476	1.3977
10 Mar 2014 05:44:39	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	596,160	833,792	1.3986
09 Mar 2014 19:15:26	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	570,240	798,091	1.3996
09 Mar 2014 09:06:03	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	544,320	762,364	1.4006
08 Mar 2014 22:47:42	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	518,400	726,370	1.4012
08 Mar 2014 12:15:56	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	492,480	689,675	1.4004
08 Mar 2014 01:42:37	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	466,560	653,104	1.3998
07 Mar 2014 15:15:15	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	440,640	616,463	1.3990
07 Mar 2014 04:42:03	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	414,720	579,763	1.3980
06 Mar 2014 16:15:00	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	388,800	543,683	1.3984
05 Mar 2014 18:07:02	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	362,880	507,805	1.3994
05 Mar 2014 08:08:05	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	336,960	471,963	1.4006
03 Mar 2014 22:57:22	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	311,040	435,552	1.4003
03 Mar 2014 12:28:12	1312293	16295369	hadcm3n_86n9_1980_40_008515116_0	285,120	399,180	1.4000