Task 17381204

Name	hadcm3n_x0um_1940_40_009148369_2
Workunit	9278705
Created	9 Nov 2014, 11:57:43 UTC
Sent	9 Nov 2014, 12:08:23 UTC
Report deadline	8 Feb 2015, 19:35:34 UTC
Received	8 Dec 2014, 3:35:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	139 (0x0000008B) Unknown error code
Computer ID	1326407
Run time	17 days 21 hours 50 min 27 sec
CPU time	15 days 18 hours 35 min 30 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.16 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process got signal 11 </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... * Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09077a28 * SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2372: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 (sizeof(size_t))) - 1)) & ~((2 (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called * Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09e96548 * SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2372: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 (sizeof(size_t))) - 1)) & ~((2 (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called * Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09663548 * SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2372: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 (sizeof(size_t))) - 1)) & ~((2 (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called * Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09180548 * SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2372: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 (sizeof(size_t))) - 1)) & ~((2 (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called * Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0989d548 * SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2372: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 (sizeof(size_t))) - 1)) & ~((2 (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called 11:33:49 (4273): No heartbeat from core client for 30 sec - exiting 11:33:55 (4273): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Dec 2014 21:09:18	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	777,600	1,331,298	1.7121
02 Dec 2014 04:36:19	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	751,680	1,280,442	1.7034
01 Dec 2014 12:23:16	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	725,760	1,224,726	1.6875
30 Nov 2014 23:11:31	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	699,840	1,178,713	1.6843
30 Nov 2014 12:05:25	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	673,920	1,139,531	1.6909
29 Nov 2014 22:22:52	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	648,000	1,101,261	1.6995
29 Nov 2014 12:30:38	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	622,080	1,063,807	1.7101
28 Nov 2014 22:48:01	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	596,160	1,021,731	1.7139
28 Nov 2014 11:14:30	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	570,240	981,609	1.7214
27 Nov 2014 20:52:57	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	544,320	939,891	1.7267
27 Nov 2014 08:16:35	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	518,400	896,696	1.7297
26 Nov 2014 18:58:04	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	492,480	855,228	1.7366
26 Nov 2014 00:00:20	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	466,560	814,355	1.7454
25 Nov 2014 10:52:03	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	440,640	772,376	1.7529
24 Nov 2014 21:40:03	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	414,720	733,009	1.7675
24 Nov 2014 09:54:38	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	388,800	691,593	1.7788
23 Nov 2014 18:54:29	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	362,880	648,836	1.7880
23 Nov 2014 01:11:21	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	336,960	603,397	1.7907
22 Nov 2014 12:24:06	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	311,040	562,736	1.8092
21 Nov 2014 21:29:08	1326407	17381204	hadcm3n_x0um_1940_40_009148369_2	285,120	519,974	1.8237