Task 15590164

Name	hadcm3n_4lp5_1940_40_008304341_0
Workunit	8455476
Created	7 Feb 2013, 2:10:13 UTC
Sent	7 Feb 2013, 2:10:18 UTC
Report deadline	9 May 2013, 9:37:29 UTC
Received	2 Mar 2013, 13:48:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1264394
Run time	21 days 3 hours 29 min 46 sec
CPU time	17 days 18 hours 57 min 33 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	1.22 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.29</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish 12:23:45 (1020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09c3db60 *** ======= Backtrace: ========= /lib/libc.so.6[0x430e5ff9] /lib/libstdc++.so.6(_ZdlPv+0x20)[0xf769cba0] /lib/libstdc++.so.6(_ZdaPv+0x1c)[0xf769cbfc] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xf5)[0x43089865] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 fd:01 264009 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 fd:01 264009 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 09be8000-09c6e000 rw-p 00000000 00:00 0 [heap] 4304d000-4306c000 r-xp 00000000 fd:01 162120 /usr/lib/ld-2.16.so 4306c000-4306d000 r--p 0001e000 fd:01 162120 /usr/lib/ld-2.16.so 4306d000-4306e000 rw-p 0001f000 fd:01 162120 /usr/lib/ld-2.16.so 43070000-43220000 r-xp 00000000 fd:01 160380 /usr/lib/libc-2.16.so 43220000-43222000 r--p 001b0000 fd:01 160380 /usr/lib/libc-2.16.so 43222000-43223000 rw-p 001b2000 fd:01 160380 /usr/lib/libc-2.16.so 43223000-43226000 rw-p 00000000 00:00 0 f7000000-f7021000 rw-p 00000000 00:00 0 f7021000-f7100000 ---p 00000000 00:00 0 f7177000-f75f2000 rw-s 00000000 fd:01 264382 /var/lib/boinc/slots/4/132845 f75f2000-f75f5000 rw-p 00000000 00:00 0 f75f5000-f7611000 r-xp 00000000 fd:01 181279 /usr/lib/libgcc_s-4.7.2-20121109.so.1 f7611000-f7612000 r--p 0001b000 fd:01 181279 /usr/lib/libgcc_s-4.7.2-20121109.so.1 f7612000-f7613000 rw-p 0001c000 fd:01 181279 /usr/lib/libgcc_s-4.7.2-20121109.so.1 f7613000-f7614000 rw-p 00000000 00:00 0 f7614000-f7652000 r-xp 00000000 fd:01 175919 /usr/lib/libm-2.16.so f7652000-f7653000 r--p 0003d000 fd:01 175919 /usr/lib/libm-2.16.so f7653000-f7654000 rw-p 0003e000 fd:01 175919 /usr/lib/libm-2.16.so f7654000-f7731000 r-xp 00000000 fd:01 175954 /usr/lib/libstdc++.so.6.0.17 f7731000-f7732000 ---p 000dd000 fd:01 175954 /usr/lib/libstdc++.so.6.0.17 f7732000-f7736000 r--p 000dd000 fd:01 175954 /usr/lib/libstdc++.so.6.0.17 f7736000-f7737000 rw-p 000e1000 fd:01 175954 /usr/lib/libstdc++.so.6.0.17 f7737000-f773e000 rw-p 00000000 00:00 0 f773e000-f7741000 r-xp 00000000 fd:01 175917 /usr/lib/libdl-2.16.so f7741000-f7742000 r--p 00002000 fd:01 175917 /usr/lib/libdl-2.16.so f7742000-f7743000 rw-p 00003000 fd:01 175917 /usr/lib/libdl-2.16.so f7743000-f7759000 r-xp 00000000 fd:01 175937 /usr/lib/libpthread-2.16.so f7759000-f775a000 r--p 00015000 fd:01 175937 /usr/lib/libpthread-2.16.so f775a000-f775b000 rw-p 00016000 fd:01 175937 /usr/lib/libpthread-2.16.so f775b000-f775d000 rw-p 00000000 00:00 0 f7770000-f7772000 rw-p 00000000 00:00 0 f7772000-f7773000 ---p 00000000 00:00 0 f7773000-f7776000 rw-p 00000000 00:00 0 [stack:12464] f7776000-f7778000 rw-s 00000000 fd:01 264082 /var/lib/boinc/slots/4/boinc_mmap_file f7778000-f7779000 rw-p 00000000 00:00 0 f7779000-f777a000 r-xp 00000000 00:00 0 [vdso] ffbd1000-ffc42000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (17 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf7779400] [0xf7779425] /lib/libc.so.6(gsignal+0x4f)[0x4309eb7f] /lib/libc.so.6(abort+0x143)[0x430a04d3] /lib/libc.so.6[0x430de405] /lib/libc.so.6[0x430e5ff9] /lib/libstdc++.so.6(_ZdlPv+0x20)[0xf769cba0] /lib/libstdc++.so.6(_ZdaPv+0x1c)[0xf769cbfc] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xf5)[0x43089865] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Mar 2013 13:50:20	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	777,600	1,537,051	1.9767
01 Mar 2013 12:23:18	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	751,680	1,483,060	1.9730
28 Feb 2013 15:50:32	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	725,760	1,428,805	1.9687
27 Feb 2013 23:15:09	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	699,840	1,375,427	1.9653
27 Feb 2013 02:05:15	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	673,920	1,322,164	1.9619
26 Feb 2013 08:50:19	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	648,000	1,270,619	1.9608
25 Feb 2013 11:05:31	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	622,080	1,218,591	1.9589
24 Feb 2013 09:05:29	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	596,160	1,167,048	1.9576
23 Feb 2013 07:31:53	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	570,240	1,115,228	1.9557
22 Feb 2013 07:46:47	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	544,320	1,063,002	1.9529
21 Feb 2013 13:05:13	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	518,400	1,011,496	1.9512
20 Feb 2013 20:35:44	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	492,480	959,402	1.9481
20 Feb 2013 03:06:57	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	466,560	907,472	1.9450
19 Feb 2013 09:28:25	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	440,640	854,519	1.9393
18 Feb 2013 15:50:43	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	414,720	802,169	1.9342
17 Feb 2013 23:16:05	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	388,800	749,181	1.9269
17 Feb 2013 04:21:06	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	362,880	697,781	1.9229
16 Feb 2013 08:48:56	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	336,960	646,183	1.9177
15 Feb 2013 13:05:09	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	311,040	594,476	1.9113
14 Feb 2013 21:03:45	1264394	15590164	hadcm3n_4lp5_1940_40_008304341_0	285,120	542,894	1.9041