Task 15312898

Name	hadcm3n_o404_2100_40_008203898_1
Workunit	8359022
Created	27 Sep 2012, 2:28:36 UTC
Sent	27 Sep 2012, 2:29:09 UTC
Report deadline	27 Dec 2012, 9:56:20 UTC
Received	7 Oct 2012, 11:12:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1236673
Run time	5 days 20 hours 35 min 37 sec
CPU time	5 days 9 hours 8 min 9 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.89 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.29</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09fcee38 *** ======= Backtrace: ========= /lib/libc.so.6[0x49a248e9] /lib/libstdc++.so.6(_ZdlPv+0x20)[0x49bdcba0] /lib/libstdc++.so.6(_ZdaPv+0x1c)[0x49bdcbfc] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xf5)[0x499c8635] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 fd:01 1444483 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 fd:01 1444483 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 09f79000-0a000000 rw-p 00000000 00:00 0 [heap] 4998c000-499ab000 r-xp 00000000 fd:01 2627484 /usr/lib/ld-2.15.so 499ab000-499ac000 r--p 0001e000 fd:01 2627484 /usr/lib/ld-2.15.so 499ac000-499ad000 rw-p 0001f000 fd:01 2627484 /usr/lib/ld-2.15.so 499af000-49b5a000 r-xp 00000000 fd:01 2644615 /usr/lib/libc-2.15.so 49b5a000-49b5b000 ---p 001ab000 fd:01 2644615 /usr/lib/libc-2.15.so 49b5b000-49b5d000 r--p 001ab000 fd:01 2644615 /usr/lib/libc-2.15.so 49b5d000-49b5e000 rw-p 001ad000 fd:01 2644615 /usr/lib/libc-2.15.so 49b5e000-49b61000 rw-p 00000000 00:00 0 49b63000-49b66000 r-xp 00000000 fd:01 2643183 /usr/lib/libdl-2.15.so 49b66000-49b67000 r--p 00002000 fd:01 2643183 /usr/lib/libdl-2.15.so 49b67000-49b68000 rw-p 00003000 fd:01 2643183 /usr/lib/libdl-2.15.so 49b6a000-49b80000 r-xp 00000000 fd:01 2644617 /usr/lib/libpthread-2.15.so 49b80000-49b81000 r--p 00015000 fd:01 2644617 /usr/lib/libpthread-2.15.so 49b81000-49b82000 rw-p 00016000 fd:01 2644617 /usr/lib/libpthread-2.15.so 49b82000-49b84000 rw-p 00000000 00:00 0 49b91000-49c71000 r-xp 00000000 fd:01 2628227 /usr/lib/libstdc++.so.6.0.17 49c71000-49c75000 r--p 000e0000 fd:01 2628227 /usr/lib/libstdc++.so.6.0.17 49c75000-49c76000 rw-p 000e4000 fd:01 2628227 /usr/lib/libstdc++.so.6.0.17 49c76000-49c7d000 rw-p 00000000 00:00 0 49c7f000-49c9b000 r-xp 00000000 fd:01 2627879 /usr/lib/libgcc_s-4.7.2-20120921.so.1 49c9b000-49c9c000 rw-p 0001b000 fd:01 2627879 /usr/lib/libgcc_s-4.7.2-20120921.so.1 49d13000-49d3c000 r-xp 00000000 fd:01 2643181 /usr/lib/libm-2.15.so 49d3c000-49d3d000 r--p 00028000 fd:01 2643181 /usr/lib/libm-2.15.so 49d3d000-49d3e000 rw-p 00029000 fd:01 2643181 /usr/lib/libm-2.15.so f732d000-f732e000 rw-p 00000000 00:00 0 f732e000-f77a9000 rw-s 00000000 fd:01 1580440 /var/lib/boinc/slots/2/130775 f77a9000-f77ad000 rw-p 00000000 00:00 0 f77bf000-f77c0000 rw-p 00000000 00:00 0 f77c0000-f77c1000 ---p 00000000 00:00 0 f77c1000-f77c4000 rw-p 00000000 00:00 0 [stack:2752] f77c4000-f77c6000 rw-s 00000000 fd:01 1580437 /var/lib/boinc/slots/2/boinc_mmap_file f77c6000-f77c7000 rw-p 00000000 00:00 0 f77c7000-f77c8000 r-xp 00000000 00:00 0 [vdso] ffca7000-ffd16000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (17 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf77c7400] [0xf77c7430] /lib/libc.so.6(gsignal+0x4f)[0x499dd93f] /lib/libc.so.6(abort+0x143)[0x499df293] /lib/libc.so.6[0x49a1cf65] /lib/libc.so.6[0x49a248e9] /lib/libstdc++.so.6(_ZdlPv+0x20)[0x49bdcba0] /lib/libstdc++.so.6(_ZdaPv+0x1c)[0x49bdcbfc] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xf5)[0x499c8635] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Oct 2012 11:15:27	1236673	15312898	hadcm3n_o404_2100_40_008203898_1	259,200	464,884	1.7935
06 Oct 2012 18:38:11	1236673	15312898	hadcm3n_o404_2100_40_008203898_1	233,280	419,949	1.8002
06 Oct 2012 03:41:18	1236673	15312898	hadcm3n_o404_2100_40_008203898_1	207,360	374,713	1.8071
05 Oct 2012 01:20:55	1236673	15312898	hadcm3n_o404_2100_40_008203898_1	181,440	330,069	1.8192
03 Oct 2012 10:31:49	1236673	15312898	hadcm3n_o404_2100_40_008203898_1	155,520	285,040	1.8328
02 Oct 2012 08:11:56	1236673	15312898	hadcm3n_o404_2100_40_008203898_1	129,600	240,715	1.8574
01 Oct 2012 04:49:34	1236673	15312898	hadcm3n_o404_2100_40_008203898_1	103,680	193,463	1.8660
30 Sep 2012 07:46:22	1236673	15312898	hadcm3n_o404_2100_40_008203898_1	77,760	144,509	1.8584
29 Sep 2012 06:45:28	1236673	15312898	hadcm3n_o404_2100_40_008203898_1	51,840	88,646	1.7100
28 Sep 2012 05:50:40	1236673	15312898	hadcm3n_o404_2100_40_008203898_1	25,920	44,602	1.7208