Task 13337623

Name	hadcm3n_o5lh_1900_40_007440390_1
Workunit	7637893
Created	5 Sep 2011, 18:20:01 UTC
Sent	5 Sep 2011, 20:16:03 UTC
Report deadline	6 Dec 2011, 3:43:14 UTC
Received	4 Oct 2011, 3:50:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1138119
Run time	21 days 19 hours 32 min 36 sec
CPU time	19 days 19 hours 18 min 38 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.00 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09341518 *** ======= Backtrace: ========= /lib/libc.so.6[0xa9cfb6] /usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0x7a46fc2] /usr/lib/libstdc++.so.6(_ZdaPv+0x1e)[0x7a4701e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe6)[0xa44e36] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 005fd000-005fe000 r-xp 00000000 00:00 0 [vdso] 00790000-00793000 r-xp 00000000 08:15 2282 /lib/libdl-2.13.so 00793000-00794000 r--p 00002000 08:15 2282 /lib/libdl-2.13.so 00794000-00795000 rw-p 00003000 08:15 2282 /lib/libdl-2.13.so 00a0d000-00a2a000 r-xp 00000000 08:15 2315 /lib/ld-2.13.so 00a2a000-00a2b000 r--p 0001c000 08:15 2315 /lib/ld-2.13.so 00a2b000-00a2c000 rw-p 0001d000 08:15 2315 /lib/ld-2.13.so 00a2e000-00bb1000 r-xp 00000000 08:15 7745 /lib/libc-2.13.so 00bb1000-00bb2000 ---p 00183000 08:15 7745 /lib/libc-2.13.so 00bb2000-00bb4000 r--p 00183000 08:15 7745 /lib/libc-2.13.so 00bb4000-00bb5000 rw-p 00185000 08:15 7745 /lib/libc-2.13.so 00bb5000-00bb8000 rw-p 00000000 00:00 0 00bba000-00bd1000 r-xp 00000000 08:15 7750 /lib/libpthread-2.13.so 00bd1000-00bd2000 r--p 00016000 08:15 7750 /lib/libpthread-2.13.so 00bd2000-00bd3000 rw-p 00017000 08:15 7750 /lib/libpthread-2.13.so 00bd3000-00bd5000 rw-p 00000000 00:00 0 00bd7000-00bff000 r-xp 00000000 08:15 7746 /lib/libm-2.13.so 00bff000-00c00000 r--p 00027000 08:15 7746 /lib/libm-2.13.so 00c00000-00c01000 rw-p 00028000 08:15 7746 /lib/libm-2.13.so 00c2c000-00c48000 r-xp 00000000 08:15 7749 /lib/libgcc_s-4.5.1-20100924.so.1 00c48000-00c49000 rw-p 0001b000 08:15 7749 /lib/libgcc_s-4.5.1-20100924.so.1 07999000-07a7c000 r-xp 00000000 08:11 934313 /usr/lib/libstdc++.so.6.0.14 07a7c000-07a80000 r--p 000e2000 08:11 934313 /usr/lib/libstdc++.so.6.0.14 07a80000-07a82000 rw-p 000e6000 08:11 934313 /usr/lib/libstdc++.so.6.0.14 07a82000-07a88000 rw-p 00000000 00:00 0 08048000-080e3000 r-xp 00000000 08:13 110 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:13 110 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 092ec000-09372000 rw-p 00000000 00:00 0 [heap] b7287000-b7702000 rw-s 00000000 08:13 135782 /var/lib/boinc/slots/2/135575 b7702000-b7705000 rw-p 00000000 00:00 0 b7719000-b771a000 rw-p 00000000 00:00 0 b771a000-b771b000 ---p 00000000 00:00 0 b771b000-b771e000 rw-p 00000000 00:00 0 b771e000-b7720000 rw-s 00000000 08:13 135691 /var/lib/boinc/slots/2/boinc_mmap_file b7720000-b7721000 rw-p 00000000 00:00 0 bfb13000-bfb83000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (17 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0x5fd400] [0x5fd416] /lib/libc.so.6(gsignal+0x51)[0xa592f1] /lib/libc.so.6(abort+0x17e)[0xa5ad5e] /lib/libc.so.6[0xa9551d] /lib/libc.so.6[0xa9cfb6] /usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0x7a46fc2] /usr/lib/libstdc++.so.6(_ZdaPv+0x1e)[0x7a4701e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe6)[0xa44e36] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Oct 2011 02:50:59	1138119	13337623	hadcm3n_o5lh_1900_40_007440390_1	259,200	1,711,106	6.6015
30 Sep 2011 09:47:13	1138119	13337623	hadcm3n_o5lh_1900_40_007440390_1	233,280	1,536,961	6.5885
23 Sep 2011 13:49:44	1138119	13337623	hadcm3n_o5lh_1900_40_007440390_1	207,360	1,364,993	6.5827
21 Sep 2011 11:53:33	1138119	13337623	hadcm3n_o5lh_1900_40_007440390_1	181,440	1,194,882	6.5855
19 Sep 2011 10:29:30	1138119	13337623	hadcm3n_o5lh_1900_40_007440390_1	155,520	1,025,988	6.5971
16 Sep 2011 20:48:48	1138119	13337623	hadcm3n_o5lh_1900_40_007440390_1	129,600	856,387	6.6079
14 Sep 2011 14:11:52	1138119	13337623	hadcm3n_o5lh_1900_40_007440390_1	103,680	684,401	6.6011
12 Sep 2011 11:13:52	1138119	13337623	hadcm3n_o5lh_1900_40_007440390_1	77,760	513,940	6.6093
10 Sep 2011 01:55:48	1138119	13337623	hadcm3n_o5lh_1900_40_007440390_1	51,840	343,122	6.6189
07 Sep 2011 22:39:36	1138119	13337623	hadcm3n_o5lh_1900_40_007440390_1	25,920	171,223	6.6058