Task 13625200

Name	hadcm3n_t72i_1940_40_007542853_0
Workunit	7740085
Created	9 Nov 2011, 23:13:09 UTC
Sent	16 Nov 2011, 16:50:23 UTC
Report deadline	16 Feb 2012, 0:17:34 UTC
Received	26 Nov 2011, 20:51:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1115931
Run time	5 days 18 hours 24 min 27 sec
CPU time	5 days 18 hours 10 min 42 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.70 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08406b60 *** ======= Backtrace: ========= /lib/libc.so.6(+0x6c501)[0x3d1501] /lib/libc.so.6(+0x6dd70)[0x3d2d70] /lib/libc.so.6(cfree+0x6d)[0x3d5e5d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0x1ba441] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0x1ba49d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe7)[0x37bce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 00110000-001ef000 r-xp 00000000 08:01 180862 /usr/lib/libstdc++.so.6.0.14 001ef000-001f3000 r--p 000de000 08:01 180862 /usr/lib/libstdc++.so.6.0.14 001f3000-001f4000 rw-p 000e2000 08:01 180862 /usr/lib/libstdc++.so.6.0.14 001f4000-001fb000 rw-p 00000000 00:00 0 00223000-0023d000 r-xp 00000000 08:01 20678755 /lib/libgcc_s.so.1 0023d000-0023e000 r--p 00019000 08:01 20678755 /lib/libgcc_s.so.1 0023e000-0023f000 rw-p 0001a000 08:01 20678755 /lib/libgcc_s.so.1 00365000-004bc000 r-xp 00000000 08:01 51994664 /lib/libc-2.12.1.so 004bc000-004be000 r--p 00157000 08:01 51994664 /lib/libc-2.12.1.so 004be000-004bf000 rw-p 00159000 08:01 51994664 /lib/libc-2.12.1.so 004bf000-004c2000 rw-p 00000000 00:00 0 00603000-0061f000 r-xp 00000000 08:01 20668510 /lib/ld-2.12.1.so 0061f000-00620000 r--p 0001b000 08:01 20668510 /lib/ld-2.12.1.so 00620000-00621000 rw-p 0001c000 08:01 20668510 /lib/ld-2.12.1.so 00b96000-00bab000 r-xp 00000000 08:01 20678384 /lib/libpthread-2.12.1.so 00bab000-00bac000 ---p 00015000 08:01 20678384 /lib/libpthread-2.12.1.so 00bac000-00bad000 r--p 00015000 08:01 20678384 /lib/libpthread-2.12.1.so 00bad000-00bae000 rw-p 00016000 08:01 20678384 /lib/libpthread-2.12.1.so 00bae000-00bb0000 rw-p 00000000 00:00 0 00d38000-00d3a000 r-xp 00000000 08:01 20678373 /lib/libdl-2.12.1.so 00d3a000-00d3b000 r--p 00001000 08:01 20678373 /lib/libdl-2.12.1.so 00d3b000-00d3c000 rw-p 00002000 08:01 20678373 /lib/libdl-2.12.1.so 00e3a000-00e3b000 r-xp 00000000 00:00 0 [vdso] 00eca000-00eee000 r-xp 00000000 08:01 20678374 /lib/libm-2.12.1.so 00eee000-00eef000 r--p 00023000 08:01 20678374 /lib/libm-2.12.1.so 00eef000-00ef0000 rw-p 00024000 08:01 20678374 /lib/libm-2.12.1.so 08048000-080e3000 r-xp 00000000 08:01 7577898 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:01 7577898 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 083b1000-08416000 rw-p 00000000 00:00 0 [heap] b7200000-b7221000 rw-p 00000000 00:00 0 b7221000-b7300000 ---p 00000000 00:00 0 b738d000-b7808000 rw-s 00000000 08:01 39198741 /var/lib/boinc-client/slots/0/134250 b7808000-b780c000 rw-p 00000000 00:00 0 b781a000-b781b000 rw-p 00000000 00:00 0 b781b000-b781c000 ---p 00000000 00:00 0 b781c000-b781f000 rw-p 00000000 00:00 0 b781f000-b7821000 rw-s 00000000 08:01 39198738 /var/lib/boinc-client/slots/0/boinc_mmap_file b7821000-b7823000 rw-p 00000000 00:00 0 bf9cc000-bfa3c000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xe3a400] [0xe3a416] /lib/libc.so.6(gsignal+0x51)[0x38f941] /lib/libc.so.6(abort+0x182)[0x392e42] /lib/libc.so.6(+0x62305)[0x3c7305] /lib/libc.so.6(+0x6c501)[0x3d1501] /lib/libc.so.6(+0x6dd70)[0x3d2d70] /lib/libc.so.6(cfree+0x6d)[0x3d5e5d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0x1ba441] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0x1ba49d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe7)[0x37bce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Nov 2011 19:51:16	1115931	13625200	hadcm3n_t72i_1940_40_007542853_0	259,200	497,435	1.9191
26 Nov 2011 05:48:54	1115931	13625200	hadcm3n_t72i_1940_40_007542853_0	233,280	447,805	1.9196
25 Nov 2011 15:37:41	1115931	13625200	hadcm3n_t72i_1940_40_007542853_0	207,360	397,608	1.9175
25 Nov 2011 01:49:11	1115931	13625200	hadcm3n_t72i_1940_40_007542853_0	181,440	348,344	1.9199
22 Nov 2011 13:40:11	1115931	13625200	hadcm3n_t72i_1940_40_007542853_0	155,520	298,466	1.9191
21 Nov 2011 23:51:26	1115931	13625200	hadcm3n_t72i_1940_40_007542853_0	129,600	249,078	1.9219
20 Nov 2011 03:41:43	1115931	13625200	hadcm3n_t72i_1940_40_007542853_0	103,680	199,456	1.9238
19 Nov 2011 13:45:07	1115931	13625200	hadcm3n_t72i_1940_40_007542853_0	77,760	149,845	1.9270
17 Nov 2011 22:06:04	1115931	13625200	hadcm3n_t72i_1940_40_007542853_0	51,840	100,329	1.9354
17 Nov 2011 07:58:07	1115931	13625200	hadcm3n_t72i_1940_40_007542853_0	25,920	50,206	1.9370