Task 13128523

Name	hadcm3n_ymqj_1900_40_007362325_0
Workunit	7559755
Created	6 Jul 2011, 15:24:56 UTC
Sent	6 Jul 2011, 18:52:56 UTC
Report deadline	6 Oct 2011, 2:20:07 UTC
Received	15 Jul 2011, 14:26:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1157008
Run time	5 days 0 hours 56 min 43 sec
CPU time	4 days 22 hours 31 min 59 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.03 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.59</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0963c6d0 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6b511)[0xf74fb511] /lib32/libc.so.6(+0x6ce1b)[0xf74fce1b] /lib32/libc.so.6(cfree+0x6d)[0xf74fff8d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76d9841] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76d989d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf74a6e37] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:01 2373835 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:01 2373835 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 095e7000-0964c000 rw-p 00000000 00:00 0 [heap] f6f00000-f6f21000 rw-p 00000000 00:00 0 f6f21000-f7000000 ---p 00000000 00:00 0 f7012000-f748d000 rw-s 00000000 08:01 2490783 /var/lib/boinc-client/slots/9/138990 f748d000-f7490000 rw-p 00000000 00:00 0 f7490000-f75e6000 r-xp 00000000 08:01 4587525 /lib32/libc-2.13.so f75e6000-f75e7000 ---p 00156000 08:01 4587525 /lib32/libc-2.13.so f75e7000-f75e9000 r--p 00156000 08:01 4587525 /lib32/libc-2.13.so f75e9000-f75ea000 rw-p 00158000 08:01 4587525 /lib32/libc-2.13.so f75ea000-f75ed000 rw-p 00000000 00:00 0 f75ed000-f7607000 r-xp 00000000 08:01 5253811 /usr/lib32/libgcc_s.so.1 f7607000-f7608000 r--p 00019000 08:01 5253811 /usr/lib32/libgcc_s.so.1 f7608000-f7609000 rw-p 0001a000 08:01 5253811 /usr/lib32/libgcc_s.so.1 f7609000-f762d000 r-xp 00000000 08:01 4587529 /lib32/libm-2.13.so f762d000-f762e000 r--p 00023000 08:01 4587529 /lib32/libm-2.13.so f762e000-f762f000 rw-p 00024000 08:01 4587529 /lib32/libm-2.13.so f762f000-f770e000 r-xp 00000000 08:01 5253814 /usr/lib32/libstdc++.so.6.0.14 f770e000-f7712000 r--p 000de000 08:01 5253814 /usr/lib32/libstdc++.so.6.0.14 f7712000-f7713000 rw-p 000e2000 08:01 5253814 /usr/lib32/libstdc++.so.6.0.14 f7713000-f771a000 rw-p 00000000 00:00 0 f771a000-f771c000 r-xp 00000000 08:01 4587528 /lib32/libdl-2.13.so f771c000-f771d000 r--p 00001000 08:01 4587528 /lib32/libdl-2.13.so f771d000-f771e000 rw-p 00002000 08:01 4587528 /lib32/libdl-2.13.so f771e000-f7733000 r-xp 00000000 08:01 4587539 /lib32/libpthread-2.13.so f7733000-f7734000 r--p 00014000 08:01 4587539 /lib32/libpthread-2.13.so f7734000-f7735000 rw-p 00015000 08:01 4587539 /lib32/libpthread-2.13.so f7735000-f7738000 rw-p 00000000 00:00 0 f7753000-f7754000 rw-p 00000000 00:00 0 f7754000-f7755000 ---p 00000000 00:00 0 f7755000-f7758000 rw-p 00000000 00:00 0 f7758000-f775a000 rw-s 00000000 08:01 2490693 /var/lib/boinc-client/slots/9/boinc_mmap_file f775a000-f775b000 rw-p 00000000 00:00 0 f775b000-f775c000 r-xp 00000000 00:00 0 [vdso] f775c000-f7778000 r-xp 00000000 08:01 4587522 /lib32/ld-2.13.so f7778000-f7779000 r--p 0001b000 08:01 4587522 /lib32/ld-2.13.so f7779000-f777a000 rw-p 0001c000 08:01 4587522 /lib32/ld-2.13.so ffeea000-fff5b000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf775b400] [0xf775b425] /lib32/libc.so.6(gsignal+0x51)[0xf74baea1] /lib32/libc.so.6(abort+0x17e)[0xf74be2ce] /lib32/libc.so.6(+0x61277)[0xf74f1277] /lib32/libc.so.6(+0x6b511)[0xf74fb511] /lib32/libc.so.6(+0x6ce1b)[0xf74fce1b] /lib32/libc.so.6(cfree+0x6d)[0xf74fff8d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76d9841] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76d989d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf74a6e37] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 12:54:46	1157008	13128523	hadcm3n_ymqj_1900_40_007362325_0	259,200	426,716	1.6463
25 Jul 2011 12:54:46	1157008	13128523	hadcm3n_ymqj_1900_40_007362325_0	233,280	383,974	1.6460
25 Jul 2011 12:54:47	1157008	13128523	hadcm3n_ymqj_1900_40_007362325_0	207,360	341,381	1.6463
25 Jul 2011 12:54:46	1157008	13128523	hadcm3n_ymqj_1900_40_007362325_0	181,440	298,881	1.6473
25 Jul 2011 12:54:46	1157008	13128523	hadcm3n_ymqj_1900_40_007362325_0	155,520	256,108	1.6468
10 Jul 2011 20:08:27	1157008	13128523	hadcm3n_ymqj_1900_40_007362325_0	129,600	213,366	1.6463
10 Jul 2011 02:54:36	1157008	13128523	hadcm3n_ymqj_1900_40_007362325_0	103,680	170,566	1.6451
09 Jul 2011 14:27:17	1157008	13128523	hadcm3n_ymqj_1900_40_007362325_0	77,760	127,961	1.6456
09 Jul 2011 00:46:29	1157008	13128523	hadcm3n_ymqj_1900_40_007362325_0	51,840	85,310	1.6456
08 Jul 2011 14:34:41	1157008	13128523	hadcm3n_ymqj_1900_40_007362325_0	25,920	42,653	1.6456