Task 15584266

Name	hadcm3n_zaue_1880_40_008247505_3
Workunit	8402629
Created	5 Feb 2013, 7:50:21 UTC
Sent	5 Feb 2013, 7:50:26 UTC
Report deadline	7 May 2013, 15:17:37 UTC
Received	14 Feb 2013, 5:32:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1229296
Run time	6 days 13 hours 0 min 55 sec
CPU time	6 days 3 hours 22 min 47 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.36 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:13:43 (3961): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: free(): invalid next size (normal): 0x09aad690 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x75e92)[0xf7443e92] /usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76678bf] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf766791b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf73e74b3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:07 18653842 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:07 18653842 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 099e9000-09ae9000 rw-p 00000000 00:00 0 [heap] f6e00000-f6e21000 rw-p 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6f50000-f73cb000 rw-s 00000000 08:07 16386904 /var/lib/boinc-client/slots/6/139330 f73cb000-f73ce000 rw-p 00000000 00:00 0 f73ce000-f756e000 r-xp 00000000 08:07 27540508 /lib32/libc-2.15.so f756e000-f756f000 ---p 001a0000 08:07 27540508 /lib32/libc-2.15.so f756f000-f7571000 r--p 001a0000 08:07 27540508 /lib32/libc-2.15.so f7571000-f7572000 rw-p 001a2000 08:07 27540508 /lib32/libc-2.15.so f7572000-f7575000 rw-p 00000000 00:00 0 f7575000-f7591000 r-xp 00000000 08:07 2101661 /usr/lib32/libgcc_s.so.1 f7591000-f7592000 r--p 0001b000 08:07 2101661 /usr/lib32/libgcc_s.so.1 f7592000-f7593000 rw-p 0001c000 08:07 2101661 /usr/lib32/libgcc_s.so.1 f7593000-f75bc000 r-xp 00000000 08:07 27540516 /lib32/libm-2.15.so f75bc000-f75bd000 r--p 00028000 08:07 27540516 /lib32/libm-2.15.so f75bd000-f75be000 rw-p 00029000 08:07 27540516 /lib32/libm-2.15.so f75be000-f7696000 r-xp 00000000 08:07 2107428 /usr/lib32/libstdc++.so.6.0.16 f7696000-f7697000 ---p 000d8000 08:07 2107428 /usr/lib32/libstdc++.so.6.0.16 f7697000-f769b000 r--p 000d8000 08:07 2107428 /usr/lib32/libstdc++.so.6.0.16 f769b000-f769c000 rw-p 000dc000 08:07 2107428 /usr/lib32/libstdc++.so.6.0.16 f769c000-f76a3000 rw-p 00000000 00:00 0 f76a3000-f76a6000 r-xp 00000000 08:07 27540507 /lib32/libdl-2.15.so f76a6000-f76a7000 r--p 00002000 08:07 27540507 /lib32/libdl-2.15.so f76a7000-f76a8000 rw-p 00003000 08:07 27540507 /lib32/libdl-2.15.so f76a8000-f76bf000 r-xp 00000000 08:07 27540510 /lib32/libpthread-2.15.so f76bf000-f76c0000 r--p 00016000 08:07 27540510 /lib32/libpthread-2.15.so f76c0000-f76c1000 rw-p 00017000 08:07 27540510 /lib32/libpthread-2.15.so f76c1000-f76c4000 rw-p 00000000 00:00 0 f76dc000-f76de000 rw-p 00000000 00:00 0 f76de000-f76df000 ---p 00000000 00:00 0 f76df000-f76e2000 rw-p 00000000 00:00 0 f76e2000-f76e4000 rw-s 00000000 08:07 16386901 /var/lib/boinc-client/slots/6/boinc_mmap_file f76e4000-f76e5000 rw-p 00000000 00:00 0 f76e5000-f76e6000 r-xp 00000000 00:00 0 [vdso] f76e6000-f7706000 r-xp 00000000 08:07 27540522 /lib32/ld-2.15.so f7706000-f7707000 r--p 0001f000 08:07 27540522 /lib32/ld-2.15.so f7707000-f7708000 rw-p 00020000 08:07 27540522 /lib32/ld-2.15.so ffd59000-ffdc9000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (17 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf76e5400] [0xf76e5430] /lib32/libc.so.6(gsignal+0x4f)[0xf73fc25f] /lib32/libc.so.6(abort+0x175)[0xf73ff7b5] /lib32/libc.so.6(+0x6b41a)[0xf743941a] /lib32/libc.so.6(+0x75e92)[0xf7443e92] /usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76678bf] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf766791b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf73e74b3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Feb 2013 05:35:03	1229296	15584266	hadcm3n_zaue_1880_40_008247505_3	259,200	530,566	2.0469
13 Feb 2013 05:50:45	1229296	15584266	hadcm3n_zaue_1880_40_008247505_3	233,280	477,964	2.0489
12 Feb 2013 06:54:12	1229296	15584266	hadcm3n_zaue_1880_40_008247505_3	207,360	425,192	2.0505
11 Feb 2013 06:35:43	1229296	15584266	hadcm3n_zaue_1880_40_008247505_3	181,440	372,385	2.0524
10 Feb 2013 14:50:41	1229296	15584266	hadcm3n_zaue_1880_40_008247505_3	155,520	319,822	2.0565
09 Feb 2013 22:54:27	1229296	15584266	hadcm3n_zaue_1880_40_008247505_3	129,600	266,328	2.0550
09 Feb 2013 07:51:36	1229296	15584266	hadcm3n_zaue_1880_40_008247505_3	103,680	213,328	2.0576
08 Feb 2013 08:52:04	1229296	15584266	hadcm3n_zaue_1880_40_008247505_3	77,760	160,705	2.0667
07 Feb 2013 08:12:40	1229296	15584266	hadcm3n_zaue_1880_40_008247505_3	51,840	106,979	2.0636
06 Feb 2013 08:23:05	1229296	15584266	hadcm3n_zaue_1880_40_008247505_3	25,920	53,421	2.0610