climateprediction.net home page
Task 13467773

Task 13467773

Name hadcm3n_p0m9_1940_40_007419500_2
Workunit 7617135
Created 9 Oct 2011, 2:05:14 UTC
Sent 9 Oct 2011, 2:05:19 UTC
Report deadline 8 Jan 2012, 9:32:30 UTC
Received 17 Oct 2011, 0:26:08 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1149368
Run time 6 days 16 hours 30 min 38 sec
CPU time 6 days 7 hours 55 min 7 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.51 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
05:44:16 (2181): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:44:47 (2181): No heartbeat from core client for 30 sec - exiting
05:44:48 (2181): No heartbeat from core client for 30 sec - exiting
05:44:49 (2181): No heartbeat from core client for 30 sec - exiting
05:44:50 (2181): No heartbeat from core client for 30 sec - exiting
05:44:51 (2181): No heartbeat from core client for 30 sec - exiting
05:44:52 (2181): No heartbeat from core client for 30 sec - exiting
05:44:53 (2181): No heartbeat from core client for 30 sec - exiting
05:44:54 (2181): No heartbeat from core client for 30 sec - exiting
05:44:55 (2181): No heartbeat from core client for 30 sec - exiting
05:44:56 (2181): No heartbeat from core client for 30 sec - exiting
05:44:57 (2181): No heartbeat from core client for 30 sec - exiting
05:44:58 (2181): No heartbeat from core client for 30 sec - exiting
05:44:59 (2181): No heartbeat from core client for 30 sec - exiting
05:45:00 (2181): No heartbeat from core client for 30 sec - exiting
05:45:01 (2181): No heartbeat from core client for 30 sec - exiting
05:45:02 (2181): No heartbeat from core client for 30 sec - exiting
05:45:03 (2181): No heartbeat from core client for 30 sec - exiting
05:45:04 (2181): No heartbeat from core client for 30 sec - exiting
05:45:05 (2181): No heartbeat from core client for 30 sec - exiting
05:45:06 (2181): No heartbeat from core client for 30 sec - exiting
05:45:07 (2181): No heartbeat from core client for 30 sec - exiting
05:45:08 (2181): No heartbeat from core client for 30 sec - exiting
05:45:09 (2181): No heartbeat from core client for 30 sec - exiting
05:45:10 (2181): No heartbeat from core client for 30 sec - exiting
05:45:11 (2181): No heartbeat from core client for 30 sec - exiting
05:45:12 (2181): No heartbeat from core client for 30 sec - exiting
05:45:14 (2181): No heartbeat from core client for 30 sec - exiting
05:45:15 (2181): No heartbeat from core client for 30 sec - exiting
05:47:18 (23122): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:55:39 (23424): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09319e98 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6eb72)[0xf750bb72]
/lib32/libc.so.6(+0x6f812)[0xf750c812]
/lib32/libc.so.6(cfree+0x6d)[0xf750f8cd]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf770cbaf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf770cc0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf74b60f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:06 3932555                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:06 3932555                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
092c4000-0932a000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f701f000-f749a000 rw-s 00000000 08:06 3936136                            /var/lib/boinc-client/slots/0/132960
f749a000-f749d000 rw-p 00000000 00:00 0 
f749d000-f7610000 r-xp 00000000 08:06 8521912                            /lib32/libc-2.13.so
f7610000-f7611000 ---p 00173000 08:06 8521912                            /lib32/libc-2.13.so
f7611000-f7613000 r--p 00173000 08:06 8521912                            /lib32/libc-2.13.so
f7613000-f7614000 rw-p 00175000 08:06 8521912                            /lib32/libc-2.13.so
f7614000-f7617000 rw-p 00000000 00:00 0 
f7617000-f7633000 r-xp 00000000 08:06 131468                             /usr/lib32/libgcc_s.so.1
f7633000-f7634000 r--p 0001b000 08:06 131468                             /usr/lib32/libgcc_s.so.1
f7634000-f7635000 rw-p 0001c000 08:06 131468                             /usr/lib32/libgcc_s.so.1
f7635000-f765d000 r-xp 00000000 08:06 8522519                            /lib32/libm-2.13.so
f765d000-f765e000 r--p 00028000 08:06 8522519                            /lib32/libm-2.13.so
f765e000-f765f000 rw-p 00029000 08:06 8522519                            /lib32/libm-2.13.so
f765f000-f773d000 r-xp 00000000 08:06 134093                             /usr/lib32/libstdc++.so.6.0.16
f773d000-f773e000 ---p 000de000 08:06 134093                             /usr/lib32/libstdc++.so.6.0.16
f773e000-f7742000 r--p 000de000 08:06 134093                             /usr/lib32/libstdc++.so.6.0.16
f7742000-f7743000 rw-p 000e2000 08:06 134093                             /usr/lib32/libstdc++.so.6.0.16
f7743000-f774b000 rw-p 00000000 00:00 0 
f774b000-f774e000 r-xp 00000000 08:06 8521972                            /lib32/libdl-2.13.so
f774e000-f774f000 r--p 00002000 08:06 8521972                            /lib32/libdl-2.13.so
f774f000-f7750000 rw-p 00003000 08:06 8521972                            /lib32/libdl-2.13.so
f7750000-f7767000 r-xp 00000000 08:06 8522441                            /lib32/libpthread-2.13.so
f7767000-f7768000 r--p 00016000 08:06 8522441                            /lib32/libpthread-2.13.so
f7768000-f7769000 rw-p 00017000 08:06 8522441                            /lib32/libpthread-2.13.so
f7769000-f776b000 rw-p 00000000 00:00 0 
f7787000-f7788000 rw-p 00000000 00:00 0 
f7788000-f7789000 ---p 00000000 00:00 0 
f7789000-f778c000 rw-p 00000000 00:00 0 
f778c000-f778e000 rw-s 00000000 08:06 3933211                            /var/lib/boinc-client/slots/0/boinc_mmap_file
f778e000-f7790000 rw-p 00000000 00:00 0 
f7790000-f7791000 r-xp 00000000 00:00 0                                  [vdso]
f7791000-f77af000 r-xp 00000000 08:06 921248                             /lib/i386-linux-gnu/ld-2.13.so
f77af000-f77b0000 r--p 0001d000 08:06 921248                             /lib/i386-linux-gnu/ld-2.13.so
f77b0000-f77b1000 rw-p 0001e000 08:06 921248                             /lib/i386-linux-gnu/ld-2.13.so
ff905000-ff975000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7790400]
[0xf7790430]
/lib32/libc.so.6(gsignal+0x4f)[0xf74cac4f]
/lib32/libc.so.6(abort+0x175)[0xf74ce175]
/lib32/libc.so.6(+0x63e8c)[0xf7500e8c]
/lib32/libc.so.6(+0x6eb72)[0xf750bb72]
/lib32/libc.so.6(+0x6f812)[0xf750c812]
/lib32/libc.so.6(cfree+0x6d)[0xf750f8cd]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf770cbaf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf770cc0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf74b60f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Oct 2011 15:02:03 1149368 13467773 hadcm3n_p0m9_1940_40_007419500_2 259,200 546,897 2.1099
15 Oct 2011 19:54:52 1149368 13467773 hadcm3n_p0m9_1940_40_007419500_2 233,280 486,779 2.0867
15 Oct 2011 01:00:41 1149368 13467773 hadcm3n_p0m9_1940_40_007419500_2 207,360 426,802 2.0583
14 Oct 2011 05:56:45 1149368 13467773 hadcm3n_p0m9_1940_40_007419500_2 181,440 366,617 2.0206
13 Oct 2011 12:14:00 1149368 13467773 hadcm3n_p0m9_1940_40_007419500_2 155,520 305,976 1.9674
12 Oct 2011 18:46:33 1149368 13467773 hadcm3n_p0m9_1940_40_007419500_2 129,600 245,141 1.8915
12 Oct 2011 01:08:22 1149368 13467773 hadcm3n_p0m9_1940_40_007419500_2 103,680 184,648 1.7809
10 Oct 2011 14:41:40 1149368 13467773 hadcm3n_p0m9_1940_40_007419500_2 77,760 125,597 1.6152
10 Oct 2011 01:42:17 1149368 13467773 hadcm3n_p0m9_1940_40_007419500_2 51,840 83,029 1.6016
09 Oct 2011 14:11:18 1149368 13467773 hadcm3n_p0m9_1940_40_007419500_2 25,920 41,585 1.6044


©2024 climateprediction.net