climateprediction.net home page
Task 15416721

Task 15416721

Name hadcm3n_zd24_1880_40_008241906_0
Workunit 8397030
Created 29 Oct 2012, 16:32:34 UTC
Sent 29 Oct 2012, 16:32:46 UTC
Report deadline 28 Jan 2013, 23:59:57 UTC
Received 5 Nov 2012, 0:08:44 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1206162
Run time 3 days 17 hours 39 min 52 sec
CPU time 3 days 17 hours 39 min 52 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 3.19 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.45</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
00:27:16 (16700): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:28:53 (18376): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:31:14 (18400): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:33:53 (18421): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:35:29 (18442): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:37:35 (18460): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:39:07 (18480): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:40:56 (18500): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:43:31 (18525): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:45:55 (18547): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:47:27 (18567): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:49:20 (18586): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:50:53 (18605): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:52:46 (18625): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:55:29 (18646): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:57:58 (18666): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:59:30 (18686): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:01:18 (18704): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:02:55 (18740): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:04:42 (18759): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:09:15 (18778): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:12:14 (18803): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:15:13 (18828): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:20:50 (18852): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:26:45 (18881): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:30:00 (18908): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:35:18 (18931): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:43:05 (18957): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:46:03 (18994): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:49:07 (19016): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:54:36 (19041): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:57:34 (19067): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:02:03 (19089): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:05:02 (19129): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:08:07 (19150): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:12:35 (19172): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:20:17 (19201): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:24:52 (19232): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:28:00 (19256): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:30:59 (19277): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:36:20 (19299): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:39:19 (19326): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:42:17 (19347): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:45:16 (19379): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:48:30 (19401): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:55:56 (19422): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:58:55 (19452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08a62a38 ***
======= Backtrace: =========
/lib/libc.so.6(+0x1d19a1)[0x3b79a1]
/lib/libc.so.6(+0x1d40e1)[0x3ba0e1]
/usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0xe9bdf2]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1e)[0xe9be4e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xe6)[0x35dce6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
0013f000-0015d000 r-xp 00000000 fd:00 2098534                            /lib/ld-2.12.so
0015d000-0015e000 r--p 0001d000 fd:00 2098534                            /lib/ld-2.12.so
0015e000-0015f000 rw-p 0001e000 fd:00 2098534                            /lib/ld-2.12.so
0023b000-00258000 r-xp 00000000 fd:00 2098335                            /lib/libgcc_s-4.4.6-20120305.so.1
00258000-00259000 rw-p 0001d000 fd:00 2098335                            /lib/libgcc_s-4.4.6-20120305.so.1
002f9000-00310000 r-xp 00000000 fd:00 2098305                            /lib/libpthread-2.12.so
00310000-00311000 r--p 00016000 fd:00 2098305                            /lib/libpthread-2.12.so
00311000-00312000 rw-p 00017000 fd:00 2098305                            /lib/libpthread-2.12.so
00312000-00314000 rw-p 00000000 00:00 0 
00316000-00319000 r-xp 00000000 fd:00 2098268                            /lib/libdl-2.12.so
00319000-0031a000 r--p 00002000 fd:00 2098268                            /lib/libdl-2.12.so
0031a000-0031b000 rw-p 00003000 fd:00 2098268                            /lib/libdl-2.12.so
0031d000-00345000 r-xp 00000000 fd:00 2098539                            /lib/libm-2.12.so
00345000-00346000 r--p 00027000 fd:00 2098539                            /lib/libm-2.12.so
00346000-00347000 rw-p 00028000 fd:00 2098539                            /lib/libm-2.12.so
00347000-004d7000 r-xp 00000000 fd:00 2098537                            /lib/libc-2.12.so
004d7000-004d9000 r--p 0018f000 fd:00 2098537                            /lib/libc-2.12.so
004d9000-004da000 rw-p 00191000 fd:00 2098537                            /lib/libc-2.12.so
004da000-004dd000 rw-p 00000000 00:00 0 
00d8a000-00d8b000 r-xp 00000000 00:00 0                                  [vdso]
00def000-00ece000 r-xp 00000000 fd:00 2374080                            /usr/lib/libstdc++.so.6.0.13
00ece000-00ed2000 r--p 000de000 fd:00 2374080                            /usr/lib/libstdc++.so.6.0.13
00ed2000-00ed3000 rw-p 000e2000 fd:00 2374080                            /usr/lib/libstdc++.so.6.0.13
00ed3000-00eda000 rw-p 00000000 00:00 0 
08048000-080e3000 r-xp 00000000 fd:00 1967509                            /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 fd:00 1967509                            /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08a0c000-08a93000 rw-p 00000000 00:00 0                                  [heap]
f70ff000-f7100000 rw-p 00000000 00:00 0 
f7100000-f7121000 rw-p 00000000 00:00 0 
f7121000-f7200000 ---p 00000000 00:00 0 
f72bc000-f7737000 rw-s 00000000 fd:00 1966281                            /var/lib/boinc/slots/6/133325
f7737000-f773a000 rw-p 00000000 00:00 0 
f7750000-f7751000 rw-p 00000000 00:00 0 
f7751000-f7752000 ---p 00000000 00:00 0 
f7752000-f7755000 rw-p 00000000 00:00 0 
f7755000-f7757000 rw-s 00000000 fd:00 1969438                            /var/lib/boinc/slots/6/boinc_mmap_file
f7757000-f7758000 rw-p 00000000 00:00 0 
ff7d8000-ff849000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (18 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xd8a400]
[0xd8a430]
/lib/libc.so.6(gsignal+0x51)[0x371b01]
/lib/libc.so.6(abort+0x17a)[0x3733da]
/lib/libc.so.6(+0x1cb545)[0x3b1545]
/lib/libc.so.6(+0x1d19a1)[0x3b79a1]
/lib/libc.so.6(+0x1d40e1)[0x3ba0e1]
/usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0xe9bdf2]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1e)[0xe9be4e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xe6)[0x35dce6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
05 Nov 2012 00:11:42 1206162 15416721 hadcm3n_zd24_1880_40_008241906_0 259,200 322,789 1.2453
05 Nov 2012 00:11:42 1206162 15416721 hadcm3n_zd24_1880_40_008241906_0 233,280 291,136 1.2480
05 Nov 2012 00:11:42 1206162 15416721 hadcm3n_zd24_1880_40_008241906_0 207,360 259,497 1.2514
05 Nov 2012 00:11:42 1206162 15416721 hadcm3n_zd24_1880_40_008241906_0 181,440 227,744 1.2552
05 Nov 2012 00:11:42 1206162 15416721 hadcm3n_zd24_1880_40_008241906_0 155,520 196,019 1.2604
05 Nov 2012 00:11:42 1206162 15416721 hadcm3n_zd24_1880_40_008241906_0 129,600 164,208 1.2670
05 Nov 2012 00:11:42 1206162 15416721 hadcm3n_zd24_1880_40_008241906_0 103,680 132,758 1.2805
05 Nov 2012 00:11:42 1206162 15416721 hadcm3n_zd24_1880_40_008241906_0 77,760 101,298 1.3027
05 Nov 2012 00:11:42 1206162 15416721 hadcm3n_zd24_1880_40_008241906_0 51,840 69,755 1.3456
30 Oct 2012 04:04:32 1206162 15416721 hadcm3n_zd24_1880_40_008241906_0 25,920 40,013 1.5437


©2024 cpdn.org