climateprediction.net home page
Task 14157519

Task 14157519

Name hadcm3n_u7jz_1980_40_007752206_2
Workunit 7907315
Created 21 Feb 2012, 2:21:31 UTC
Sent 21 Feb 2012, 2:23:33 UTC
Report deadline 22 May 2012, 9:50:44 UTC
Received 4 Mar 2012, 23:00:07 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1172856
Run time 7 days 3 hours 56 min 54 sec
CPU time 6 days 16 hours 36 min 46 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.41 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:21:08 (11343): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:03:10 (19286): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:12:18 (19286): No heartbeat from core client for 30 sec - exiting
23:12:19 (19286): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
23:23:14 (2449): No heartbeat from core client for 30 sec - exiting
23:23:15 (2449): No heartbeat from core client for 30 sec - exiting
23:23:16 (2449): No heartbeat from core client for 30 sec - exiting
23:23:17 (2449): No heartbeat from core client for 30 sec - exiting
23:23:19 (2449): No heartbeat from core client for 30 sec - exiting
23:23:20 (2449): No heartbeat from core client for 30 sec - exiting
23:23:21 (2449): No heartbeat from core client for 30 sec - exiting
23:23:22 (2449): No heartbeat from core client for 30 sec - exiting
23:23:23 (2449): No heartbeat from core client for 30 sec - exiting
23:23:24 (2449): No heartbeat from core client for 30 sec - exiting
23:23:25 (2449): No heartbeat from core client for 30 sec - exiting
23:23:26 (2449): No heartbeat from core client for 30 sec - exiting
23:23:27 (2449): No heartbeat from core client for 30 sec - exiting
23:23:28 (2449): No heartbeat from core client for 30 sec - exiting
23:23:29 (2449): No heartbeat from core client for 30 sec - exiting
23:23:30 (2449): No heartbeat from core client for 30 sec - exiting
23:23:31 (2449): No heartbeat from core client for 30 sec - exiting
23:23:32 (2449): No heartbeat from core client for 30 sec - exiting
23:23:33 (2449): No heartbeat from core client for 30 sec - exiting
23:23:35 (2449): No heartbeat from core client for 30 sec - exiting
23:23:36 (2449): No heartbeat from core client for 30 sec - exiting
23:23:37 (2449): No heartbeat from core client for 30 sec - exiting
23:23:38 (2449): No heartbeat from core client for 30 sec - exiting
23:23:39 (2449): No heartbeat from core client for 30 sec - exiting
23:23:40 (2449): No heartbeat from core client for 30 sec - exiting
23:23:41 (2449): No heartbeat from core client for 30 sec - exiting
23:23:42 (2449): No heartbeat from core client for 30 sec - exiting
23:23:43 (2449): No heartbeat from core client for 30 sec - exiting
23:23:44 (2449): No heartbeat from core client for 30 sec - exiting
23:23:45 (2449): No heartbeat from core client for 30 sec - exiting
23:23:46 (2449): No heartbeat from core client for 30 sec - exiting
23:23:47 (2449): No heartbeat from core client for 30 sec - exiting
23:23:48 (2449): No heartbeat from core client for 30 sec - exiting
23:23:49 (2449): No heartbeat from core client for 30 sec - exiting
23:23:50 (2449): No heartbeat from core client for 30 sec - exiting
23:23:51 (2449): No heartbeat from core client for 30 sec - exiting
23:23:52 (2449): No heartbeat from core client for 30 sec - exiting
23:23:53 (2449): No heartbeat from core client for 30 sec - exiting
23:23:54 (2449): No heartbeat from core client for 30 sec - exiting
23:23:56 (2449): No heartbeat from core client for 30 sec - exiting
23:23:57 (2449): No heartbeat from core client for 30 sec - exiting
23:23:58 (2449): No heartbeat from core client for 30 sec - exiting
23:23:59 (2449): No heartbeat from core client for 30 sec - exiting
23:24:00 (2449): No heartbeat from core client for 30 sec - exiting
23:24:01 (2449): No heartbeat from core client for 30 sec - exiting
23:24:02 (2449): No heartbeat from core client for 30 sec - exiting
23:24:03 (2449): No heartbeat from core client for 30 sec - exiting
23:24:04 (2449): No heartbeat from core client for 30 sec - exiting
23:24:05 (2449): No heartbeat from core client for 30 sec - exiting
23:24:06 (2449): No heartbeat from core client for 30 sec - exiting
23:24:07 (2449): No heartbeat from core client for 30 sec - exiting
23:24:08 (2449): No heartbeat from core client for 30 sec - exiting
23:24:09 (2449): No heartbeat from core client for 30 sec - exiting
23:24:10 (2449): No heartbeat from core client for 30 sec - exiting
23:24:11 (2449): No heartbeat from core client for 30 sec - exiting
23:24:12 (2449): No heartbeat from core client for 30 sec - exiting
23:24:13 (2449): No heartbeat from core client for 30 sec - exiting
23:24:14 (2449): No heartbeat from core client for 30 sec - exiting
23:24:15 (2449): No heartbeat from core client for 30 sec - exiting
23:24:16 (2449): No heartbeat from core client for 30 sec - exiting
23:24:17 (2449): No heartbeat from core client for 30 sec - exiting
23:24:18 (2449): No heartbeat from core client for 30 sec - exiting
23:24:19 (2449): No heartbeat from core client for 30 sec - exiting
23:24:20 (2449): No heartbeat from core client for 30 sec - exiting
23:24:21 (2449): No heartbeat from core client for 30 sec - exiting
23:24:22 (2449): No heartbeat from core client for 30 sec - exiting
23:24:24 (2449): No heartbeat from core client for 30 sec - exiting
23:24:25 (2449): No heartbeat from core client for 30 sec - exiting
23:24:26 (2449): No heartbeat from core client for 30 sec - exiting
23:24:28 (2449): No heartbeat from core client for 30 sec - exiting
23:24:29 (2449): No heartbeat from core client for 30 sec - exiting
23:24:30 (2449): No heartbeat from core client for 30 sec - exiting
23:24:31 (2449): No heartbeat from core client for 30 sec - exiting
23:24:32 (2449): No heartbeat from core client for 30 sec - exiting
23:25:03 (2449): No heartbeat from core client for 30 sec - exiting
23:25:04 (2449): No heartbeat from core client for 30 sec - exiting
23:25:05 (2449): No heartbeat from core client for 30 sec - exiting
23:25:06 (2449): No heartbeat from core client for 30 sec - exiting
23:25:07 (2449): No heartbeat from core client for 30 sec - exiting
23:25:08 (2449): No heartbeat from core client for 30 sec - exiting
23:25:09 (2449): No heartbeat from core client for 30 sec - exiting
23:25:10 (2449): No heartbeat from core client for 30 sec - exiting
23:25:11 (2449): No heartbeat from core client for 30 sec - exiting
23:25:42 (2449): No heartbeat from core client for 30 sec - exiting
23:25:43 (2449): No heartbeat from core client for 30 sec - exiting
23:25:44 (2449): No heartbeat from core client for 30 sec - exiting
23:25:45 (2449): No heartbeat from core client for 30 sec - exiting
23:25:51 (2449): No heartbeat from core client for 30 sec - exiting
23:25:55 (2449): No heartbeat from core client for 30 sec - exiting
23:25:56 (2449): No heartbeat from core client for 30 sec - exiting
23:25:57 (2449): No heartbeat from core client for 30 sec - exiting
23:25:58 (2449): No heartbeat from core client for 30 sec - exiting
23:25:59 (2449): No heartbeat from core client for 30 sec - exiting
23:26:00 (2449): No heartbeat from core client for 30 sec - exiting
23:26:01 (2449): No heartbeat from core client for 30 sec - exiting
23:26:02 (2449): No heartbeat from core client for 30 sec - exiting
23:26:03 (2449): No heartbeat from core client for 30 sec - exiting
23:26:04 (2449): No heartbeat from core client for 30 sec - exiting
23:26:05 (2449): No heartbeat from core client for 30 sec - exiting
23:26:06 (2449): No heartbeat from core client for 30 sec - exiting
23:26:07 (2449): No heartbeat from core client for 30 sec - exiting
23:26:08 (2449): No heartbeat from core client for 30 sec - exiting
23:26:09 (2449): No heartbeat from core client for 30 sec - exiting
23:26:10 (2449): No heartbeat from core client for 30 sec - exiting
23:26:11 (2449): No heartbeat from core client for 30 sec - exiting
23:26:12 (2449): No heartbeat from core client for 30 sec - exiting
23:26:13 (2449): No heartbeat from core client for 30 sec - exiting
23:26:14 (2449): No heartbeat from core client for 30 sec - exiting
23:26:15 (2449): No heartbeat from core client for 30 sec - exiting
23:26:18 (2449): No heartbeat from core client for 30 sec - exiting
23:26:19 (2449): No heartbeat from core client for 30 sec - exiting
23:26:20 (2449): No heartbeat from core client for 30 sec - exiting
23:26:21 (2449): No heartbeat from core client for 30 sec - exiting
23:26:22 (2449): No heartbeat from core client for 30 sec - exiting
23:26:23 (2449): No heartbeat from core client for 30 sec - exiting
23:26:24 (2449): No heartbeat from core client for 30 sec - exiting
23:26:25 (2449): No heartbeat from core client for 30 sec - exiting
23:26:28 (2449): No heartbeat from core client for 30 sec - exiting
23:26:29 (2449): No heartbeat from core client for 30 sec - exiting
23:26:30 (2449): No heartbeat from core client for 30 sec - exiting
23:26:31 (2449): No heartbeat from core client for 30 sec - exiting
23:26:32 (2449): No heartbeat from core client for 30 sec - exiting
23:26:33 (2449): No heartbeat from core client for 30 sec - exiting
23:26:34 (2449): No heartbeat from core client for 30 sec - exiting
23:26:35 (2449): No heartbeat from core client for 30 sec - exiting
23:26:36 (2449): No heartbeat from core client for 30 sec - exiting
23:26:37 (2449): No heartbeat from core client for 30 sec - exiting
23:26:38 (2449): No heartbeat from core client for 30 sec - exiting
23:26:39 (2449): No heartbeat from core client for 30 sec - exiting
23:26:40 (2449): No heartbeat from core client for 30 sec - exiting
23:26:41 (2449): No heartbeat from core client for 30 sec - exiting
23:26:42 (2449): No heartbeat from core client for 30 sec - exiting
23:26:43 (2449): No heartbeat from core client for 30 sec - exiting
23:26:44 (2449): No heartbeat from core client for 30 sec - exiting
23:26:45 (2449): No heartbeat from core client for 30 sec - exiting
23:26:46 (2449): No heartbeat from core client for 30 sec - exiting
23:26:47 (2449): No heartbeat from core client for 30 sec - exiting
23:26:48 (2449): No heartbeat from core client for 30 sec - exiting
23:26:49 (2449): No heartbeat from core client for 30 sec - exiting
23:26:50 (2449): No heartbeat from core client for 30 sec - exiting
23:26:51 (2449): No heartbeat from core client for 30 sec - exiting
23:26:53 (2449): No heartbeat from core client for 30 sec - exiting
23:26:54 (2449): No heartbeat from core client for 30 sec - exiting
23:26:55 (2449): No heartbeat from core client for 30 sec - exiting
23:26:56 (2449): No heartbeat from core client for 30 sec - exiting
23:26:57 (2449): No heartbeat from core client for 30 sec - exiting
23:26:58 (2449): No heartbeat from core client for 30 sec - exiting
23:26:59 (2449): No heartbeat from core client for 30 sec - exiting
23:27:00 (2449): No heartbeat from core client for 30 sec - exiting
23:27:01 (2449): No heartbeat from core client for 30 sec - exiting
23:27:02 (2449): No heartbeat from core client for 30 sec - exiting
23:27:03 (2449): No heartbeat from core client for 30 sec - exiting
23:27:04 (2449): No heartbeat from core client for 30 sec - exiting
23:27:05 (2449): No heartbeat from core client for 30 sec - exiting
23:27:06 (2449): No heartbeat from core client for 30 sec - exiting
23:27:08 (2449): No heartbeat from core client for 30 sec - exiting
23:27:09 (2449): No heartbeat from core client for 30 sec - exiting
23:27:10 (2449): No heartbeat from core client for 30 sec - exiting
23:27:11 (2449): No heartbeat from core client for 30 sec - exiting
23:27:12 (2449): No heartbeat from core client for 30 sec - exiting
23:27:13 (2449): No heartbeat from core client for 30 sec - exiting
23:27:14 (2449): No heartbeat from core client for 30 sec - exiting
23:27:15 (2449): No heartbeat from core client for 30 sec - exiting
23:27:16 (2449): No heartbeat from core client for 30 sec - exiting
23:27:17 (2449): No heartbeat from core client for 30 sec - exiting
23:27:18 (2449): No heartbeat from core client for 30 sec - exiting
23:27:19 (2449): No heartbeat from core client for 30 sec - exiting
23:27:20 (2449): No heartbeat from core client for 30 sec - exiting
23:27:21 (2449): No heartbeat from core client for 30 sec - exiting
23:27:22 (2449): No heartbeat from core client for 30 sec - exiting
23:27:23 (2449): No heartbeat from core client for 30 sec - exiting
23:27:24 (2449): No heartbeat from core client for 30 sec - exiting
23:27:25 (2449): No heartbeat from core client for 30 sec - exiting
23:27:26 (2449): No heartbeat from core client for 30 sec - exiting
23:27:29 (2449): No heartbeat from core client for 30 sec - exiting
23:27:30 (2449): No heartbeat from core client for 30 sec - exiting
23:27:31 (2449): No heartbeat from core client for 30 sec - exiting
23:27:32 (2449): No heartbeat from core client for 30 sec - exiting
23:27:33 (2449): No heartbeat from core client for 30 sec - exiting
23:27:34 (2449): No heartbeat from core client for 30 sec - exiting
23:27:36 (2449): No heartbeat from core client for 30 sec - exiting
23:27:37 (2449): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:36:33 (3057): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:45:15 (16937): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09d00050 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6eb72)[0xf7559b72]
/lib32/libc.so.6(+0x6f812)[0xf755a812]
/lib32/libc.so.6(cfree+0x6d)[0xf755d8cd]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf775abaf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf775ac0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf75040f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:03 8921296                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:03 8921296                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09caa000-09d10000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f706d000-f74e8000 rw-s 00000000 08:03 9961700                            /var/lib/boinc-client/slots/6/137615
f74e8000-f74eb000 rw-p 00000000 00:00 0 
f74eb000-f765e000 r-xp 00000000 08:03 29884583                           /lib32/libc-2.13.so
f765e000-f765f000 ---p 00173000 08:03 29884583                           /lib32/libc-2.13.so
f765f000-f7661000 r--p 00173000 08:03 29884583                           /lib32/libc-2.13.so
f7661000-f7662000 rw-p 00175000 08:03 29884583                           /lib32/libc-2.13.so
f7662000-f7665000 rw-p 00000000 00:00 0 
f7665000-f7681000 r-xp 00000000 08:03 34475222                           /usr/lib32/libgcc_s.so.1
f7681000-f7682000 r--p 0001b000 08:03 34475222                           /usr/lib32/libgcc_s.so.1
f7682000-f7683000 rw-p 0001c000 08:03 34475222                           /usr/lib32/libgcc_s.so.1
f7683000-f76ab000 r-xp 00000000 08:03 29884593                           /lib32/libm-2.13.so
f76ab000-f76ac000 r--p 00028000 08:03 29884593                           /lib32/libm-2.13.so
f76ac000-f76ad000 rw-p 00029000 08:03 29884593                           /lib32/libm-2.13.so
f76ad000-f778b000 r-xp 00000000 08:03 34476738                           /usr/lib32/libstdc++.so.6.0.16
f778b000-f778c000 ---p 000de000 08:03 34476738                           /usr/lib32/libstdc++.so.6.0.16
f778c000-f7790000 r--p 000de000 08:03 34476738                           /usr/lib32/libstdc++.so.6.0.16
f7790000-f7791000 rw-p 000e2000 08:03 34476738                           /usr/lib32/libstdc++.so.6.0.16
f7791000-f7799000 rw-p 00000000 00:00 0 
f7799000-f779c000 r-xp 00000000 08:03 29884584                           /lib32/libdl-2.13.so
f779c000-f779d000 r--p 00002000 08:03 29884584                           /lib32/libdl-2.13.so
f779d000-f779e000 rw-p 00003000 08:03 29884584                           /lib32/libdl-2.13.so
f779e000-f77b5000 r-xp 00000000 08:03 29884591                           /lib32/libpthread-2.13.so
f77b5000-f77b6000 r--p 00016000 08:03 29884591                           /lib32/libpthread-2.13.so
f77b6000-f77b7000 rw-p 00017000 08:03 29884591                           /lib32/libpthread-2.13.so
f77b7000-f77b9000 rw-p 00000000 00:00 0 
f77d5000-f77d6000 rw-p 00000000 00:00 0 
f77d6000-f77d7000 ---p 00000000 00:00 0 
f77d7000-f77da000 rw-p 00000000 00:00 0 
f77da000-f77dc000 rw-s 00000000 08:03 9961694                            /var/lib/boinc-client/slots/6/boinc_mmap_file
f77dc000-f77de000 rw-p 00000000 00:00 0 
f77de000-f77df000 r-xp 00000000 00:00 0                                  [vdso]
f77df000-f77fd000 r-xp 00000000 08:03 7472263                            /lib/i386-linux-gnu/ld-2.13.so
f77fd000-f77fe000 r--p 0001d000 08:03 7472263                            /lib/i386-linux-gnu/ld-2.13.so
f77fe000-f77ff000 rw-p 0001e000 08:03 7472263                            /lib/i386-linux-gnu/ld-2.13.so
ffa15000-ffa86000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77de400]
[0xf77de430]
/lib32/libc.so.6(gsignal+0x4f)[0xf7518c4f]
/lib32/libc.so.6(abort+0x175)[0xf751c175]
/lib32/libc.so.6(+0x63e8c)[0xf754ee8c]
/lib32/libc.so.6(+0x6eb72)[0xf7559b72]
/lib32/libc.so.6(+0x6f812)[0xf755a812]
/lib32/libc.so.6(cfree+0x6d)[0xf755d8cd]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf775abaf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf775ac0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf75040f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
04 Mar 2012 23:02:07 1172856 14157519 hadcm3n_u7jz_1980_40_007752206_2 259,200 578,200 2.2307
04 Mar 2012 03:43:11 1172856 14157519 hadcm3n_u7jz_1980_40_007752206_2 233,280 519,496 2.2269
03 Mar 2012 09:50:07 1172856 14157519 hadcm3n_u7jz_1980_40_007752206_2 207,360 461,195 2.2241
02 Mar 2012 15:59:36 1172856 14157519 hadcm3n_u7jz_1980_40_007752206_2 181,440 402,972 2.2210
02 Mar 2012 00:07:08 1172856 14157519 hadcm3n_u7jz_1980_40_007752206_2 155,520 344,222 2.2134
01 Mar 2012 04:21:13 1172856 14157519 hadcm3n_u7jz_1980_40_007752206_2 129,600 285,910 2.2061
29 Feb 2012 10:12:14 1172856 14157519 hadcm3n_u7jz_1980_40_007752206_2 103,680 227,501 2.1943
28 Feb 2012 17:51:06 1172856 14157519 hadcm3n_u7jz_1980_40_007752206_2 77,760 170,266 2.1896
28 Feb 2012 01:37:26 1172856 14157519 hadcm3n_u7jz_1980_40_007752206_2 51,840 113,977 2.1986
27 Feb 2012 09:47:50 1172856 14157519 hadcm3n_u7jz_1980_40_007752206_2 25,920 56,969 2.1979


©2024 cpdn.org