climateprediction.net home page
Task 15591978

Task 15591978

Name hadcm3n_49bv_1940_40_008305799_0
Workunit 8456934
Created 7 Feb 2013, 7:29:42 UTC
Sent 7 Feb 2013, 7:32:54 UTC
Report deadline 9 May 2013, 15:00:05 UTC
Received 16 Feb 2013, 3:13:30 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1217015
Run time 8 days 16 hours 32 min 32 sec
CPU time 8 days 8 hours 25 min 33 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 3.40 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:44:56 (2100): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:54:32 (10231): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:42:44 (10334): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:57:46 (18703): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:33:01 (18931): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
16:16:07 (1765): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
16:29:42 (3931): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:34:14 (4131): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0924e048 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x72102)[0xf754c102]
/lib32/libc.so.6(+0x72da2)[0xf754cda2]
/lib32/libc.so.6(cfree+0x6d)[0xf754fe5d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf774ebaf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf774ec0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf74f30f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 3409836                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 3409836                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
091f8000-0925c000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f705c000-f74d7000 rw-s 00000000 08:01 4730445                            /var/lib/boinc-client/slots/1/135955
f74d7000-f74da000 rw-p 00000000 00:00 0 
f74da000-f7653000 r-xp 00000000 08:01 9576785                            /lib32/libc-2.13.so
f7653000-f7655000 r--p 00178000 08:01 9576785                            /lib32/libc-2.13.so
f7655000-f7656000 rw-p 0017a000 08:01 9576785                            /lib32/libc-2.13.so
f7656000-f7659000 rw-p 00000000 00:00 0 
f7659000-f7675000 r-xp 00000000 08:01 4070488                            /usr/lib32/libgcc_s.so.1
f7675000-f7676000 r--p 0001b000 08:01 4070488                            /usr/lib32/libgcc_s.so.1
f7676000-f7677000 rw-p 0001c000 08:01 4070488                            /usr/lib32/libgcc_s.so.1
f7677000-f769f000 r-xp 00000000 08:01 9576779                            /lib32/libm-2.13.so
f769f000-f76a0000 r--p 00028000 08:01 9576779                            /lib32/libm-2.13.so
f76a0000-f76a1000 rw-p 00029000 08:01 9576779                            /lib32/libm-2.13.so
f76a1000-f777f000 r-xp 00000000 08:01 4070491                            /usr/lib32/libstdc++.so.6.0.16
f777f000-f7780000 ---p 000de000 08:01 4070491                            /usr/lib32/libstdc++.so.6.0.16
f7780000-f7784000 r--p 000de000 08:01 4070491                            /usr/lib32/libstdc++.so.6.0.16
f7784000-f7785000 rw-p 000e2000 08:01 4070491                            /usr/lib32/libstdc++.so.6.0.16
f7785000-f778d000 rw-p 00000000 00:00 0 
f778d000-f7790000 r-xp 00000000 08:01 9576778                            /lib32/libdl-2.13.so
f7790000-f7791000 r--p 00002000 08:01 9576778                            /lib32/libdl-2.13.so
f7791000-f7792000 rw-p 00003000 08:01 9576778                            /lib32/libdl-2.13.so
f7792000-f77a9000 r-xp 00000000 08:01 9576776                            /lib32/libpthread-2.13.so
f77a9000-f77aa000 r--p 00016000 08:01 9576776                            /lib32/libpthread-2.13.so
f77aa000-f77ab000 rw-p 00017000 08:01 9576776                            /lib32/libpthread-2.13.so
f77ab000-f77ad000 rw-p 00000000 00:00 0 
f77d0000-f77d1000 rw-p 00000000 00:00 0 
f77d1000-f77d2000 ---p 00000000 00:00 0 
f77d2000-f77d5000 rw-p 00000000 00:00 0 
f77d5000-f77d7000 rw-s 00000000 08:01 4730352                            /var/lib/boinc-client/slots/1/boinc_mmap_file
f77d7000-f77d9000 rw-p 00000000 00:00 0 
f77d9000-f77da000 r-xp 00000000 00:00 0                                  [vdso]
f77da000-f77f8000 r-xp 00000000 08:01 2891952                            /lib/i386-linux-gnu/ld-2.13.so
f77f8000-f77f9000 r--p 0001d000 08:01 2891952                            /lib/i386-linux-gnu/ld-2.13.so
f77f9000-f77fa000 rw-p 0001e000 08:01 2891952                            /lib/i386-linux-gnu/ld-2.13.so
ff919000-ff989000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77d9400]
[0xf77d9430]
/lib32/libc.so.6(gsignal+0x4f)[0xf7507c4f]
/lib32/libc.so.6(abort+0x175)[0xf750b175]
/lib32/libc.so.6(+0x6741c)[0xf754141c]
/lib32/libc.so.6(+0x72102)[0xf754c102]
/lib32/libc.so.6(+0x72da2)[0xf754cda2]
/lib32/libc.so.6(cfree+0x6d)[0xf754fe5d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf774ebaf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf774ec0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf74f30f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Feb 2013 03:17:48 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 518,400 721,524 1.3918
15 Feb 2013 17:21:12 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 492,480 686,137 1.3932
15 Feb 2013 06:36:42 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 466,560 650,800 1.3949
14 Feb 2013 20:53:32 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 440,640 615,628 1.3971
14 Feb 2013 10:05:59 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 414,720 579,851 1.3982
13 Feb 2013 23:58:41 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 388,800 543,607 1.3982
13 Feb 2013 12:30:01 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 362,880 507,311 1.3980
13 Feb 2013 02:25:02 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 336,960 471,049 1.3979
12 Feb 2013 15:56:24 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 311,040 434,808 1.3979
12 Feb 2013 04:28:42 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 285,120 398,203 1.3966
11 Feb 2013 15:55:52 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 259,200 361,252 1.3937
11 Feb 2013 05:05:23 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 233,280 324,816 1.3924
10 Feb 2013 18:53:27 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 207,360 288,754 1.3925
10 Feb 2013 08:36:53 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 181,440 252,646 1.3924
09 Feb 2013 22:24:17 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 155,520 216,504 1.3921
09 Feb 2013 12:12:39 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 129,600 180,390 1.3919
09 Feb 2013 01:55:08 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 103,680 144,255 1.3913
08 Feb 2013 15:20:43 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 77,760 108,102 1.3902
08 Feb 2013 04:55:37 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 51,840 71,978 1.3885
07 Feb 2013 18:44:27 1217015 15591978 hadcm3n_49bv_1940_40_008305799_0 25,920 35,888 1.3846


©2024 cpdn.org