climateprediction.net home page
Task 13958085

Task 13958085

Name hadcm3n_o2mk_1980_40_007694238_2
Workunit 7849346
Created 23 Jan 2012, 23:11:01 UTC
Sent 24 Jan 2012, 0:05:22 UTC
Report deadline 24 Apr 2012, 7:32:33 UTC
Received 11 Mar 2012, 1:08:43 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1059379
Run time 14 days 3 hours 18 min 21 sec
CPU time 13 days 6 hours 16 min 40 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.65 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:53:09 (1722): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:05:03 (28204): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:05:52 (6922): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:06:39 (6971): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:07:51 (7001): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
22:01:28 (1615): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0901dca0 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6eb72)[0xf74b4b72]
/lib32/libc.so.6(+0x6f812)[0xf74b5812]
/lib32/libc.so.6(cfree+0x6d)[0xf74b88cd]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76b5baf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf76b5c0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf745f0f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 13108694                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 13108694                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08fc8000-0902e000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fc8000-f7443000 rw-s 00000000 08:01 13238954                           /var/lib/boinc-client/slots/9/137825
f7443000-f7446000 rw-p 00000000 00:00 0 
f7446000-f75b9000 r-xp 00000000 08:01 11798522                           /lib32/libc-2.13.so (deleted)
f75b9000-f75ba000 ---p 00173000 08:01 11798522                           /lib32/libc-2.13.so (deleted)
f75ba000-f75bc000 r--p 00173000 08:01 11798522                           /lib32/libc-2.13.so (deleted)
f75bc000-f75bd000 rw-p 00175000 08:01 11798522                           /lib32/libc-2.13.so (deleted)
f75bd000-f75c0000 rw-p 00000000 00:00 0 
f75c0000-f75dc000 r-xp 00000000 08:01 12714125                           /usr/lib32/libgcc_s.so.1
f75dc000-f75dd000 r--p 0001b000 08:01 12714125                           /usr/lib32/libgcc_s.so.1
f75dd000-f75de000 rw-p 0001c000 08:01 12714125                           /usr/lib32/libgcc_s.so.1
f75de000-f7606000 r-xp 00000000 08:01 11798532                           /lib32/libm-2.13.so (deleted)
f7606000-f7607000 r--p 00028000 08:01 11798532                           /lib32/libm-2.13.so (deleted)
f7607000-f7608000 rw-p 00029000 08:01 11798532                           /lib32/libm-2.13.so (deleted)
f7608000-f76e6000 r-xp 00000000 08:01 12714854                           /usr/lib32/libstdc++.so.6.0.16
f76e6000-f76e7000 ---p 000de000 08:01 12714854                           /usr/lib32/libstdc++.so.6.0.16
f76e7000-f76eb000 r--p 000de000 08:01 12714854                           /usr/lib32/libstdc++.so.6.0.16
f76eb000-f76ec000 rw-p 000e2000 08:01 12714854                           /usr/lib32/libstdc++.so.6.0.16
f76ec000-f76f4000 rw-p 00000000 00:00 0 
f76f4000-f76f7000 r-xp 00000000 08:01 11798523                           /lib32/libdl-2.13.so (deleted)
f76f7000-f76f8000 r--p 00002000 08:01 11798523                           /lib32/libdl-2.13.so (deleted)
f76f8000-f76f9000 rw-p 00003000 08:01 11798523                           /lib32/libdl-2.13.so (deleted)
f76f9000-f7710000 r-xp 00000000 08:01 11798530                           /lib32/libpthread-2.13.so (deleted)
f7710000-f7711000 r--p 00016000 08:01 11798530                           /lib32/libpthread-2.13.so (deleted)
f7711000-f7712000 rw-p 00017000 08:01 11798530                           /lib32/libpthread-2.13.so (deleted)
f7712000-f7714000 rw-p 00000000 00:00 0 
f772e000-f772f000 rw-p 00000000 00:00 0 
f772f000-f7730000 ---p 00000000 00:00 0 
f7730000-f7733000 rw-p 00000000 00:00 0 
f7733000-f7735000 rw-s 00000000 08:01 13238868                           /var/lib/boinc-client/slots/9/boinc_mmap_file
f7735000-f7737000 rw-p 00000000 00:00 0 
f7737000-f7738000 r-xp 00000000 00:00 0                                  [vdso]
f7738000-f7756000 r-xp 00000000 08:01 12850806                           /lib/i386-linux-gnu/ld-2.13.so (deleted)
f7756000-f7757000 r--p 0001d000 08:01 12850806                           /lib/i386-linux-gnu/ld-2.13.so (deleted)
f7757000-f7758000 rw-p 0001e000 08:01 12850806                           /lib/i386-linux-gnu/ld-2.13.so (deleted)
ff8fc000-ff96c000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7737400]
[0xf7737425]
/lib32/libc.so.6(gsignal+0x4f)[0xf7473c4f]
/lib32/libc.so.6(abort+0x175)[0xf7477175]
/lib32/libc.so.6(+0x63e8c)[0xf74a9e8c]
/lib32/libc.so.6(+0x6eb72)[0xf74b4b72]
/lib32/libc.so.6(+0x6f812)[0xf74b5812]
/lib32/libc.so.6(cfree+0x6d)[0xf74b88cd]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76b5baf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf76b5c0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf745f0f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Mar 2012 00:00:18 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 518,400 1,145,794 2.2103
06 Mar 2012 22:07:49 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 492,480 1,089,310 2.2119
03 Mar 2012 16:07:47 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 466,560 1,034,545 2.2174
29 Feb 2012 02:59:44 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 440,640 979,064 2.2219
26 Feb 2012 02:25:42 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 414,720 923,297 2.2263
24 Feb 2012 21:17:16 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 388,800 867,303 2.2307
21 Feb 2012 00:47:45 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 362,880 810,697 2.2341
19 Feb 2012 13:34:12 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 336,960 755,677 2.2426
18 Feb 2012 06:43:26 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 311,040 700,629 2.2525
15 Feb 2012 02:07:19 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 285,120 644,834 2.2616
05 Feb 2012 22:33:40 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 259,200 589,298 2.2735
05 Feb 2012 04:20:12 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 233,280 531,012 2.2763
04 Feb 2012 11:13:32 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 207,360 472,745 2.2798
01 Feb 2012 03:49:37 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 181,440 413,780 2.2805
30 Jan 2012 02:47:03 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 155,520 354,338 2.2784
29 Jan 2012 11:15:34 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 129,600 297,733 2.2973
28 Jan 2012 17:02:44 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 103,680 238,206 2.2975
27 Jan 2012 23:33:57 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 77,760 178,556 2.2962
26 Jan 2012 20:14:36 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 51,840 119,466 2.3045
25 Jan 2012 04:41:57 1059379 13958085 hadcm3n_o2mk_1980_40_007694238_2 25,920 59,490 2.2951


©2024 climateprediction.net