climateprediction.net home page
Task 14359096

Task 14359096

Name hadcm3n_o7i8_2020_40_007856871_0
Workunit 8011983
Created 4 Apr 2012, 19:32:50 UTC
Sent 4 Apr 2012, 19:35:17 UTC
Report deadline 5 Jul 2012, 3:02:28 UTC
Received 25 Apr 2012, 22:40:01 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1106168
Run time 11 days 6 hours 5 min 49 sec
CPU time 9 days 17 hours 36 min 14 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 3.01 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:25:44 (1685): No heartbeat from core client for 30 sec - exiting
08:25:46 (1685): No heartbeat from core client for 30 sec - exiting
08:25:47 (1685): No heartbeat from core client for 30 sec - exiting
08:25:48 (1685): No heartbeat from core client for 30 sec - exiting
08:25:49 (1685): No heartbeat from core client for 30 sec - exiting
08:25:50 (1685): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf776f400]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8238a9f]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x82e7d7c]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837a559]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf75a10f3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15191, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0a12ac90 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6ff02)[0xf7496f02]
/lib32/libc.so.6(+0x70ba2)[0xf7497ba2]
/lib32/libc.so.6(cfree+0x6d)[0xf749ac5d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf7696baf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf7696c0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf74400f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 23724641                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 23724641                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
0a0d5000-0a13b000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fa9000-f7424000 rw-s 00000000 08:01 27132260                           /var/lib/boinc-client/slots/3/134385
f7424000-f7427000 rw-p 00000000 00:00 0 
f7427000-f759b000 r-xp 00000000 08:01 17563697                           /lib32/libc-2.13.so
f759b000-f759d000 r--p 00174000 08:01 17563697                           /lib32/libc-2.13.so
f759d000-f759e000 rw-p 00176000 08:01 17563697                           /lib32/libc-2.13.so
f759e000-f75a1000 rw-p 00000000 00:00 0 
f75a1000-f75bd000 r-xp 00000000 08:01 9699355                            /usr/lib32/libgcc_s.so.1
f75bd000-f75be000 r--p 0001b000 08:01 9699355                            /usr/lib32/libgcc_s.so.1
f75be000-f75bf000 rw-p 0001c000 08:01 9699355                            /usr/lib32/libgcc_s.so.1
f75bf000-f75e7000 r-xp 00000000 08:01 17563703                           /lib32/libm-2.13.so
f75e7000-f75e8000 r--p 00028000 08:01 17563703                           /lib32/libm-2.13.so
f75e8000-f75e9000 rw-p 00029000 08:01 17563703                           /lib32/libm-2.13.so
f75e9000-f76c7000 r-xp 00000000 08:01 9699447                            /usr/lib32/libstdc++.so.6.0.16
f76c7000-f76c8000 ---p 000de000 08:01 9699447                            /usr/lib32/libstdc++.so.6.0.16
f76c8000-f76cc000 r--p 000de000 08:01 9699447                            /usr/lib32/libstdc++.so.6.0.16
f76cc000-f76cd000 rw-p 000e2000 08:01 9699447                            /usr/lib32/libstdc++.so.6.0.16
f76cd000-f76d5000 rw-p 00000000 00:00 0 
f76d5000-f76d8000 r-xp 00000000 08:01 17563702                           /lib32/libdl-2.13.so
f76d8000-f76d9000 r--p 00002000 08:01 17563702                           /lib32/libdl-2.13.so
f76d9000-f76da000 rw-p 00003000 08:01 17563702                           /lib32/libdl-2.13.so
f76da000-f76f1000 r-xp 00000000 08:01 17563714                           /lib32/libpthread-2.13.so
f76f1000-f76f2000 r--p 00016000 08:01 17563714                           /lib32/libpthread-2.13.so
f76f2000-f76f3000 rw-p 00017000 08:01 17563714                           /lib32/libpthread-2.13.so
f76f3000-f76f5000 rw-p 00000000 00:00 0 
f770e000-f770f000 rw-p 00000000 00:00 0 
f770f000-f7710000 ---p 00000000 00:00 0 
f7710000-f7713000 rw-p 00000000 00:00 0 
f7713000-f7715000 rw-s 00000000 08:01 27132257                           /var/lib/boinc-client/slots/3/boinc_mmap_file
f7715000-f7717000 rw-p 00000000 00:00 0 
f7717000-f7718000 r-xp 00000000 00:00 0                                  [vdso]
f7718000-f7736000 r-xp 00000000 08:01 14680430                           /lib/i386-linux-gnu/ld-2.13.so
f7736000-f7737000 r--p 0001d000 08:01 14680430                           /lib/i386-linux-gnu/ld-2.13.so
f7737000-f7738000 rw-p 0001e000 08:01 14680430                           /lib/i386-linux-gnu/ld-2.13.so
ffd28000-ffd98000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7717400]
[0xf7717430]
/lib32/libc.so.6(gsignal+0x4f)[0xf7454c4f]
/lib32/libc.so.6(abort+0x175)[0xf7458175]
/lib32/libc.so.6(+0x6521c)[0xf748c21c]
/lib32/libc.so.6(+0x6ff02)[0xf7496f02]
/lib32/libc.so.6(+0x70ba2)[0xf7497ba2]
/lib32/libc.so.6(cfree+0x6d)[0xf749ac5d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf7696baf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf7696c0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf74400f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Apr 2012 20:09:20 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 518,400 840,967 1.6222
24 Apr 2012 13:16:57 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 492,480 797,942 1.6203
23 Apr 2012 22:27:43 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 466,560 755,714 1.6198
22 Apr 2012 20:15:21 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 440,640 713,348 1.6189
22 Apr 2012 03:49:31 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 414,720 674,777 1.6271
21 Apr 2012 12:05:08 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 388,800 632,794 1.6276
20 Apr 2012 14:40:56 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 362,880 590,424 1.6271
19 Apr 2012 23:41:13 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 336,960 547,976 1.6262
19 Apr 2012 06:51:58 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 311,040 505,527 1.6253
17 Apr 2012 15:13:05 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 285,120 462,864 1.6234
16 Apr 2012 22:27:15 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 259,200 420,374 1.6218
14 Apr 2012 00:52:27 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 233,280 378,061 1.6206
13 Apr 2012 10:23:43 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 207,360 336,088 1.6208
10 Apr 2012 14:46:11 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 181,440 294,093 1.6209
09 Apr 2012 22:45:52 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 155,520 252,104 1.6210
09 Apr 2012 07:33:00 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 129,600 210,319 1.6228
08 Apr 2012 16:12:13 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 103,680 168,417 1.6244
08 Apr 2012 00:34:56 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 77,760 126,413 1.6257
07 Apr 2012 08:36:48 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 51,840 84,193 1.6241
06 Apr 2012 14:47:45 1106168 14359096 hadcm3n_o7i8_2020_40_007856871_0 25,920 42,001 1.6204


©2024 climateprediction.net