climateprediction.net home page
Task 12927074

Task 12927074

Name hadcm3n_o77n_1940_40_007266812_1
Workunit 7465052
Created 2 Jun 2011, 23:48:44 UTC
Sent 2 Jun 2011, 23:48:50 UTC
Report deadline 2 Sep 2011, 7:16:01 UTC
Received 2 Jul 2011, 0:59:30 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1148172
Run time 12 days 11 hours 26 min 47 sec
CPU time 10 days 20 hours 48 min 32 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 1.70 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.59</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
SIGSEGV: segmentation violation
Stack trace (14 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x278400]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x828a0dc]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8090808]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x808a417]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8299901]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x821c545]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8219da1]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838720b]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83995c6]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xe7)[0x126e37]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20669, iMonCtr=1
Model crash detected, will try to restart...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (15 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x4df400]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x80df8d5]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x828b4a1]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8090808]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x808a417]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8299901]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x821c545]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8219da1]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838720b]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83995c6]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xe7)[0x126e37]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1309, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:25:05 (1781): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:01:34 (1336): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:01:39 (1336): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
16:05:52 (1362): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08c04c60 ***
======= Backtrace: =========
/lib/i386-linux-gnu/libc.so.6(+0x6b961)[0x17b961]
/lib/i386-linux-gnu/libc.so.6(+0x6d28b)[0x17d28b]
/lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0x18041d]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x21)[0x5444d1]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1d)[0x54452d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xe7)[0x126e37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
00110000-0026a000 r-xp 00000000 08:01 10486593   /lib/i386-linux-gnu/libc-2.13.so
0026a000-0026b000 ---p 0015a000 08:01 10486593   /lib/i386-linux-gnu/libc-2.13.so
0026b000-0026d000 r--p 0015a000 08:01 10486593   /lib/i386-linux-gnu/libc-2.13.so
0026d000-0026e000 rw-p 0015c000 08:01 10486593   /lib/i386-linux-gnu/libc-2.13.so
0026e000-00271000 rw-p 00000000 00:00 0 
003b2000-003c7000 r-xp 00000000 08:01 10486658   /lib/i386-linux-gnu/libpthread-2.13.so
003c7000-003c8000 r--p 00015000 08:01 10486658   /lib/i386-linux-gnu/libpthread-2.13.so
003c8000-003c9000 rw-p 00016000 08:01 10486658   /lib/i386-linux-gnu/libpthread-2.13.so
003c9000-003cb000 rw-p 00000000 00:00 0 
0049a000-00579000 r-xp 00000000 08:01 13113625   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.14
00579000-0057d000 r--p 000de000 08:01 13113625   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.14
0057d000-0057e000 rw-p 000e2000 08:01 13113625   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.14
0057e000-00585000 rw-p 00000000 00:00 0 
006b5000-006d9000 r-xp 00000000 08:01 10486630   /lib/i386-linux-gnu/libm-2.13.so
006d9000-006da000 r--p 00023000 08:01 10486630   /lib/i386-linux-gnu/libm-2.13.so
006da000-006db000 rw-p 00024000 08:01 10486630   /lib/i386-linux-gnu/libm-2.13.so
009cb000-009e5000 r-xp 00000000 08:01 10486621   /lib/i386-linux-gnu/libgcc_s.so.1
009e5000-009e6000 r--p 00019000 08:01 10486621   /lib/i386-linux-gnu/libgcc_s.so.1
009e6000-009e7000 rw-p 0001a000 08:01 10486621   /lib/i386-linux-gnu/libgcc_s.so.1
00b5d000-00b5f000 r-xp 00000000 08:01 10486603   /lib/i386-linux-gnu/libdl-2.13.so
00b5f000-00b60000 r--p 00001000 08:01 10486603   /lib/i386-linux-gnu/libdl-2.13.so
00b60000-00b61000 rw-p 00002000 08:01 10486603   /lib/i386-linux-gnu/libdl-2.13.so
00c46000-00c62000 r-xp 00000000 08:01 10486580   /lib/i386-linux-gnu/ld-2.13.so
00c62000-00c63000 r--p 0001b000 08:01 10486580   /lib/i386-linux-gnu/ld-2.13.so
00c63000-00c64000 rw-p 0001c000 08:01 10486580   /lib/i386-linux-gnu/ld-2.13.so
00dfa000-00dfb000 r-xp 00000000 00:00 0          [vdso]
08048000-080e3000 r-xp 00000000 08:01 5245207    /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 5245207    /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08baf000-08c15000 rw-p 00000000 00:00 0          [heap]
b7200000-b7221000 rw-p 00000000 00:00 0 
b7221000-b7300000 ---p 00000000 00:00 0 
b73be000-b7839000 rw-s 00000000 08:01 5376891    /var/lib/boinc-client/slots/7/134280
b7839000-b783d000 rw-p 00000000 00:00 0 
b7845000-b7846000 rw-p 00000000 00:00 0 
b7846000-b7847000 ---p 00000000 00:00 0 
b7847000-b784a000 rw-p 00000000 00:00 0 
b784a000-b784c000 rw-s 00000000 08:01 5374403    /var/lib/boinc-client/slots/7/boinc_mmap_file
b784c000-b784e000 rw-p 00000000 00:00 0 
bfb65000-bfbd4000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xdfa400]
[0xdfa416]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x51)[0x13ae71]
/lib/i386-linux-gnu/libc.so.6(abort+0x17e)[0x13e34e]
/lib/i386-linux-gnu/libc.so.6(+0x61577)[0x171577]
/lib/i386-linux-gnu/libc.so.6(+0x6b961)[0x17b961]
/lib/i386-linux-gnu/libc.so.6(+0x6d28b)[0x17d28b]
/lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0x18041d]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x21)[0x5444d1]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1d)[0x54452d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xe7)[0x126e37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
02 Jul 2011 01:01:08 1148172 12927074 hadcm3n_o77n_1940_40_007266812_1 259,200 938,906 3.6223
29 Jun 2011 20:39:46 1148172 12927074 hadcm3n_o77n_1940_40_007266812_1 233,280 839,150 3.5972
27 Jun 2011 02:42:09 1148172 12927074 hadcm3n_o77n_1940_40_007266812_1 207,360 744,442 3.5901
25 Jun 2011 20:35:14 1148172 12927074 hadcm3n_o77n_1940_40_007266812_1 181,440 644,336 3.5512
23 Jun 2011 09:44:28 1148172 12927074 hadcm3n_o77n_1940_40_007266812_1 155,520 542,530 3.4885
22 Jun 2011 05:26:20 1148172 12927074 hadcm3n_o77n_1940_40_007266812_1 129,600 443,845 3.4247
21 Jun 2011 00:19:23 1148172 12927074 hadcm3n_o77n_1940_40_007266812_1 103,680 346,363 3.3407
19 Jun 2011 22:28:14 1148172 12927074 hadcm3n_o77n_1940_40_007266812_1 77,760 255,446 3.2851
14 Jun 2011 23:35:21 1148172 12927074 hadcm3n_o77n_1940_40_007266812_1 51,840 150,520 2.9035
08 Jun 2011 14:24:53 1148172 12927074 hadcm3n_o77n_1940_40_007266812_1 25,920 92,132 3.5545


©2024 cpdn.org