climateprediction.net home page
Task 15980678

Task 15980678

Name hadcm3n_7rpa_1980_40_008447185_0
Workunit 8598041
Created 30 Aug 2013, 13:22:12 UTC
Sent 30 Aug 2013, 13:26:44 UTC
Report deadline 29 Nov 2013, 20:53:55 UTC
Received 18 Sep 2013, 5:59:46 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1288780
Run time 4 days 21 hours 0 min 39 sec
CPU time 4 days 15 hours 36 min 54 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.23 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>7.2.15</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  2048    
SIGSEGV: segmentation violation
Stack trace (14 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x638400]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815505a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8159b01]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81518bf]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815a74a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8153291]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807f0e3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0x19cce6]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4209, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (14 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xdae400]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815505a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8159b01]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81518bf]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815a74a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8153291]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807f0e3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0x18ece6]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4209, iMonCtr=1
Model crash detected, will try to restart...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x091e82f0 ***
======= Backtrace: =========
/lib/libc.so.6(-0xff95720f)[0x261df1]
/lib/libc.so.6(-0xff954acf)[0x264531]
/usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0xc4bdf2]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1e)[0xc4be4e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xe6)[0x207ce6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
001f1000-00381000 r-xp 00000000 08:03 657280                             /lib/libc-2.12.so
00381000-00382000 ---p 00190000 08:03 657280                             /lib/libc-2.12.so
00382000-00384000 r--p 00190000 08:03 657280                             /lib/libc-2.12.so
00384000-00385000 rw-p 00192000 08:03 657280                             /lib/libc-2.12.so
00385000-00388000 rw-p 00000000 00:00 0 
00616000-00634000 r-xp 00000000 08:03 657278                             /lib/ld-2.12.so
00634000-00635000 r--p 0001d000 08:03 657278                             /lib/ld-2.12.so
00635000-00636000 rw-p 0001e000 08:03 657278                             /lib/ld-2.12.so
0072d000-0074a000 r-xp 00000000 08:03 677064                             /lib/libgcc_s-4.4.7-20120601.so.1
0074a000-0074b000 rw-p 0001d000 08:03 677064                             /lib/libgcc_s-4.4.7-20120601.so.1
007d1000-007d4000 r-xp 00000000 08:03 658861                             /lib/libdl-2.12.so
007d4000-007d5000 r--p 00002000 08:03 658861                             /lib/libdl-2.12.so
007d5000-007d6000 rw-p 00003000 08:03 658861                             /lib/libdl-2.12.so
008c9000-008f1000 r-xp 00000000 08:03 659154                             /lib/libm-2.12.so
008f1000-008f2000 r--p 00027000 08:03 659154                             /lib/libm-2.12.so
008f2000-008f3000 rw-p 00028000 08:03 659154                             /lib/libm-2.12.so
00b9f000-00c7e000 r-xp 00000000 08:03 2009492                            /usr/lib/libstdc++.so.6.0.13
00c7e000-00c82000 r--p 000de000 08:03 2009492                            /usr/lib/libstdc++.so.6.0.13
00c82000-00c83000 rw-p 000e2000 08:03 2009492                            /usr/lib/libstdc++.so.6.0.13
00c83000-00c8a000 rw-p 00000000 00:00 0 
00d79000-00d90000 r-xp 00000000 08:03 659349                             /lib/libpthread-2.12.so
00d90000-00d91000 r--p 00016000 08:03 659349                             /lib/libpthread-2.12.so
00d91000-00d92000 rw-p 00017000 08:03 659349                             /lib/libpthread-2.12.so
00d92000-00d94000 rw-p 00000000 00:00 0 
00daf000-00db0000 r-xp 00000000 00:00 0                                  [vdso]
08048000-080e3000 r-xp 00000000 08:03 788471                             /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:03 788471                             /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09199000-0921f000 rw-p 00000000 00:00 0                                  [heap]
f71ff000-f7200000 rw-p 00000000 00:00 0 
f7200000-f7221000 rw-p 00000000 00:00 0 
f7221000-f7300000 ---p 00000000 00:00 0 
f731d000-f7798000 rw-s 00000000 08:03 813868                             /var/lib/boinc/slots/6/137835
f7798000-f779b000 rw-p 00000000 00:00 0 
f77b3000-f77b4000 rw-p 00000000 00:00 0 
f77b4000-f77b5000 ---p 00000000 00:00 0 
f77b5000-f77b8000 rw-p 00000000 00:00 0 
f77b8000-f77ba000 rw-s 00000000 08:03 813756                             /var/lib/boinc/slots/6/boinc_mmap_file
f77ba000-f77bb000 rw-p 00000000 00:00 0 
ff8bf000-ff92f000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (18 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xdaf400]
[0xdaf425]
/lib/libc.so.6(gsignal+0x51)[0x21bad1]
/lib/libc.so.6(abort+0x17a)[0x21d3aa]
/lib/libc.so.6(-0xff95d66b)[0x25b995]
/lib/libc.so.6(-0xff95720f)[0x261df1]
/lib/libc.so.6(-0xff954acf)[0x264531]
/usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0xc4bdf2]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1e)[0xc4be4e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xe6)[0x207ce6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
18 Sep 2013 06:01:37 1288780 15980678 hadcm3n_7rpa_1980_40_008447185_0 259,200 401,812 1.5502
17 Sep 2013 06:17:20 1288780 15980678 hadcm3n_7rpa_1980_40_008447185_0 233,280 361,931 1.5515
15 Sep 2013 11:29:52 1288780 15980678 hadcm3n_7rpa_1980_40_008447185_0 207,360 321,661 1.5512
14 Sep 2013 12:03:54 1288780 15980678 hadcm3n_7rpa_1980_40_008447185_0 181,440 281,356 1.5507
09 Sep 2013 13:10:49 1288780 15980678 hadcm3n_7rpa_1980_40_008447185_0 155,520 241,180 1.5508
08 Sep 2013 09:17:14 1288780 15980678 hadcm3n_7rpa_1980_40_008447185_0 129,600 200,946 1.5505
06 Sep 2013 21:41:16 1288780 15980678 hadcm3n_7rpa_1980_40_008447185_0 103,680 160,659 1.5496
05 Sep 2013 17:46:42 1288780 15980678 hadcm3n_7rpa_1980_40_008447185_0 77,760 120,287 1.5469
03 Sep 2013 20:56:02 1288780 15980678 hadcm3n_7rpa_1980_40_008447185_0 51,840 79,950 1.5422
01 Sep 2013 18:53:33 1288780 15980678 hadcm3n_7rpa_1980_40_008447185_0 25,920 39,737 1.5331


©2024 cpdn.org