climateprediction.net home page
Task 13919726

Task 13919726

Name hadcm3n_o71f_1980_40_007616647_4
Workunit 7794777
Created 14 Jan 2012, 12:12:55 UTC
Sent 14 Jan 2012, 12:13:09 UTC
Report deadline 14 Apr 2012, 19:40:20 UTC
Received 6 Feb 2012, 8:37:41 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 786733
Run time 7 days 12 hours 49 min 52 sec
CPU time 6 days 22 hours 51 min 42 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.84 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.42</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xffffe400]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x82a909e]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8140cfb]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81dadc8]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8267a6b]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807b49e]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf751a3c6]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=17953, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08190d98 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6e5cf)[0xf75095cf]
/lib32/libc.so.6(+0x6fee3)[0xf750aee3]
/lib32/libc.so.6(cfree+0x6d)[0xf750e03d]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.5.3/32/libstdc++.so.6(_ZdlPv+0x21)[0xf76e4591]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.5.3/32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76e45ed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf74b5356]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 09:01 27755                              /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 09:01 27755                              /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-081a1000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f701d000-f7498000 rw-s 00000000 09:01 1452820                            /var/lib/boinc/slots/2/134570
f7498000-f749b000 rw-p 00000000 00:00 0 
f749b000-f75f4000 r-xp 00000000 09:01 826550                             /lib32/libc-2.14.1.so
f75f4000-f75f6000 r--p 00159000 09:01 826550                             /lib32/libc-2.14.1.so
f75f6000-f75f7000 rw-p 0015b000 09:01 826550                             /lib32/libc-2.14.1.so
f75f7000-f75fa000 rw-p 00000000 00:00 0 
f75fa000-f7613000 r-xp 00000000 09:01 7878901                            /lib32/libgcc_s.so.1
f7613000-f7614000 r--p 00018000 09:01 7878901                            /lib32/libgcc_s.so.1
f7614000-f7615000 rw-p 00019000 09:01 7878901                            /lib32/libgcc_s.so.1
f7615000-f7639000 r-xp 00000000 09:01 826601                             /lib32/libm-2.14.1.so
f7639000-f763a000 r--p 00023000 09:01 826601                             /lib32/libm-2.14.1.so
f763a000-f763b000 rw-p 00024000 09:01 826601                             /lib32/libm-2.14.1.so
f763b000-f763c000 rw-p 00000000 00:00 0 
f763c000-f7715000 r-xp 00000000 09:01 2519592                            /usr/lib64/gcc/x86_64-pc-linux-gnu/4.5.3/32/libstdc++.so.6.0.14
f7715000-f7719000 r--p 000d8000 09:01 2519592                            /usr/lib64/gcc/x86_64-pc-linux-gnu/4.5.3/32/libstdc++.so.6.0.14
f7719000-f771a000 rw-p 000dc000 09:01 2519592                            /usr/lib64/gcc/x86_64-pc-linux-gnu/4.5.3/32/libstdc++.so.6.0.14
f771a000-f7721000 rw-p 00000000 00:00 0 
f7721000-f7723000 r-xp 00000000 09:01 826650                             /lib32/libdl-2.14.1.so
f7723000-f7724000 r--p 00001000 09:01 826650                             /lib32/libdl-2.14.1.so
f7724000-f7725000 rw-p 00002000 09:01 826650                             /lib32/libdl-2.14.1.so
f7725000-f773a000 r-xp 00000000 09:01 826784                             /lib32/libpthread-2.14.1.so
f773a000-f773b000 r--p 00015000 09:01 826784                             /lib32/libpthread-2.14.1.so
f773b000-f773c000 rw-p 00016000 09:01 826784                             /lib32/libpthread-2.14.1.so
f773c000-f773e000 rw-p 00000000 00:00 0 
f777d000-f777f000 rw-p 00000000 00:00 0 
f777f000-f7780000 ---p 00000000 00:00 0 
f7780000-f7783000 rw-p 00000000 00:00 0 
f7783000-f7785000 rw-s 00000000 09:01 1452740                            /var/lib/boinc/slots/2/boinc_mmap_file
f7785000-f7786000 rw-p 00000000 00:00 0 
f7786000-f77a3000 r-xp 00000000 09:01 826851                             /lib32/ld-2.14.1.so
f77a3000-f77a4000 r--p 0001c000 09:01 826851                             /lib32/ld-2.14.1.so
f77a4000-f77a5000 rw-p 0001d000 09:01 826851                             /lib32/ld-2.14.1.so
ff86b000-ff8dc000 rw-p 00000000 00:00 0                                  [stack]
ffffe000-fffff000 r-xp 00000000 00:00 0                                  [vdso]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xffffe400]
[0xffffe425]
/lib32/libc.so.6(gsignal+0x51)[0xf74c9011]
/lib32/libc.so.6(abort+0x17c)[0xf74ca7ec]
/lib32/libc.so.6(+0x6876b)[0xf750376b]
/lib32/libc.so.6(+0x6e5cf)[0xf75095cf]
/lib32/libc.so.6(+0x6fee3)[0xf750aee3]
/lib32/libc.so.6(cfree+0x6d)[0xf750e03d]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.5.3/32/libstdc++.so.6(_ZdlPv+0x21)[0xf76e4591]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.5.3/32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76e45ed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf74b5356]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 Feb 2012 02:38:02 786733 13919726 hadcm3n_o71f_1980_40_007616647_4 259,200 600,699 2.3175
04 Feb 2012 21:07:11 786733 13919726 hadcm3n_o71f_1980_40_007616647_4 233,280 548,210 2.3500
03 Feb 2012 21:17:42 786733 13919726 hadcm3n_o71f_1980_40_007616647_4 207,360 495,069 2.3875
03 Feb 2012 06:35:22 786733 13919726 hadcm3n_o71f_1980_40_007616647_4 181,440 442,018 2.4362
02 Feb 2012 07:56:01 786733 13919726 hadcm3n_o71f_1980_40_007616647_4 155,520 389,122 2.5021
01 Feb 2012 09:51:02 786733 13919726 hadcm3n_o71f_1980_40_007616647_4 129,600 335,885 2.5917
31 Jan 2012 09:28:01 786733 13919726 hadcm3n_o71f_1980_40_007616647_4 103,680 282,699 2.7266
30 Jan 2012 09:54:24 786733 13919726 hadcm3n_o71f_1980_40_007616647_4 77,760 229,701 2.9540
22 Jan 2012 09:36:17 786733 13919726 hadcm3n_o71f_1980_40_007616647_4 51,840 179,486 3.4623
16 Jan 2012 20:04:59 786733 13919726 hadcm3n_o71f_1980_40_007616647_4 25,920 78,882 3.0433


©2024 cpdn.org