climateprediction.net home page
Task 13951945

Task 13951945

Name hadcm3n_yg5m_1980_40_007683866_4
Workunit 7838953
Created 21 Jan 2012, 17:24:25 UTC
Sent 21 Jan 2012, 17:24:29 UTC
Report deadline 22 Apr 2012, 0:51:40 UTC
Received 7 Feb 2012, 23:00:12 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1191373
Run time 11 days 3 hours 11 min 34 sec
CPU time 10 days 12 hours 46 min 30 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.27 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:19:52 (27507): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:21:05 (27574): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (16 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xb7834400]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x82cb008]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83374ba]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x820b23a]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x82aa92e]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8140cfb]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x82f1357]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x82646ad]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807b49e]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb76aabd6]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8358, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (17 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xb78c2400]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x811c619]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81c9dd3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8309a29]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x828d3b0]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8090808]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x808a417]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8299901]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x821c545]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8219da1]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838720b]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83995c6]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb7738bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8358, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08ddc760 ***
======= Backtrace: =========
/lib/tls/i686/cmov/libc.so.6(+0x6b591)[0xb75bb591]
/lib/tls/i686/cmov/libc.so.6(+0x6cde8)[0xb75bcde8]
/lib/tls/i686/cmov/libc.so.6(cfree+0x6d)[0xb75bfecd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb77aa741]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb77aa79d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb7566bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 3545684    /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 3545684    /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08d87000-08ded000 rw-p 00000000 00:00 0          [heap]
b6f00000-b6f21000 rw-p 00000000 00:00 0 
b6f21000-b7000000 ---p 00000000 00:00 0 
b70d3000-b754e000 rw-s 00000000 08:01 3545788    /var/lib/boinc-client/slots/0/138605
b754e000-b7550000 rw-p 00000000 00:00 0 
b7550000-b76a3000 r-xp 00000000 08:01 2621462    /lib/tls/i686/cmov/libc-2.11.1.so
b76a3000-b76a4000 ---p 00153000 08:01 2621462    /lib/tls/i686/cmov/libc-2.11.1.so
b76a4000-b76a6000 r--p 00153000 08:01 2621462    /lib/tls/i686/cmov/libc-2.11.1.so
b76a6000-b76a7000 rw-p 00155000 08:01 2621462    /lib/tls/i686/cmov/libc-2.11.1.so
b76a7000-b76aa000 rw-p 00000000 00:00 0 
b76aa000-b76c7000 r-xp 00000000 08:01 2621511    /lib/libgcc_s.so.1
b76c7000-b76c8000 r--p 0001c000 08:01 2621511    /lib/libgcc_s.so.1
b76c8000-b76c9000 rw-p 0001d000 08:01 2621511    /lib/libgcc_s.so.1
b76c9000-b76ed000 r-xp 00000000 08:01 2621466    /lib/tls/i686/cmov/libm-2.11.1.so
b76ed000-b76ee000 r--p 00023000 08:01 2621466    /lib/tls/i686/cmov/libm-2.11.1.so
b76ee000-b76ef000 rw-p 00024000 08:01 2621466    /lib/tls/i686/cmov/libm-2.11.1.so
b76ef000-b77d8000 r-xp 00000000 08:01 1574456    /usr/lib/libstdc++.so.6.0.13
b77d8000-b77d9000 ---p 000e9000 08:01 1574456    /usr/lib/libstdc++.so.6.0.13
b77d9000-b77dd000 r--p 000e9000 08:01 1574456    /usr/lib/libstdc++.so.6.0.13
b77dd000-b77de000 rw-p 000ed000 08:01 1574456    /usr/lib/libstdc++.so.6.0.13
b77de000-b77e6000 rw-p 00000000 00:00 0 
b77e6000-b77e8000 r-xp 00000000 08:01 2621465    /lib/tls/i686/cmov/libdl-2.11.1.so
b77e8000-b77e9000 r--p 00001000 08:01 2621465    /lib/tls/i686/cmov/libdl-2.11.1.so
b77e9000-b77ea000 rw-p 00002000 08:01 2621465    /lib/tls/i686/cmov/libdl-2.11.1.so
b77ea000-b77ff000 r-xp 00000000 08:01 2621476    /lib/tls/i686/cmov/libpthread-2.11.1.so
b77ff000-b7800000 r--p 00014000 08:01 2621476    /lib/tls/i686/cmov/libpthread-2.11.1.so
b7800000-b7801000 rw-p 00015000 08:01 2621476    /lib/tls/i686/cmov/libpthread-2.11.1.so
b7801000-b7803000 rw-p 00000000 00:00 0 
b7814000-b7815000 rw-p 00000000 00:00 0 
b7815000-b7816000 ---p 00000000 00:00 0 
b7816000-b7819000 rw-p 00000000 00:00 0 
b7819000-b781b000 rw-s 00000000 08:01 3545536    /var/lib/boinc-client/slots/0/boinc_mmap_file
b781b000-b781d000 rw-p 00000000 00:00 0 
b781d000-b781e000 r-xp 00000000 00:00 0          [vdso]
b781e000-b7839000 r-xp 00000000 08:01 2621639    /lib/ld-2.11.1.so
b7839000-b783a000 r--p 0001a000 08:01 2621639    /lib/ld-2.11.1.so
b783a000-b783b000 rw-p 0001b000 08:01 2621639    /lib/ld-2.11.1.so
bf948000-bf9b8000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xb781d400]
[0xb781d430]
/lib/tls/i686/cmov/libc.so.6(gsignal+0x51)[0xb757a651]
/lib/tls/i686/cmov/libc.so.6(abort+0x182)[0xb757da82]
/lib/tls/i686/cmov/libc.so.6(+0x6149d)[0xb75b149d]
/lib/tls/i686/cmov/libc.so.6(+0x6b591)[0xb75bb591]
/lib/tls/i686/cmov/libc.so.6(+0x6cde8)[0xb75bcde8]
/lib/tls/i686/cmov/libc.so.6(cfree+0x6d)[0xb75bfecd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb77aa741]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb77aa79d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb7566bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
07 Feb 2012 22:00:00 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 518,400 909,981 1.7554
07 Feb 2012 03:15:37 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 492,480 862,266 1.7509
06 Feb 2012 10:52:14 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 466,560 814,347 1.7454
05 Feb 2012 21:42:35 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 440,640 766,897 1.7404
03 Feb 2012 17:55:45 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 414,720 735,449 1.7734
03 Feb 2012 03:37:23 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 388,800 689,109 1.7724
02 Feb 2012 04:22:36 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 362,880 642,491 1.7705
01 Feb 2012 06:32:25 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 336,960 596,031 1.7688
31 Jan 2012 13:59:39 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 311,040 550,419 1.7696
30 Jan 2012 16:44:54 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 285,120 503,725 1.7667
29 Jan 2012 20:14:36 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 259,200 456,864 1.7626
28 Jan 2012 22:46:44 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 233,280 410,502 1.7597
28 Jan 2012 00:55:19 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 207,360 364,793 1.7592
27 Jan 2012 07:21:13 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 181,440 319,257 1.7596
26 Jan 2012 11:10:37 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 155,520 277,644 1.7853
25 Jan 2012 12:09:29 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 129,600 232,293 1.7924
24 Jan 2012 17:02:25 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 103,680 185,655 1.7907
23 Jan 2012 23:54:53 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 77,760 138,932 1.7867
23 Jan 2012 06:14:40 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 51,840 92,503 1.7844
22 Jan 2012 12:16:53 1191373 13951945 hadcm3n_yg5m_1980_40_007683866_4 25,920 46,655 1.8000


©2024 climateprediction.net