climateprediction.net home page
Task 11642018

Task 11642018

Name hadsm3dhet2_u2am_006669831_1
Workunit 6873085
Created 9 Aug 2010, 15:30:49 UTC
Sent 26 Sep 2010, 7:32:36 UTC
Report deadline 8 Sep 2011, 12:52:36 UTC
Received 7 Nov 2010, 11:32:16 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1072778
Run time 11 days 7 hours 21 min 8 sec
CPU time 10 days 13 hours 43 min 54 sec
Validate state Invalid
Credit 4,267.47
Device peak FLOPS 1.08 GFLOPS
Application version UK Met Office HadSM3 Slab Model v6.08
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3055, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (4 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86234de]
[0x3fb4902e]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3081, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...

Model crashed: 7R
SIGSEGV: segmentation violation
Stack trace (11 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x84452e4]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x821f518]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80978ea]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c22cf]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3113, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...

Model crashed: 7R
SIGSEGV: segmentation violation
Stack trace (13 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8139590]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x816a4cd]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3281, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (11 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x865002f]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80685f3]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x809092b]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c22cf]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3281, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...

Model crashed: 7R
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8429bbd]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3533, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8166b8e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3942, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (16 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8181fc1]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81872e8]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81c5856]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x817eb53]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x816bdf0]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3942, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81669e5]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3942, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8236314]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8228d22]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x82063dc]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8069026]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x809092b]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c22cf]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3942, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81665b4]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3942, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (14 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81e3f12]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x813949e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x816a4cd]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5305, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8075dc2]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x860c996]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80710e6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8095fe4]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c22cf]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4706, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8075495]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4706, iMonCtr=1
Model crash detected, will try to restart...

Model crashed: 7R
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8075495]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4738, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8166b8e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1610, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (16 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8081ded]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81872e8]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81c5856]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x817eb53]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x816bdf0]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2294, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (14 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x807b17e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x850d378]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8249fa7]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x85f336b]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x84b44e6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b273e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2318, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (14 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8135c3c]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8228d22]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x82063dc]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x860ec61]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80710e6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8095fe4]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c22cf]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1497, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (17 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8576f2f]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8127d8d]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x862c82b]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x83e7879]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x850d2fd]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8249fa7]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x85f336b]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x84b44e6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b273e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1497, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (14 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81e3f12]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x813949e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x816a4cd]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8166b8e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8075495]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8079653]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86697d8]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8659f96]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x806f4c9]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8095fe4]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c22cf]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1
Model crash detected, will try to restart...

Model crashed: 7R
SIGSEGV: segmentation violation
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86696b3]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8659f96]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x806f4c9]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8095fe4]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c22cf]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1
Model crash detected, will try to restart...
SIGILL: illegal instruction
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8166b7e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (14 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8429782]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x813921e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x816a4cd]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (14 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x823604e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8228d22]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x82063dc]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x860ec61]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80710e6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8095fe4]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c22cf]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGILL: illegal instruction
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8166b7e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3056, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (14 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x807afda]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x850d378]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8249fa7]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x85f336b]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x84b44e6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b273e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3056, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (15 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x842b381]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81c5e3a]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x817eb53]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x816bdf0]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3056, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x862c41b]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3056, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (4 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86032e1]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8429c0e]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3056, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (14 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8429782]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x813921e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x816a4cd]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3056, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (4 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8603758]
[0x0]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3056, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8075495]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3056, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (10 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x821efd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80978ea]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c22cf]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8075495]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (15 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8603250]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8429c0e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x813921e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x816a4cd]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8075495]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...

Model crashed: 7R
SIGSEGV: segmentation violation
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8166bf3]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3136, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8429bbd]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3136, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8075495]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3136, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8075495]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3136, iMonCtr=1
Model crash detected, will try to restart...

Model crashed: 7R
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86234de]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3136, iMonCtr=1
Model crash detected, will try to restart...

Model crashed: 7R
SIGSEGV: segmentation violation
Stack trace (16 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8590b9a]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x862cb4c]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x83e7879]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x850d2fd]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8249fa7]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x85f336b]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x84b44e6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b273e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3136, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8429bbd]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3136, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8075495]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3136, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: 7R
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (17 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x85a5ef1]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8127e5d]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x862c82b]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x83e7879]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x850d2fd]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8249fa7]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x85f336b]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x84b44e6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b273e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1860, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (14 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x807b17e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x850d378]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8249fa7]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x85f336b]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x84b44e6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b273e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1860, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86697bd]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8659f96]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x806f4c9]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8095fe4]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c22cf]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2455, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (17 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x85a5ef1]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8127e5d]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x862c82b]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x83e7879]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x850d2fd]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8249fa7]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x85f336b]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x84b44e6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b273e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3307, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (18 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8622c72]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x85f94e6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8640c54]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x862bfd1]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x83e7879]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x850d2fd]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8249fa7]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x835164a]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x84b6a30]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b273e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3372, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3372, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x862c41b]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3486, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3486, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (3 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8127d36]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3512, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8079811]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8659153]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x806f4c9]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8095fe4]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c22cf]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3735, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...

Model crashed: 7R
SIGSEGV: segmentation violation
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8169f0c]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3825, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (12 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b]
[0x4001d400]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x816941c]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8250464]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81477ff]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b5640]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x40076bd6]
/var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31]

Exiting...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3851, iMonCtr=1
Model crash detected, will try to restart...

Model crashed: 7R
SIGSEGV: segmentation violation
Stack trace (3 frames):
[0x80a1fb7]
[0x805d018]
[0x8108308]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 Nov 2010 19:17:23 1072778 11642018 hadsm3dhet2_u2am_006669831_1 205,238 903,186 1.9445
06 Nov 2010 07:28:14 1072778 11642018 hadsm3dhet2_u2am_006669831_1 194,436 882,461 1.9451
05 Nov 2010 05:16:11 1072778 11642018 hadsm3dhet2_u2am_006669831_1 183,634 862,091 1.9465
04 Nov 2010 00:39:53 1072778 11642018 hadsm3dhet2_u2am_006669831_1 172,832 837,533 1.9384
02 Nov 2010 08:41:38 1072778 11642018 hadsm3dhet2_u2am_006669831_1 162,030 816,810 1.9389
29 Oct 2010 19:04:04 1072778 11642018 hadsm3dhet2_u2am_006669831_1 151,228 796,056 1.9393
29 Oct 2010 07:26:51 1072778 11642018 hadsm3dhet2_u2am_006669831_1 140,426 774,582 1.9380
28 Oct 2010 07:30:15 1072778 11642018 hadsm3dhet2_u2am_006669831_1 129,624 753,714 1.9382
26 Oct 2010 23:47:31 1072778 11642018 hadsm3dhet2_u2am_006669831_1 118,822 733,220 1.9394
26 Oct 2010 03:54:43 1072778 11642018 hadsm3dhet2_u2am_006669831_1 108,020 711,706 1.9378
25 Oct 2010 10:37:22 1072778 11642018 hadsm3dhet2_u2am_006669831_1 97,218 689,747 1.9350
24 Oct 2010 20:00:43 1072778 11642018 hadsm3dhet2_u2am_006669831_1 86,416 668,924 1.9352
24 Oct 2010 03:57:00 1072778 11642018 hadsm3dhet2_u2am_006669831_1 75,614 648,309 1.9360
23 Oct 2010 12:19:58 1072778 11642018 hadsm3dhet2_u2am_006669831_1 64,812 626,214 1.9324
23 Oct 2010 03:51:22 1072778 11642018 hadsm3dhet2_u2am_006669831_1 54,010 605,720 1.9336
22 Oct 2010 12:54:49 1072778 11642018 hadsm3dhet2_u2am_006669831_1 43,208 584,722 1.9332
22 Oct 2010 03:33:51 1072778 11642018 hadsm3dhet2_u2am_006669831_1 32,406 564,122 1.9342
21 Oct 2010 03:18:18 1072778 11642018 hadsm3dhet2_u2am_006669831_1 21,604 542,289 1.9309
20 Oct 2010 02:55:36 1072778 11642018 hadsm3dhet2_u2am_006669831_1 10,802 521,106 1.9297
18 Oct 2010 10:30:58 1072778 11642018 hadsm3dhet2_u2am_006669831_1 259,248 500,918 1.9322


©2024 climateprediction.net