climateprediction.net home page
Task 16776806

Task 16776806

Name hadcm3n_8ccq_1980_40_008725429_1
Workunit 8871407
Created 9 Jul 2014, 0:45:14 UTC
Sent 9 Jul 2014, 0:45:20 UTC
Report deadline 8 Oct 2014, 8:12:31 UTC
Received 13 Jul 2014, 13:55:20 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1485220
Run time 3 days 12 hours 20 min 14 sec
CPU time 2 days 19 hours 8 min 45 sec
Validate state Invalid
Credit 2,488.32
Device peak FLOPS 3.24 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>7.0.65</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
20:46:11 (1577): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:46:12 (1577): No heartbeat from core client for 30 sec - exiting
20:46:13 (1577): No heartbeat from core client for 30 sec - exiting
20:46:14 (1577): No heartbeat from core client for 30 sec - exiting
20:46:15 (1577): No heartbeat from core client for 30 sec - exiting
20:46:16 (1577): No heartbeat from core client for 30 sec - exiting
20:46:17 (1577): No heartbeat from core client for 30 sec - exiting
20:46:18 (1577): No heartbeat from core client for 30 sec - exiting
20:46:19 (1577): No heartbeat from core client for 30 sec - exiting
20:46:20 (1577): No heartbeat from core client for 30 sec - exiting
20:46:21 (1577): No heartbeat from core client for 30 sec - exiting
20:46:22 (1577): No heartbeat from core client for 30 sec - exiting
20:46:23 (1577): No heartbeat from core client for 30 sec - exiting
20:46:24 (1577): No heartbeat from core client for 30 sec - exiting
20:46:25 (1577): No heartbeat from core client for 30 sec - exiting
20:46:26 (1577): No heartbeat from core client for 30 sec - exiting
20:46:27 (1577): No heartbeat from core client for 30 sec - exiting
20:46:28 (1577): No heartbeat from core client for 30 sec - exiting
20:46:29 (1577): No heartbeat from core client for 30 sec - exiting
20:46:30 (1577): No heartbeat from core client for 30 sec - exiting
20:46:31 (1577): No heartbeat from core client for 30 sec - exiting
20:46:32 (1577): No heartbeat from core client for 30 sec - exiting
20:46:33 (1577): No heartbeat from core client for 30 sec - exiting
20:46:34 (1577): No heartbeat from core client for 30 sec - exiting
20:46:35 (1577): No heartbeat from core client for 30 sec - exiting
20:46:36 (1577): No heartbeat from core client for 30 sec - exiting
20:46:37 (1577): No heartbeat from core client for 30 sec - exiting
20:46:38 (1577): No heartbeat from core client for 30 sec - exiting
20:46:39 (1577): No heartbeat from core client for 30 sec - exiting
20:46:40 (1577): No heartbeat from core client for 30 sec - exiting
20:46:41 (1577): No heartbeat from core client for 30 sec - exiting
20:46:42 (1577): No heartbeat from core client for 30 sec - exiting
20:46:43 (1577): No heartbeat from core client for 30 sec - exiting
20:46:44 (1577): No heartbeat from core client for 30 sec - exiting
20:46:45 (1577): No heartbeat from core client for 30 sec - exiting
20:46:46 (1577): No heartbeat from core client for 30 sec - exiting
20:46:47 (1577): No heartbeat from core client for 30 sec - exiting
20:46:48 (1577): No heartbeat from core client for 30 sec - exiting
20:46:49 (1577): No heartbeat from core client for 30 sec - exiting
20:46:50 (1577): No heartbeat from core client for 30 sec - exiting
20:46:51 (1577): No heartbeat from core client for 30 sec - exiting
20:46:52 (1577): No heartbeat from core client for 30 sec - exiting
20:46:53 (1577): No heartbeat from core client for 30 sec - exiting
SIGSEGV: segmentation violation
Stack trace (13 frames):
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7738400]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8155092]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8159b01]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81518bf]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815a74a]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8153291]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807f0e3]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/usr/lib32/libc.so.6(__libc_start_main+0xf3)[0xf7530993]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8975, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7760400]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8155092]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8159b01]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81518bf]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815a74a]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8153291]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807f0e3]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/usr/lib32/libc.so.6(__libc_start_main+0xf3)[0xf7558993]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8975, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7741400]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8155092]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8159b01]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81518bf]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815a74a]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8153291]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807f0e3]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/usr/lib32/libc.so.6(__libc_start_main+0xf3)[0xf7539993]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8975, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c2400]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8155092]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8159b01]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81518bf]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815a74a]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8153291]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807f0e3]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/usr/lib32/libc.so.6(__libc_start_main+0xf3)[0xf75ba993]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8975, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bb400]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8155092]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8159b01]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81518bf]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815a74a]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8153291]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807f0e3]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/usr/lib32/libc.so.6(__libc_start_main+0xf3)[0xf75b3993]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8975, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776f400]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8155092]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8159b01]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81518bf]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815a74a]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8153291]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807f0e3]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/boinc/main/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/usr/lib32/libc.so.6(__libc_start_main+0xf3)[0xf7567993]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8975, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 Jul 2014 08:41:31 1301258 16776806 hadcm3n_8ccq_1980_40_008725429_1 207,360 280,670 1.3535
12 Jul 2014 22:51:57 1301258 16776806 hadcm3n_8ccq_1980_40_008725429_1 181,440 245,478 1.3529
12 Jul 2014 12:14:26 1301258 16776806 hadcm3n_8ccq_1980_40_008725429_1 155,520 210,357 1.3526
12 Jul 2014 03:10:15 1301258 16776806 hadcm3n_8ccq_1980_40_008725429_1 129,600 175,349 1.3530
11 Jul 2014 16:31:05 1301258 16776806 hadcm3n_8ccq_1980_40_008725429_1 103,680 140,245 1.3527
11 Jul 2014 06:52:37 1301258 16776806 hadcm3n_8ccq_1980_40_008725429_1 77,760 105,214 1.3531
10 Jul 2014 21:39:59 1301258 16776806 hadcm3n_8ccq_1980_40_008725429_1 51,840 70,102 1.3523
10 Jul 2014 11:37:28 1301258 16776806 hadcm3n_8ccq_1980_40_008725429_1 25,920 35,036 1.3517


©2024 climateprediction.net