climateprediction.net home page
Task 15598606

Task 15598606

Name hadcm3n_4it3_1940_40_008311085_0
Workunit 8462220
Created 8 Feb 2013, 3:13:36 UTC
Sent 8 Feb 2013, 23:06:22 UTC
Report deadline 11 May 2013, 6:33:33 UTC
Received 19 Feb 2013, 22:44:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1268697
Run time 6 days 1 hours 15 min 49 sec
CPU time 1 days 4 hours 49 min 58 sec
Validate state Invalid
Credit 1,866.24
Device peak FLOPS 1.89 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>7.0.29</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

SETPOS: Seek Failed: No space left on device
SETPOS: Unit 42 to Word Address 10612736 Failed with Error Code -1

Model crashed: SETPOS: Unit 42 to Word Address 10612736 Failed with Error Code -1

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
05:46:27 (26967): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:46:30 (26967): No heartbeat from core client for 30 sec - exiting
05:46:31 (26967): No heartbeat from core client for 30 sec - exiting
21:08:28 (22870): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:12:47 (28077): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:12:49 (28077): No heartbeat from core client for 30 sec - exiting
21:21:34 (28216): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:31:13 (28417): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:30:44 (1213): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:30:46 (1213): No heartbeat from core client for 30 sec - exiting
02:30:47 (1213): No heartbeat from core client for 30 sec - exiting
02:30:48 (1213): No heartbeat from core client for 30 sec - exiting
02:30:49 (1213): No heartbeat from core client for 30 sec - exiting
02:30:50 (1213): No heartbeat from core client for 30 sec - exiting
02:30:51 (1213): No heartbeat from core client for 30 sec - exiting
02:30:52 (1213): No heartbeat from core client for 30 sec - exiting
02:30:53 (1213): No heartbeat from core client for 30 sec - exiting
02:30:54 (1213): No heartbeat from core client for 30 sec - exiting
02:30:55 (1213): No heartbeat from core client for 30 sec - exiting
02:30:56 (1213): No heartbeat from core client for 30 sec - exiting
02:30:57 (1213): No heartbeat from core client for 30 sec - exiting
02:30:58 (1213): No heartbeat from core client for 30 sec - exiting
02:30:59 (1213): No heartbeat from core client for 30 sec - exiting
02:31:00 (1213): No heartbeat from core client for 30 sec - exiting
02:31:01 (1213): No heartbeat from core client for 30 sec - exiting
02:31:02 (1213): No heartbeat from core client for 30 sec - exiting
02:31:03 (1213): No heartbeat from core client for 30 sec - exiting
02:31:04 (1213): No heartbeat from core client for 30 sec - exiting
02:31:05 (1213): No heartbeat from core client for 30 sec - exiting
02:31:06 (1213): No heartbeat from core client for 30 sec - exiting
02:31:07 (1213): No heartbeat from core client for 30 sec - exiting
02:31:08 (1213): No heartbeat from core client for 30 sec - exiting
02:31:09 (1213): No heartbeat from core client for 30 sec - exiting
02:31:10 (1213): No heartbeat from core client for 30 sec - exiting
02:31:11 (1213): No heartbeat from core client for 30 sec - exiting
02:31:12 (1213): No heartbeat from core client for 30 sec - exiting
02:31:13 (1213): No heartbeat from core client for 30 sec - exiting
02:31:14 (1213): No heartbeat from core client for 30 sec - exiting
02:31:15 (1213): No heartbeat from core client for 30 sec - exiting
02:31:16 (1213): No heartbeat from core client for 30 sec - exiting
02:31:17 (1213): No heartbeat from core client for 30 sec - exiting
02:31:18 (1213): No heartbeat from core client for 30 sec - exiting
02:31:19 (1213): No heartbeat from core client for 30 sec - exiting
02:31:20 (1213): No heartbeat from core client for 30 sec - exiting
02:31:21 (1213): No heartbeat from core client for 30 sec - exiting
02:31:22 (1213): No heartbeat from core client for 30 sec - exiting
02:31:23 (1213): No heartbeat from core client for 30 sec - exiting
02:31:24 (1213): No heartbeat from core client for 30 sec - exiting
02:31:25 (1213): No heartbeat from core client for 30 sec - exiting
02:31:26 (1213): No heartbeat from core client for 30 sec - exiting
02:31:27 (1213): No heartbeat from core client for 30 sec - exiting
02:31:28 (1213): No heartbeat from core client for 30 sec - exiting
02:31:29 (1213): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
09:22:25 (13989): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:22:26 (13989): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
14:25:55 (6688): No heartbeat from core client for 30 sec - exiting
14:25:56 (6688): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:25:57 (6688): No heartbeat from core client for 30 sec - exiting
14:25:58 (6688): No heartbeat from core client for 30 sec - exiting
14:25:59 (6688): No heartbeat from core client for 30 sec - exiting
14:26:00 (6688): No heartbeat from core client for 30 sec - exiting
14:26:01 (6688): No heartbeat from core client for 30 sec - exiting
14:26:02 (6688): No heartbeat from core client for 30 sec - exiting
14:26:03 (6688): No heartbeat from core client for 30 sec - exiting
14:26:04 (6688): No heartbeat from core client for 30 sec - exiting
SIGSEGV: segmentation violation
Stack trace (13 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8155092]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8159b01]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81518bf]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815a74a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8153291]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807f0e3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf3)[0xb7544ba3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11642, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8155092]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8159b01]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81518bf]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815a74a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8153291]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807f0e3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf3)[0xb75d5ba3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11642, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8155092]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8159b01]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81518bf]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815a74a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8153291]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807f0e3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf3)[0xb75a7ba3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11642, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8155092]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8159b01]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81518bf]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815a74a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8153291]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807f0e3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf3)[0xb7543ba3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11642, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8155092]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8159b01]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81518bf]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815a74a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8153291]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807f0e3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf3)[0xb75ceba3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11642, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8155092]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8159b01]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x81518bf]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x815a74a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8153291]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x807f0e3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837e9f4]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf3)[0xb753dba3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11642, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
18 Feb 2013 16:40:54 1268697 15598606 hadcm3n_4it3_1940_40_008311085_0 155,520 113,207 0.7279
14 Feb 2013 09:20:49 1268697 15598606 hadcm3n_4it3_1940_40_008311085_0 129,600 62,674 0.4836
12 Feb 2013 15:46:21 1268697 15598606 hadcm3n_4it3_1940_40_008311085_0 103,680 9,850 0.0950
11 Feb 2013 19:43:28 1268697 15598606 hadcm3n_4it3_1940_40_008311085_0 77,760 168,820 2.1710
10 Feb 2013 19:39:51 1268697 15598606 hadcm3n_4it3_1940_40_008311085_0 51,840 111,784 2.1563
09 Feb 2013 19:07:17 1268697 15598606 hadcm3n_4it3_1940_40_008311085_0 25,920 55,521 2.1420


©2024 cpdn.org