climateprediction.net home page
Task 15772977

Task 15772977

Name hadcm3n_48w9_1980_40_008363732_0
Workunit 8514591
Created 10 May 2013, 17:54:46 UTC
Sent 10 May 2013, 17:58:48 UTC
Report deadline 10 Aug 2013, 1:25:59 UTC
Received 3 Sep 2013, 16:13:09 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1291528
Run time 2 days 18 hours 15 min 47 sec
CPU time 2 days 15 hours 6 min 59 sec
Validate state Invalid
Credit 933.12
Device peak FLOPS 2.00 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
00:55:15 (11530): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:59:36 (11750): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:03:44 (12039): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:07:31 (12141): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:12:08 (12238): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:12:09 (12238): No heartbeat from core client for 30 sec - exiting
01:12:10 (12238): No heartbeat from core client for 30 sec - exiting
01:12:11 (12238): No heartbeat from core client for 30 sec - exiting
01:12:12 (12238): No heartbeat from core client for 30 sec - exiting
01:12:13 (12238): No heartbeat from core client for 30 sec - exiting
01:12:14 (12238): No heartbeat from core client for 30 sec - exiting
01:16:15 (12336): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:16:16 (12336): No heartbeat from core client for 30 sec - exiting
01:16:17 (12336): No heartbeat from core client for 30 sec - exiting
01:16:18 (12336): No heartbeat from core client for 30 sec - exiting
01:16:19 (12336): No heartbeat from core client for 30 sec - exiting
01:16:20 (12336): No heartbeat from core client for 30 sec - exiting
01:16:21 (12336): No heartbeat from core client for 30 sec - exiting
01:16:22 (12336): No heartbeat from core client for 30 sec - exiting
01:20:14 (12432): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:22:16 (12529): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:26:25 (12647): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:30:09 (12749): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:41:30 (12837): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:41:31 (12837): No heartbeat from core client for 30 sec - exiting
03:41:32 (12837): No heartbeat from core client for 30 sec - exiting
03:41:33 (12837): No heartbeat from core client for 30 sec - exiting
03:41:34 (12837): No heartbeat from core client for 30 sec - exiting
03:45:27 (12934): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:49:26 (13017): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:53:27 (13101): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:20:45 (13185): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:24:33 (13316): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:24:34 (13316): No heartbeat from core client for 30 sec - exiting
04:24:35 (13316): No heartbeat from core client for 30 sec - exiting
04:24:36 (13316): No heartbeat from core client for 30 sec - exiting
04:24:37 (13316): No heartbeat from core client for 30 sec - exiting
04:28:36 (13408): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:28:37 (13408): No heartbeat from core client for 30 sec - exiting
04:28:38 (13408): No heartbeat from core client for 30 sec - exiting
04:28:39 (13408): No heartbeat from core client for 30 sec - exiting
04:28:40 (13408): No heartbeat from core client for 30 sec - exiting
04:28:41 (13408): No heartbeat from core client for 30 sec - exiting
04:28:42 (13408): No heartbeat from core client for 30 sec - exiting
04:28:43 (13408): No heartbeat from core client for 30 sec - exiting
04:28:44 (13408): No heartbeat from core client for 30 sec - exiting
04:28:45 (13408): No heartbeat from core client for 30 sec - exiting
04:28:46 (13408): No heartbeat from core client for 30 sec - exiting
04:28:47 (13408): No heartbeat from core client for 30 sec - exiting
04:28:48 (13408): No heartbeat from core client for 30 sec - exiting
04:28:49 (13408): No heartbeat from core client for 30 sec - exiting
04:28:50 (13408): No heartbeat from core client for 30 sec - exiting
04:28:51 (13408): No heartbeat from core client for 30 sec - exiting
04:28:52 (13408): No heartbeat from core client for 30 sec - exiting
04:33:08 (13500): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:33:09 (13500): No heartbeat from core client for 30 sec - exiting
04:33:10 (13500): No heartbeat from core client for 30 sec - exiting
04:33:11 (13500): No heartbeat from core client for 30 sec - exiting
04:33:12 (13500): No heartbeat from core client for 30 sec - exiting
04:33:13 (13500): No heartbeat from core client for 30 sec - exiting
04:33:14 (13500): No heartbeat from core client for 30 sec - exiting
04:33:15 (13500): No heartbeat from core client for 30 sec - exiting
04:36:45 (13576): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
04:44:30 (13679): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:47:10 (13763): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:51:09 (13920): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:12:18 (14000): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:55:33 (14866): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:59:35 (15059): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:03:29 (15182): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:03:30 (15182): No heartbeat from core client for 30 sec - exiting
06:03:31 (15182): No heartbeat from core client for 30 sec - exiting
06:03:32 (15182): No heartbeat from core client for 30 sec - exiting
06:07:42 (15283): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:09:58 (15368): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:09:59 (15368): No heartbeat from core client for 30 sec - exiting
18:10:00 (15368): No heartbeat from core client for 30 sec - exiting
18:10:01 (15368): No heartbeat from core client for 30 sec - exiting
18:10:02 (15368): No heartbeat from core client for 30 sec - exiting
18:10:03 (15368): No heartbeat from core client for 30 sec - exiting
18:13:43 (16068): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:13:44 (16068): No heartbeat from core client for 30 sec - exiting
18:13:45 (16068): No heartbeat from core client for 30 sec - exiting
18:13:46 (16068): No heartbeat from core client for 30 sec - exiting
18:17:25 (16148): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:17:26 (16148): No heartbeat from core client for 30 sec - exiting
18:17:27 (16148): No heartbeat from core client for 30 sec - exiting
18:17:28 (16148): No heartbeat from core client for 30 sec - exiting
18:17:29 (16148): No heartbeat from core client for 30 sec - exiting
18:17:30 (16148): No heartbeat from core client for 30 sec - exiting
18:17:31 (16148): No heartbeat from core client for 30 sec - exiting
18:17:32 (16148): No heartbeat from core client for 30 sec - exiting
18:17:33 (16148): No heartbeat from core client for 30 sec - exiting
18:17:34 (16148): No heartbeat from core client for 30 sec - exiting
18:17:35 (16148): No heartbeat from core client for 30 sec - exiting
18:17:36 (16148): No heartbeat from core client for 30 sec - exiting
18:17:37 (16148): No heartbeat from core client for 30 sec - exiting
18:17:38 (16148): No heartbeat from core client for 30 sec - exiting
18:17:39 (16148): No heartbeat from core client for 30 sec - exiting
18:17:40 (16148): No heartbeat from core client for 30 sec - exiting
18:17:41 (16148): No heartbeat from core client for 30 sec - exiting
18:17:42 (16148): No heartbeat from core client for 30 sec - exiting
18:17:43 (16148): No heartbeat from core client for 30 sec - exiting
18:21:14 (16231): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:21:27 (16231): No heartbeat from core client for 30 sec - exiting
18:25:12 (16311): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:29:06 (16391): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:32:55 (16471): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:32:56 (16471): No heartbeat from core client for 30 sec - exiting
18:32:57 (16471): No heartbeat from core client for 30 sec - exiting
18:32:58 (16471): No heartbeat from core client for 30 sec - exiting
18:32:59 (16471): No heartbeat from core client for 30 sec - exiting
18:33:00 (16471): No heartbeat from core client for 30 sec - exiting
18:33:01 (16471): No heartbeat from core client for 30 sec - exiting
18:33:02 (16471): No heartbeat from core client for 30 sec - exiting
18:33:03 (16471): No heartbeat from core client for 30 sec - exiting
18:33:04 (16471): No heartbeat from core client for 30 sec - exiting
18:33:05 (16471): No heartbeat from core client for 30 sec - exiting
18:33:06 (16471): No heartbeat from core client for 30 sec - exiting
18:33:07 (16471): No heartbeat from core client for 30 sec - exiting
18:33:08 (16471): No heartbeat from core client for 30 sec - exiting
18:33:09 (16471): No heartbeat from core client for 30 sec - exiting
18:33:10 (16471): No heartbeat from core client for 30 sec - exiting
18:33:11 (16471): No heartbeat from core client for 30 sec - exiting
18:33:12 (16471): No heartbeat from core client for 30 sec - exiting
18:33:13 (16471): No heartbeat from core client for 30 sec - exiting
18:36:45 (16559): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:36:52 (16559): No heartbeat from core client for 30 sec - exiting
18:40:33 (16641): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:23:21 (16705): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
15:48:56 (3911): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:48:58 (3911): No heartbeat from core client for 30 sec - exiting
15:48:59 (3911): No heartbeat from core client for 30 sec - exiting
15:49:00 (3911): No heartbeat from core client for 30 sec - exiting
15:49:01 (3911): No heartbeat from core client for 30 sec - exiting
15:49:02 (3911): No heartbeat from core client for 30 sec - exiting
15:49:03 (3911): No heartbeat from core client for 30 sec - exiting
15:49:04 (3911): No heartbeat from core client for 30 sec - exiting
15:49:05 (3911): No heartbeat from core client for 30 sec - exiting
15:49:06 (3911): No heartbeat from core client for 30 sec - exiting
15:49:07 (3911): No heartbeat from core client for 30 sec - exiting
15:49:08 (3911): No heartbeat from core client for 30 sec - exiting
15:49:09 (3911): No heartbeat from core client for 30 sec - exiting
15:49:10 (3911): No heartbeat from core client for 30 sec - exiting
15:49:11 (3911): No heartbeat from core client for 30 sec - exiting
16:23:10 (4290): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:39:50 (4817): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:42:09 (4927): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:42:10 (4927): No heartbeat from core client for 30 sec - exiting
16:42:11 (4927): No heartbeat from core client for 30 sec - exiting
16:42:12 (4927): No heartbeat from core client for 30 sec - exiting
16:42:13 (4927): No heartbeat from core client for 30 sec - exiting
16:42:14 (4927): No heartbeat from core client for 30 sec - exiting
16:42:15 (4927): No heartbeat from core client for 30 sec - exiting
16:42:16 (4927): No heartbeat from core client for 30 sec - exiting
16:42:17 (4927): No heartbeat from core client for 30 sec - exiting
16:42:18 (4927): No heartbeat from core client for 30 sec - exiting
16:42:19 (4927): No heartbeat from core client for 30 sec - exiting
16:42:20 (4927): No heartbeat from core client for 30 sec - exiting
16:42:21 (4927): No heartbeat from core client for 30 sec - exiting
16:42:22 (4927): No heartbeat from core client for 30 sec - exiting
16:42:23 (4927): No heartbeat from core client for 30 sec - exiting
16:42:24 (4927): No heartbeat from core client for 30 sec - exiting
16:42:25 (4927): No heartbeat from core client for 30 sec - exiting
16:48:19 (5035): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:50:59 (5142): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf77c5400]
[0xf77c5430]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75e21df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75e5825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75cd4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5256, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7768400]
[0xf7768430]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75851df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7588825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75704d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5256, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf778f400]
[0xf778f430]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75ac1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75af825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75974d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5256, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7742400]
[0xf7742430]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf755f1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7562825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf754a4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5256, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7728400]
[0xf7728430]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75451df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7548825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75304d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5256, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf76eb400]
[0xf76eb430]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75081df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf750b825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf74f34d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5256, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 May 2013 04:00:50 1281428 15772977 hadcm3n_48w9_1980_40_008363732_0 77,760 183,835 2.3641
12 May 2013 09:46:23 1281428 15772977 hadcm3n_48w9_1980_40_008363732_0 51,840 124,235 2.3965
11 May 2013 14:45:22 1281428 15772977 hadcm3n_48w9_1980_40_008363732_0 25,920 61,270 2.3638


©2024 cpdn.org