climateprediction.net home page
Task 15823208

Task 15823208

Name hadcm3n_o00i_1980_40_008387386_0
Workunit 8538245
Created 3 Jun 2013, 9:46:10 UTC
Sent 7 Jun 2013, 14:48:37 UTC
Report deadline 6 Sep 2013, 22:15:48 UTC
Received 9 Jun 2013, 3:35:19 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1282401
Run time 1 days 6 hours 3 min 53 sec
CPU time 1 days 5 hours 22 min 58 sec
Validate state Invalid
Credit 311.04
Device peak FLOPS 2.00 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
16:51:35 (3248): No heartbeat from core client for 30 sec - exiting
16:51:36 (3248): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:56:28 (3691): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:01:17 (5465): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:06:34 (5678): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:11:20 (5885): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:16:18 (6102): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:20:12 (6267): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:24:17 (6395): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:13:37 (6577): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:18:38 (7134): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:18:39 (7134): No heartbeat from core client for 30 sec - exiting
21:18:40 (7134): No heartbeat from core client for 30 sec - exiting
21:18:41 (7134): No heartbeat from core client for 30 sec - exiting
22:01:14 (7345): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:05:13 (7868): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:13:14 (8034): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:17:00 (13902): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:17:01 (13902): No heartbeat from core client for 30 sec - exiting
08:17:02 (13902): No heartbeat from core client for 30 sec - exiting
08:43:35 (14093): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:48:13 (14456): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:51:59 (14647): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:52:00 (14647): No heartbeat from core client for 30 sec - exiting
08:52:01 (14647): No heartbeat from core client for 30 sec - exiting
08:52:02 (14647): No heartbeat from core client for 30 sec - exiting
08:52:03 (14647): No heartbeat from core client for 30 sec - exiting
08:52:04 (14647): No heartbeat from core client for 30 sec - exiting
08:52:05 (14647): No heartbeat from core client for 30 sec - exiting
08:52:06 (14647): No heartbeat from core client for 30 sec - exiting
08:52:07 (14647): No heartbeat from core client for 30 sec - exiting
08:52:08 (14647): No heartbeat from core client for 30 sec - exiting
08:52:09 (14647): No heartbeat from core client for 30 sec - exiting
08:52:10 (14647): No heartbeat from core client for 30 sec - exiting
08:52:11 (14647): No heartbeat from core client for 30 sec - exiting
08:52:12 (14647): No heartbeat from core client for 30 sec - exiting
08:52:13 (14647): No heartbeat from core client for 30 sec - exiting
08:52:14 (14647): No heartbeat from core client for 30 sec - exiting
09:43:32 (14831): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:48:14 (15411): No heartbeat from core client for 30 sec - exiting
09:48:15 (15411): No heartbeat from core client for 30 sec - exiting
09:48:16 (15411): No heartbeat from core client for 30 sec - exiting
09:48:17 (15411): No heartbeat from core client for 30 sec - exiting
09:48:18 (15411): No heartbeat from core client for 30 sec - exiting
09:48:19 (15411): No heartbeat from core client for 30 sec - exiting
09:48:20 (15411): No heartbeat from core client for 30 sec - exiting
09:48:21 (15411): No heartbeat from core client for 30 sec - exiting
09:48:22 (15411): No heartbeat from core client for 30 sec - exiting
09:48:23 (15411): No heartbeat from core client for 30 sec - exiting
09:48:24 (15411): No heartbeat from core client for 30 sec - exiting
09:48:25 (15411): No heartbeat from core client for 30 sec - exiting
09:48:26 (15411): No heartbeat from core client for 30 sec - exiting
09:48:27 (15411): No heartbeat from core client for 30 sec - exiting
09:48:28 (15411): No heartbeat from core client for 30 sec - exiting
09:48:29 (15411): No heartbeat from core client for 30 sec - exiting
09:48:30 (15411): No heartbeat from core client for 30 sec - exiting
09:48:31 (15411): No heartbeat from core client for 30 sec - exiting
09:48:32 (15411): No heartbeat from core client for 30 sec - exiting
09:48:33 (15411): No heartbeat from core client for 30 sec - exiting
09:48:34 (15411): No heartbeat from core client for 30 sec - exiting
09:48:35 (15411): No heartbeat from core client for 30 sec - exiting
09:48:36 (15411): No heartbeat from core client for 30 sec - exiting
09:48:37 (15411): No heartbeat from core client for 30 sec - exiting
09:48:38 (15411): No heartbeat from core client for 30 sec - exiting
09:48:39 (15411): No heartbeat from core client for 30 sec - exiting
09:48:40 (15411): No heartbeat from core client for 30 sec - exiting
09:48:41 (15411): No heartbeat from core client for 30 sec - exiting
09:48:42 (15411): No heartbeat from core client for 30 sec - exiting
09:48:43 (15411): No heartbeat from core client for 30 sec - exiting
09:48:44 (15411): No heartbeat from core client for 30 sec - exiting
09:48:45 (15411): No heartbeat from core client for 30 sec - exiting
09:48:46 (15411): No heartbeat from core client for 30 sec - exiting
09:48:47 (15411): No heartbeat from core client for 30 sec - exiting
09:48:48 (15411): No heartbeat from core client for 30 sec - exiting
09:48:49 (15411): No heartbeat from core client for 30 sec - exiting
09:48:50 (15411): No heartbeat from core client for 30 sec - exiting
09:48:51 (15411): No heartbeat from core client for 30 sec - exiting
09:48:52 (15411): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:52:58 (15612): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:52:59 (15612): No heartbeat from core client for 30 sec - exiting
09:53:00 (15612): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
15:03:41 (15816): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:08:06 (18847): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:13:02 (19029): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:20:20 (19214): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:24:25 (19974): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:24:26 (19974): No heartbeat from core client for 30 sec - exiting
16:24:27 (19974): No heartbeat from core client for 30 sec - exiting
16:24:28 (19974): No heartbeat from core client for 30 sec - exiting
16:29:21 (20146): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:18:47 (20318): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:23:13 (20873): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:27:16 (21033): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:41:24 (21199): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:45:26 (21993): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:54:18 (22153): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:58:29 (22351): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:58:30 (22351): No heartbeat from core client for 30 sec - exiting
21:36:17 (22503): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:40:42 (23940): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:40:43 (23940): No heartbeat from core client for 30 sec - exiting
21:40:44 (23940): No heartbeat from core client for 30 sec - exiting
21:40:45 (23940): No heartbeat from core client for 30 sec - exiting
21:40:46 (23940): No heartbeat from core client for 30 sec - exiting
21:40:47 (23940): No heartbeat from core client for 30 sec - exiting
21:40:48 (23940): No heartbeat from core client for 30 sec - exiting
21:40:49 (23940): No heartbeat from core client for 30 sec - exiting
21:40:50 (23940): No heartbeat from core client for 30 sec - exiting
21:40:51 (23940): No heartbeat from core client for 30 sec - exiting
21:40:52 (23940): No heartbeat from core client for 30 sec - exiting
21:40:53 (23940): No heartbeat from core client for 30 sec - exiting
21:40:54 (23940): No heartbeat from core client for 30 sec - exiting
21:40:55 (23940): No heartbeat from core client for 30 sec - exiting
21:40:56 (23940): No heartbeat from core client for 30 sec - exiting
21:40:57 (23940): No heartbeat from core client for 30 sec - exiting
21:40:58 (23940): No heartbeat from core client for 30 sec - exiting
21:40:59 (23940): No heartbeat from core client for 30 sec - exiting
21:41:00 (23940): No heartbeat from core client for 30 sec - exiting
21:41:01 (23940): No heartbeat from core client for 30 sec - exiting
21:41:02 (23940): No heartbeat from core client for 30 sec - exiting
21:41:03 (23940): No heartbeat from core client for 30 sec - exiting
21:41:04 (23940): No heartbeat from core client for 30 sec - exiting
21:41:05 (23940): No heartbeat from core client for 30 sec - exiting
21:41:06 (23940): No heartbeat from core client for 30 sec - exiting
21:41:07 (23940): No heartbeat from core client for 30 sec - exiting
21:41:08 (23940): No heartbeat from core client for 30 sec - exiting
21:45:05 (24094): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:45:06 (24094): No heartbeat from core client for 30 sec - exiting
21:45:07 (24094): No heartbeat from core client for 30 sec - exiting
21:57:11 (24283): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:31:05 (24501): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:06:04 (25419): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:24:52 (25824): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:28:43 (26609): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:28:44 (26609): No heartbeat from core client for 30 sec - exiting
01:28:45 (26609): No heartbeat from core client for 30 sec - exiting
01:32:22 (26763): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:32:59 (26763): No heartbeat from core client for 30 sec - exiting
01:37:43 (26923): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:37:44 (26923): No heartbeat from core client for 30 sec - exiting
01:37:45 (26923): No heartbeat from core client for 30 sec - exiting
01:37:46 (26923): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf76e5400]
[0xf76e5425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75021df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7505825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf74ed4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27098, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf774e400]
[0xf774e425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf756b1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf756e825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75564d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27098, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7715400]
[0xf7715425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75321df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7535825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf751d4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27098, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf777b400]
[0xf777b425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75981df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf759b825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75834d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27098, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf772d400]
[0xf772d425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf754a1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf754d825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75354d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27098, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf77d6400]
[0xf77d6425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75f31df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75f6825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75de4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27098, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2013 12:09:59 1282401 15823208 hadcm3n_o00i_1980_40_008387386_0 25,920 65,170 2.5143


©2024 climateprediction.net