climateprediction.net home page
Task 15833676

Task 15833676

Name hadcm3n_o4ol_1980_40_008388566_1
Workunit 8539425
Created 7 Jun 2013, 2:57:11 UTC
Sent 7 Jun 2013, 3:19:19 UTC
Report deadline 6 Sep 2013, 10:46:30 UTC
Received 8 Jun 2013, 21:28:02 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1282401
Run time 1 days 10 hours 18 min 23 sec
CPU time 1 days 9 hours 38 min 8 sec
Validate state Invalid
Credit 311.04
Device peak FLOPS 1.99 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
05:59:36 (43808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:56:02 (44726): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:59:42 (48197): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
15:46:57 (2769): No heartbeat from core client for 30 sec - exiting
15:47:27 (2769): No heartbeat from core client for 30 sec - exiting
15:47:28 (2769): No heartbeat from core client for 30 sec - exiting
15:47:29 (2769): No heartbeat from core client for 30 sec - exiting
15:47:30 (2769): No heartbeat from core client for 30 sec - exiting
15:47:31 (2769): No heartbeat from core client for 30 sec - exiting
15:47:33 (2769): No heartbeat from core client for 30 sec - exiting
15:47:34 (2769): No heartbeat from core client for 30 sec - exiting
15:47:35 (2769): No heartbeat from core client for 30 sec - exiting
15:47:36 (2769): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:56:28 (3056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:01:16 (5435): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:01:17 (5435): No heartbeat from core client for 30 sec - exiting
20:06:33 (5648): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:11:20 (5858): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:20:12 (6075): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:24:17 (6335): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:24:18 (6335): No heartbeat from core client for 30 sec - exiting
20:24:19 (6335): No heartbeat from core client for 30 sec - exiting
20:24:20 (6335): No heartbeat from core client for 30 sec - exiting
20:24:21 (6335): No heartbeat from core client for 30 sec - exiting
20:24:22 (6335): No heartbeat from core client for 30 sec - exiting
20:24:23 (6335): No heartbeat from core client for 30 sec - exiting
20:24:24 (6335): No heartbeat from core client for 30 sec - exiting
21:13:37 (6512): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:18:39 (7084): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:01:14 (7295): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:05:13 (7822): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:13:14 (7994): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:16:59 (13865): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:17:00 (13865): No heartbeat from core client for 30 sec - exiting
08:17:01 (13865): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
08:43:36 (14054): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:48:12 (14420): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:48:13 (14420): No heartbeat from core client for 30 sec - exiting
08:51:59 (14610): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:52:00 (14610): No heartbeat from core client for 30 sec - exiting
08:52:01 (14610): No heartbeat from core client for 30 sec - exiting
08:52:02 (14610): No heartbeat from core client for 30 sec - exiting
08:52:03 (14610): No heartbeat from core client for 30 sec - exiting
08:52:04 (14610): No heartbeat from core client for 30 sec - exiting
08:52:05 (14610): No heartbeat from core client for 30 sec - exiting
08:52:06 (14610): No heartbeat from core client for 30 sec - exiting
08:52:07 (14610): No heartbeat from core client for 30 sec - exiting
08:52:08 (14610): No heartbeat from core client for 30 sec - exiting
08:52:09 (14610): No heartbeat from core client for 30 sec - exiting
08:52:10 (14610): No heartbeat from core client for 30 sec - exiting
08:52:11 (14610): No heartbeat from core client for 30 sec - exiting
08:52:12 (14610): No heartbeat from core client for 30 sec - exiting
08:52:13 (14610): No heartbeat from core client for 30 sec - exiting
08:52:14 (14610): No heartbeat from core client for 30 sec - exiting
09:43:32 (14793): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:48:14 (15372): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:52:58 (15569): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:59:37 (15777): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:03:42 (18705): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:08:06 (18881): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:13:02 (19057): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:20:19 (19241): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:24:25 (19985): No heartbeat from core client for 30 sec - exiting
16:24:26 (19985): No heartbeat from core client for 30 sec - exiting
16:24:27 (19985): No heartbeat from core client for 30 sec - exiting
16:24:28 (19985): No heartbeat from core client for 30 sec - exiting
16:24:29 (19985): No heartbeat from core client for 30 sec - exiting
16:24:30 (19985): No heartbeat from core client for 30 sec - exiting
16:24:31 (19985): No heartbeat from core client for 30 sec - exiting
16:24:32 (19985): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:29:21 (20155): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:18:46 (20324): No heartbeat from core client for 30 sec - exiting
17:18:47 (20324): No heartbeat from core client for 30 sec - exiting
17:18:48 (20324): No heartbeat from core client for 30 sec - exiting
17:18:49 (20324): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:23:13 (20884): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:27:16 (21041): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:27:17 (21041): No heartbeat from core client for 30 sec - exiting
17:27:18 (21041): No heartbeat from core client for 30 sec - exiting
17:27:19 (21041): No heartbeat from core client for 30 sec - exiting
17:27:20 (21041): No heartbeat from core client for 30 sec - exiting
17:27:21 (21041): No heartbeat from core client for 30 sec - exiting
17:27:22 (21041): No heartbeat from core client for 30 sec - exiting
17:27:23 (21041): No heartbeat from core client for 30 sec - exiting
17:27:24 (21041): No heartbeat from core client for 30 sec - exiting
17:27:25 (21041): No heartbeat from core client for 30 sec - exiting
17:27:26 (21041): No heartbeat from core client for 30 sec - exiting
17:27:27 (21041): No heartbeat from core client for 30 sec - exiting
17:27:28 (21041): No heartbeat from core client for 30 sec - exiting
17:27:29 (21041): No heartbeat from core client for 30 sec - exiting
17:27:30 (21041): No heartbeat from core client for 30 sec - exiting
17:27:31 (21041): No heartbeat from core client for 30 sec - exiting
17:27:32 (21041): No heartbeat from core client for 30 sec - exiting
17:27:33 (21041): No heartbeat from core client for 30 sec - exiting
17:27:34 (21041): No heartbeat from core client for 30 sec - exiting
17:27:35 (21041): No heartbeat from core client for 30 sec - exiting
17:27:36 (21041): No heartbeat from core client for 30 sec - exiting
17:27:37 (21041): No heartbeat from core client for 30 sec - exiting
18:41:24 (21212): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:45:25 (21998): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:45:26 (21998): No heartbeat from core client for 30 sec - exiting
18:45:27 (21998): No heartbeat from core client for 30 sec - exiting
18:45:28 (21998): No heartbeat from core client for 30 sec - exiting
18:45:29 (21998): No heartbeat from core client for 30 sec - exiting
18:45:30 (21998): No heartbeat from core client for 30 sec - exiting
18:45:31 (21998): No heartbeat from core client for 30 sec - exiting
18:45:32 (21998): No heartbeat from core client for 30 sec - exiting
18:45:33 (21998): No heartbeat from core client for 30 sec - exiting
18:45:34 (21998): No heartbeat from core client for 30 sec - exiting
18:45:35 (21998): No heartbeat from core client for 30 sec - exiting
18:45:36 (21998): No heartbeat from core client for 30 sec - exiting
18:45:37 (21998): No heartbeat from core client for 30 sec - exiting
18:45:38 (21998): No heartbeat from core client for 30 sec - exiting
18:45:39 (21998): No heartbeat from core client for 30 sec - exiting
18:54:18 (22158): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:58:29 (22356): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:58:30 (22356): No heartbeat from core client for 30 sec - exiting
18:58:31 (22356): No heartbeat from core client for 30 sec - exiting
18:58:32 (22356): No heartbeat from core client for 30 sec - exiting
18:58:33 (22356): No heartbeat from core client for 30 sec - exiting
18:58:34 (22356): No heartbeat from core client for 30 sec - exiting
18:58:35 (22356): No heartbeat from core client for 30 sec - exiting
18:58:36 (22356): No heartbeat from core client for 30 sec - exiting
21:36:18 (22507): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:40:42 (23944): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:40:43 (23944): No heartbeat from core client for 30 sec - exiting
21:40:44 (23944): No heartbeat from core client for 30 sec - exiting
21:40:45 (23944): No heartbeat from core client for 30 sec - exiting
21:40:46 (23944): No heartbeat from core client for 30 sec - exiting
21:40:47 (23944): No heartbeat from core client for 30 sec - exiting
21:40:48 (23944): No heartbeat from core client for 30 sec - exiting
21:40:49 (23944): No heartbeat from core client for 30 sec - exiting
21:40:50 (23944): No heartbeat from core client for 30 sec - exiting
21:40:51 (23944): No heartbeat from core client for 30 sec - exiting
21:40:52 (23944): No heartbeat from core client for 30 sec - exiting
21:40:53 (23944): No heartbeat from core client for 30 sec - exiting
21:40:54 (23944): No heartbeat from core client for 30 sec - exiting
21:40:55 (23944): No heartbeat from core client for 30 sec - exiting
21:40:56 (23944): No heartbeat from core client for 30 sec - exiting
21:40:57 (23944): No heartbeat from core client for 30 sec - exiting
21:40:58 (23944): No heartbeat from core client for 30 sec - exiting
21:40:59 (23944): No heartbeat from core client for 30 sec - exiting
21:41:00 (23944): No heartbeat from core client for 30 sec - exiting
21:41:01 (23944): No heartbeat from core client for 30 sec - exiting
21:41:02 (23944): No heartbeat from core client for 30 sec - exiting
21:41:03 (23944): No heartbeat from core client for 30 sec - exiting
21:41:04 (23944): No heartbeat from core client for 30 sec - exiting
21:41:05 (23944): No heartbeat from core client for 30 sec - exiting
21:41:06 (23944): No heartbeat from core client for 30 sec - exiting
21:41:07 (23944): No heartbeat from core client for 30 sec - exiting
21:41:08 (23944): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7781400]
[0xf7781425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf759e1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75a1825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75894d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=24099, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf778e400]
[0xf778e425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75ab1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75ae825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75964d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=24099, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7770400]
[0xf7770425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf758d1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7590825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75784d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=24099, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf772b400]
[0xf772b425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75481df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf754b825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75334d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=24099, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7720400]
[0xf7720425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf753d1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7540825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75284d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=24099, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf76e3400]
[0xf76e3425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75001df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7503825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf74eb4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=24099, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2013 02:46:05 1282401 15833676 hadcm3n_o4ol_1980_40_008388566_1 25,920 64,715 2.4967


©2024 climateprediction.net