climateprediction.net home page
Task 15821961

Task 15821961

Name hadcm3n_o3iv_1980_40_008386395_0
Workunit 8537254
Created 3 Jun 2013, 6:25:02 UTC
Sent 8 Jun 2013, 14:36:15 UTC
Report deadline 7 Sep 2013, 22:03:26 UTC
Received 9 Jun 2013, 20:18:46 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1282401
Run time 1 days 1 hours 34 min 10 sec
CPU time 1 days 0 hours 47 min 47 sec
Validate state Invalid
Credit 311.04
Device peak FLOPS 2.00 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
16:20:20 (19932): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

Model crashed: CHK_LOOK: Consistency check                                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  2048    
16:24:25 (20100): No heartbeat from core client for 30 sec - exiting
16:24:33 (20100): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:29:21 (20288): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
17:18:47 (20437): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:23:13 (20989): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:27:16 (21158): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:41:25 (21341): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:45:26 (22042): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
18:54:19 (22207): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:58:29 (22401): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:58:30 (22401): No heartbeat from core client for 30 sec - exiting
18:58:31 (22401): No heartbeat from core client for 30 sec - exiting
18:58:32 (22401): No heartbeat from core client for 30 sec - exiting
18:58:33 (22401): No heartbeat from core client for 30 sec - exiting
18:58:34 (22401): No heartbeat from core client for 30 sec - exiting
18:58:35 (22401): No heartbeat from core client for 30 sec - exiting
18:58:36 (22401): No heartbeat from core client for 30 sec - exiting
21:36:18 (22561): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:40:42 (23991): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:40:43 (23991): No heartbeat from core client for 30 sec - exiting
21:40:44 (23991): No heartbeat from core client for 30 sec - exiting
21:40:45 (23991): No heartbeat from core client for 30 sec - exiting
21:40:46 (23991): No heartbeat from core client for 30 sec - exiting
21:40:47 (23991): No heartbeat from core client for 30 sec - exiting
21:40:48 (23991): No heartbeat from core client for 30 sec - exiting
21:40:49 (23991): No heartbeat from core client for 30 sec - exiting
21:40:50 (23991): No heartbeat from core client for 30 sec - exiting
21:40:51 (23991): No heartbeat from core client for 30 sec - exiting
21:40:52 (23991): No heartbeat from core client for 30 sec - exiting
21:40:53 (23991): No heartbeat from core client for 30 sec - exiting
21:40:54 (23991): No heartbeat from core client for 30 sec - exiting
21:40:55 (23991): No heartbeat from core client for 30 sec - exiting
21:40:56 (23991): No heartbeat from core client for 30 sec - exiting
21:40:57 (23991): No heartbeat from core client for 30 sec - exiting
21:40:58 (23991): No heartbeat from core client for 30 sec - exiting
21:40:59 (23991): No heartbeat from core client for 30 sec - exiting
21:41:00 (23991): No heartbeat from core client for 30 sec - exiting
21:41:01 (23991): No heartbeat from core client for 30 sec - exiting
21:41:02 (23991): No heartbeat from core client for 30 sec - exiting
21:41:03 (23991): No heartbeat from core client for 30 sec - exiting
21:41:04 (23991): No heartbeat from core client for 30 sec - exiting
21:41:05 (23991): No heartbeat from core client for 30 sec - exiting
21:41:06 (23991): No heartbeat from core client for 30 sec - exiting
21:41:07 (23991): No heartbeat from core client for 30 sec - exiting
21:41:08 (23991): No heartbeat from core client for 30 sec - exiting
21:45:05 (24159): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:45:06 (24159): No heartbeat from core client for 30 sec - exiting
21:45:07 (24159): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
21:57:11 (24327): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:31:06 (24548): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:06:04 (25457): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:21:05 (25857): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:24:52 (26549): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:28:43 (26670): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:28:44 (26670): No heartbeat from core client for 30 sec - exiting
01:32:22 (26824): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:32:23 (26824): No heartbeat from core client for 30 sec - exiting
01:32:24 (26824): No heartbeat from core client for 30 sec - exiting
01:32:25 (26824): No heartbeat from core client for 30 sec - exiting
01:32:26 (26824): No heartbeat from core client for 30 sec - exiting
01:32:27 (26824): No heartbeat from core client for 30 sec - exiting
01:37:44 (26997): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:45:28 (27189): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:45:29 (27189): No heartbeat from core client for 30 sec - exiting
01:45:30 (27189): No heartbeat from core client for 30 sec - exiting
01:45:31 (27189): No heartbeat from core client for 30 sec - exiting
01:45:32 (27189): No heartbeat from core client for 30 sec - exiting
01:45:33 (27189): No heartbeat from core client for 30 sec - exiting
01:45:34 (27189): No heartbeat from core client for 30 sec - exiting
01:45:35 (27189): No heartbeat from core client for 30 sec - exiting
01:45:36 (27189): No heartbeat from core client for 30 sec - exiting
01:45:37 (27189): No heartbeat from core client for 30 sec - exiting
01:45:38 (27189): No heartbeat from core client for 30 sec - exiting
01:45:39 (27189): No heartbeat from core client for 30 sec - exiting
01:45:40 (27189): No heartbeat from core client for 30 sec - exiting
01:49:44 (27381): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:53:15 (27552): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:57:46 (27691): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:50:51 (27853): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:55:20 (34197): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:59:40 (34355): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:36:04 (34524): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:40:17 (35438): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:40:18 (35438): No heartbeat from core client for 30 sec - exiting
15:40:19 (35438): No heartbeat from core client for 30 sec - exiting
15:40:20 (35438): No heartbeat from core client for 30 sec - exiting
15:40:21 (35438): No heartbeat from core client for 30 sec - exiting
15:40:22 (35438): No heartbeat from core client for 30 sec - exiting
15:40:23 (35438): No heartbeat from core client for 30 sec - exiting
15:40:24 (35438): No heartbeat from core client for 30 sec - exiting
15:40:25 (35438): No heartbeat from core client for 30 sec - exiting
15:40:26 (35438): No heartbeat from core client for 30 sec - exiting
15:40:27 (35438): No heartbeat from core client for 30 sec - exiting
15:40:28 (35438): No heartbeat from core client for 30 sec - exiting
15:49:04 (35596): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:49:05 (35596): No heartbeat from core client for 30 sec - exiting
15:49:06 (35596): No heartbeat from core client for 30 sec - exiting
15:49:07 (35596): No heartbeat from core client for 30 sec - exiting
15:53:16 (35783): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:53:17 (35783): No heartbeat from core client for 30 sec - exiting
15:53:18 (35783): No heartbeat from core client for 30 sec - exiting
15:53:19 (35783): No heartbeat from core client for 30 sec - exiting
15:53:20 (35783): No heartbeat from core client for 30 sec - exiting
15:53:21 (35783): No heartbeat from core client for 30 sec - exiting
15:53:22 (35783): No heartbeat from core client for 30 sec - exiting
15:53:23 (35783): No heartbeat from core client for 30 sec - exiting
15:53:24 (35783): No heartbeat from core client for 30 sec - exiting
15:53:25 (35783): No heartbeat from core client for 30 sec - exiting
15:53:26 (35783): No heartbeat from core client for 30 sec - exiting
15:53:27 (35783): No heartbeat from core client for 30 sec - exiting
15:53:28 (35783): No heartbeat from core client for 30 sec - exiting
15:53:29 (35783): No heartbeat from core client for 30 sec - exiting
15:53:30 (35783): No heartbeat from core client for 30 sec - exiting
15:57:07 (35919): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:57:08 (35919): No heartbeat from core client for 30 sec - exiting
15:57:09 (35919): No heartbeat from core client for 30 sec - exiting
15:57:10 (35919): No heartbeat from core client for 30 sec - exiting
15:57:11 (35919): No heartbeat from core client for 30 sec - exiting
15:57:12 (35919): No heartbeat from core client for 30 sec - exiting
15:57:13 (35919): No heartbeat from core client for 30 sec - exiting
15:57:14 (35919): No heartbeat from core client for 30 sec - exiting
15:57:15 (35919): No heartbeat from core client for 30 sec - exiting
15:57:16 (35919): No heartbeat from core client for 30 sec - exiting
15:57:17 (35919): No heartbeat from core client for 30 sec - exiting
15:57:18 (35919): No heartbeat from core client for 30 sec - exiting
15:57:19 (35919): No heartbeat from core client for 30 sec - exiting
15:57:20 (35919): No heartbeat from core client for 30 sec - exiting
15:57:21 (35919): No heartbeat from core client for 30 sec - exiting
15:57:22 (35919): No heartbeat from core client for 30 sec - exiting
16:01:27 (36067): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:46:58 (36202): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:50:48 (36702): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:55:00 (36849): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:53:26 (37004): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:05:51 (39106): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:10:10 (39328): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:10:11 (39328): No heartbeat from core client for 30 sec - exiting
21:10:12 (39328): No heartbeat from core client for 30 sec - exiting
21:10:13 (39328): No heartbeat from core client for 30 sec - exiting
21:10:14 (39328): No heartbeat from core client for 30 sec - exiting
21:10:15 (39328): No heartbeat from core client for 30 sec - exiting
21:10:16 (39328): No heartbeat from core client for 30 sec - exiting
21:10:17 (39328): No heartbeat from core client for 30 sec - exiting
21:10:18 (39328): No heartbeat from core client for 30 sec - exiting
21:10:19 (39328): No heartbeat from core client for 30 sec - exiting
21:10:20 (39328): No heartbeat from core client for 30 sec - exiting
21:10:21 (39328): No heartbeat from core client for 30 sec - exiting
21:10:22 (39328): No heartbeat from core client for 30 sec - exiting
21:10:23 (39328): No heartbeat from core client for 30 sec - exiting
21:10:24 (39328): No heartbeat from core client for 30 sec - exiting
21:10:25 (39328): No heartbeat from core client for 30 sec - exiting
21:10:26 (39328): No heartbeat from core client for 30 sec - exiting
21:10:27 (39328): No heartbeat from core client for 30 sec - exiting
21:14:32 (39480): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:14:33 (39480): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7764400]
[0xf7764425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75811df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7584825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf756c4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=39632, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf76df400]
[0xf76df425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf74fc1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf74ff825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf74e74d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=39632, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7720400]
[0xf7720425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf753d1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7540825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75284d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=39632, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7707400]
[0xf7707425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75241df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7527825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf750f4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=39632, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf76e4400]
[0xf76e4425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75011df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7504825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf74ec4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=39632, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf76e2400]
[0xf76e2425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf74ff1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7502825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf74ea4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=39632, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Jun 2013 11:40:48 1282401 15821961 hadcm3n_o3iv_1980_40_008386395_0 25,920 63,389 2.4456


©2024 climateprediction.net