climateprediction.net home page
Task 15820325

Task 15820325

Name hadcm3n_3mok_1980_40_008367819_3
Workunit 8518678
Created 3 Jun 2013, 2:08:39 UTC
Sent 3 Jun 2013, 2:51:05 UTC
Report deadline 2 Sep 2013, 10:18:16 UTC
Received 4 Jun 2013, 11:59:34 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1282401
Run time 1 days 3 hours 16 min 12 sec
CPU time 1 days 2 hours 57 min 16 sec
Validate state Invalid
Credit 311.04
Device peak FLOPS 1.99 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
11:59:53 (41891): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:04:17 (46422): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:09:02 (46621): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:13:45 (46796): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:13:46 (46796): No heartbeat from core client for 30 sec - exiting
12:13:47 (46796): No heartbeat from core client for 30 sec - exiting
12:13:48 (46796): No heartbeat from core client for 30 sec - exiting
12:13:49 (46796): No heartbeat from core client for 30 sec - exiting
12:13:50 (46796): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
13:45:45 (46983): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:55:22 (47920): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:45:06 (48170): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:45:07 (48170): No heartbeat from core client for 30 sec - exiting
16:45:08 (48170): No heartbeat from core client for 30 sec - exiting
16:45:09 (48170): No heartbeat from core client for 30 sec - exiting
16:45:10 (48170): No heartbeat from core client for 30 sec - exiting
16:45:11 (48170): No heartbeat from core client for 30 sec - exiting
16:45:12 (48170): No heartbeat from core client for 30 sec - exiting
16:45:13 (48170): No heartbeat from core client for 30 sec - exiting
16:49:30 (49785): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:53:24 (49956): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:56:51 (50094): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:01:30 (50789): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:05:45 (50931): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:05:46 (50931): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
21:57:37 (51123): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:01:54 (53344): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:01:55 (53344): No heartbeat from core client for 30 sec - exiting
22:01:56 (53344): No heartbeat from core client for 30 sec - exiting
22:01:57 (53344): No heartbeat from core client for 30 sec - exiting
22:01:58 (53344): No heartbeat from core client for 30 sec - exiting
22:01:59 (53344): No heartbeat from core client for 30 sec - exiting
22:02:00 (53344): No heartbeat from core client for 30 sec - exiting
22:02:01 (53344): No heartbeat from core client for 30 sec - exiting
22:02:02 (53344): No heartbeat from core client for 30 sec - exiting
22:02:03 (53344): No heartbeat from core client for 30 sec - exiting
22:02:04 (53344): No heartbeat from core client for 30 sec - exiting
22:02:05 (53344): No heartbeat from core client for 30 sec - exiting
22:07:18 (53503): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:35:28 (53630): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:39:44 (54097): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:39:45 (54097): No heartbeat from core client for 30 sec - exiting
22:39:46 (54097): No heartbeat from core client for 30 sec - exiting
22:39:47 (54097): No heartbeat from core client for 30 sec - exiting
22:39:48 (54097): No heartbeat from core client for 30 sec - exiting
22:39:49 (54097): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
22:44:14 (54273): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:10:39 (54420): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:15:09 (56353): No heartbeat from core client for 30 sec - exiting
02:15:10 (56353): No heartbeat from core client for 30 sec - exiting
02:15:11 (56353): No heartbeat from core client for 30 sec - exiting
02:15:12 (56353): No heartbeat from core client for 30 sec - exiting
02:15:13 (56353): No heartbeat from core client for 30 sec - exiting
02:15:14 (56353): No heartbeat from core client for 30 sec - exiting
02:15:15 (56353): No heartbeat from core client for 30 sec - exiting
02:15:16 (56353): No heartbeat from core client for 30 sec - exiting
02:15:17 (56353): No heartbeat from core client for 30 sec - exiting
02:15:18 (56353): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:19:33 (56452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:24:16 (56630): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:24:17 (56630): No heartbeat from core client for 30 sec - exiting
02:24:18 (56630): No heartbeat from core client for 30 sec - exiting
02:24:19 (56630): No heartbeat from core client for 30 sec - exiting
02:24:20 (56630): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
03:34:49 (56800): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:38:57 (57541): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:38:58 (57541): No heartbeat from core client for 30 sec - exiting
03:38:59 (57541): No heartbeat from core client for 30 sec - exiting
03:39:00 (57541): No heartbeat from core client for 30 sec - exiting
03:39:01 (57541): No heartbeat from core client for 30 sec - exiting
03:39:02 (57541): No heartbeat from core client for 30 sec - exiting
04:01:36 (57701): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:06:28 (58015): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:06:29 (58015): No heartbeat from core client for 30 sec - exiting
04:06:30 (58015): No heartbeat from core client for 30 sec - exiting
04:11:23 (58187): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:11:24 (58187): No heartbeat from core client for 30 sec - exiting
05:59:45 (58367): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:14:35 (59474): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:19:16 (60270): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:19:17 (60270): No heartbeat from core client for 30 sec - exiting
07:19:18 (60270): No heartbeat from core client for 30 sec - exiting
07:19:19 (60270): No heartbeat from core client for 30 sec - exiting
07:19:20 (60270): No heartbeat from core client for 30 sec - exiting
07:19:21 (60270): No heartbeat from core client for 30 sec - exiting
07:19:22 (60270): No heartbeat from core client for 30 sec - exiting
07:19:23 (60270): No heartbeat from core client for 30 sec - exiting
07:19:24 (60270): No heartbeat from core client for 30 sec - exiting
07:19:25 (60270): No heartbeat from core client for 30 sec - exiting
07:19:26 (60270): No heartbeat from core client for 30 sec - exiting
07:19:27 (60270): No heartbeat from core client for 30 sec - exiting
07:23:24 (60433): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:23:26 (60433): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
07:40:52 (60600): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:05:05 (60918): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:07:13 (61446): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
11:11:41 (63114): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:11:42 (63114): No heartbeat from core client for 30 sec - exiting
11:11:43 (63114): No heartbeat from core client for 30 sec - exiting
11:11:44 (63114): No heartbeat from core client for 30 sec - exiting
11:11:45 (63114): No heartbeat from core client for 30 sec - exiting
11:11:46 (63114): No heartbeat from core client for 30 sec - exiting
11:11:47 (63114): No heartbeat from core client for 30 sec - exiting
11:11:48 (63114): No heartbeat from core client for 30 sec - exiting
11:11:49 (63114): No heartbeat from core client for 30 sec - exiting
11:15:47 (63277): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:11:17 (63433): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:11:18 (63433): No heartbeat from core client for 30 sec - exiting
12:11:19 (63433): No heartbeat from core client for 30 sec - exiting
12:11:20 (63433): No heartbeat from core client for 30 sec - exiting
12:11:21 (63433): No heartbeat from core client for 30 sec - exiting
12:11:22 (63433): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7740400]
[0xf7740425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf755d1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7560825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75484d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=64021, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf76f9400]
[0xf76f9425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75161df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7519825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75014d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=64021, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7713400]
[0xf7713425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75301df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7533825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf751b4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=64021, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf770d400]
[0xf770d425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf752a1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf752d825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75154d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=64021, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7771400]
[0xf7771425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf758e1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7591825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75794d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=64021, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf778e400]
[0xf778e425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75ab1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75ae825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75964d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=64021, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
04 Jun 2013 00:29:56 1282401 15820325 hadcm3n_3mok_1980_40_008367819_3 25,920 65,759 2.5370


©2024 climateprediction.net