climateprediction.net home page
Task 15806076

Task 15806076

Name hadcm3n_3jp8_1980_40_008366006_2
Workunit 8516865
Created 30 May 2013, 5:04:26 UTC
Sent 31 May 2013, 13:38:24 UTC
Report deadline 30 Aug 2013, 21:05:35 UTC
Received 1 Jun 2013, 19:21:13 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1282401
Run time 1 days 0 hours 26 min 4 sec
CPU time 23 hours 46 min 39 sec
Validate state Invalid
Credit 311.04
Device peak FLOPS 1.99 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
15:37:05 (62835): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:16:06 (63450): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:20:28 (64400): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:20:29 (64400): No heartbeat from core client for 30 sec - exiting
17:20:30 (64400): No heartbeat from core client for 30 sec - exiting
17:20:31 (64400): No heartbeat from core client for 30 sec - exiting
17:20:32 (64400): No heartbeat from core client for 30 sec - exiting
17:20:33 (64400): No heartbeat from core client for 30 sec - exiting
17:20:34 (64400): No heartbeat from core client for 30 sec - exiting
17:20:35 (64400): No heartbeat from core client for 30 sec - exiting
17:20:36 (64400): No heartbeat from core client for 30 sec - exiting
17:24:54 (64583): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
20:04:59 (64738): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:05:00 (64738): No heartbeat from core client for 30 sec - exiting
20:05:01 (64738): No heartbeat from core client for 30 sec - exiting
20:09:33 (1027): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:14:05 (1207): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:14:06 (1207): No heartbeat from core client for 30 sec - exiting
20:14:07 (1207): No heartbeat from core client for 30 sec - exiting
20:14:08 (1207): No heartbeat from core client for 30 sec - exiting
20:14:09 (1207): No heartbeat from core client for 30 sec - exiting
20:14:10 (1207): No heartbeat from core client for 30 sec - exiting
20:14:11 (1207): No heartbeat from core client for 30 sec - exiting
20:14:12 (1207): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
20:31:18 (1393): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:35:21 (1684): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:35:22 (1684): No heartbeat from core client for 30 sec - exiting
20:35:23 (1684): No heartbeat from core client for 30 sec - exiting
20:35:24 (1684): No heartbeat from core client for 30 sec - exiting
20:35:25 (1684): No heartbeat from core client for 30 sec - exiting
20:35:26 (1684): No heartbeat from core client for 30 sec - exiting
20:35:27 (1684): No heartbeat from core client for 30 sec - exiting
20:35:28 (1684): No heartbeat from core client for 30 sec - exiting
20:35:29 (1684): No heartbeat from core client for 30 sec - exiting
20:35:30 (1684): No heartbeat from core client for 30 sec - exiting
20:35:31 (1684): No heartbeat from core client for 30 sec - exiting
20:35:32 (1684): No heartbeat from core client for 30 sec - exiting
20:35:33 (1684): No heartbeat from core client for 30 sec - exiting
20:35:34 (1684): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
21:10:08 (1859): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:12:56 (2380): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:23:39 (3167): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:23:40 (3167): No heartbeat from core client for 30 sec - exiting
00:23:41 (3167): No heartbeat from core client for 30 sec - exiting
00:23:42 (3167): No heartbeat from core client for 30 sec - exiting
00:23:43 (3167): No heartbeat from core client for 30 sec - exiting
01:21:05 (4397): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:11:47 (5031): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:20:50 (6133): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:24:54 (6331): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:12:08 (6438): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:16:07 (7492): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:16:08 (7492): No heartbeat from core client for 30 sec - exiting
05:16:09 (7492): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
05:41:04 (7662): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:45:28 (7976): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:50:24 (8137): No heartbeat from core client for 30 sec - exiting
05:50:25 (8137): No heartbeat from core client for 30 sec - exiting
05:50:26 (8137): No heartbeat from core client for 30 sec - exiting
05:50:27 (8137): No heartbeat from core client for 30 sec - exiting
05:50:28 (8137): No heartbeat from core client for 30 sec - exiting
05:50:29 (8137): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:41:53 (8304): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:45:18 (11261): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:45:19 (11261): No heartbeat from core client for 30 sec - exiting
10:45:20 (11261): No heartbeat from core client for 30 sec - exiting
11:42:23 (11382): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:46:56 (11995): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:47:06 (11995): No heartbeat from core client for 30 sec - exiting
12:20:14 (12157): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:24:45 (12530): No heartbeat from core client for 30 sec - exiting
12:24:46 (12530): No heartbeat from core client for 30 sec - exiting
12:24:47 (12530): No heartbeat from core client for 30 sec - exiting
12:24:48 (12530): No heartbeat from core client for 30 sec - exiting
12:24:49 (12530): No heartbeat from core client for 30 sec - exiting
12:24:50 (12530): No heartbeat from core client for 30 sec - exiting
12:24:51 (12530): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:30:01 (12690): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:38:45 (12833): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:47:30 (13025): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:47:31 (13025): No heartbeat from core client for 30 sec - exiting
12:47:32 (13025): No heartbeat from core client for 30 sec - exiting
12:47:33 (13025): No heartbeat from core client for 30 sec - exiting
12:47:34 (13025): No heartbeat from core client for 30 sec - exiting
12:47:35 (13025): No heartbeat from core client for 30 sec - exiting
12:47:36 (13025): No heartbeat from core client for 30 sec - exiting
12:47:37 (13025): No heartbeat from core client for 30 sec - exiting
12:47:38 (13025): No heartbeat from core client for 30 sec - exiting
12:47:39 (13025): No heartbeat from core client for 30 sec - exiting
12:47:40 (13025): No heartbeat from core client for 30 sec - exiting
12:47:41 (13025): No heartbeat from core client for 30 sec - exiting
12:47:42 (13025): No heartbeat from core client for 30 sec - exiting
12:47:43 (13025): No heartbeat from core client for 30 sec - exiting
12:47:44 (13025): No heartbeat from core client for 30 sec - exiting
12:47:45 (13025): No heartbeat from core client for 30 sec - exiting
12:47:46 (13025): No heartbeat from core client for 30 sec - exiting
12:47:47 (13025): No heartbeat from core client for 30 sec - exiting
12:47:48 (13025): No heartbeat from core client for 30 sec - exiting
12:52:43 (13191): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:57:15 (13335): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:57:16 (13335): No heartbeat from core client for 30 sec - exiting
12:57:17 (13335): No heartbeat from core client for 30 sec - exiting
12:57:18 (13335): No heartbeat from core client for 30 sec - exiting
13:02:21 (13495): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:02:22 (13495): No heartbeat from core client for 30 sec - exiting
13:02:23 (13495): No heartbeat from core client for 30 sec - exiting
13:02:24 (13495): No heartbeat from core client for 30 sec - exiting
13:02:25 (13495): No heartbeat from core client for 30 sec - exiting
13:02:26 (13495): No heartbeat from core client for 30 sec - exiting
13:59:15 (13647): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:03:21 (14228): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:03:22 (14228): No heartbeat from core client for 30 sec - exiting
14:03:23 (14228): No heartbeat from core client for 30 sec - exiting
14:03:24 (14228): No heartbeat from core client for 30 sec - exiting
14:03:25 (14228): No heartbeat from core client for 30 sec - exiting
14:03:26 (14228): No heartbeat from core client for 30 sec - exiting
14:08:20 (14362): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:08:21 (14362): No heartbeat from core client for 30 sec - exiting
14:08:22 (14362): No heartbeat from core client for 30 sec - exiting
14:08:23 (14362): No heartbeat from core client for 30 sec - exiting
14:08:24 (14362): No heartbeat from core client for 30 sec - exiting
14:08:25 (14362): No heartbeat from core client for 30 sec - exiting
14:08:26 (14362): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
14:12:41 (14491): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:12:42 (14491): No heartbeat from core client for 30 sec - exiting
19:05:03 (14655): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:05:04 (14655): No heartbeat from core client for 30 sec - exiting
19:05:05 (14655): No heartbeat from core client for 30 sec - exiting
19:05:06 (14655): No heartbeat from core client for 30 sec - exiting
19:05:07 (14655): No heartbeat from core client for 30 sec - exiting
19:05:08 (14655): No heartbeat from core client for 30 sec - exiting
19:05:09 (14655): No heartbeat from core client for 30 sec - exiting
19:05:10 (14655): No heartbeat from core client for 30 sec - exiting
19:32:58 (17296): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:38:04 (17639): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:38:05 (17639): No heartbeat from core client for 30 sec - exiting
19:38:06 (17639): No heartbeat from core client for 30 sec - exiting
19:38:07 (17639): No heartbeat from core client for 30 sec - exiting
19:38:08 (17639): No heartbeat from core client for 30 sec - exiting
19:38:09 (17639): No heartbeat from core client for 30 sec - exiting
19:38:10 (17639): No heartbeat from core client for 30 sec - exiting
19:38:11 (17639): No heartbeat from core client for 30 sec - exiting
19:38:12 (17639): No heartbeat from core client for 30 sec - exiting
19:38:13 (17639): No heartbeat from core client for 30 sec - exiting
19:38:14 (17639): No heartbeat from core client for 30 sec - exiting
19:38:15 (17639): No heartbeat from core client for 30 sec - exiting
19:38:16 (17639): No heartbeat from core client for 30 sec - exiting
19:38:17 (17639): No heartbeat from core client for 30 sec - exiting
19:38:18 (17639): No heartbeat from core client for 30 sec - exiting
19:38:19 (17639): No heartbeat from core client for 30 sec - exiting
19:42:57 (17808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:42:58 (17808): No heartbeat from core client for 30 sec - exiting
19:42:59 (17808): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7762400]
[0xf7762425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf757f1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7582825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf756a4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=17972, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7776400]
[0xf7776425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75931df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7596825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf757e4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=17972, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf76fb400]
[0xf76fb425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75181df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf751b825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75034d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=17972, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf770d400]
[0xf770d425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf752a1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf752d825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75154d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=17972, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf770f400]
[0xf770f425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf752c1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf752f825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75174d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=17972, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7758400]
[0xf7758425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75751df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7578825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75604d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=17972, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Jun 2013 10:55:05 1282401 15806076 hadcm3n_3jp8_1980_40_008366006_2 25,920 63,863 2.4639


©2024 climateprediction.net