climateprediction.net home page
Task 16275492

Task 16275492

Name hadcm3n_o9xf_1900_40_008467990_4
Workunit 8618829
Created 24 Jan 2014, 10:42:27 UTC
Sent 24 Jan 2014, 10:42:36 UTC
Report deadline 25 Apr 2014, 18:09:47 UTC
Received 27 Jan 2014, 9:50:07 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1266912
Run time 1 days 11 hours 11 min 19 sec
CPU time 1 days 9 hours 11 min 33 sec
Validate state Invalid
Credit 622.08
Device peak FLOPS 2.97 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.12.43</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
05:39:03 (8092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:56:14 (8187): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:56:15 (8187): No heartbeat from core client for 30 sec - exiting
06:02:02 (8468): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:25:38 (11969): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:33:58 (12825): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:19:40 (12968): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
13:18:47 (15586): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:18:48 (15586): No heartbeat from core client for 30 sec - exiting
13:18:49 (15586): No heartbeat from core client for 30 sec - exiting
13:18:50 (15586): No heartbeat from core client for 30 sec - exiting
13:18:51 (15586): No heartbeat from core client for 30 sec - exiting
13:18:52 (15586): No heartbeat from core client for 30 sec - exiting
13:18:53 (15586): No heartbeat from core client for 30 sec - exiting
13:18:54 (15586): No heartbeat from core client for 30 sec - exiting
13:18:55 (15586): No heartbeat from core client for 30 sec - exiting
13:18:56 (15586): No heartbeat from core client for 30 sec - exiting
13:18:57 (15586): No heartbeat from core client for 30 sec - exiting
13:18:58 (15586): No heartbeat from core client for 30 sec - exiting
13:18:59 (15586): No heartbeat from core client for 30 sec - exiting
13:19:00 (15586): No heartbeat from core client for 30 sec - exiting
13:19:01 (15586): No heartbeat from core client for 30 sec - exiting
13:19:02 (15586): No heartbeat from core client for 30 sec - exiting
13:19:03 (15586): No heartbeat from core client for 30 sec - exiting
13:19:04 (15586): No heartbeat from core client for 30 sec - exiting
14:01:09 (15703): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
15:05:19 (17351): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
17:01:32 (18876): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:42:34 (19149): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
19:25:48 (20735): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
21:57:13 (22858): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:57:14 (22858): No heartbeat from core client for 30 sec - exiting
21:57:15 (22858): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:51:51 (29268): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
04:58:53 (2999): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:23:32 (3173): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:23:33 (3173): No heartbeat from core client for 30 sec - exiting
05:23:34 (3173): No heartbeat from core client for 30 sec - exiting
05:23:35 (3173): No heartbeat from core client for 30 sec - exiting
05:23:36 (3173): No heartbeat from core client for 30 sec - exiting
05:23:37 (3173): No heartbeat from core client for 30 sec - exiting
05:23:38 (3173): No heartbeat from core client for 30 sec - exiting
05:23:39 (3173): No heartbeat from core client for 30 sec - exiting
05:23:40 (3173): No heartbeat from core client for 30 sec - exiting
05:23:41 (3173): No heartbeat from core client for 30 sec - exiting
05:23:42 (3173): No heartbeat from core client for 30 sec - exiting
05:23:43 (3173): No heartbeat from core client for 30 sec - exiting
05:23:44 (3173): No heartbeat from core client for 30 sec - exiting
05:23:45 (3173): No heartbeat from core client for 30 sec - exiting
05:23:46 (3173): No heartbeat from core client for 30 sec - exiting
05:23:47 (3173): No heartbeat from core client for 30 sec - exiting
05:23:48 (3173): No heartbeat from core client for 30 sec - exiting
05:23:49 (3173): No heartbeat from core client for 30 sec - exiting
05:23:50 (3173): No heartbeat from core client for 30 sec - exiting
05:23:51 (3173): No heartbeat from core client for 30 sec - exiting
05:23:52 (3173): No heartbeat from core client for 30 sec - exiting
05:23:53 (3173): No heartbeat from core client for 30 sec - exiting
05:23:54 (3173): No heartbeat from core client for 30 sec - exiting
05:23:55 (3173): No heartbeat from core client for 30 sec - exiting
05:23:56 (3173): No heartbeat from core client for 30 sec - exiting
05:23:57 (3173): No heartbeat from core client for 30 sec - exiting
05:23:58 (3173): No heartbeat from core client for 30 sec - exiting
05:26:09 (3694): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:29:49 (3763): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:29:50 (3763): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
07:01:33 (4848): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:23:19 (12045): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:23:20 (12045): No heartbeat from core client for 30 sec - exiting
12:23:21 (12045): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
12:53:10 (12091): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:53:11 (12091): No heartbeat from core client for 30 sec - exiting
12:53:12 (12091): No heartbeat from core client for 30 sec - exiting
12:53:13 (12091): No heartbeat from core client for 30 sec - exiting
12:53:14 (12091): No heartbeat from core client for 30 sec - exiting
12:53:15 (12091): No heartbeat from core client for 30 sec - exiting
12:53:16 (12091): No heartbeat from core client for 30 sec - exiting
12:53:17 (12091): No heartbeat from core client for 30 sec - exiting
13:40:43 (13131): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
15:22:16 (17162): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:22:17 (17162): No heartbeat from core client for 30 sec - exiting
15:22:18 (17162): No heartbeat from core client for 30 sec - exiting
15:22:19 (17162): No heartbeat from core client for 30 sec - exiting
15:22:20 (17162): No heartbeat from core client for 30 sec - exiting
15:22:21 (17162): No heartbeat from core client for 30 sec - exiting
15:22:22 (17162): No heartbeat from core client for 30 sec - exiting
15:22:23 (17162): No heartbeat from core client for 30 sec - exiting
15:22:24 (17162): No heartbeat from core client for 30 sec - exiting
15:22:25 (17162): No heartbeat from core client for 30 sec - exiting
15:22:26 (17162): No heartbeat from core client for 30 sec - exiting
15:22:27 (17162): No heartbeat from core client for 30 sec - exiting
15:32:33 (17359): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:51:57 (21207): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:59:54 (21355): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:53:43 (21425): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:55:14 (22051): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:28:25 (25740): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:28:28 (25740): No heartbeat from core client for 30 sec - exiting
02:17:18 (26154): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:17:30 (28754): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:42:05 (29374): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:16:42 (29616): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:49:23 (30030): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7792400]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7792430]
/lib/libc.so.6(gsignal+0x4f)[0xf75cc31f]
/lib/libc.so.6(abort+0x143)[0xf75cdc03]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf75b73d5]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32374, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c3400]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77c3430]
/lib/libc.so.6(gsignal+0x4f)[0xf75fd31f]
/lib/libc.so.6(abort+0x143)[0xf75fec03]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf75e83d5]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32374, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf773f400]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf773f430]
/lib/libc.so.6(gsignal+0x4f)[0xf757931f]
/lib/libc.so.6(abort+0x143)[0xf757ac03]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf75643d5]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32374, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d3400]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77d3430]
/lib/libc.so.6(gsignal+0x4f)[0xf760d31f]
/lib/libc.so.6(abort+0x143)[0xf760ec03]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf75f83d5]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32374, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76fb400]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76fb430]
/lib/libc.so.6(gsignal+0x4f)[0xf753531f]
/lib/libc.so.6(abort+0x143)[0xf7536c03]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf75203d5]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32374, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf773a400]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf773a430]
/lib/libc.so.6(gsignal+0x4f)[0xf757431f]
/lib/libc.so.6(abort+0x143)[0xf7575c03]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf755f3d5]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32374, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
27 Jan 2014 00:46:11 1266912 16275492 hadcm3n_o9xf_1900_40_008467990_4 51,840 98,816 1.9062
26 Jan 2014 03:06:06 1266912 16275492 hadcm3n_o9xf_1900_40_008467990_4 25,920 49,992 1.9287


©2024 cpdn.org