climateprediction.net home page
Task 15608777

Task 15608777

Name hadcm3n_4l2c_1940_40_008304107_1
Workunit 8455242
Created 15 Feb 2013, 0:37:02 UTC
Sent 15 Feb 2013, 0:37:47 UTC
Report deadline 17 May 2013, 8:04:58 UTC
Received 6 Apr 2013, 20:36:21 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1190420
Run time 18 days 4 hours 10 min 51 sec
CPU time 15 days 13 hours 6 min 46 sec
Validate state Invalid
Credit 8,398.08
Device peak FLOPS 2.24 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:01:59 (6019): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:34:01 (31576): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:07:25 (6270): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:09:54 (6497): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:07:28 (6522): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:08:57 (6732): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:13:23 (6943): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:48:25 (7431): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:15:19 (7553): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:15:21 (7553): No heartbeat from core client for 30 sec - exiting
14:18:47 (7599): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:25:19 (7629): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:21:46 (7668): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:28:03 (7724): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:32:16 (7754): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:32:18 (7754): No heartbeat from core client for 30 sec - exiting
15:32:19 (7754): No heartbeat from core client for 30 sec - exiting
15:32:20 (7754): No heartbeat from core client for 30 sec - exiting
15:32:21 (7754): No heartbeat from core client for 30 sec - exiting
15:32:22 (7754): No heartbeat from core client for 30 sec - exiting
15:32:23 (7754): No heartbeat from core client for 30 sec - exiting
15:32:24 (7754): No heartbeat from core client for 30 sec - exiting
15:32:25 (7754): No heartbeat from core client for 30 sec - exiting
15:32:26 (7754): No heartbeat from core client for 30 sec - exiting
15:32:27 (7754): No heartbeat from core client for 30 sec - exiting
15:32:28 (7754): No heartbeat from core client for 30 sec - exiting
15:32:29 (7754): No heartbeat from core client for 30 sec - exiting
15:32:30 (7754): No heartbeat from core client for 30 sec - exiting
15:32:31 (7754): No heartbeat from core client for 30 sec - exiting
15:32:32 (7754): No heartbeat from core client for 30 sec - exiting
15:32:33 (7754): No heartbeat from core client for 30 sec - exiting
15:32:34 (7754): No heartbeat from core client for 30 sec - exiting
15:32:35 (7754): No heartbeat from core client for 30 sec - exiting
15:32:36 (7754): No heartbeat from core client for 30 sec - exiting
15:32:37 (7754): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x61f400]
[0x61f416]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0x13dcff]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0x141325]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x129113]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7777, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xa28400]
[0xa28416]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0x13dcff]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0x141325]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x129113]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7777, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xceb400]
[0xceb416]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0x73dcff]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0x741325]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x729113]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7777, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xda2400]
[0xda2416]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0x1c9cff]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0x1cd325]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x1b5113]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7777, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xdaa400]
[0xdaa416]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0x2a1cff]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0x2a5325]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x28d113]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7777, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xfa4400]
[0xfa4416]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0x478cff]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0x47c325]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x464113]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7777, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 Apr 2013 10:24:13 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 699,840 1,326,259 1.8951
05 Apr 2013 07:44:04 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 673,920 1,276,561 1.8942
04 Apr 2013 14:20:26 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 648,000 1,228,665 1.8961
03 Apr 2013 20:55:05 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 622,080 1,180,700 1.8980
03 Apr 2013 03:23:23 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 596,160 1,132,715 1.9000
02 Apr 2013 09:59:03 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 570,240 1,084,589 1.9020
01 Apr 2013 15:50:53 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 544,320 1,033,856 1.8994
31 Mar 2013 20:59:37 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 518,400 982,226 1.8947
31 Mar 2013 02:32:30 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 492,480 931,148 1.8907
30 Mar 2013 08:19:13 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 466,560 880,710 1.8877
29 Mar 2013 17:49:20 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 440,640 830,763 1.8854
29 Mar 2013 02:32:41 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 414,720 780,887 1.8829
28 Mar 2013 11:55:14 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 388,800 731,708 1.8820
27 Mar 2013 21:33:43 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 362,880 682,889 1.8819
27 Mar 2013 07:16:46 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 336,960 633,918 1.8813
26 Mar 2013 17:01:51 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 311,040 584,918 1.8805
26 Mar 2013 02:48:47 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 285,120 535,965 1.8798
25 Mar 2013 13:19:47 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 259,200 486,993 1.8788
24 Mar 2013 22:14:17 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 233,280 438,033 1.8777
24 Mar 2013 08:01:55 1190420 15608777 hadcm3n_4l2c_1940_40_008304107_1 207,360 389,220 1.8770


©2024 climateprediction.net