climateprediction.net home page
Task 16186016

Task 16186016

Name hadcm3n_odzl_1900_40_008473252_2
Workunit 8624091
Created 1 Jan 2014, 0:53:57 UTC
Sent 1 Jan 2014, 0:54:00 UTC
Report deadline 2 Apr 2014, 8:21:11 UTC
Received 31 Jan 2014, 22:03:24 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1286187
Run time 29 days 21 hours 37 min 26 sec
CPU time 25 days 10 hours 39 min 13 sec
Validate state Invalid
Credit 8,398.08
Device peak FLOPS 1.70 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.45</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:35:47 (12386): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:35:48 (12386): No heartbeat from core client for 30 sec - exiting
09:43:57 (6243): No heartbeat from core client for 30 sec - exiting
09:44:28 (6243): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:44:29 (6243): No heartbeat from core client for 30 sec - exiting
09:44:30 (6243): No heartbeat from core client for 30 sec - exiting
11:14:29 (8084): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:14:37 (8084): No heartbeat from core client for 30 sec - exiting
11:14:40 (8084): No heartbeat from core client for 30 sec - exiting
11:14:53 (8084): No heartbeat from core client for 30 sec - exiting
11:14:57 (8084): No heartbeat from core client for 30 sec - exiting
11:15:01 (8084): No heartbeat from core client for 30 sec - exiting
11:15:07 (8084): No heartbeat from core client for 30 sec - exiting
11:15:13 (8084): No heartbeat from core client for 30 sec - exiting
11:15:16 (8084): No heartbeat from core client for 30 sec - exiting
11:15:20 (8084): No heartbeat from core client for 30 sec - exiting
11:15:26 (8084): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
12:02:37 (9018): No heartbeat from core client for 30 sec - exiting
12:02:39 (9018): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:02:40 (9018): No heartbeat from core client for 30 sec - exiting
12:02:41 (9018): No heartbeat from core client for 30 sec - exiting
12:02:42 (9018): No heartbeat from core client for 30 sec - exiting
12:02:43 (9018): No heartbeat from core client for 30 sec - exiting
12:02:44 (9018): No heartbeat from core client for 30 sec - exiting
12:02:46 (9018): No heartbeat from core client for 30 sec - exiting
12:02:47 (9018): No heartbeat from core client for 30 sec - exiting
12:02:48 (9018): No heartbeat from core client for 30 sec - exiting
12:02:49 (9018): No heartbeat from core client for 30 sec - exiting
12:02:50 (9018): No heartbeat from core client for 30 sec - exiting
12:02:51 (9018): No heartbeat from core client for 30 sec - exiting
12:02:53 (9018): No heartbeat from core client for 30 sec - exiting
12:02:57 (9018): No heartbeat from core client for 30 sec - exiting
12:02:58 (9018): No heartbeat from core client for 30 sec - exiting
12:03:01 (9018): No heartbeat from core client for 30 sec - exiting
12:03:05 (9018): No heartbeat from core client for 30 sec - exiting
12:03:07 (9018): No heartbeat from core client for 30 sec - exiting
12:03:14 (9018): No heartbeat from core client for 30 sec - exiting
12:03:26 (9018): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (10 frames):
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x494400]
[0x494425]
/lib/libc.so.6(gsignal+0x51)[0x322b11]
/lib/libc.so.6(abort+0x17a)[0x3243ea]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0x30ed26]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9841, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x4c8400]
[0x4c8425]
/lib/libc.so.6(gsignal+0x51)[0x32ab11]
/lib/libc.so.6(abort+0x17a)[0x32c3ea]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0x316d26]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9841, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x919400]
[0x919425]
/lib/libc.so.6(gsignal+0x51)[0x32ab11]
/lib/libc.so.6(abort+0x17a)[0x32c3ea]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0x316d26]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9841, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x849400]
[0x849425]
/lib/libc.so.6(gsignal+0x51)[0x36eb11]
/lib/libc.so.6(abort+0x17a)[0x3703ea]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0x35ad26]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9841, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x656400]
[0x656425]
/lib/libc.so.6(gsignal+0x51)[0x32ab11]
/lib/libc.so.6(abort+0x17a)[0x32c3ea]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0x316d26]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9841, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x643400]
[0x643425]
/lib/libc.so.6(gsignal+0x51)[0x32ab11]
/lib/libc.so.6(abort+0x17a)[0x32c3ea]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0x316d26]
/home/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9841, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
31 Jan 2014 08:58:55 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 699,840 2,175,729 3.1089
30 Jan 2014 20:59:41 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 673,920 2,093,165 3.1060
30 Jan 2014 20:59:41 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 648,000 2,003,629 3.0920
27 Jan 2014 20:08:40 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 622,080 1,914,811 3.0781
26 Jan 2014 11:42:30 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 596,160 1,816,526 3.0470
24 Jan 2014 20:49:44 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 570,240 1,709,028 2.9970
24 Jan 2014 11:00:52 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 544,320 1,631,025 2.9964
22 Jan 2014 19:27:26 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 518,400 1,554,027 2.9977
21 Jan 2014 19:00:22 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 492,480 1,476,356 2.9978
20 Jan 2014 16:04:23 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 466,560 1,397,391 2.9951
19 Jan 2014 14:01:25 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 440,640 1,319,591 2.9947
18 Jan 2014 11:12:34 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 414,720 1,240,559 2.9913
17 Jan 2014 10:17:31 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 388,800 1,163,145 2.9916
16 Jan 2014 08:53:30 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 362,880 1,084,430 2.9884
15 Jan 2014 07:38:36 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 336,960 1,005,416 2.9838
14 Jan 2014 06:07:31 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 311,040 927,534 2.9820
13 Jan 2014 05:37:11 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 285,120 851,908 2.9879
12 Jan 2014 04:32:26 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 259,200 775,003 2.9900
11 Jan 2014 02:34:58 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 233,280 697,047 2.9880
10 Jan 2014 01:00:03 1286187 16186016 hadcm3n_odzl_1900_40_008473252_2 207,360 619,927 2.9896


©2024 climateprediction.net