climateprediction.net home page
Task 18129389

Task 18129389

Name hadam3pm2_nek3_1983_10_009649116_0
Workunit 9723450
Created 18 Mar 2015, 12:11:55 UTC
Sent 18 Mar 2015, 19:53:36 UTC
Report deadline 29 Feb 2016, 1:13:36 UTC
Received 24 Mar 2015, 12:40:30 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1304823
Run time 5 days 8 hours 37 min 35 sec
CPU time 6 min 27 sec
Validate state Invalid
Credit 7,070.56
Device peak FLOPS 3.83 GFLOPS
Application version UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03
i686-pc-linux-gnu
Stderr
<core_client_version>7.2.42</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
oa.pc|3dec.nc
oa.pc|4jan.nc
oa.pc|4feb.nc
oa.pc|4mar.nc
oa.pc|4apr.nc
oa.pc|4may.nc
oa.pc|4jun.nc
oa.pc|4jul.nc
oa.pc|4aug.nc
oa.pc|4sep.nc
oa.pc|4oct.nc
oa.pc|4nov.nc
oa.pe|3dec.nc
oa.pe|4jan.nc
oa.pe|4feb.nc
oa.pe|4mar.nc
oa.pe|4apr.nc
oa.pe|4may.nc
oa.pe|4jun.nc
oa.pe|4jul.nc
oa.pe|4aug.nc
oa.pe|4sep.nc
oa.pe|4oct.nc
oa.pe|4nov.nc
oa.pc|4dec.nc
oa.pc|5jan.nc
oa.pc|5feb.nc
oa.pc|5mar.nc
oa.pc|5apr.nc
oa.pc|5may.nc
oa.pc|5jun.nc
oa.pc|5jul.nc
oa.pc|5aug.nc
oa.pc|5sep.nc
oa.pc|5oct.nc
oa.pc|5nov.nc
oa.pe|4dec.nc
oa.pe|5jan.nc
oa.pe|5feb.nc
oa.pe|5mar.nc
oa.pe|5apr.nc
oa.pe|5may.nc
oa.pe|5jun.nc
oa.pe|5jul.nc
oa.pe|5aug.nc
oa.pe|5sep.nc
oa.pe|5oct.nc
oa.pe|5nov.nc
oa.pc|5dec.nc
oa.pc|6jan.nc
oa.pc|6feb.nc
oa.pc|6mar.nc
oa.pc|6apr.nc
oa.pc|6may.nc
oa.pc|6jun.nc
oa.pc|6jul.nc
oa.pc|6aug.nc
oa.pc|6sep.nc
oa.pc|6oct.nc
oa.pc|6nov.nc
oa.pe|5dec.nc
oa.pe|6jan.nc
oa.pe|6feb.nc
oa.pe|6mar.nc
oa.pe|6apr.nc
oa.pe|6may.nc
oa.pe|6jun.nc
oa.pe|6jul.nc
oa.pe|6aug.nc
oa.pe|6sep.nc
oa.pe|6oct.nc
oa.pe|6nov.nc
oa.pc|6dec.nc
oa.pc|7jan.nc
oa.pc|7feb.nc
oa.pc|7mar.nc
oa.pc|7apr.nc
oa.pc|7may.nc
oa.pc|7jun.nc
oa.pc|7jul.nc
oa.pc|7aug.nc
oa.pc|7sep.nc
oa.pc|7oct.nc
oa.pc|7nov.nc
oa.pe|6dec.nc
oa.pe|7jan.nc
oa.pe|7feb.nc
oa.pe|7mar.nc
oa.pe|7apr.nc
oa.pe|7may.nc
oa.pe|7jun.nc
oa.pe|7jul.nc
oa.pe|7aug.nc
oa.pe|7sep.nc
oa.pe|7oct.nc
oa.pe|7nov.nc
oa.pc|7dec.nc
oa.pc|8jan.nc
oa.pc|8feb.nc
oa.pc|8mar.nc
oa.pc|8apr.nc
oa.pc|8may.nc
oa.pc|8jun.nc
oa.pc|8jul.nc
oa.pc|8aug.nc
oa.pc|8sep.nc
oa.pc|8oct.nc
oa.pc|8nov.nc
oa.pe|7dec.nc
oa.pe|8jan.nc
oa.pe|8feb.nc
oa.pe|8mar.nc
oa.pe|8apr.nc
oa.pe|8may.nc
oa.pe|8jun.nc
oa.pe|8jul.nc
oa.pe|8aug.nc
oa.pe|8sep.nc
oa.pe|8oct.nc
oa.pe|8nov.nc
oa.pc|8dec.nc
oa.pc|9jan.nc
oa.pc|9feb.nc
oa.pc|9mar.nc
oa.pc|9apr.nc
oa.pc|9may.nc
oa.pc|9jun.nc
oa.pc|9jul.nc
oa.pc|9aug.nc
oa.pc|9sep.nc
oa.pc|9oct.nc
oa.pc|9nov.nc
oa.pe|8dec.nc
oa.pe|9jan.nc
oa.pe|9feb.nc
oa.pe|9mar.nc
oa.pe|9apr.nc
oa.pe|9may.nc
oa.pe|9jun.nc
oa.pe|9jul.nc
oa.pe|9aug.nc
oa.pe|9sep.nc
oa.pe|9oct.nc
oa.pe|9nov.nc
oa.pc|9dec.nc
oa.pc|0jan.nc
oa.pc|0feb.nc
oa.pc|0mar.nc
oa.pc|0apr.nc
oa.pc|0may.nc
oa.pc|0jun.nc
oa.pc|0jul.nc
oa.pc|0aug.nc
oa.pc|0sep.nc
oa.pc|0oct.nc
oa.pc|0nov.nc
oa.pe|9dec.nc
oa.pe|0jan.nc
oa.pe|0feb.nc
oa.pe|0mar.nc
oa.pe|0apr.nc
oa.pe|0may.nc
oa.pe|0jun.nc
oa.pe|0jul.nc
oa.pe|0aug.nc
oa.pe|0sep.nc
oa.pe|0oct.nc
oa.pe|0nov.nc
SIGSEGV: segmentation violation
Stack trace (13 frames):
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf]
[0xf0f72400]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf0d55a83]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3457, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf]
[0xf0f7b400]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf0d5ea83]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3457, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf]
[0xf0fa0400]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf0d83a83]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3457, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf]
[0xf0f78400]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf0d5ba83]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3457, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf]
[0xf0f3f400]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf0d22a83]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3457, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
Stack trace (13 frames):
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf]
[0xf0f88400]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9]
/home/cpdn/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf0d6ba83]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3457, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
00:00:47 (3457): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
26 Mar 2015 09:21:01 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 244,868 459,294 1.8757
26 Mar 2015 09:21:02 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 239,108 448,419 1.8754
26 Mar 2015 09:21:01 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 236,228 443,002 1.8753
26 Mar 2015 09:21:01 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 233,348 437,551 1.8751
26 Mar 2015 09:21:01 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 230,468 432,004 1.8745
26 Mar 2015 09:21:02 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 227,588 426,594 1.8744
26 Mar 2015 09:21:01 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 224,708 421,183 1.8744
26 Mar 2015 09:21:02 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 221,828 415,777 1.8743
23 Mar 2015 14:55:33 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 218,948 410,323 1.8741
23 Mar 2015 13:55:14 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 216,068 404,949 1.8742
23 Mar 2015 11:54:24 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 213,188 399,559 1.8742
23 Mar 2015 10:49:08 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 210,308 394,122 1.8740
23 Mar 2015 07:03:02 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 204,548 383,307 1.8739
23 Mar 2015 06:02:20 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 201,668 377,896 1.8739
23 Mar 2015 04:15:53 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 198,788 372,422 1.8735
23 Mar 2015 03:02:22 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 195,908 366,999 1.8733
23 Mar 2015 01:00:34 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 193,028 361,614 1.8734
23 Mar 2015 00:00:13 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 190,148 356,219 1.8734
22 Mar 2015 21:54:48 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 187,268 350,765 1.8731
22 Mar 2015 20:54:33 1304823 18129389 hadam3pm2_nek3_1983_10_009649116_0 184,388 345,353 1.8730


©2024 climateprediction.net