climateprediction.net home page
Task 17202633

Task 17202633

Name hadam3pm2_e8y3_1991_10_008714638_1
Workunit 8861112
Created 16 Oct 2014, 10:14:22 UTC
Sent 16 Oct 2014, 10:42:16 UTC
Report deadline 28 Sep 2015, 16:02:16 UTC
Received 23 Oct 2014, 4:54:43 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1366213
Run time 2 days 15 hours 2 min 23 sec
CPU time 2 min 20 sec
Validate state Invalid
Credit 2,663.08
Device peak FLOPS 3.74 GFLOPS
Application version UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03
i686-pc-linux-gnu
Stderr
<core_client_version>7.2.28</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
oa.pc|1dec.nc
oa.pc|2jan.nc
oa.pc|2feb.nc
oa.pc|2mar.nc
oa.pc|2apr.nc
oa.pc|2may.nc
oa.pc|2jun.nc
oa.pc|2jul.nc
oa.pc|2aug.nc
oa.pc|2sep.nc
oa.pc|2oct.nc
oa.pc|2nov.nc
oa.pe|1dec.nc
oa.pe|2jan.nc
oa.pe|2feb.nc
oa.pe|2mar.nc
oa.pe|2apr.nc
oa.pe|2may.nc
oa.pe|2jun.nc
oa.pe|2jul.nc
oa.pe|2aug.nc
oa.pe|2sep.nc
oa.pe|2oct.nc
oa.pe|2nov.nc
oa.pc|2dec.nc
oa.pc|3jan.nc
oa.pc|3feb.nc
oa.pc|3mar.nc
oa.pc|3apr.nc
oa.pc|3may.nc
oa.pc|3jun.nc
oa.pc|3jul.nc
oa.pc|3aug.nc
oa.pc|3sep.nc
oa.pc|3oct.nc
oa.pc|3nov.nc
oa.pe|2dec.nc
oa.pe|3jan.nc
oa.pe|3feb.nc
oa.pe|3mar.nc
oa.pe|3apr.nc
oa.pe|3may.nc
oa.pe|3jun.nc
oa.pe|3jul.nc
oa.pe|3aug.nc
oa.pe|3sep.nc
oa.pe|3oct.nc
oa.pe|3nov.nc
OPEN:  File Creation Failed: No such file or directory
OPEN:  Unable to Open File dataout/e8y3oa.pej4aug for Read/Write

Model crashed: go
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/jobs/xhjlo.ihist after 11 attempts
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/jobs/xhjlo.namelists after 11 attempts
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/dataout/restart.day after 11 attempts
forrtl: Bad file descriptor
forrtl: severe (30): open failure, unit 6, file stdout
Image              PC        Routine            Line        Source             
hadam3pm2_um_7.03  0845AB9D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08459995  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0842865F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7E1D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7767  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0841C093  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0831E96F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0834C82D  Unknown               Unknown  Unknown
libc.so.6          F0D98A83  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32214, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/jobs/xhjlo.ihist after 11 attempts
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/jobs/xhjlo.namelists after 11 attempts
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/dataout/restart.day after 11 attempts
forrtl: Bad file descriptor
forrtl: severe (30): open failure, unit 6, file stdout
Image              PC        Routine            Line        Source             
hadam3pm2_um_7.03  0845AB9D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08459995  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0842865F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7E1D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7767  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0841C093  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0831E96F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0834C82D  Unknown               Unknown  Unknown
libc.so.6          F0D8DA83  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32214, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/jobs/xhjlo.ihist after 11 attempts
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/jobs/xhjlo.namelists after 11 attempts
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/dataout/restart.day after 11 attempts
forrtl: Bad file descriptor
forrtl: severe (30): open failure, unit 6, file stdout
Image              PC        Routine            Line        Source             
hadam3pm2_um_7.03  0845AB9D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08459995  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0842865F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7E1D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7767  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0841C093  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0831E96F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0834C82D  Unknown               Unknown  Unknown
libc.so.6          F0D1FA83  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32214, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/jobs/xhjlo.ihist after 11 attempts
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/jobs/xhjlo.namelists after 11 attempts
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/dataout/restart.day after 11 attempts
forrtl: Bad file descriptor
forrtl: severe (30): open failure, unit 6, file stdout
Image              PC        Routine            Line        Source             
hadam3pm2_um_7.03  0845AB9D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08459995  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0842865F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7E1D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7767  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0841C093  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0831E96F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0834C82D  Unknown               Unknown  Unknown
libc.so.6          F0D91A83  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32214, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/jobs/xhjlo.ihist after 11 attempts
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/jobs/xhjlo.namelists after 11 attempts
cpdnmonitor: cannot open input file /home/boinc/BOINC/projects/climateprediction.net/hadam3pm2_e8y3_1991_10_008714638/dataout/restart.day after 11 attempts
forrtl: Bad file descriptor
forrtl: severe (30): open failure, unit 6, file stdout
Image              PC        Routine            Line        Source             
hadam3pm2_um_7.03  0845AB9D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08459995  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0842865F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7E1D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7767  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0841C093  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0831E96F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0834C82D  Unknown               Unknown  Unknown
libc.so.6          F0CEEA83  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32214, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
23:17:21 (32214): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
12 Dec 2014 11:16:52 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 92,228 220,091 2.3864
12 Dec 2014 11:16:52 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 89,348 213,305 2.3874
12 Dec 2014 11:16:52 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 86,468 206,513 2.3883
12 Dec 2014 11:16:52 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 83,588 199,761 2.3898
12 Dec 2014 11:16:52 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 80,708 193,031 2.3917
12 Dec 2014 11:16:52 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 77,828 186,306 2.3938
12 Dec 2014 11:16:51 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 74,948 179,610 2.3965
12 Dec 2014 11:16:51 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 72,068 172,920 2.3994
12 Dec 2014 11:16:51 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 66,308 159,456 2.4048
12 Dec 2014 11:16:51 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 63,428 152,738 2.4081
12 Dec 2014 11:16:51 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 60,548 145,965 2.4107
12 Dec 2014 11:16:51 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 57,668 139,180 2.4135
12 Dec 2014 11:16:51 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 54,788 132,239 2.4136
12 Dec 2014 11:16:51 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 51,908 125,244 2.4128
12 Dec 2014 11:16:51 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 49,028 118,266 2.4122
12 Dec 2014 11:16:51 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 46,148 111,324 2.4123
12 Dec 2014 11:16:50 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 43,268 104,381 2.4124
12 Dec 2014 11:16:50 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 40,388 97,461 2.4131
21 Oct 2014 19:22:31 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 37,508 90,554 2.4143
21 Oct 2014 19:22:31 805269 17202633 hadam3pm2_e8y3_1991_10_008714638_1 31,748 76,644 2.4141


©2024 climateprediction.net