climateprediction.net home page
Task 16295335

Task 16295335

Name hadcm3n_86mb_1980_40_008515082_0
Workunit 8662594
Created 26 Feb 2014, 16:08:11 UTC
Sent 26 Feb 2014, 17:06:06 UTC
Report deadline 29 May 2014, 0:33:17 UTC
Received 22 Mar 2014, 18:26:46 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1316604
Run time 14 days 21 hours 51 min 43 sec
CPU time 14 days 16 hours 48 min 28 sec
Validate state Invalid
Credit 10,264.32
Device peak FLOPS 3.09 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B75C6DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4428, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B7750DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4428, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B7640DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4428, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B772DDA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4428, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B772DDA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4428, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86mb_1980_40_008515082/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B769BDA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4428, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
21 Mar 2014 02:04:17 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 855,360 1,268,188 1.4826
20 Mar 2014 15:02:03 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 829,440 1,229,186 1.4819
19 Mar 2014 19:23:22 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 803,520 1,190,069 1.4811
18 Mar 2014 21:40:09 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 777,600 1,151,083 1.4803
17 Mar 2014 22:07:27 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 751,680 1,112,519 1.4800
17 Mar 2014 02:24:30 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 725,760 1,074,183 1.4801
16 Mar 2014 15:23:43 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 699,840 1,035,910 1.4802
16 Mar 2014 04:26:25 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 673,920 997,020 1.4794
15 Mar 2014 17:33:22 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 648,000 958,629 1.4794
15 Mar 2014 06:05:20 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 622,080 920,152 1.4792
14 Mar 2014 18:26:56 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 596,160 881,468 1.4786
13 Mar 2014 20:56:34 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 570,240 843,122 1.4785
12 Mar 2014 21:00:17 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 544,320 806,583 1.4818
12 Mar 2014 02:51:28 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 518,400 770,745 1.4868
11 Mar 2014 17:05:47 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 492,480 734,093 1.4906
10 Mar 2014 22:31:26 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 466,560 695,496 1.4907
10 Mar 2014 11:31:27 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 440,640 654,827 1.4861
09 Mar 2014 20:25:56 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 414,720 613,869 1.4802
09 Mar 2014 08:45:57 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 388,800 573,541 1.4752
08 Mar 2014 19:26:32 1316604 16295335 hadcm3n_86mb_1980_40_008515082_0 362,880 533,744 1.4709


©2024 climateprediction.net