climateprediction.net home page
Task 16295334

Task 16295334

Name hadcm3n_86ma_1980_40_008515081_0
Workunit 8662593
Created 26 Feb 2014, 16:08:11 UTC
Sent 26 Feb 2014, 17:06:06 UTC
Report deadline 29 May 2014, 0:33:17 UTC
Received 22 Mar 2014, 18:26:46 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1316604
Run time 13 days 16 hours 26 min 32 sec
CPU time 13 days 11 hours 57 min
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 3.09 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B7759DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4429, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B75CFDA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4429, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B769FDA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4429, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B7586DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4429, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B75C1DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4429, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_86ma_1980_40_008515081/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B76BDDA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4429, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Mar 2014 22:33:30 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 777,600 1,151,854 1.4813
20 Mar 2014 02:59:41 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 751,680 1,112,804 1.4804
19 Mar 2014 05:36:14 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 725,760 1,073,852 1.4796
18 Mar 2014 17:54:37 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 699,840 1,034,668 1.4784
17 Mar 2014 18:36:55 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 673,920 996,416 1.4785
16 Mar 2014 22:57:53 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 648,000 958,228 1.4787
16 Mar 2014 12:02:30 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 622,080 919,718 1.4785
16 Mar 2014 01:10:52 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 596,160 881,168 1.4781
15 Mar 2014 14:22:24 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 570,240 842,883 1.4781
15 Mar 2014 01:49:33 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 544,320 804,280 1.4776
14 Mar 2014 04:08:10 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 518,400 765,455 1.4766
13 Mar 2014 17:19:06 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 492,480 727,205 1.4766
12 Mar 2014 17:43:09 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 466,560 692,082 1.4834
11 Mar 2014 22:39:59 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 440,640 655,882 1.4885
11 Mar 2014 04:58:46 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 414,720 618,258 1.4908
10 Mar 2014 18:40:07 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 388,800 579,250 1.4898
10 Mar 2014 01:43:12 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 362,880 538,233 1.4832
09 Mar 2014 20:25:56 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 336,960 497,244 1.4757
09 Mar 2014 08:45:57 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 311,040 457,060 1.4695
08 Mar 2014 11:25:41 1316604 16295334 hadcm3n_86ma_1980_40_008515081_0 285,120 417,283 1.4635


©2024 climateprediction.net