climateprediction.net home page

Upload stops at 10MB with HTTP error


Advanced search

Message boards : Number crunching : Upload stops at 10MB with HTTP error

AuthorMessage
JanBogutzki
Send message
Joined: Dec 21 11
Posts: 2
Credit: 106,772
RAC: 0
Message 43745 - Posted 4 Feb 2012 12:17:41 UTC

    04.02.2012 13:13:03 | climateprediction.net | Temporarily failed upload of hadam3p_eu_86rz_2002_1_007691326_2_5.zip: HTTP error
    04.02.2012 13:13:03 | climateprediction.net | Backing off 8 hr 48 min 57 sec on upload of hadam3p_eu_86rz_2002_1_007691326_2_5.zip
    04.02.2012 13:13:06 | | Project communication failed: attempting access to reference site
    04.02.2012 13:13:08 | | Internet access OK - project servers may be temporarily down.

    The upload tries since yesterday and has no chance to complete. Seems to me, that there is a problem with this file (13MB) when the uplaod reaches 10MB.
    ____________
    test PHP online: md5, preg_match, ...

    Les Bayliss
    Forum moderator
    Send message
    Joined: Sep 5 04
    Posts: 5336
    Credit: 8,876,229
    RAC: 549
    Message 43746 - Posted 4 Feb 2012 13:36:36 UTC - in response to Message 43745.

      It might be the bug in BOINC when there are several files to upload, and the connection is slow.
      Try Thyme Lawn's solution in this post on our other board.

      It might also be a different problem, where one of the nodes between you and the project is using an older version of HTTP, which can be fixed with a different option in cc_config.

      Ask again if the fix above doesn't work.


      ____________
      Backups: Here

      JanBogutzki
      Send message
      Joined: Dec 21 11
      Posts: 2
      Credit: 106,772
      RAC: 0
      Message 43747 - Posted 4 Feb 2012 14:11:45 UTC

        There are no other uploads, the only thing i have limited is the bandwith of the upload. Without this limit, the upload is working. Seems to be a bug in the server software ...
        ____________
        test PHP online: md5, preg_match, ...

        Profile Thyme Lawn
        Forum moderator
        Send message
        Joined: Aug 5 04
        Posts: 1231
        Credit: 10,354,096
        RAC: 1,273
        Message 43757 - Posted 5 Feb 2012 15:29:10 UTC

          The problem is in the BOINC client rather than the server. It's related to the way uploads are handled (blocks of data are store in a cache which is refreshed as it starts to run down, with a default timeout of 5 minutes on the refresh). It's possible your upload is hitting BOINC's transfer inactivity limit, particularly if some of your other projects start large uploads when your CPDN file is being uploaded. The post Les linked to partially caters for that.

          For the complete solution you need to be running BOINC 6.12.27 or later which added an option to increase the inactivity timeout. The change is documented as follows in BOINC Client Configuration:

          <http_transfer_timeout>seconds</http_transfer_timeout> abort HTTP transfers if idle for this many seconds; default 300 + New in 6.12.27

          As in the post Les linked to, you'll need to create a cc_config.xml file in your BOINC data directory with the timeout you require. My file (with the upload limit set to 30 Kbytes/sec) contains the following, increasing the timeout limit to 30 minutes:
          <cc_config>
          <options>
          <http_transfer_timeout>1800</http_transfer_timeout>
          <max_file_xfers>3</max_file_xfers>
          <max_file_xfers_per_project>1</max_file_xfers_per_project>
          </options>
          </cc_config>

          ____________
          "The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer

          richard schumacher
          Send message
          Joined: Feb 20 06
          Posts: 22
          Credit: 2,140,455
          RAC: 0
          Message 43765 - Posted 10 Feb 2012 13:53:55 UTC - in response to Message 43757.

            I have an upload which immediately halts:
            Fri Feb 10 07:40:33 2012 | climateprediction.net | Started upload of hadam3p_eu_9bqy_1961_1_007735282_1_12.zip
            Fri Feb 10 07:40:34 2012 | climateprediction.net | Temporarily failed upload of hadam3p_eu_9bqy_1961_1_007735282_1_12.zip: HTTP error
            Fri Feb 10 07:40:34 2012 | climateprediction.net | Backing off 8 hr 57 min 16 sec on upload of hadam3p_eu_9bqy_1961_1_007735282_1_12.zip


            Can this be a timeout? While this result has been mouldering at least one other completed result has uploaded successfully.
            ____________

            Profile Dave Jackson
            Send message
            Joined: May 15 09
            Posts: 804
            Credit: 632,379
            RAC: 338
            Message 43766 - Posted 10 Feb 2012 14:29:55 UTC - in response to Message 43765.

              My guess is that this is probably due to uploader1.atm being out at the moment - if you look at the server status page. Different zip files go to different servers which would account for some going through fine.

              Dave

              Les Bayliss
              Forum moderator
              Send message
              Joined: Sep 5 04
              Posts: 5336
              Credit: 8,876,229
              RAC: 549
              Message 43768 - Posted 10 Feb 2012 15:24:35 UTC

                uploader1.atm is having a lot of problems, and the project people are trying to deal with it. It may need to be replaced.
                This is the server that stores the EU models. The others go to a different server.


                ____________
                Backups: Here

                richard schumacher
                Send message
                Joined: Feb 20 06
                Posts: 22
                Credit: 2,140,455
                RAC: 0
                Message 43769 - Posted 11 Feb 2012 0:49:05 UTC - in response to Message 43768.

                  Ah, yes. Thanks.
                  ____________

                  richard schumacher
                  Send message
                  Joined: Feb 20 06
                  Posts: 22
                  Credit: 2,140,455
                  RAC: 0
                  Message 43770 - Posted 11 Feb 2012 12:22:43 UTC - in response to Message 43757.

                    Would a donation of money or equipment help?
                    ____________

                    MarkJ
                    Avatar
                    Send message
                    Joined: Mar 28 09
                    Posts: 102
                    Credit: 5,075,426
                    RAC: 6
                    Message 43775 - Posted 11 Feb 2012 22:51:11 UTC - in response to Message 43770.

                      Would a donation of money or equipment help?


                      On that point I don't recall seeing a Donate option anywhere on CPDN like most other projects seem to have. Is there one?
                      ____________
                      BOINC blog

                      Les Bayliss
                      Forum moderator
                      Send message
                      Joined: Sep 5 04
                      Posts: 5336
                      Credit: 8,876,229
                      RAC: 549
                      Message 43777 - Posted 11 Feb 2012 23:06:53 UTC - in response to Message 43775.

                        ... I don't recall seeing a Donate option ...


                        Start on the front page of the project, here.

                        In the menu to the right, click on:
                        About
                        then Donations

                        The nature of the current problem hasn't been determined yet.
                        And it's the weekend. Again.


                        ____________
                        Backups: Here

                        richard schumacher
                        Send message
                        Joined: Feb 20 06
                        Posts: 22
                        Credit: 2,140,455
                        RAC: 0
                        Message 43797 - Posted 14 Feb 2012 13:20:39 UTC - in response to Message 43777.

                          Uploads can stack up indefinitely and not be lost, true?
                          ____________

                          Profile Dave Jackson
                          Send message
                          Joined: May 15 09
                          Posts: 804
                          Credit: 632,379
                          RAC: 338
                          Message 43798 - Posted 14 Feb 2012 13:45:46 UTC - in response to Message 43797.

                            Yes they can - one of the three I had pending went through about an hour ago but the relevant server was then shown as being down again though a few seconds ago it was back up.

                            Ingleside
                            Send message
                            Joined: Aug 5 04
                            Posts: 92
                            Credit: 7,982,232
                            RAC: 8,702
                            Message 43803 - Posted 15 Feb 2012 0:30:35 UTC - in response to Message 43797.

                              Uploads can stack up indefinitely and not be lost, true?

                              Not completely indefinitely, if you're running an old BOINC-client the cut-off is 14 days from 1st. upload-try of each individual upload, while with v6.10.0 and later BOINC-clients the cut-off has been extended to 90 days.

                              Post to thread

                              Message boards : Number crunching : Upload stops at 10MB with HTTP error




                              Copyright © 2002-2014 climateprediction.net