climateprediction.net home page
Upload stops at 10MB with HTTP error

Upload stops at 10MB with HTTP error

Message boards : Number crunching : Upload stops at 10MB with HTTP error
Message board moderation

To post messages, you must log in.

AuthorMessage
JanBogutzki

Send message
Joined: 21 Dec 11
Posts: 2
Credit: 274,571
RAC: 0
Message 43745 - Posted: 4 Feb 2012, 12:17:41 UTC

04.02.2012 13:13:03 | climateprediction.net | Temporarily failed upload of hadam3p_eu_86rz_2002_1_007691326_2_5.zip: HTTP error
04.02.2012 13:13:03 | climateprediction.net | Backing off 8 hr 48 min 57 sec on upload of hadam3p_eu_86rz_2002_1_007691326_2_5.zip
04.02.2012 13:13:06 | | Project communication failed: attempting access to reference site
04.02.2012 13:13:08 | | Internet access OK - project servers may be temporarily down.

The upload tries since yesterday and has no chance to complete. Seems to me, that there is a problem with this file (13MB) when the uplaod reaches 10MB.
test PHP online: md5, preg_match, ...
ID: 43745 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 43746 - Posted: 4 Feb 2012, 13:36:36 UTC - in response to Message 43745.  

It might be the bug in BOINC when there are several files to upload, and the connection is slow.
Try Thyme Lawn's solution in this post on our other board.

It might also be a different problem, where one of the nodes between you and the project is using an older version of HTTP, which can be fixed with a different option in cc_config.

Ask again if the fix above doesn't work.


Backups: Here
ID: 43746 · Report as offensive     Reply Quote
JanBogutzki

Send message
Joined: 21 Dec 11
Posts: 2
Credit: 274,571
RAC: 0
Message 43747 - Posted: 4 Feb 2012, 14:11:45 UTC

There are no other uploads, the only thing i have limited is the bandwith of the upload. Without this limit, the upload is working. Seems to be a bug in the server software ...
test PHP online: md5, preg_match, ...
ID: 43747 · Report as offensive     Reply Quote
Profile Thyme Lawn
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1283
Credit: 15,824,334
RAC: 0
Message 43757 - Posted: 5 Feb 2012, 15:29:10 UTC

The problem is in the BOINC client rather than the server. It's related to the way uploads are handled (blocks of data are store in a cache which is refreshed as it starts to run down, with a default timeout of 5 minutes on the refresh). It's possible your upload is hitting BOINC's transfer inactivity limit, particularly if some of your other projects start large uploads when your CPDN file is being uploaded. The post Les linked to partially caters for that.

For the complete solution you need to be running BOINC 6.12.27 or later which added an option to increase the inactivity timeout. The change is documented as follows in BOINC Client Configuration:
<http_transfer_timeout>seconds</http_transfer_timeout> abort HTTP transfers if idle for this many seconds; default 300 + New in 6.12.27

As in the post Les linked to, you'll need to create a cc_config.xml file in your BOINC data directory with the timeout you require. My file (with the upload limit set to 30 Kbytes/sec) contains the following, increasing the timeout limit to 30 minutes:
<cc_config>
<options>
<http_transfer_timeout>1800</http_transfer_timeout>
<max_file_xfers>3</max_file_xfers>
<max_file_xfers_per_project>1</max_file_xfers_per_project>
</options>
</cc_config>

"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer
ID: 43757 · Report as offensive     Reply Quote
richard schumacher

Send message
Joined: 20 Feb 06
Posts: 22
Credit: 3,416,696
RAC: 451
Message 43765 - Posted: 10 Feb 2012, 13:53:55 UTC - in response to Message 43757.  

I have an upload which immediately halts:
Fri Feb 10 07:40:33 2012 | climateprediction.net | Started upload of hadam3p_eu_9bqy_1961_1_007735282_1_12.zip
Fri Feb 10 07:40:34 2012 | climateprediction.net | Temporarily failed upload of hadam3p_eu_9bqy_1961_1_007735282_1_12.zip: HTTP error
Fri Feb 10 07:40:34 2012 | climateprediction.net | Backing off 8 hr 57 min 16 sec on upload of hadam3p_eu_9bqy_1961_1_007735282_1_12.zip


Can this be a timeout? While this result has been mouldering at least one other completed result has uploaded successfully.
ID: 43765 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4314
Credit: 16,377,675
RAC: 3,657
Message 43766 - Posted: 10 Feb 2012, 14:29:55 UTC - in response to Message 43765.  

My guess is that this is probably due to uploader1.atm being out at the moment - if you look at the server status page. Different zip files go to different servers which would account for some going through fine.

Dave
ID: 43766 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 43768 - Posted: 10 Feb 2012, 15:24:35 UTC

uploader1.atm is having a lot of problems, and the project people are trying to deal with it. It may need to be replaced.
This is the server that stores the EU models. The others go to a different server.


Backups: Here
ID: 43768 · Report as offensive     Reply Quote
richard schumacher

Send message
Joined: 20 Feb 06
Posts: 22
Credit: 3,416,696
RAC: 451
Message 43769 - Posted: 11 Feb 2012, 0:49:05 UTC - in response to Message 43768.  

Ah, yes. Thanks.
ID: 43769 · Report as offensive     Reply Quote
richard schumacher

Send message
Joined: 20 Feb 06
Posts: 22
Credit: 3,416,696
RAC: 451
Message 43770 - Posted: 11 Feb 2012, 12:22:43 UTC - in response to Message 43757.  

Would a donation of money or equipment help?
ID: 43770 · Report as offensive     Reply Quote
MarkJ
Avatar

Send message
Joined: 28 Mar 09
Posts: 126
Credit: 9,825,980
RAC: 0
Message 43775 - Posted: 11 Feb 2012, 22:51:11 UTC - in response to Message 43770.  

Would a donation of money or equipment help?


On that point I don't recall seeing a Donate option anywhere on CPDN like most other projects seem to have. Is there one?
BOINC blog
ID: 43775 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 43777 - Posted: 11 Feb 2012, 23:06:53 UTC - in response to Message 43775.  

... I don't recall seeing a Donate option ...


Start on the front page of the project, here.

In the menu to the right, click on:
About
then Donations

The nature of the current problem hasn't been determined yet.
And it's the weekend. Again.


Backups: Here
ID: 43777 · Report as offensive     Reply Quote
richard schumacher

Send message
Joined: 20 Feb 06
Posts: 22
Credit: 3,416,696
RAC: 451
Message 43797 - Posted: 14 Feb 2012, 13:20:39 UTC - in response to Message 43777.  

Uploads can stack up indefinitely and not be lost, true?
ID: 43797 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4314
Credit: 16,377,675
RAC: 3,657
Message 43798 - Posted: 14 Feb 2012, 13:45:46 UTC - in response to Message 43797.  

Yes they can - one of the three I had pending went through about an hour ago but the relevant server was then shown as being down again though a few seconds ago it was back up.
ID: 43798 · Report as offensive     Reply Quote
Ingleside

Send message
Joined: 5 Aug 04
Posts: 108
Credit: 18,234,265
RAC: 35,417
Message 43803 - Posted: 15 Feb 2012, 0:30:35 UTC - in response to Message 43797.  

Uploads can stack up indefinitely and not be lost, true?

Not completely indefinitely, if you're running an old BOINC-client the cut-off is 14 days from 1st. upload-try of each individual upload, while with v6.10.0 and later BOINC-clients the cut-off has been extended to 90 days.

ID: 43803 · Report as offensive     Reply Quote

Message boards : Number crunching : Upload stops at 10MB with HTTP error

©2024 climateprediction.net