climateprediction.net home page
Upload stops at 10MB with HTTP error
Upload stops at 10MB with HTTP error
log in

Advanced search

Message boards : Number crunching : Upload stops at 10MB with HTTP error

Author Message
JanBogutzki
Send message
Joined: 21 Dec 11
Posts: 2
Credit: 119,995
RAC: 0
Message 43745 - Posted: 4 Feb 2012, 12:17:41 UTC

04.02.2012 13:13:03 | climateprediction.net | Temporarily failed upload of hadam3p_eu_86rz_2002_1_007691326_2_5.zip: HTTP error
04.02.2012 13:13:03 | climateprediction.net | Backing off 8 hr 48 min 57 sec on upload of hadam3p_eu_86rz_2002_1_007691326_2_5.zip
04.02.2012 13:13:06 | | Project communication failed: attempting access to reference site
04.02.2012 13:13:08 | | Internet access OK - project servers may be temporarily down.

The upload tries since yesterday and has no chance to complete. Seems to me, that there is a problem with this file (13MB) when the uplaod reaches 10MB.
____________
test PHP online: md5, preg_match, ...

Les Bayliss
Volunteer moderator
Send message
Joined: 5 Sep 04
Posts: 6233
Credit: 14,607,204
RAC: 543
Message 43746 - Posted: 4 Feb 2012, 13:36:36 UTC - in response to Message 43745.

It might be the bug in BOINC when there are several files to upload, and the connection is slow.
Try Thyme Lawn's solution in this post on our other board.

It might also be a different problem, where one of the nodes between you and the project is using an older version of HTTP, which can be fixed with a different option in cc_config.

Ask again if the fix above doesn't work.


____________
Backups: Here

JanBogutzki
Send message
Joined: 21 Dec 11
Posts: 2
Credit: 119,995
RAC: 0
Message 43747 - Posted: 4 Feb 2012, 14:11:45 UTC

There are no other uploads, the only thing i have limited is the bandwith of the upload. Without this limit, the upload is working. Seems to be a bug in the server software ...
____________
test PHP online: md5, preg_match, ...

Profile Thyme Lawn
Volunteer moderator
Send message
Joined: 5 Aug 04
Posts: 1266
Credit: 12,068,949
RAC: 1,197
Message 43757 - Posted: 5 Feb 2012, 15:29:10 UTC

The problem is in the BOINC client rather than the server. It's related to the way uploads are handled (blocks of data are store in a cache which is refreshed as it starts to run down, with a default timeout of 5 minutes on the refresh). It's possible your upload is hitting BOINC's transfer inactivity limit, particularly if some of your other projects start large uploads when your CPDN file is being uploaded. The post Les linked to partially caters for that.

For the complete solution you need to be running BOINC 6.12.27 or later which added an option to increase the inactivity timeout. The change is documented as follows in BOINC Client Configuration:

<http_transfer_timeout>seconds</http_transfer_timeout> abort HTTP transfers if idle for this many seconds; default 300 + New in 6.12.27

As in the post Les linked to, you'll need to create a cc_config.xml file in your BOINC data directory with the timeout you require. My file (with the upload limit set to 30 Kbytes/sec) contains the following, increasing the timeout limit to 30 minutes:
<cc_config>
<options>
<http_transfer_timeout>1800</http_transfer_timeout>
<max_file_xfers>3</max_file_xfers>
<max_file_xfers_per_project>1</max_file_xfers_per_project>
</options>
</cc_config>

____________
"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer

richard schumacher
Send message
Joined: 20 Feb 06
Posts: 22
Credit: 3,218,256
RAC: 0
Message 43765 - Posted: 10 Feb 2012, 13:53:55 UTC - in response to Message 43757.

I have an upload which immediately halts:
Fri Feb 10 07:40:33 2012 | climateprediction.net | Started upload of hadam3p_eu_9bqy_1961_1_007735282_1_12.zip
Fri Feb 10 07:40:34 2012 | climateprediction.net | Temporarily failed upload of hadam3p_eu_9bqy_1961_1_007735282_1_12.zip: HTTP error
Fri Feb 10 07:40:34 2012 | climateprediction.net | Backing off 8 hr 57 min 16 sec on upload of hadam3p_eu_9bqy_1961_1_007735282_1_12.zip


Can this be a timeout? While this result has been mouldering at least one other completed result has uploaded successfully.
____________

Profile Dave Jackson
Send message
Joined: 15 May 09
Posts: 1357
Credit: 1,900,281
RAC: 3,506
Message 43766 - Posted: 10 Feb 2012, 14:29:55 UTC - in response to Message 43765.

My guess is that this is probably due to uploader1.atm being out at the moment - if you look at the server status page. Different zip files go to different servers which would account for some going through fine.

Dave

Les Bayliss
Volunteer moderator
Send message
Joined: 5 Sep 04
Posts: 6233
Credit: 14,607,204
RAC: 543
Message 43768 - Posted: 10 Feb 2012, 15:24:35 UTC

uploader1.atm is having a lot of problems, and the project people are trying to deal with it. It may need to be replaced.
This is the server that stores the EU models. The others go to a different server.


____________
Backups: Here

richard schumacher
Send message
Joined: 20 Feb 06
Posts: 22
Credit: 3,218,256
RAC: 0
Message 43769 - Posted: 11 Feb 2012, 0:49:05 UTC - in response to Message 43768.

Ah, yes. Thanks.
____________

richard schumacher
Send message
Joined: 20 Feb 06
Posts: 22
Credit: 3,218,256
RAC: 0
Message 43770 - Posted: 11 Feb 2012, 12:22:43 UTC - in response to Message 43757.

Would a donation of money or equipment help?
____________

MarkJ
Avatar
Send message
Joined: 28 Mar 09
Posts: 114
Credit: 9,825,980
RAC: 267
Message 43775 - Posted: 11 Feb 2012, 22:51:11 UTC - in response to Message 43770.

Would a donation of money or equipment help?


On that point I don't recall seeing a Donate option anywhere on CPDN like most other projects seem to have. Is there one?
____________
BOINC blog

Les Bayliss
Volunteer moderator
Send message
Joined: 5 Sep 04
Posts: 6233
Credit: 14,607,204
RAC: 543
Message 43777 - Posted: 11 Feb 2012, 23:06:53 UTC - in response to Message 43775.

... I don't recall seeing a Donate option ...


Start on the front page of the project, here.

In the menu to the right, click on:
About
then Donations

The nature of the current problem hasn't been determined yet.
And it's the weekend. Again.


____________
Backups: Here

richard schumacher
Send message
Joined: 20 Feb 06
Posts: 22
Credit: 3,218,256
RAC: 0
Message 43797 - Posted: 14 Feb 2012, 13:20:39 UTC - in response to Message 43777.

Uploads can stack up indefinitely and not be lost, true?
____________

Profile Dave Jackson
Send message
Joined: 15 May 09
Posts: 1357
Credit: 1,900,281
RAC: 3,506
Message 43798 - Posted: 14 Feb 2012, 13:45:46 UTC - in response to Message 43797.

Yes they can - one of the three I had pending went through about an hour ago but the relevant server was then shown as being down again though a few seconds ago it was back up.

Ingleside
Send message
Joined: 5 Aug 04
Posts: 95
Credit: 9,003,655
RAC: 0
Message 43803 - Posted: 15 Feb 2012, 0:30:35 UTC - in response to Message 43797.

Uploads can stack up indefinitely and not be lost, true?

Not completely indefinitely, if you're running an old BOINC-client the cut-off is 14 days from 1st. upload-try of each individual upload, while with v6.10.0 and later BOINC-clients the cut-off has been extended to 90 days.

Message boards : Number crunching : Upload stops at 10MB with HTTP error


Main page · Your account · Message boards


Copyright © 2016 climateprediction.net