threads / discuss / 16111

large publicly accessible HTTP archive?

Subject: large publicly accessible HTTP archive?

## tl;dr

2 messages between Oct 31, 2008 and Oct 31, 2008.

replies: 1people: 2as markdown or json

Bryan Larsen· Oct 31, 2008, 17:07 UTC · lore
Hello,
I'm one of the maintainers of MacPorts git port.

A long time ago, we had problems pulling extremely large archives over HTTP on PowerPC machines. By large, I mean on the order of 500 megabytes: I was testing using an embedded Linux distribution.

We "fixed" the problem by turning off CURL_MULTI and ignored the problem. Yes, bad form, I know.

Our problems were against curl 7.16.2.

However, in recent git's, CURL_MULTI is required to do an HTTP push, so we've had users complaining.

Curl is up to 7.19.0, they may have fixed our problem. Unfortunately, the distribution I used for testing is gone now. Putting up a local archive doesn't exhibit the problem either.

Is anybody aware of a very large HTTP accessible repository that wouldn't mind me doing a few test pulls from? By large, I mean >500 megabytes of network traffic for a single pull.

thanks, Bryan

Daniel Stenberg· Oct 31, 2008, 19:01 UTC · re: Bryan Larsen · lore

Re: large publicly accessible HTTP archive?

On Fri, 31 Oct 2008, Bryan Larsen wrote:
> We "fixed" the problem by turning off CURL_MULTI and ignored the problem. 
>
> Our problems were against curl 7.16.2.

Right, libcurl has had 8 releases since with perhaps an average of 30 bugfixes per release so...

I'm not aware of any current known libcurl bugs with the multi interface and "simple" HTTP transfers such as this.

-- 
  / daniel.haxx.se - libcurl hacker

← back to recent threads