[mirrorbrain] MirrorBrain with IETF Metalink support (was: Re: The Transition)

From: Peter Pöml <poeml_at_cmdline.net>
Date: Fri, 12 Mar 2010 01:23:33 +0100
Hi,

Am 27.02.2010 um 21:00 schrieb Anthony Bryan:
> Peter is working on it for MirrorBrain. it'll nice to be test it out
> with aria2/checker.

I implemented most of it now! Actually, all I can think of right now. Inclusion of Torrent links is missing yet, and maybe I forgot something else.

*Please test*:

Small file (1.4MB): http://go-oo.mirrorbrain.org/stable/linux-i586/3.2/ooobasis3.2-sw-TZ-calc-3.2.0-9483.i586.rpm
Huge file: http://go-oo.mirrorbrain.org/builder/ooobuilder-1.tar.bz2

Append .meta4 to get the Metalink - or .metalink to get the old (v3) metalink.

I tested with checker, and it didn't complain!

Transparent negotiation is still there btw, based on the Accept header for metalink+xml resp. metalink4+xml.

An important requirement for this change was that old v3 Metalinks are still completely supported, and don't collide in any way, mainly for long-term support of openSUSE 11.2 which uses aria2c for downloading extensively.  


A major restructuring was required to improve working with verification hashes. I redesigned the cache of hashes and moved it from on-disk storage into the database (see http://mirrorbrain.org/issues/issue40). A side effect is that now many more things can be done with the hashes. For instance, the mirror lists that you get by appending ?mirrorlist or .mirrorlist now include them:
http://go-oo.mirrorbrain.org/builder/ooobuilder-1.tar.bz2.mirrorlist
Things like adding checksums to HTTP headers becomes feasible now, which is great.

Peter



_______________________________________________
mirrorbrain mailing list
Archive: http://mirrorbrain.org/archive/mirrorbrain/

Note: To remove yourself from this mailing list, send a mail with the content
 	unsubscribe
to the address mirrorbrain-request_at_mirrorbrain.org
Received on Fri Mar 12 2010 - 00:23:46 GMT

This archive was generated by hypermail 2.3.0 : Thu Mar 25 2010 - 19:30:56 GMT