Info about the MirrorBrain Scanner
The MirrorBrain mirror scanner is a script which crawls mirrors and checks which files it contains. The list of files is stored in a database which is used by the MirrorBrain download redirector.
In the logs, it will show up like this:
195.135.221.138 - - [22/Nov/2007:11:16:39 +0100] "GET /repositories/Banshee/ HTTP/1.1" 200 1046 "-" "MirrorBrain Scanner/0.9c (See http://mirrorbrain.org/scanner_info)" 194 1294 195.135.221.138 - - [22/Nov/2007:11:16:39 +0100] "GET /repositories/Banshee/Fedora_7/ HTTP/1.1" 200 1407 "-" "MirrorBrain Scanner/0.9c (See http://mirrorbrain.org/scanner_info)" 203 1656 195.135.221.138 - - [22/Nov/2007:11:16:39 +0100] "GET /repositories/Banshee/Fedora_7/i386/ HTTP/1.1" 200 889 "-" "MirrorBrain Scanner/0.9c (See http://mirrorbrain.org/scanner_info)" 208 1137
The code lives here: http://svn.mirrorbrain.org/svn/mirrorbrain/trunk/tools/scanner.pl
See here for general information about the mirroring framework.
For questions, suggestions, bug reports please mail to the contact address. Thanks!