-
Notifications
You must be signed in to change notification settings - Fork 27
Instant update mirroring
The future tier'ed CPAN mirroring will use File::Rsync::Mirror::Recent (also known as rrr). Currently for CPAN mirroring (as opposed to PAUSE-only mirroring...) a recent version from git is recommended.
This setup is just in testing for now; don't try it unless you want to help make sure it works!
You can use this for the full CPAN; no need to separately use rrr for the PAUSE directories. When we move this to "full production" the changes from PAUSE will come through with an extra delay of just 10-30 seconds.
The goal of this is to find and fix any bugs in the rrr tools and make sure that all updates to CPAN comes through to your mirror the same as the traditional "full" rsync.
In production it'll likely be recommended to run a full rsync every few days in case rrr missed something; but for the testing please don't do that. Maybe it won't be necessary at all.
In the not too far future this or a variation of it will be in the main git repository, but for now get rrr-client from https://github.com/abh/rersyncrecent/raw/master/bin/rrr-client.
It will take a while to get synced up (and use a good deal of CPU), but after that it'll get the latest changes every 20 seconds with very little overhead.
Please sync into a separate directory from your regular "production CPAN mirror" for now (and report on any differences between the two!).
rrr-client --source cpan-rsync.perl.org::CPAN --target /home/mirrors/CPAN-rrr- Public, no authentication required: cpan-rsync.perl.org
- For "Tier 1" mirrors, cpan-rsync-master.perl.org; get a username and password from Ask.
Right now the two hostnames actually point to the same box, but when we're happy with the performance and reliability of the rrr tool, the plan is to make cpan-rsync.perl.org point to a group of instantly updated mirrors -- the "Tier 1" mirrors. With some clever DNS, we can even have clients of the tier 1 mirrors pull appropriately from a mirror in their country or on their continent.
If you wish to be a tier 1 mirror, please email [email protected] for a username/password for the master mirror for testing.