tag:help.rubygems.org,2010-01-19:/discussions/suggestions/3311-rsync-mirrorsRubyGems.org: Discussion 2015-08-17T19:42:27Ztag:help.rubygems.org,2010-01-19:Comment/262496632013-04-09T20:14:30Z2013-04-09T20:14:31Zrsync mirrors?<div><p>bump</p></div>smcclanahantag:help.rubygems.org,2010-01-19:Comment/262496632013-05-08T00:15:55Z2013-05-08T00:15:55Zrsync mirrors?<div><p>Agreed. Check out this thread:</p>
<p><a href=
"http://help.rubygems.org/discussions/problems/5225-any-successful-internal-mirroring-solutions-out-there-for-rubygemsorg">
http://help.rubygems.org/discussions/problems/5225-any-successful-i...</a></p>
<p>We really just need people who are excited and passionate about
making sure mirroring works to help make it work and stick around
to help.</p></div>Nick Quarantotag:help.rubygems.org,2010-01-19:Comment/262496632014-11-21T21:42:43Z2014-11-21T21:42:44Zrsync mirrors?<div><p>It appears that there has been some <a href=
"https://github.com/rubygems/rubygems-mirror/pull/27">recent
work</a> on rubygems-mirror to simply mirror the index files rather
than rebuilding them locally. But an rsync still seems like the
most sensible solution.</p>
<p>I've done a lot of work with the CPAN ecosystem, and I'm
starting to poke around in Ruby-land. For CPAN, we have the
<a href="https://metacpan.org/source/ANDK/File-Rsync-Mirror-Recent-0.3.4/HOWTO.mirrorcpan">
rrr</a> client which uses rsync under the hood.</p>
<p>rrr uses a set of <code>RECENT</code> files on the server to
figure out exactly which things need to be mirrored since a certain
point in time, rather than letting rsync scan the entire filesystem
every time. This greatly reduces the load on the upstream server
(and clients too) and allows CPAN to support hundreds of mirrors
that are synchronized in near real-time.</p>
<p>Would something like that make sense for rubygems.org? I could
certainly cook it up.</p></div>Jeffrey Thalhammertag:help.rubygems.org,2010-01-19:Comment/262496632015-01-06T22:22:07Z2015-01-06T22:22:07Zrsync mirrors?<div><p>I'm wishing for a working solution to this as well, as
generate_index is not behaving well for me either. Trying to figure
out the best way to handle this.</p></div>Steve Snodgrass