Best way to query dependencies
Hi, I would like guidance/recommendations on how a third party tool can query rubygems without tripping limits. I run a service which monitors 50,000+ repositories for dependency updates so sticking to 15 requests per second is *really* tough. I suspect that Bundler itself may not use the JSON API, so is it allowed/recommended for third party tools to also query the same endpoints as Bundler does, to be as efficient as bundler is?
I also have some specific questions:
- Is the following URL legacy/dead/unmaintained? https://index.rubygems.org/versions
- Should a tool query URLs like https://index.rubygems.org/info/activesupport instead of https://index.rubygems.org/api/v1/versions/activesupport.json or it makes no difference to rate limits?
Keyboard shortcuts
Generic
| ? | Show this help |
|---|---|
| ESC | Blurs the current field |
Comment Form
| r | Focus the comment reply box |
|---|---|
| ^ + ↩ | Submit the comment |
You can use Command ⌘ instead of Control ^ on Mac
Support Staff 1 Posted by sonalkr132 on 13 Mar, 2019 02:54 PM
So far we haven't had to selectively increase this limit for any service provider.
No. index.rubygems.org is a just CNAME of rubygems.org. gems index endpoints will always be available on it.
Yes, both of them has limit of 10 req/sec. Only
/api/v1/dependencieshas limit of 15req/sec. You can check our nginx conf if you are interested in details.If current rate limits don't work for you at all, you can use our weekly data dump.