Odd behavior with rubygems

Tim Carey-Smith's Avatar

Tim Carey-Smith

05 Feb, 2010 07:02 PM

Hi,

At Engine Yard we are seeing odd search results on our EC2 instances when doing gem search/list.
We're unsure if it is a problem with rubygems or our ruby patchlevel.

The script we've been using to reproduce has been:
https://gist.github.com/791f92b770205495411a

Some results are as follows:
https://gist.github.com/fbfb8408bd3e095a4a7b

The odd thing is that the version at the end do not seem to exist.
http://www.gemcutter.org/gems/twitter4r/versions

Other output is:
https://gist.github.com/68b68dedf99effbe8df7
https://gist.github.com/c4ceb45aba1aa39e3c28

This is happening for multiple different gems.
Please let us know if you need access to an EC2 instance which you can test on.

Thanks a lot,
Tim

  1. Support Staff 1 Posted by Nick Quaranto on 05 Feb, 2010 07:17 PM

    Nick Quaranto's Avatar

    I tried to look into this yesterday but couldn't come to a conclusion as to what's going on...it seems like the local cache is getting corrupted.

    I tried running some queries on the results, couldn't really determine much:

    >> %w[0.5.2 0.5.1 0.5.0 0.4.8 0.4.7 0.4.6 0.4.5 0.4.3 0.1.0 0.0.39 0.0.38].map { |v| 
    Version.find_all_by_number(v, :include => :rubygem).map { |vv| vv.rubygem.name } 
    }.inject { |arr, n| arr & n }
    => ["dango", "dango_generator"]
    
  2. Support Staff 2 Posted by Eric Hodel on 07 Feb, 2010 06:12 AM

    Eric Hodel's Avatar

    Do the RubyGems tests run fine on your ruby patchlevel?

    Do the RubySpecs for Marshal run fine on your ruby patchlevel?

  3. 3 Posted by Tim Carey-Smith on 07 Feb, 2010 07:43 AM

    Tim Carey-Smith's Avatar

    Rubygems 1.3.5 tests fail
    https://gist.github.com/50dc8a67763d979fbc83.
    But it seems to be fixed:
    http://github.com/vvs/rubygems/commit/4cf260369268dffe36590cd96978e...
    Rubyspecs for marshal succeed.

  4. 4 Posted by Tim Carey-Smith on 10 Feb, 2010 08:29 PM

    Tim Carey-Smith's Avatar

    Hi there,

    Is there anything we can do to help debugging this?
    I just missed you on IRC.

  5. Support Staff 5 Posted by Nick Quaranto on 13 Mar, 2010 06:44 PM

    Nick Quaranto's Avatar

    Another update with this, I'm hearing reports from multiple sources about it:

    http://help.rubygems.org/discussions/problems/41-intermittent-gem-i...

    I'm still not sure about narrowing it down, but they're running gem sources -c before installing gems and that seems to help.

    Has this situation changed at all or are the install failures still happening?

  6. 6 Posted by apsoto on 13 Mar, 2010 08:33 PM

    apsoto's Avatar

    I've got my chef recipes doing a gem sources -c at the beginning of every run. I have seen reduced errors, but still seeing intermittent failures.

  7. Support Staff 7 Posted by John Barnette on 17 Nov, 2010 07:23 AM

    John Barnette's Avatar

    Repinging watchers. Any change in behavior, folks?

  8. 8 Posted by apsoto on 18 Nov, 2010 01:05 AM

    apsoto's Avatar

    To answer your question, I have not seen it for a while.

    However, I have been migrating away from Centos to Ubuntu, so that may change this. I have only a handful of Centos servers remaining. In addition, those are much less dependent on gems as well, so I'm running few to no gem installs on Centos lately.

    I have not observed this behavior on Ubuntu where I do have a lot of gem installs occurring.

Reply to this discussion

Internal reply

Formatting help / Preview (switch to plain text) No formatting (switch to Markdown)

Attached Files

You can attach files up to 10MB

If you don't have an account yet, we need to confirm you're human and not a machine trying to post spam.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac