Odd behavior with rubygems

Tim Carey-Smith's Avatar

Tim Carey-Smith

05 Feb, 2010 07:02 PM

Hi,

At Engine Yard we are seeing odd search results on our EC2 instances when doing gem search/list.
We're unsure if it is a problem with rubygems or our ruby patchlevel.

The script we've been using to reproduce has been:
https://gist.github.com/791f92b770205495411a

Some results are as follows:
https://gist.github.com/fbfb8408bd3e095a4a7b

The odd thing is that the version at the end do not seem to exist.
http://www.gemcutter.org/gems/twitter4r/versions

Other output is:
https://gist.github.com/68b68dedf99effbe8df7
https://gist.github.com/c4ceb45aba1aa39e3c28

This is happening for multiple different gems.
Please let us know if you need access to an EC2 instance which you can test on.

Thanks a lot,
Tim

  1. Support Staff 1 Posted by Nick Quaranto on 05 Feb, 2010 07:17 PM

    Nick Quaranto's Avatar

    I tried to look into this yesterday but couldn't come to a conclusion as to what's going on...it seems like the local cache is getting corrupted.

    I tried running some queries on the results, couldn't really determine much:

    >> %w[0.5.2 0.5.1 0.5.0 0.4.8 0.4.7 0.4.6 0.4.5 0.4.3 0.1.0 0.0.39 0.0.38].map { |v| 
    Version.find_all_by_number(v, :include => :rubygem).map { |vv| vv.rubygem.name } 
    }.inject { |arr, n| arr & n }
    => ["dango", "dango_generator"]
    
  2. Support Staff 2 Posted by Eric Hodel on 07 Feb, 2010 06:12 AM

    Eric Hodel's Avatar

    Do the RubyGems tests run fine on your ruby patchlevel?

    Do the RubySpecs for Marshal run fine on your ruby patchlevel?

  3. 3 Posted by Tim Carey-Smith on 07 Feb, 2010 07:43 AM

    Tim Carey-Smith's Avatar

    Rubygems 1.3.5 tests fail
    https://gist.github.com/50dc8a67763d979fbc83.
    But it seems to be fixed:
    http://github.com/vvs/rubygems/commit/4cf260369268dffe36590cd96978e...
    Rubyspecs for marshal succeed.

  4. 4 Posted by Tim Carey-Smith on 10 Feb, 2010 08:29 PM

    Tim Carey-Smith's Avatar

    Hi there,

    Is there anything we can do to help debugging this?
    I just missed you on IRC.

  5. Support Staff 5 Posted by Nick Quaranto on 13 Mar, 2010 06:44 PM

    Nick Quaranto's Avatar

    Another update with this, I'm hearing reports from multiple sources about it:

    http://help.rubygems.org/discussions/problems/41-intermittent-gem-i...

    I'm still not sure about narrowing it down, but they're running gem sources -c before installing gems and that seems to help.

    Has this situation changed at all or are the install failures still happening?

  6. 6 Posted by apsoto on 13 Mar, 2010 08:33 PM

    apsoto's Avatar

    I've got my chef recipes doing a gem sources -c at the beginning of every run. I have seen reduced errors, but still seeing intermittent failures.

  7. 7 Posted by John Barnette on 17 Nov, 2010 07:23 AM

    John Barnette's Avatar

    Repinging watchers. Any change in behavior, folks?

  8. 8 Posted by apsoto on 18 Nov, 2010 01:05 AM

    apsoto's Avatar

    To answer your question, I have not seen it for a while.

    However, I have been migrating away from Centos to Ubuntu, so that may change this. I have only a handful of Centos servers remaining. In addition, those are much less dependent on gems as well, so I'm running few to no gem installs on Centos lately.

    I have not observed this behavior on Ubuntu where I do have a lot of gem installs occurring.

Reply to this discussion

Internal reply

Formatting help / Preview (switch to plain text) No formatting (switch to Markdown)

Attaching KB article:

»

Attached Files

You can attach files up to 10MB

If you don't have an account yet, we need to confirm you're human and not a machine trying to post spam.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac