Marshal.load encoding error #456
Description
When trying using the tactful_tokenizer gem, you get this error.
matt$ bundle exec irb
irb(main):001:0> require 'tactful_tokenizer'
=> true
irb(main):002:0> m = TactfulTokenizer::Model.new; nil
ArgumentError: invalid encoding in marshaling stream: f
from org/jruby/RubyMarshal.java:148:in `load'
from /Users/matt/.rbenv/versions/jruby-1.7.1/lib/ruby/gems/shared/gems/tactful_tokenizer-0.0.2/lib/tactful_tokenizer.rb:55:in `initialize'
from org/jruby/RubyIO.java:1183:in `open'
from /Users/matt/.rbenv/versions/jruby-1.7.1/lib/ruby/gems/shared/gems/tactful_tokenizer-0.0.2/lib/tactful_tokenizer.rb:54:in `initialize'
from org/jruby/RubyArray.java:2360:in `map'
from /Users/matt/.rbenv/versions/jruby-1.7.1/lib/ruby/gems/shared/gems/tactful_tokenizer-0.0.2/lib/tactful_tokenizer.rb:53:in `initialize'
from (irb):52:in `evaluate'
from org/jruby/RubyKernel.java:1066:in `eval'
from org/jruby/RubyKernel.java:1392:in `loop'
from org/jruby/RubyKernel.java:1174:in `catch'
from org/jruby/RubyKernel.java:1174:in `catch'
from /Users/matt/.rbenv/versions/jruby-1.7.1/bin/irb:13:in `(root)'
I've confirmed that it works fine in MRI 1.9.3-p327.
tactful_tokenizer: https://github.com/SlyShy/Tactful_Tokenizer (though it's unclear exactly which version was shipped as 0.0.2, so you're probably better off with the gem sources themselves)