`write': "\xCF" from ASCII-8BIT to UTF-8 (Encoding::UndefinedConversionError) while writing to file from url

Vadim picture Vadim · Jul 14, 2017 · Viewed 7.1k times · Source

I am getting error:

write': "\xCF" from ASCII-8BIT to UTF-8 (Encoding::UndefinedConversionError)

from line:

open(uri) {|url_file| tempfile.write(url_file.read)}

relevant code is:

require 'tempfile'
require 'open-uri'
require 'uri'
..
uri = URI.parse(@download_link)
tempfile = Tempfile.create(file_name)
open(uri) {|url_file| tempfile.write(url_file.read)}`
..

It runs completely fine if I run it like ruby lib/file.rb, but gives error when I run it in rails environment: rails runner lib/file.rb.

Most questions with this error refer to gem installation scenarios. My guess that I have to include/update some gems, but have no idea which.

Answer

Michael Malov picture Michael Malov · Jul 14, 2017

Use force_encoding:

open(uri) {|url_file| tempfile.write(url_file.read.force_encoding("UTF-8"))