Python encoding characters with urllib.quote

python encoding urllib
Saulpila picture Saulpila · Jun 21, 2011 · Viewed 32k times · Source

I'm trying to encode non-ASCII characters so I can put them inside an url and use them in urlopen. The problem is that I want an encoding like JavaScript (that for example encodes ó as %C3%B3):

encodeURIComponent(ó)
'%C3%B3'

But urllib.quote in python returns ó as %F3:

urllib.quote(ó)
'%F3'

I want to know how to achieve an encoding like javascript's encodeURIComponent in Python, and also if I can encode non ISO 8859-1 characters like Chinese. Thanks!

Answer

Bryan picture Bryan · Jun 21, 2011

You want to make sure you're using unicode.

Example:

import urllib

s = u"ó"
print urllib.quote(s.encode("utf-8"))

Outputs:

%C3%B3

Related questions

How to percent-encode URL parameters in Python?

If I do url = "http://example.com?p=" + urllib.quote(query) It doesn't encode / to %2F (breaks OAuth normalization) It doesn't handle Unicode (it throws an exception) Is there a better library?

Read More
How to handle response encoding from urllib.request.urlopen()

I'm trying to search a webpage using regular expressions, but I'm getting the following error: TypeError: can't use a string pattern on a bytes-like object I understand why, urllib.request.urlopen() returns a bytestream and so, at least I'm guessing, …

Read More
Python standard library to POST multipart/form-data encoded data

I would like to POST multipart/form-data encoded data. I have found an external module that does it: http://atlee.ca/software/poster/index.html however I would rather avoid this dependency. Is there a way to do this using …

Read More