pyMySQL set connection character set

python mysql unicode pymysql
MalphasWats picture MalphasWats · Jun 18, 2012 · Viewed 23.7k times · Source

I'm developing a fairly straightforward web app using Flask and MySQL.

I'm struggling with unicode. Users sometimes paste stuff that they copied from Word and it's falling over with the old smart quotes u'\u201c'.

A little bit of investigation shows that the connection I have to MySQL is using the Latin1 charset (seems to be the default).

How can I specify for it to use unicode for its connection?

I'm using pyMySQL, which purports to be a drop-in replacement for MySQLdb. MySQLdb defines a set_character_set(self, charset) function for connection objects, but pyMySQL doesn't (I get an error if I try).

Answer

MalphasWats picture MalphasWats · Jun 18, 2012

I worked it out by poking around in the pyMySQL source (I had tried, but couldn't find the right place!).

You can specify it when you create the connection:

conn = pymysql.connect(host='localhost',
                       user='username',
                       passwd='password',
                       db='database',
                       charset='utf8')

Solved my problem.

Related questions

UnicodeEncodeError: 'latin-1' codec can't encode character

What could be causing this error when I try to insert a foreign character into the database? >>UnicodeEncodeError: 'latin-1' codec can't encode character u'\u201c' in position 0: ordinal not in range(256) And how do I resolve …

Read More
MySQL "incorrect string value" error when save unicode string in Django

I got strange error message when tried to save first_name, last_name to Django's auth_user model. Failed examples user = User.object.create_user(username, email, password) user.first_name = u'Rytis' user.last_name = u'Slatkevičius' user.save() >&…

Read More
Python & MySql: Unicode and Encoding

I am parsing json data and trying to store some of the json data into Mysql database. I am currently getting following unicode error. My question is how should I handle this. Should I handle it from the database side, …

Read More