Using xlrd to read Excel xls file containing Chinese and/or Hindi characters

Hulk picture Hulk · Aug 18, 2010 · Viewed 16.2k times · Source

http://scienceoss.com/read-excel-files-from-python/comment-page-1/#comment-1051

From the above link, I used this utility to read an XLS file. If the XLS file contains different language characters like Chinese or Hindi, it does not output them correctly. Is there a workaround for this?

After Googling, I found this:

import xlrd

def upload_xls(dir,file,request):
    try:
        global msg
        global row_num
        row_num = []
        header_arr = []
        global file_path
        file_path = dir
        #reader = csv.reader(open(file), delimiter='#', quotechar='"')
        book = xlrd.open_workbook('dodgy.xls',encoding='cp1252')   ##To specify UTF8-encoding
        wb.sheet_names()
        sh =  wb.sheet_by_index(0)
        valid_xl_format = 0
        invalid_xl_format = 0
     except:
        print "Error

But there is an error in the line book = open_workbook('dodgy.xls',encoding='cp1252'):

TypeError: open_workbook() got an unexpected keyword argument 'encoding'

Answer

John Machin picture John Machin · Aug 19, 2010

[dis]claimer: I'm the author of xlrd.

If the xls contains different language characters like chine or hindi.It does not output the exact wordings.Is there a work around for this..

The encoding_override argument is (as explained in the documentation) used ONLY for OLD files (produced by Excels earlier than Excel 97 (that's the year 1997)) and only then when the internally-recorded "codepage" is missing or incorrect.

Note: Old file with Chinese characters: Overriding with 'cp1252' is guaranteed to raise an exception.

Note: Old file with "Hindi" (Devanagari?) characters: very unlikely ... as far as I know there never was an officially-supported codepage for any of the ISCII scripts, and I haven't heard of any unofficial one. Any information on this topic and/or sample files would be very welcome.

Excel 97 and later versions record all text data in (effectively) UTF-16LE. The encoding_override is ignored if the file is a valid Excel-97-or-later file.

Whatever the version of Excel that produced the file, (as documented) xlrd returns unicode strings. Your problems are much more likely to be related to how you are displaying or converting those unicode strings.

For further assistance, edit your question to show examples of the actual output together with the "exact wording".