python pandas read_csv not recognizing \t in tab delimited file

Omar picture Omar · Aug 1, 2017 · Viewed 27.6k times · Source

I'm trying to read in the following tab separated data into pandas:
test.txt:

col_a\tcol_b\tcol_c\tcol_d
4\t3\t2\t1  
4\t3\t2\t1 

I import test.txt as follows:

pd.read_csv('test.txt',sep='\t')

The resulting dataframe has 1 column. The \t is not recognized as tab.

If I replace \t with a 'keyboard tab' the file is parsed correctly. I also tried replacing '\t with \t and /t and didn't have any luck.

Thanks in advance for your help.
Omar

PS: Screenshot http://imgur.com/a/nXvW3

Answer

piRSquared picture piRSquared · Aug 1, 2017

The \t in your file is an actual backslash followed by a t. It is not a tab. You're going to have to use some escape characters on your sep parameter.

pd.read_csv('test.txt', sep=r'\\t', engine='python')

   col_a  col_b  col_c  col_d
0      4      3      2      1
1      4      3      2      1

Or

pd.read_csv('test.txt', sep='\\\\t', engine='python')

   col_a  col_b  col_c  col_d
0      4      3      2      1
1      4      3      2      1

response to comment

The r is indicating that it is a raw string and special characters should be interpreted the raw character. That is why in one solution I indicated that the string was raw and only had two backslashes. In the other, I had to escape each backslash with another backslash, leaving four backslashes.