Stripping all trailing empty spaces in a column of a pandas dataframe

python pandas strip
headdetective picture headdetective · Dec 24, 2015 · Viewed 25.6k times · Source

I have a pandas DF that has many string elements that contains words like this:

'Frost                              '

Which has many leading white spaces in front of it. When I compare this string to:

'Frost'

I realized that the comparison was False due to the leading spaces.

Although I can solve this by iterating over every element of the pandas DF, the process is slow due to the large number of records I have.

This other approach should work, but it is not working:

rawlossDF['damage_description'] = rawlossDF['damage_description'].map(lambda x: x.strip(''))

So when I inspect an element:

rawlossDF.iloc[0]['damage_description']

It returns:

'Frost                              '

What's going on here?

Answer

Luis Miguel picture Luis Miguel · Dec 24, 2015

Replace your function with this:

rawlossDF['damage_description'] = rawlossDF['damage_description'].map(lambda x: x.strip())

You almost had it right, you needed to get rid off the '' inside strip()

Related questions

Removing space in dataframe python

I am getting an error in my code because I tried to make a dataframe by calling an element from a csv. I have two columns I call from a file: CompanyName and QualityIssue. There are three types of Quality …

Read More
'float' object has no attribute 'strip'

I want to clean one column of my df['emp_length'] [shown in the screen shot]1 but when I use df_10v['emp_length'] = df_10v['emp_length'].map(lambda x: x.lstrip('<').rstrip('+')) to …

Read More
How to select rows from a DataFrame based on column values

How can I select rows from a DataFrame based on values in some column in Pandas? In SQL, I would use: SELECT * FROM table WHERE colume_name = some_value I tried to look at Pandas' documentation, but I did not …

Read More