Filtering Pandas Dataframe using OR statement

python pandas filter dataframe
Josh picture Josh · Apr 5, 2015 · Viewed 119.7k times · Source

I have a pandas dataframe and I want to filter the whole df based on the value of two columns in the data frame. I want to get back all rows and columns where IBRD or IMF != 0. 

alldata_balance = alldata[(alldata[IBRD] !=0) or (alldata[IMF] !=0)]

but this gives me a ValueError

ValueError: The truth value of a Series is ambiguous. Use a.empty, a.bool(), a.item(), a.any() or a.all().

So I know I am not using the or statement correctly, is there a way to do this?

Answer

Liam Foley picture Liam Foley · Apr 5, 2015

From the docs:

Another common operation is the use of boolean vectors to filter the data. The operators are: | for or, & for and, and ~ for not. These must be grouped by using parentheses.

http://pandas.pydata.org/pandas-docs/version/0.15.2/indexing.html#boolean-indexing

Try:

alldata_balance = alldata[(alldata[IBRD] !=0) | (alldata[IMF] !=0)]

Related questions

Delete rows if there are null values in a specific column in Pandas dataframe

I'm new to python pandas. Need some help with deleting a few rows where there are null values. In the screenshot, I need to delete rows where charge_per_line == "-" using python pandas.

Read More
Dynamically filtering a pandas dataframe

I am trying to filter a pandas data frame using thresholds for three columns import pandas as pd df = pd.DataFrame({"A" : [6, 2, 10, -5, 3], "B" : [2, 5, 3, 2, 6], "C" : [-5, 2, 1, 8, 2]}) df = df.loc[(df.A > 0) & (df.B > 2) & (df.C > …

Read More
how do you filter pandas dataframes by multiple columns

To filter a dataframe (df) by a single column, if we consider data with male and females we might: males = df[df[Gender]=='Male'] Question 1 - But what if the data spanned multiple years and i wanted to only see …

Read More