I'm new to Python. I learned C++ in college years ago and recently have been using VBA in excel. I've learned you can use Python to manipulate excel files and am trying to learn a new skill and streamline a weekly reporting requirement.

I'm trying to filter the data across multiple columns and multiple values in some columns.

So far I have:

OutputData = RawData [ (RawData['Column1']=='ABC') & (RawData['Column2']!='XYZ') ]

This works thus far, but how to I get:

Column3 == AAA or BBB

Also, how would I exclude values starting with CCC

Hi,

I have a csv file with approx. 100 columns and I want to filter rows if two of the columns are set to a value of X and the other columns are blank / Nan values. In order to make the code more readable, I would like to specify the column names in a list and then use the variable name within the Pandas query e.g. something like the following:

my_file=/home/test.csv
my_df=pd.read_csv(my_file)

control_fields=['Is_Active','Is_Valid']  
data_fields=['Age','DOB','Country','City']  

As a starting point, I have tried the following but this isn't filtering the data at all:

my_new_df=my_df[my_df['control_fields']==1]

Can someone please explain why the above isn't working and also advise if there is a better way of achieving my requirement?

Thanks!