Aporia has been acquired by Coralogix, instantly bringing AI security and reliability to thousands of enterprises | Read the announcement
In this short how-to article, we will learn how to select multiple columns in Pandas and PySpark DataFrames.
We can select multiple columns by writing them in a list.
cols = ["f2", "f4"]
df[cols]The iloc method can be used for selecting columns based on their indices. Consider you have a DataFrame with 30 columns and you want to select the first 10. You can perform this task as follows:
# Select the first 10 columns
df.iloc[:,:10]
# Select from the second to fifth
df.iloc[:,2:5]The select function can be used for selecting multiple columns from a PySpark DataFrame.
# first method
df.select("f1", "f2")
# second method
df.select(df.f1, df.f2)
This tutorial will show you how to build a robust end-to-end ML pipeline with Databricks and Aporia. Here’s what you’ll...
Alon Gubkin
Dictionary is a built-in data structure of Python, which consists of key-value pairs. In this short how-to article, we will...
Aporia Team
A row in a DataFrame can be considered as an observation with several features that are represented by columns. We...
Aporia Team
DataFrame is a two-dimensional data structure with labeled rows and columns. Row labels are also known as the index of...
Aporia Team
DataFrames are great for data cleaning, analysis, and visualization. However, they cannot be used in storing or transferring data. Once...
Aporia Team
In this short how-to article, we will learn how to sort the rows of a DataFrame by the value in...
Aporia Team
In a column with categorical or distinct values, it is important to know the number of occurrences of each value....
Aporia Team
NaN values are also called missing values and simply indicate the data we do not have. We do not like...
Aporia Team