In this short how-to article, we will learn how to sort the rows of a DataFrame by the value in a column in Pandas and PySpark.
The sort_values function can be used for this task. We just need to give it the column name.
df.sort_values(by="Age")By default, the index of the rows prior to sorting are kept, which is not an ideal situation. We can change this behavior by using the ignore_index parameter.
df.sort_values(by="Age", ignore_index=True)By default, the values are sorted in ascending order and this can be changed using the ascending parameter.
df.sort_values(by="Age", ignore_index=True, ascending=False)The orderBy function can be used for this task. The syntax is similar to that of the sort_values function of Pandas.
df.orderBy("number")The orderBy also sorts rows in ascending order. We can use the ascending parameter to sort in descending order.
df.orderBy("number", ascending=False)
This tutorial will show you how to build a robust end-to-end ML pipeline with Databricks and Aporia. Here’s what you’ll...
Alon Gubkin
Dictionary is a built-in data structure of Python, which consists of key-value pairs. In this short how-to article, we will...
Aporia Team
A row in a DataFrame can be considered as an observation with several features that are represented by columns. We...
Aporia Team
DataFrame is a two-dimensional data structure with labeled rows and columns. Row labels are also known as the index of...
Aporia Team
DataFrames are great for data cleaning, analysis, and visualization. However, they cannot be used in storing or transferring data. Once...
Aporia Team
In a column with categorical or distinct values, it is important to know the number of occurrences of each value....
Aporia Team
NaN values are also called missing values and simply indicate the data we do not have. We do not like...
Aporia Team
DataFrame is a two-dimensional data structure, which consists of labeled rows and columns. Each row can be considered as a...
Aporia Team
