Back to Blog
How-To

How to Check If a DataFrame is Empty

How to Check if DataFrame is Empty Pandas and PySpark
Dor Schwartz Dor Schwartz 1 min read Sep 06, 2022

An empty DataFrame is one that does not contain any data points (i.e., rows). In this short how-to article, we will learn how to check if a Pandas or PySpark DataFrame is empty.

check-if-dataframe-is-empty
 

Pandas

We can use the empty method which returns True if the DataFrame is empty.

df.empty
True

We can also check the number of rows in a DataFrame using the len function or the shape method. If they return 0, then the DataFrame is empty.

len(df) == 0
True

df.shape[0] == 0
True

PySpark

We can count the number of rows using the count method and check if it equals to zero.

df.count() == 0
True

Another way of checking if a DataFrame is empty is the isEmpty method.

df.rdd.isEmpty()
True

This question is also being asked as:

  • Removing empty DataFrames inside a dictionary

People have also asked for:

Rate this article

Average rating 0 / 5. Vote count: 0

No votes so far! Be the first to rate this post.

Slack

On this page

Blog
Building a RAG app?

Consider AI Guardrails to get to production faster

Learn more
Table of Contents

Related Articles