The most advanced ML Observability platform
We’re super excited to share that Aporia is now the first ML observability offering integration to the Databricks Lakehouse Platform. This partnership means that you can now effortlessly automate your data pipelines, monitor, visualize, and explain your ML models in production. Aporia and Databricks: A Match Made in Data Heaven One key benefit of this […]
Start integrating our products and tools.
We’re excited 😁 to share that Forbes has named Aporia a Next Billion-Dollar Company. This recognition comes on the heels of our recent $25 million Series A funding and is a huge testament that Aporia’s mission and the need for trust in AI are more relevant than ever. We are very proud to be listed […]
We sometimes need to create columns by combining two or more columns together. In this how-to article, we will learn how to combine two text columns in Pandas and PySpark DataFrames.
We can combine text columns with the “+” operator.
df["full_name"] = df["first_name"] + " " + df["last_name"]
The expression in between is used for adding a space between the first and last names. Another way of combining text columns is aggregating columns by joining.
df["full_name"] = df[["first_name","last_name"]].agg(" ".join, axis=1)
We can use both these methods to combine as many columns as needed. The only requirement is that the columns must be of object or string data type.
We can use the concat function for this task.
df = df.withColumn( "full_name", F.concat("first_name", F.lit(" "), "last_name") )
The lit function is used for adding the space between the first and last names.