When testing your data engineering etl pipelines it can be a real help to quickly create simple DataFrames with the data scenarios you are transforming. Also, when you encounter problems in production that were unexpected, quickly creating test cases that account for that new situation are also highly beneficial. Thankfully the Spark Scala toDF function found in the implicits library can assist with this.

Ut molestiae voluptatem accusamus esse esse. Id consequuntur quam id odio qui illum nihil et modi id atque molestiae explicabo. Necessitatibus excepturi consequatur quis ab voluptatem eum nihil libero est libero temporibus enim tenetur