Skip to content

Releases: mrpowers-io/spark-daria

v0.5.0

19 May 16:50
Compare
Choose a tag to compare

Summary of changes:

  • Update the createDF method to use the terse syntax of the toDF method with the control of the createDataFrame method

Full list of changes: v0.4.0...v0.5.0

v0.4.0

09 May 22:26
Compare
Choose a tag to compare

Summary of changes:

  • Added a SparkSession#createDF method to create DataFrames with a syntax that's less verbose.

Diff of changes: v0.3.0...v0.4.0

v0.3.0

31 Mar 17:52
Compare
Choose a tag to compare

Summary of changes:

  • Add a validateAbsenceOfColumns to the DataFrameValidator to raise errors if DataFrames contain prohibited columns

Full diff of changes: 0.2.0...v0.3.0

v0.2.0

26 Mar 17:08
Compare
Choose a tag to compare

Summary of changes:

  • Added a validateSchema to the DataFrameValidator trait to validate the presence of all StructFields in a DataFrame.

  • Added the scalariform plugin to automatically format the code consistently

  • Renamed variables to be consistent with the spark-style-guide

Full diff of changes: 0.1.0...v0.2.0

Version 0.1.0

22 Mar 02:14
Compare
Choose a tag to compare

Refactored DataFrameValidator to be a trait, so it's easier to include in classes.

First official release

09 Mar 02:10
Compare
Choose a tag to compare
0.0.1

Clean up the code a bit