Skip to content

This project is a collection of Spark Unit Tests Examples to help new Spark users have good examples on how to unit start their code for Spark Core, Spark SQL, and Spark Streaming

License

Notifications You must be signed in to change notification settings

iprovalo/SparkUnitTestingExamples

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Spark Unit Test Examples

In this github you will find examples for Spark Core, Spark SQL, and Spark Streaming unit test.

This is by no means the only way to unit test Spark, it is just to be used as a guide for training

Running

Simply load this project into your IDE and execute the test classes.

Back sure to add the following JVM parameters -Xmx1536m -XX:MaxPermSize=512m -XX:ReservedCodeCacheSize=512m

Or just use mvn test

About

This project is a collection of Spark Unit Tests Examples to help new Spark users have good examples on how to unit start their code for Spark Core, Spark SQL, and Spark Streaming

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Scala 100.0%