Skip to content

Latest commit

 

History

History
17 lines (12 loc) · 504 Bytes

README.md

File metadata and controls

17 lines (12 loc) · 504 Bytes

Spark Async Shuffle Upload Plugin

An implementation of SPARK-25299 that continues to write shuffle files to local disk, but asynchronously replicates shuffle files to a distributed storage layer.

More details to follow!

Gradle Tasks

./gradlew tasks - to get the list of gradle tasks

Start Developing

Run one of the following commands:

  • ./gradlew idea for IntelliJ
  • ./gradlew eclipse for Eclipse