Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
Data Set - Sheet1.csv		Data Set - Sheet1.csv
Project Description.pdf		Project Description.pdf
README.md		README.md
finalProject.ipynb		finalProject.ipynb

Repository files navigation

pySpark Project

This task was given to explore pySpark

Project Description

Read the CSV/excel file.
Check the table definition.
Create schema based on the table definition.
Take the given CSV file as input
Process the data based on the given definition of each table.
Save different CSV files based on the table definition.
Full description here.

About

Exploring pySpark

python big-data spark jupyter-notebook pyspark

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%