This program will process legal report via Stanford CoreNLP and index them in ElasticSearch
-
Updated
Dec 4, 2019 - Scala
This program will process legal report via Stanford CoreNLP and index them in ElasticSearch
The goal is to train a linear regression model to predict Deerfoot commute times given weather and accident conditions using Spark RDD and MLlib
Advanced Topics in Databases course project - NTUA ECE - 2022-23
A POC written in Java using the Spring framework, which uses Apache Spark to read a file from Amazon S3 FS and counts the number of lines in the file.
A notes for Coursera Course: Big Data Essentials - HDFS, MapReduce and Spark RDD
In this project, we use Spark to visualize, manipulate, model and stream historical flight-delays data using Spark RDD, Spark SQL and Kafka
I have implemented the sample programs using apache spark. The programs have developed on the concepts of Spark RDD and Spark SQL Dataframe.
Demonstration of basic data transformations using Spark RDD and Spark DataFrame in Scala
spark hadoop exercise of cloud computing course - aut 1402-1403 fall
This project utilizes PySpark RDD and the Breadth-first Search (BFS) algorithm to find the shortest path and degrees of separation between two given Marvel superheroes based on based on their appearances together in the same comic books, empowering users to discover connections between their favourite superheroes in the Marvel universe.
This project utilizes PySpark DataFrames and PySpark RDD to implement item-based collaborative filtering. By calculating cosine similarity scores or identifying movies with the highest number of shared viewers, the system recommends 10 similar movies for a given target movie that aligns users’ preferences.
This project builds a scalable log analytics pipeline use Lambda architecture for real-time and batch processing of NASA server logs.
Implementation of Girvan-Newman Algorithm to detect communities in graphs using Yelp dataset
Various data stream/batch process demo with Apache Scala Spark 🚀
Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.
Add a description, image, and links to the spark-rdd topic page so that developers can more easily learn about it.
To associate your repository with the spark-rdd topic, visit your repo's landing page and select "manage topics."