spark_streaming_of_twitter_data

A Spark streaming pipeline to ingest the twitter data for a particular hashtag using twitter APIs into a csv file in real-time into Hadoop filesystem , and then creating a Hive External table with the csv file.