VU BlackBoard
LSDE: Large Scale Data Engineering 2015
Project G: Trending Dutch Places

performed by Group 7

Twitter status updates are increasingly annotated with GPS coordinates. If something interesting is going on, we can suspect that there will be an increased number of updates from that location. Your task will be to determine so-called "Trending places" in the Netherlands by observing the frequency of status updates for different areas.

Idea
  • Analyze the live Twitter stream, use geofencing to only consider the NL area
  • Aggregate the number of posts per geographic area, cities, districts etc.
  • Output a list of trending locations with actual names
  • Stretch goal: Summarize what is going on at the trending locations by looking at the tweet text, e.g. hastags or words
Technology

This analysis will be using Spark Streaming.

Data

Geonames could be used to map coordinates to places. The data will use the publicly available Twitter stream, read directly using Spark.

Literature