Analyse Weather Data And Twitter Sentiment With Spark And Watson – Margriet Groenendijk

Weather is a source of fascination and endless conversation. When you combine weather data sets with twitter chatter about the weather, what kinds of surprising insights might you find? Are the weather sentiments on Twitter related to the actual weather and forecasts? Or is there something else at play? This talk shows you how to extract, combine, and analyze Twitter and weather feeds in Python, using Spark, Insight for Twitter, Weather Company Data for Bluemix and Watson Tone Analyser. We will explore how to analyse this data in a Python notebook to draw insights into patterns and sentiment that may not otherwise be apparent.

The talk covers how to:

– Extract Twitter feeds daily and store them in a Cloudant database.

– Analyze the tweet sentiment using Watson Tone Analyzer. – Deploy Weather Company Data for Bluemix to collect daily weather data and load it into Cloudant.

– Combine and analyze the stored data to understand correlations between sentiment and weather in a Python notebook using Spark and multivariate statistical methods. We’ll also use clustering algorithms to compare correlations between regions to find out if the English weather really is as bad as they say.

Add comment

Highlight option

Turn on the "highlight" option for any widget, to get an alternative styling like this. You can change the colors for highlighted widgets in the theme options. See more examples below.


Instagram has returned empty data. Please authorize your Instagram account in the plugin settings .

Ivana Kotorchevikj

Categories count color


Small ads


  • It never ends
  • stand still screening-smoking girl
  • Maria d'Odessa performs her art of make-up
  • Afro-deko-mono
  • Maria d'Odessa, touching
  • Maria d'Odessa au bâton de rouge-baiser
  • Maria d'Odessa & the red lipstick
  • Maria d'Odessa, soulful.
  • Peanuts

Social Widget

Collaboratively harness market-driven processes whereas resource-leveling internal or "organic" sources.