audio and live blog notes http://cmsw.mit.edu/liveblog-hong-qu-keepr/

1. Keepr
Algorithm for Extracting Entities, Eyewitnesses and Amplifiers
Hong Qu
September 19, 2013

3. http://twitpic.com/135xa
https://twitter.
com/jkrums/status/1121915133

4. http://www.telegraph.co.uk/technology/twitter/4269765/New-York-plane-crash-Twitter-breaks-the-news-again.html

5. http://www2.sims.berkeley.edu/courses/is290-2/f04/sched.html

7. https://twitter.com/hqu/status/1745171763

25. Humans vs Machines
Pattern RecognitionValue Judgment

26. Computers count
really, really fast!

27. What is a Tweet?
140 characters:
● words
● @user mentions
● #hashtags
● links

28. Hows does Keepr process tweets?
140 character * 100 tweets = 14,000 characters
❏ Parse it
❏ Count it
❏ Visualize it
❏ Zoom in
❏ Archive it

29. https://canvas.instructure.com/courses/812708/assignments/syllabus
Natural Language Processing

31. Humans are way better at
at making value judgements
and telling stories

32. Social media and the Boston bombings: When citizens and journalists cover the same story

33. Keepr’s Algorithm
➔ Entity extraction
◆ Topics
➔ Media extraction
◆ images, videos
➔ Link expansion
◆ articles
➔ Conversation analysis
◆ @ mentions
◆ source discovery
◆ amplification velocity
➔ Source verification
◆ geo-location
◆ social media profiles

34. Topic Extraction by Term Frequency
http://trimc-nlp.blogspot.com/2013/04/tfidf-with-google-n-grams-and-pos-tags.html

35. https://twitter.com/hqu/stawww.cs.cornell.edu/home/kleinber/bhs.
pdftus/1745171763

36. Journalists want
❏ Source discovery and curation
❏ Passive monitoring and alerts
❏ Saving and archiving
❏ Visualizations
❏ Parity with TweetDeck user interface

37. People want
“I want to catch up with a summary of key
information about the breaking news
story.”
I want to get a list of Twitter accounts who are
official organizations related to that story.

38. My Musing

40. What’s next for keepr?
➔ refine algorithm
➔ source classification
➔ conversation analysis and visualization
➔ archiving search results and tweets
Rolling out a Beta program for newsrooms
Sign up at www.keepr.com/beta

42. https://github.com/hqu/keepr

43. Verification Resources
● Verifying Social Media Content
● verificationjunkie.tumblr.com
● BBC processes for verifying social media content
● Storyful’s validation process
● InformaCam