The document provides an overview of data journalism including what it is, sources for finding data, and tools for analyzing and visualizing data. It discusses scraping data from websites, using tools like Google searches, spreadsheets, and APIs to extract structured data. Ethical considerations around scraping are also mentioned. The document concludes with assigning students to group blogs and individual strategies focusing on different aspects of online journalism.

1. Online Journalism City University Paul Bradshaw Data journalism

3. 1. What is it? 2. Where to get it 3. How to get it Themes

10. “ Each weekday, my computer program goes to the Chicago Police Department's website and gathers all crimes reported in Chicago.” Adrian Holovaty

13. Times film genres

17. ” QUOTE” Now is a good time.

18. “ The Tribune’s more than three dozen interactive databases , collectively have drawn three times as many page views as the site’s stories . [75% of traffic]” http://bit.ly/dj2dmz

19. . What is data?

20. Numbers Text Live data Behavioural data Images, audio, video Anything that a computer can work with

22. Start with the data and look for the stories? (MPs’ expenses) Or start with a lead and look for the data? Passive vs active data journalism

23. Data Journalism Continuum

24. Data.gov.uk Guardian datastore Openlylocal,Open Corporates, Open Charities, Who's Lobbying etc. FOI requests (WDTK), disclosure logs Books - British Political Facts Finding

25. GetTheData.org WDMMG forums MySociety mailing lists Open Data Cookbook Wolfram Alpha forum Finding – data communities

27. Government - national and local 'Monitors' - regulators & other bodies Charities, pressure groups Institutions - academic, scientific, health Business, finance Media, entertainment, sport Other secondary sources

28. Site:gov.uk (etc) Filetype:pdf (etc) Imagine the page you hope to find, including jargon etc. Database contents are invisible Google News alerts: report OR review Advanced search

29. "quotes search for exact phrases" "disclosure logs" site:nhs.uk + ensures page contains word: +logs - omits results with word: -wooden * wildcard, e.g. "deaths * custody" ~ synonyms, e.g. ~deaths Advanced search

32. RSS, XML, JSON, RDF - and APIs Scraperwiki Outwit Hub Yahoo! Pipes Spreadsheet formulae (look them up) Feeds and scrapers

33. Format? Table? Pattern? URL? 'Structured' data

34. http://www.eib.org/projects/pipeline/?start=2009&end=2010&status=&region=&country=united+kingdom&sector=

36. =ImportHTML("http://bob.com/mytable", "table", 1) =ImportXML("http://backtweets.com/search.xml?itemsperpage=100&...”) =ImportFeed("http://search.twitter.com/search.atom?rpp=20&page=1&q="&A2) Spreadsheet formulae

37. Fetch Page module Regex Yahoo! Pipes

38. "A problem for sites who want to provide privacy while allowing new users to join easily. Scraping services may constitute a violation of terms of service; tactics often resemble a denial-of-service attack or a security exploit." Ethics

39. . Questions?

40. Links OnlineJournalismClasses.tumblr.com Delicious.com/paulb/cityoj08 Delicious.com/paulb/datajournalism Delicious.com/paulb/visualisation Delicious.com/paulb/data

42. Books Darrell Huff - How To Lie With Statistics Blastland & Dilnot - The Tiger That Isn't Donna Wong - The WSJ Guide to Information Graphics Brian Suda - A Practical Guide to Designing with Data

43. . Assignments

44. Enough time? 10 credits = 100 hours Lectures = 15 hours Group blog = 60 hours (75%) Strategy = 20 hours (25%) (Some in labs) + 5 hours on other issues

45. Enough time? Blog Just an example: 10 posts ranging from simple links to interviews, analysis, experiment 5.5 hours ave per week x10 weeks = 55 hours + 5 hours to write evaluation

46. Enough time? Strategy Just an example: 12.5 hours researching community 30 mins per week x10 weeks with community (2.5 hours) 5 hours analysis & write up

48. Criteria Ass1: Newsgathering/research Production Law, ethics and strategy Ass 2: Research Analysis Execution