Presentation to Advisory Panel on Public Sector Information (APPSI), September 17, 2009

1. OPENING UP LOCAL GOVERNMENT
INFORMATION
A presentation to the
Advisory Panel on Public Sector Information (APPSI)
September 17, 2009
by Chris Taggart, OpenlyLocal.com

2. WHY OPEN UP LOCAL
GOVERNMENT INFORMATION?

3. WHY OPEN UP LOCAL
GOVERNMENT INFORMATION?
• Local is becoming more important All three main parties plan to
devolve power to local authorities, with a consequent increase in focus
on their workings and quality of service

4. WHY OPEN UP LOCAL
GOVERNMENT INFORMATION?
• Local is becoming more important All three main parties plan to
devolve power to local authorities, with a consequent increase in focus
on their workings and quality of service
• Democracy requires transparency The expenses scandal has reduced
trust in elected representatives, leading to greater demands for
transparency. Local government in many ways is worse than central
government, being poorly understood and fairly opaque, with much basic
democratic data (e.g. voting records) simply not available

5. WHY OPEN UP LOCAL
GOVERNMENT INFORMATION?
• Local is becoming more important All three main parties plan to
devolve power to local authorities, with a consequent increase in focus
on their workings and quality of service
• Democracy requires transparency The expenses scandal has reduced
trust in elected representatives, leading to greater demands for
transparency. Local government in many ways is worse than central
government, being poorly understood and fairly opaque, with much basic
democratic data (e.g. voting records) simply not available
• It’s our data, we have a right to it Expectations have increased about
access to data, through the FoI Act, OPSI & APPSI’s work, and sites such as
TheyWorkForYou and data.gov

6. WHY OPEN UP LOCAL
GOVERNMENT INFORMATION?

7. WHY OPEN UP LOCAL
GOVERNMENT INFORMATION?
• Local media are dying This will increase the disconnect between the
public (when they do bother to vote – local elections are generally poorly
attended, and votes often cast on national lines) and the people they elect

8. WHY OPEN UP LOCAL
GOVERNMENT INFORMATION?
• Local media are dying This will increase the disconnect between the
public (when they do bother to vote – local elections are generally poorly
attended, and votes often cast on national lines) and the people they elect
• The goalposts of an ‘acceptable website’ are moving As the internet is
ever more a part of our lives, and commercial websites increase in quality,
experience and functionality, our patience for messy, difficult-to-use, poorly
structured local-authority websites is diminishing fast

9. WHY OPEN UP LOCAL
GOVERNMENT INFORMATION?
• Local media are dying This will increase the disconnect between the
public (when they do bother to vote – local elections are generally poorly
attended, and votes often cast on national lines) and the people they elect
• The goalposts of an ‘acceptable website’ are moving As the internet is
ever more a part of our lives, and commercial websites increase in quality,
experience and functionality, our patience for messy, difficult-to-use, poorly
structured local-authority websites is diminishing fast
• Local budgets are going to be tightened and services cut This will
increase tensions if it is not done openly and with the involvement of
the community

10. WHY OPEN UP LOCAL
GOVERNMENT INFORMATION?
• Local media are dying This will increase the disconnect between the
public (when they do bother to vote – local elections are generally poorly
attended, and votes often cast on national lines) and the people they elect
• The goalposts of an ‘acceptable website’ are moving As the internet is
ever more a part of our lives, and commercial websites increase in quality,
experience and functionality, our patience for messy, difficult-to-use, poorly
structured local-authority websites is diminishing fast
• Local budgets are going to be tightened and services cut This will
increase tensions if it is not done openly and with the involvement of
the community
• Open access to raw information leads to innovation and added value

11. BUT DON’T TAKE MY WORD FOR IT

12. BUT DON’T TAKE MY WORD FOR IT
“From the performance of a local school to the most recent statistics on
crime we need to make sure that people have the facts they need to
make informed choices and hold public services to account.”
Tessa Jowell MP, Minister for the Cabinet Office, June 2009

13. BUT DON’T TAKE MY WORD FOR IT
“From the performance of a local school to the most recent statistics on
crime we need to make sure that people have the facts they need to
make informed choices and hold public services to account.”
Tessa Jowell MP, Minister for the Cabinet Office, June 2009
“The founding principle of local government is that citizens have the right
to influence the decisions that affect their lives and their communities.
There is a large and untapped pool of people who would like more say in
what happens in their area”
Department of Communities and Local Government,
Strengthening Local Democracy Consultation, July 2009

14. BUT DON’T TAKE MY WORD FOR IT
“From the performance of a local school to the most recent statistics on
crime we need to make sure that people have the facts they need to
make informed choices and hold public services to account.”
Tessa Jowell MP, Minister for the Cabinet Office, June 2009
“The founding principle of local government is that citizens have the right
to influence the decisions that affect their lives and their communities.
There is a large and untapped pool of people who would like more say in
what happens in their area”
Department of Communities and Local Government,
Strengthening Local Democracy Consultation, July 2009
“Because [councils] all present... information differently, it’s impossible for
the public, charities or private companies to effectively collate this data,
compare and contrast [their] performance and hold [them] to account.
David Cameron, Feb 2008

15. BUT DON’T TAKE MY WORD FOR IT

16. BUT DON’T TAKE MY WORD FOR IT
“Increasing citizen awareness of government functions to enable greater
accountability; contributing valuable information about the world; enabling
the government, the country, and the world to function more efficiently.”
“Whatever else, the raw data should be made available as soon as
possible... As a lower priority, nice user interfaces should be made to it - if
interested communities outside government have not already done it”
Tim Berners-Lee, Putting Government Data Online, June 2009

17. BUT DON’T TAKE MY WORD FOR IT
“Increasing citizen awareness of government functions to enable greater
accountability; contributing valuable information about the world; enabling
the government, the country, and the world to function more efficiently.”
“Whatever else, the raw data should be made available as soon as
possible... As a lower priority, nice user interfaces should be made to it - if
interested communities outside government have not already done it”
Tim Berners-Lee, Putting Government Data Online, June 2009
“Local Government forms possibly the largest conduit of citizen centric
governance within the UK where ‘policy directives’ impact directly on the
local electorate... Local Government as a sector needs to be seen as an
active participant and partner in the process.”
APPSI’s response to Power of Information Task Force Report

18. LOCAL DATA FUTURE: THE DREAM
Photo credit: http://www.flickr.com/photos/dmcl/50806774

19. LOCAL DATA FUTURE: THE DREAM
• A rich universe of local and hyperlocal
sites generating awareness of and
involvement with the community
Photo credit: http://www.flickr.com/photos/dmcl/50806774

20. LOCAL DATA FUTURE: THE DREAM
• A rich universe of local and hyperlocal
sites generating awareness of and
involvement with the community
Photo credit: http://www.flickr.com/photos/dmcl/50806774

21. LOCAL DATA FUTURE: THE DREAM
• A rich universe of local and hyperlocal
sites generating awareness of and
involvement with the community
• Local data becomes part of the linked
data universe bringing myriad benefits
or shared knowledge, increased
efficiency and greater transparency
Photo credit: http://www.flickr.com/photos/dmcl/50806774

22. LOCAL DATA FUTURE: THE DREAM
• A rich universe of local and hyperlocal
sites generating awareness of and
involvement with the community
• Local data becomes part of the linked
data universe bringing myriad benefits
or shared knowledge, increased
efficiency and greater transparency
Photo credit: http://www.flickr.com/photos/dmcl/50806774

23. LOCAL DATA FUTURE: THE DREAM
• A rich universe of local and hyperlocal
sites generating awareness of and
involvement with the community
• Local data becomes part of the linked
data universe bringing myriad benefits
or shared knowledge, increased
efficiency and greater transparency
• A renewed public relationship with
local authorities which reassert their
position at the heart of their
community
Photo credit: http://www.flickr.com/photos/dmcl/50806774

24. LOCAL DATA FUTURE: THE DREAM
• A rich universe of local and hyperlocal
sites generating awareness of and
involvement with the community
• Local data becomes part of the linked
data universe bringing myriad benefits
or shared knowledge, increased
efficiency and greater transparency
• A renewed public relationship with
local authorities which reassert their
position at the heart of their
community
Photo credit: http://www.flickr.com/photos/dmcl/50806774

25. LOCAL DATA FUTURE: THE REALITY

26. LOCAL DATA FUTURE: THE REALITY
• Council websites – as far as reuse of data
goes – are largely basic, verging on hopeless

27. LOCAL DATA FUTURE: THE REALITY
• Council websites – as far as reuse of data
goes – are largely basic, verging on hopeless

28. LOCAL DATA FUTURE: THE REALITY
• Council websites – as far as reuse of data
goes – are largely basic, verging on hopeless
• Many local councils, even large, well-funded
ones, have little awareness of the issues and
commission websites that actively prevent
access to the data and underlying structure

29. LOCAL DATA FUTURE: THE REALITY
• Council websites – as far as reuse of data
goes – are largely basic, verging on hopeless
• Many local councils, even large, well-funded
ones, have little awareness of the issues and http://www.birmingham.gov.uk/cs/Satellite?
commission websites that actively prevent c=Page&childpagename=Member-Services
%2FPageLayout&cid=1223092734434&pagename
access to the data and underlying structure =BCC%2FCommon%2FWrapper%2FWrapper

30. LOCAL DATA FUTURE: THE REALITY
• Council websites – as far as reuse of data
goes – are largely basic, verging on hopeless
• Many local councils, even large, well-funded
ones, have little awareness of the issues and http://www.birmingham.gov.uk/cs/Satellite?
commission websites that actively prevent c=Page&childpagename=Member-Services
%2FPageLayout&cid=1223092734434&pagename
access to the data and underlying structure =BCC%2FCommon%2FWrapper%2FWrapper
• Councils guard their territories fiercely
and many have not even embraced
Freedom of Information, let alone
considered opening up their raw data

31. LOCAL DATA FUTURE: THE REALITY
• Council websites – as far as reuse of data
goes – are largely basic, verging on hopeless
• Many local councils, even large, well-funded
ones, have little awareness of the issues and http://www.birmingham.gov.uk/cs/Satellite?
commission websites that actively prevent c=Page&childpagename=Member-Services
%2FPageLayout&cid=1223092734434&pagename
access to the data and underlying structure =BCC%2FCommon%2FWrapper%2FWrapper
• Councils guard their territories fiercely
and many have not even embraced
Freedom of Information, let alone
considered opening up their raw data

32. LOCAL DATA FUTURE: THE REALITY
• Council websites – as far as reuse of data
goes – are largely basic, verging on hopeless
• Many local councils, even large, well-funded
ones, have little awareness of the issues and http://www.birmingham.gov.uk/cs/Satellite?
commission websites that actively prevent c=Page&childpagename=Member-Services
%2FPageLayout&cid=1223092734434&pagename
access to the data and underlying structure =BCC%2FCommon%2FWrapper%2FWrapper
• Councils guard their territories fiercely
and many have not even embraced
Freedom of Information, let alone
considered opening up their raw data
• Hyperlocal sites rarely have the technical
know-how to extract information from
their council website, and depend on a
huge investment in time from dedicated
individuals just to maintain basic information

33. LOCAL DATA FUTURE: THE REALITY
• Council websites – as far as reuse of data
goes – are largely basic, verging on hopeless
• Many local councils, even large, well-funded
ones, have little awareness of the issues and http://www.birmingham.gov.uk/cs/Satellite?
commission websites that actively prevent c=Page&childpagename=Member-Services
%2FPageLayout&cid=1223092734434&pagename
access to the data and underlying structure =BCC%2FCommon%2FWrapper%2FWrapper
• Councils guard their territories fiercely
and many have not even embraced
Freedom of Information, let alone
considered opening up their raw data
• Hyperlocal sites rarely have the technical
know-how to extract information from
their council website, and depend on a
huge investment in time from dedicated
individuals just to maintain basic information

34. ENTER OPENLYLOCAL.COM
Clean, bare, simple and easy-to-use

35. Scrapes Local Authority websites...
(basic info for all, scraped info for over 70 so far)

36. it
e
sp m.at
a (
&i n.mg 'div
te La .m
sp m b g
an .at( el[t Cont
ne .m 'd ex en
xt g i t t
_n Labe v.mg ()*=
od l[ Co "V
e.
in text nten enue
ne "]
r_ ()*= t ')
Par
te
xt "Ven &
.s ue
tr
ip "]')
.
ser
Parses the rough and ready information...

37. ...into structured data
(linking members to committees, wards, for example)

38. Matches up council data with other references (ONS SNAC
code, WhatDoTheyKnow id, Wikipedia url) and datasets from
central government and Guardian Datastore

39. • Makes the whole thing available in open form as...
an accessible web page (great for screenreaders)

40. Available as...
XML or JSON data

41. or as...
RDFa (linked data)

42. PLUS, WITH
OPENLYLOCAL
YOU CAN...

43. PLUS, WITH
OPENLYLOCAL
YOU CAN...
• Subscribe to meetings to
your online diary (iCal,
Outlook, Google Calendar)

44. PLUS, WITH
OPENLYLOCAL
YOU CAN...
• Subscribe to meetings to
your online diary (iCal,
Outlook, Google Calendar)

45. PLUS, WITH
OPENLYLOCAL
YOU CAN...
• Subscribe to meetings to
your online diary (iCal,
Outlook, Google Calendar)
• Filter minutes and agendas
by keyword

46. PLUS, WITH
OPENLYLOCAL
YOU CAN...
• Subscribe to meetings to
your online diary (iCal,
Outlook, Google Calendar)
• Filter minutes and agendas
by keyword

47. PLUS, WITH
OPENLYLOCAL
YOU CAN...
• Subscribe to meetings to
your online diary (iCal,
Outlook, Google Calendar)
• Filter minutes and agendas
by keyword
• Subscribe to RSS feed for
alerts when more
documents with that
keyword are added

48. PLUS, WITH
OPENLYLOCAL
YOU CAN...
• Subscribe to meetings to
your online diary (iCal,
Outlook, Google Calendar)
• Filter minutes and agendas
by keyword
• Subscribe to RSS feed for
alerts when more
documents with that
keyword are added

49. AND... Import the data into Google Spreadsheets, Yahoo
Pipes, or your own mashup

50. BUT...

51. BUT...
• Copyright is a BIG problem -- we would like to release the data under an
open license (e.g. OpenDatabase or Click-Use) but can’t, and could be
forced to remove data by “rights holders”

52. BUT...
• Copyright is a BIG problem -- we would like to release the data under an
open license (e.g. OpenDatabase or Click-Use) but can’t, and could be
forced to remove data by “rights holders”
• Some websites are so bad that the information is REALLY difficult to get
out (e.g. Birmingham), never mind adhering to best standards, and others
actively try to block access to the data (West Lothian)

53. BUT...
• Copyright is a BIG problem -- we would like to release the data under an
open license (e.g. OpenDatabase or Click-Use) but can’t, and could be
forced to remove data by “rights holders”
• Some websites are so bad that the information is REALLY difficult to get
out (e.g. Birmingham), never mind adhering to best standards, and others
actively try to block access to the data (West Lothian)
• Lack of core infrastructure data to tie things together (e.g. council/ward
boundaries), and also of unified IDs that are actually used by government

54. BUT...
• Copyright is a BIG problem -- we would like to release the data under an
open license (e.g. OpenDatabase or Click-Use) but can’t, and could be
forced to remove data by “rights holders”
• Some websites are so bad that the information is REALLY difficult to get
out (e.g. Birmingham), never mind adhering to best standards, and others
actively try to block access to the data (West Lothian)
• Lack of core infrastructure data to tie things together (e.g. council/ward
boundaries), and also of unified IDs that are actually used by government
• Much of the information just isn’t online (e.g. councillor voting records), or
is very patchy (election results)

55. BUT...
• Copyright is a BIG problem -- we would like to release the data under an
open license (e.g. OpenDatabase or Click-Use) but can’t, and could be
forced to remove data by “rights holders”
• Some websites are so bad that the information is REALLY difficult to get
out (e.g. Birmingham), never mind adhering to best standards, and others
actively try to block access to the data (West Lothian)
• Lack of core infrastructure data to tie things together (e.g. council/ward
boundaries), and also of unified IDs that are actually used by government
• Much of the information just isn’t online (e.g. councillor voting records), or
is very patchy (election results)
• Huge amounts of stuff is unnecessarily in PDF and Word docs -- it’s trivial
to turn structured data into a PDF; darned hard to do it the other way

56. WHAT DO WE NEED?
(AND BY WE I MEAN THE COMMUNITY AT LARGE)

57. WHAT DO WE NEED?
(AND BY WE I MEAN THE COMMUNITY AT LARGE)
• All local authority democratic data, data generated as part of its statutory
role, and data released as a result of a Freedom of Information request
must be reusable under an open licence (e.g. similar to Crown Copyright
Click Use Licence)

58. WHAT DO WE NEED?
(AND BY WE I MEAN THE COMMUNITY AT LARGE)
• All local authority democratic data, data generated as part of its statutory
role, and data released as a result of a Freedom of Information request
must be reusable under an open licence (e.g. similar to Crown Copyright
Click Use Licence)
• Basic infrastructure data to allow us (or anyone else) to tie things
together, especially geo data for Local Authority and Ward boundaries

59. WHAT DO WE NEED?
(AND BY WE I MEAN THE COMMUNITY AT LARGE)
• All local authority democratic data, data generated as part of its statutory
role, and data released as a result of a Freedom of Information request
must be reusable under an open licence (e.g. similar to Crown Copyright
Click Use Licence)
• Basic infrastructure data to allow us (or anyone else) to tie things
together, especially geo data for Local Authority and Ward boundaries
• Government Departments to use ONS SNAC ids (or some other
universal id) when publishing local data/stats

60. WHAT DO WE NEED?
(AND BY WE I MEAN THE COMMUNITY AT LARGE)
• All local authority democratic data, data generated as part of its statutory
role, and data released as a result of a Freedom of Information request
must be reusable under an open licence (e.g. similar to Crown Copyright
Click Use Licence)
• Basic infrastructure data to allow us (or anyone else) to tie things
together, especially geo data for Local Authority and Ward boundaries
• Government Departments to use ONS SNAC ids (or some other
universal id) when publishing local data/stats
• Simple, best-practice recommendations to Local Government to follow
re websites and open data (see Birmingham fiasco)

61. LINKS
• http://OpenlyLocal.com
• http://www.w3.org/DesignIssues/GovData.html
• http://twitter.com/#search?q=%23bccwebsite