This document summarizes a presentation about measuring outcomes in small libraries using Project Outcome. It discusses why libraries should measure outcomes rather than just outputs, and how Project Outcome provides free, standardized surveys and tools to help libraries assess the impact of their programs and services. The presentation then shares the experience of Winslow Public Library in Maine in using Project Outcome, noting how the easy-to-use surveys and reports require little time but provide valuable data. Finally, examples are given of how other small libraries have used their Project Outcome data to inform programming decisions, develop partnerships, increase funding, and advocate for their library.
3. What We’ll Cover Today
Winslow Public Library’s
Experience
Why
Measure
Outcomes
What
Project
Outcome is &
its benefits
How
Libraries are
Using
Outcomes
5. Why Measure Outcomes
Times have changed
Intuition is not enough
Attendance counts are not enough
Anecdotes are not enough
6. Why Measure Outcomes
Libraries need more data & evidence to
demonstrate their value in the community.
Image: https://alcalde.texasexes.org/2014/04/what-gets-measured-gets-done/
9. Measuring the Good We Do
Specific benefit from a library program/service
Can be quantitative or qualitative
Expressed as changes that individuals perceive
10. Measuring the Good We Do
Learning what changes/effects/impacts your
programs are having in/on…
Knowledge
Skills
Attitudes
Opinions
Behaviors
Actions
Status
11. What’s a problem you need to solve?
How could measuring outcomes help?
What are people seeking
when they attend adult
learning programs? What
do they want us to offer?
Are patrons finding value
in our programs?
How can we better demonstrate to grantors
that our programs are effective?
Are we actually helping
people get jobs?
Programs for adults & children with
special needs – making sure what
we’re offering is a good fit
16. Project Outcome
Goals:
Outcome measurement “business as usual” for
public libraries
Supply standardized outcome measures that any
library can use and learn from
Provide user-friendly tools that can be used at any
capacity
It’s FREE!
www.ProjectOutcome.org
17. Project Outcome Toolkit
Access to:
Quick & simple surveys
Easy-to-use survey tool
Custom data reports
Interactive data dashboards
Resources & training
It’s FREE!
www.ProjectOutcome.org
18. Survey Questions
What did patrons like most?
What can the library do to improve?
Knowledge
Confidence
Behavior Change
Awareness
23. Outcome Measurement Guidelines
• Developing outcome measures
• Implementing data collection
methods other than the existing
standardized surveys
• Measuring data over time
• Developing strategies for working
with partners on outcome
measurement projects
28. Survey Management Tool
Survey customization includes:
Logo
Program name & date
Intro & footer messages
Thank you page URL
Additional questions (pre-set or write your own)
40. Benefits of Project Outcome Data
Capturing snapshot data
― Short, simple surveys save time
― Higher response rate from patrons
― Open-ended comments are goldmine
We’ve done the heavy lifting for you!
― Real-time results
― Data visualizations
― Ready-to-use reports
41. Benefits of Project Outcome Data
Standardization of outcome measures
― Across time & locations
― Variety of programs
― Aggregate national & state comparisons
43. Winslow Public Library
A municipal library
serving a population of
just under 8,000
Mix of rural and
suburban areas
Staffing: 3 full time and
2 part time
Open 6 days a week, 46
hours per week
A former roller rink!
44. Fears we had about joining Project Outcome
Not enough staff
Too big a commitment of time
Afraid we were committing to surveying every program
Feared patrons would balk at filling out surveys
45. Statistics Only Tell Part of the Story
Numbers show how busy we
are, but they don’t show the
impact the library has on the
community.
46. My fears were unfounded
The surveys are ready to use and easy to implement – and no
pressure to survey more often than you want
The results are gathered and analyzed for you
At the push of a button you get beautiful reports and graphs
No patron push-back
47.
48. Project Outcome reports are amazing!
Here are some excerpts from the report on our 2017
Summer Reading Program:
“Wherever public libraries are working, possibility lives. People who work in public libraries know
that library services open new opportunities for anyone who enters – putting people on the path
to literacy, technological know-how, or a better job. Libraries see evidence of this every day…For
example, the Project Outcome: Year in Review 2016 Annual Report sites that nearly 80% of
library users surveyed report that library programs and services have had some kind of positive
impact on their lives in the last year, with a majority of patrons reporting that the educational
aspect of these programs and services is what they like most. And these patron benefits are in
high demand. Patrons most commonly suggested improvement for the library is new, more, or
more frequent classes and programs.i”
…Of the percentage of parents or caregivers surveyed who either agreed or strongly agreed that
they benefited from the service or program:
83% reported their child maintained or increased their reading skills
68% reported their child reads more often
79% reported their child is a more confident reader
76% reported their child uses the library more often
49. Qualitative responses are automatically collated in a
spreadsheet
What did you like most about the program/service?
Having a summer goal set to be reached
I liked the challenge of trying to complete the square
The program made me more aware of what types of books I do read and more open to
reading books in other areas of interest.
Loved the board with all the different categories of books. Makes a person read something
that may be out of their comfort zone.
It encourages me to read material that I don't normally read.
Reading new books!
50. 50
By contributing our survey results to Project
Outcome’s national database we are able to
work with libraries across the country to
support and justify the importance of public
libraries to the culture of our nation and to the
fabric of democracy.
59. Turning Small Data into Smart Data
Project Outcome helps Burnsville Public Library:
Understand impact
Develop new partnerships
Design new programs
Increase funding
Burnsville Public Library, WV
60. Develop new partnerships
Summer Reading survey results show desire for tutoring
& homework help for children
Library partners with local school to have 2 teachers
offer tutoring at the library the following summer
Turning Small Data into Smart Data
Burnsville Public Library, WV
“[The children] work on reading, math, they
get on the computer… It's really benefitting
them. And some of the kids are here because
they need the extra help, and some of them
are here just to try to beat the summer slide.
It's working very well.” – Library Staff
61. Design new programs based on community input
Library started new after-school programming based on
survey results
New program includes hands-on STEAM classes
“The reason we do it is we
are trying to find out the
interests of the community so
we can serve the community
better. Any library can use it.”
– BPL Board Member
Turning Small Data into Smart Data
Burnsville Public Library, WV
62. Increase funding
Digital Learning survey results showed increase
confidence and behavior change
Desire for more access to better technology
Shared results in funding request & received technology
grant from West Virginia Library Commission
Upgraded & expanded computer lab
Turning Small Data into Smart Data
Burnsville Public Library, WV
69. Advocacy
Shared Summary Reports with Friends of the Library
Added patron comments in Library Board reports
Included patron comments in thank you notes to
business donors
71. Partnerships
Outcome data in quarterly reports to county leaders
Increased championship of the library – county
leaders refer local career center to library
New partnership to provide youth programming for
work experience, college & career readiness
73. What’s a problem you need to solve?
How could measuring outcomes help?
What are people seeking
when they attend adult
learning programs? What
do they want us to offer?
Are patrons finding value
in our programs?
How can we better demonstrate to grantors
that our programs are effective?
Are we actually helping
people get jobs?
Programs for adults & children with
special needs – making sure what
we’re offering is a good fit
77. Check Out
Tutorial videos to help you
get started
Case studies to learn
more about how libraries
are using their data to
take action
78. What’s Next
Register for FREE at www.projectoutcome.org
Review training resources
Create a new survey
Analyze data dashboards
Join the Facebook group
Follow us on Twitter
Engage on Peer Discussion Board
#ProjectOutcome