SlideShare uma empresa Scribd logo
1 de 23
The Downton Abbey
         Guide
to Library Assessment
Why are you measuring?
            Strategic plan, grant
             application, or building
             project?
            Some other goal?
            What are the problems?
            What do you need to justify
             or defend?
            What needs improvement?
            What standards must you
             meet?
What are you
        measuring?
Customer Satisfaction
  Inputs
    Resources
      Services
          Outputs
            Facility
 Processes
   Staff
     Organization
         Community
Finding    Population

Peers      Budget
           Number of
            outlets

           Enrollment
           Budget
           Outlets

           Ethnicity
           Poverty level
           Education level
           Average income
Benchmarking
  Cautions
          Old data
          Quantitative only
          Out of context
          Misleading

       USE FOR:
        Starting point
        Yellow flags
Benchmarking Public
Libraries - Easy
               LJ Index of
                Public Library
                Service

               Hennen’s
                American Public
                Library Ratings
                (HAPLR)
Benchmarking Public
Libraries - Harder

             Institute of Museum and
              Library Services (IMLS)
             Public Library Association
              Metrics (PLDS)
             Urban Libraries Council
              Technology Benchmarks
Benchmarking
Academics
Deceptive Data
Public Library
Success Predictors
                Lower poverty
              Higher education
                         $$$$
               Large collection
                 More outlets
Customer Feedback
 Phone surveys
 Mailed surveys
 Online surveys
 Focus group
 One-on-one
  interviews
 Ongoing feedback
DIY
• Focus on
  important #s

• Schedule
  annually

• Get help and
  resources

• Find data
  partners

Mais conteúdo relacionado

Semelhante a Pa la benchmarking

Library intelligence notes
Library intelligence notesLibrary intelligence notes
Library intelligence notesJoe Matthews
 
Data, evidence and outcomes
Data, evidence and outcomes Data, evidence and outcomes
Data, evidence and outcomes Joe Matthews
 
Racine Public Library
Racine Public LibraryRacine Public Library
Racine Public LibraryArmin_Mehic
 
The value of academic libraries
The value of  academic libraries The value of  academic libraries
The value of academic libraries Joe Matthews
 
FOPL and OLA Persona Strategies
  FOPL and OLA Persona Strategies  FOPL and OLA Persona Strategies
FOPL and OLA Persona StrategiesStephen Abram
 
The Value & Economic Measures of Libraries
The Value & Economic Measures of LibrariesThe Value & Economic Measures of Libraries
The Value & Economic Measures of LibrariesJoe Matthews
 
Roadmap to Resources: Creating Effective I&R Directories
Roadmap to Resources:  Creating Effective I&R DirectoriesRoadmap to Resources:  Creating Effective I&R Directories
Roadmap to Resources: Creating Effective I&R DirectoriesDamone Virgilio
 
Planning for the Future
Planning for the FuturePlanning for the Future
Planning for the FutureWiLS
 
Data Driven Strategies for Communication Success
Data Driven Strategies for Communication SuccessData Driven Strategies for Communication Success
Data Driven Strategies for Communication Successlumpjm
 
Data-Driven Communications Strategies
Data-Driven Communications StrategiesData-Driven Communications Strategies
Data-Driven Communications Strategiessaquiresearch
 
Count Your Impact: Getting Started with Outcome-Based Evaluation
Count Your Impact: Getting Started with Outcome-Based EvaluationCount Your Impact: Getting Started with Outcome-Based Evaluation
Count Your Impact: Getting Started with Outcome-Based Evaluationlibrary_research_service
 
Evidence Based Learning
Evidence Based LearningEvidence Based Learning
Evidence Based Learningrmoniz
 
Cross Channel Fundraising Strategies
Cross Channel Fundraising StrategiesCross Channel Fundraising Strategies
Cross Channel Fundraising StrategiesTanya Zumach
 
Straight Talk about the "B" Word: using the Edge benchmarks in your library
Straight Talk about the "B" Word: using the Edge benchmarks in your libraryStraight Talk about the "B" Word: using the Edge benchmarks in your library
Straight Talk about the "B" Word: using the Edge benchmarks in your libraryTechSoup for Libraries
 
Intelligent library presentation
Intelligent library presentationIntelligent library presentation
Intelligent library presentationJoe Matthews
 

Semelhante a Pa la benchmarking (20)

Library intelligence notes
Library intelligence notesLibrary intelligence notes
Library intelligence notes
 
Data, evidence and outcomes
Data, evidence and outcomes Data, evidence and outcomes
Data, evidence and outcomes
 
Racine Public Library
Racine Public LibraryRacine Public Library
Racine Public Library
 
The value of academic libraries
The value of  academic libraries The value of  academic libraries
The value of academic libraries
 
Empowering the Masses: Brooklyn Public Library's Information Literacy Efforts
Empowering the Masses: Brooklyn Public Library's Information Literacy EffortsEmpowering the Masses: Brooklyn Public Library's Information Literacy Efforts
Empowering the Masses: Brooklyn Public Library's Information Literacy Efforts
 
FOPL and OLA Persona Strategies
  FOPL and OLA Persona Strategies  FOPL and OLA Persona Strategies
FOPL and OLA Persona Strategies
 
Bright "Analysis or What The Data Demands"
Bright "Analysis or What The Data Demands"Bright "Analysis or What The Data Demands"
Bright "Analysis or What The Data Demands"
 
The Value & Economic Measures of Libraries
The Value & Economic Measures of LibrariesThe Value & Economic Measures of Libraries
The Value & Economic Measures of Libraries
 
Strategic Metrics
Strategic MetricsStrategic Metrics
Strategic Metrics
 
Roadmap to Resources: Creating Effective I&R Directories
Roadmap to Resources:  Creating Effective I&R DirectoriesRoadmap to Resources:  Creating Effective I&R Directories
Roadmap to Resources: Creating Effective I&R Directories
 
Planning for the Future
Planning for the FuturePlanning for the Future
Planning for the Future
 
Caledon pl trends
Caledon pl trendsCaledon pl trends
Caledon pl trends
 
Data Driven Strategies for Communication Success
Data Driven Strategies for Communication SuccessData Driven Strategies for Communication Success
Data Driven Strategies for Communication Success
 
Data-Driven Communications Strategies
Data-Driven Communications StrategiesData-Driven Communications Strategies
Data-Driven Communications Strategies
 
Count Your Impact: Getting Started with Outcome-Based Evaluation
Count Your Impact: Getting Started with Outcome-Based EvaluationCount Your Impact: Getting Started with Outcome-Based Evaluation
Count Your Impact: Getting Started with Outcome-Based Evaluation
 
Community needs assessment.pla_2014.handout
Community needs assessment.pla_2014.handoutCommunity needs assessment.pla_2014.handout
Community needs assessment.pla_2014.handout
 
Evidence Based Learning
Evidence Based LearningEvidence Based Learning
Evidence Based Learning
 
Cross Channel Fundraising Strategies
Cross Channel Fundraising StrategiesCross Channel Fundraising Strategies
Cross Channel Fundraising Strategies
 
Straight Talk about the "B" Word: using the Edge benchmarks in your library
Straight Talk about the "B" Word: using the Edge benchmarks in your libraryStraight Talk about the "B" Word: using the Edge benchmarks in your library
Straight Talk about the "B" Word: using the Edge benchmarks in your library
 
Intelligent library presentation
Intelligent library presentationIntelligent library presentation
Intelligent library presentation
 

Mais de Schlow Centre Region Library (8)

Pa la benchmark talk
Pa la benchmark talkPa la benchmark talk
Pa la benchmark talk
 
Oh benchmarking talk
Oh benchmarking talkOh benchmarking talk
Oh benchmarking talk
 
Llo presentation-trends-cathi
Llo presentation-trends-cathiLlo presentation-trends-cathi
Llo presentation-trends-cathi
 
Fundraising
FundraisingFundraising
Fundraising
 
Budget highlights
Budget highlightsBudget highlights
Budget highlights
 
From dream to ribbon cutting
From dream to ribbon cuttingFrom dream to ribbon cutting
From dream to ribbon cutting
 
Trustees2010
Trustees2010Trustees2010
Trustees2010
 
By The Numbers
By The NumbersBy The Numbers
By The Numbers
 

Pa la benchmarking

  • 1.
  • 2.
  • 3.
  • 4. The Downton Abbey Guide to Library Assessment
  • 5.
  • 6. Why are you measuring?  Strategic plan, grant application, or building project?  Some other goal?  What are the problems?  What do you need to justify or defend?  What needs improvement?  What standards must you meet?
  • 7.
  • 8. What are you measuring? Customer Satisfaction Inputs Resources Services Outputs Facility Processes Staff Organization Community
  • 9.
  • 10.
  • 11. Finding  Population Peers  Budget  Number of outlets  Enrollment  Budget  Outlets  Ethnicity  Poverty level  Education level  Average income
  • 12.
  • 13.
  • 14.
  • 15. Benchmarking Cautions  Old data  Quantitative only  Out of context  Misleading USE FOR:  Starting point  Yellow flags
  • 16. Benchmarking Public Libraries - Easy  LJ Index of Public Library Service  Hennen’s American Public Library Ratings (HAPLR)
  • 17.
  • 18. Benchmarking Public Libraries - Harder  Institute of Museum and Library Services (IMLS)  Public Library Association Metrics (PLDS)  Urban Libraries Council Technology Benchmarks
  • 21. Public Library Success Predictors Lower poverty Higher education $$$$ Large collection More outlets
  • 22. Customer Feedback  Phone surveys  Mailed surveys  Online surveys  Focus group  One-on-one interviews  Ongoing feedback
  • 23. DIY • Focus on important #s • Schedule annually • Get help and resources • Find data partners

Notas do Editor

  1. Audience poll on Downton Abbey…..Haiku descriptions:Upstairs and downstairsChanges in societyEnglish soap opera
  2. Season 4 preview: one new character will be the Downton Abbey Librarian!
  3. And so we find that the story of Downton Abbey makes a great framework for our talk today! So many similarities to our library situation today: we work in a service culture; there are great changes in society and technology; there are organizational and personal challenges in the transition to new ways. This is an quick introduction to some of the most effective ways to evaluate and benchmark your library operations. The focus is on valuable, practical and uncomplicated ways to manage YOUR library estate so you can spend more time drinking tea than fussing over complicated spreadsheets.
  4. If you take on the project of assessing your library, you are likely to feel overwhelmed by the project, this talk, the books in the bibliography. If you have never done an assessment before, start small. Just try to answer a few questions, or look at a few one or two services or attributes. Or break down a complete library assessment into parts.
  5. Goal: Funding increase – we need more $ because we are falling behind other libraries OR wish to maintain our strong positionProblems: We think the book budget is not big enough for our status as a research institutionDefend: We need more computers because….Improve: We need to improve school reading test scores
  6. Case study: the strategic plan … the underwhelming bookmobile
  7. Strategic plan: We want to know: more about community perceptions of the library. how our service statistics are, compared to similar libraries. if we are worse or better funded than similar libraries. we know we are understaffed, right? We want to know why your benchmarking figures show we are underperforming when everyone on the board is happy with our library’s achievements!
  8. Schlow staffing shortage
  9. Out of 18 libraries, we had the 9th largest staff BUT our activity level was higher – very productive people.
  10. Finding peer libraries is an important and worthwhile first step in benchmarking and evaluation. Just as Lord Grantham wants a match of peers for his lovely daughters, you want to compare yourself to libraries like yours! Libraries are so different that comparisons of large groups of them are not very meaningful. In addition, finding peers gives opportunities for sharing, learning, exchanges of best practices. Sometimes, it’s more important to look at similar communities. So, if you are wondering how your library compares to others in communities with high unemployment, you want to compare yourself to libraries in other impoverished cities. Schools and academics might want to look at enrollment instead of population, some kind of budget figure, and number of outlets is important if you are looking at the entire campus or school system, otherwise you should look to other institutional markers of your context. The libraries should ideally be within about 20% of your stats in these areas to be similar.
  11. You can find peers by comparing your library to all others in the state or region…..big groups of similar population or budget, which is how LJ Index and Hennen do it for public libraries. OR you can spend a little time and find libraries that are really a lot like yours! Here’s how.
  12. The NCES website has a compare academic libraries program and data for school libraries. MLA and SLA can help for special libraries. It’s best to have a list of between 7 and 16 peers for detailed comparisons, or it gets too unwieldy.
  13. So, let’s start by benchmarking.
  14. If there are all these problems, why do it? Well, it gives you a sense of where you stand compared to others.
  15. The easy way for public libraries to benchmark. The LJ Index, identifies “America’s Star Libraries.” Authored by librarian/statistician Ray Lyons and Keith Curry Lance, groups libraries by total operating expenditures instead of population. It uses these 4 per capita outputs from IMLS data weighed equally: circulation, program attendance, visits, and public computer use. Hennen groups libraries by population served and then looks at 15 inputs, such as funding and staffing, and outputs such as circulation and visits per capita that have varying weights in the formula, producing a final numerical score. GROUPS ARE TOO BIG.The LJ authors state emphatically: “this should be one among several sources of information…decide how to incorporate it into a more comprehensive assessment process.” Or, as I said before, use them to start you on the benchmarking path. The ratings will prompt questions and concerns and drive research that may help improve library performance.
  16. Hennen, LJ, and other benchmarks don’t, and can’t, measure customer service, leadership, management, collection quality and other factors that play a role in a library’s community success. The proof of that is that winners of the Bill & Melinda Gates Foundation and Library Journal “The Best Small Library in America” often have ratings in the bottom half. MILANOF-SCHOCK LIBRARY      MOUNT JOY            10 K     454 41%So why look at them? It’s a rough “place-marker” as where a library stands among others, Lyons - “I think of them as a kind of filter…we do it as an advocacy tool and predictor of potential or additional success.” Leads to exploration of values, additional data.
  17. Circulation numbers – why could a library have an unusually high or low number? Story about 2 week vs. 3 week circ and renewals.
  18. Better demographics and inputs ($, collection, building) = better outputs (stats like circ, ref, etc.)
  19. Group bias and self-selection issues with each methodology:Landline phone – age biasCell phone – survey challenges for lists, age, invalid area codeMail – low response rateOnline – bias but promote with mailed card, ads and prizesFocus groups – BLAHHHHInterviews – great prand cheap