SlideShare a Scribd company logo
1 of 57
Los Angeles | London | New Delhi
Singapore | Washington DC
Michael Quinn Patton
December 2014 #SAGEtalks
Please be
sure to check
your settings
Make sure your
volume is set
appropriately
Make sure you have
followed the
instructions on your
keypad properly
Make sure
everything is
plugged in properly
to assure your
devices are working
correctly
If you continue to
have audio or
visual difficulties,
please let us know
via the Q&A box
and one of our
SAGE employees
will be happy to
assist you.You can also run a short test webinar to ensure your
system settings are up-to-date:
http://www.webex.com/test-meeting.html
Los Angeles | London | New Delhi
Singapore | Washington DC
Michael Quinn Patton
December 2014 #SAGEtalks
Please take a moment to
answer a quick question from
our presenter.
Before we get started…
Los Angeles | London | New Delhi
Singapore | Washington DC
Top Ten Developments in Qualitative
Evaluation Over the Last Decade
Content and Presentation by
Michael Quinn Patton
Los Angeles | London | New Delhi
Singapore | Washington DC
Michael Quinn Patton
December 2014 #SAGEtalks
Michael Quinn Patton
University of Minnesota
University of Wisconsin - Madison
American Evaluation Association
Nicole Elliott
Executive Marketing Manager, SAGE
Los Angeles | London | New Delhi
Singapore | Washington DC
Michael Quinn Patton
December 2014 #SAGEtalks
While we do our best to answer as many questions as we can, time constraints
may not allows us to answer every question. Thank you for understanding.
Send us your questions!
Using Twitter? Use the
hashtag #SAGEtalks.
Send in your questions
via the Q&A Box
on your screen. →
6
Michael Quinn Patton
Top Ten Developments in
Qualitative Evaluation
over the Last Decade…
and Emergent Challenges
1980
1987
1990
2002
7
8
November 2014
10. Powerful
Qualitative
Software
9
9. Social media as data --
for data collection –
and sharing findings
10
11
Complexity concepts are catching on. Under
“relationship status” Facebook just added
“dynamical” as an option.
8. Ethical challenges,
IRB constraints
• Anticipating impact on participants
• Confidentiality with small sample sizes
• Appropriate compensation – principle of
reciprocity
• IRB constraints
12
“I know your study is important. I’m just
not ready to commit to being your case.”
7. Mixed Methods
13
14
Nov. 7, 1926 -
Jan. 8, 2013
Mixed
Methods
571 1138 1459
Qualitative
Methods
960 1434 1447 1547
Quantitative
Methods
807 1403 1436 1580
2003 2011 2012 2013
AEA TIG Memberships
http://www.eval.org/p/cm/ld/fid=101
15
6.
16
Viet Nam Helmet Law
• Road traffic injuries have long been a leading cause
of death and disability in Viet Nam.
• 60% of fatalities occur in motorcycle riders and
passengers.
• Viet Nam has had a partial motorcycle helmet
legislation since 1995. However, implementation and
enforcement had been limited.
• On 15 December 2007, Viet Nam's first
comprehensive mandatory helmet law came into
effect, covering all riders and passengers on all roads
nationwide. Penalties increased ten-fold and cohorts
of police were mobilized for enforcement.
17
18
19
20
21
22
23
15 December, 2007
24
25
26
27
28
29
30
31
Results
The Asia Injury Prevention Foundation reported:
“Nearly 100% of Vietnam’s motorbike users left
home wearing a helmet. It was an unbelievable
sight with a near instantaneous effect. Major
hospitals report the number of patients
admitted for traumatic brain injuries in the two
days after the law’s enactment was much lower
than on previous weekends. In Ho Chi Minh City
alone, serious traffic accident injuries fell by
almost 50 percent compared with pre-helmet
weekends.”
32
5. Driven by
evaluation practice
and users’ demands
• Doing QE (methods-driven) vs.
grounded in theoretical traditions
• Short, tight timelines
• Large, multi-site studies
• Speed
33
34
Observation
Underutilized
Interviewing dominates
35
4. Qualitative Evaluation
as an Intervention
Process Use
36
Qualitative Evaluation
as an Intervention
• Participatory evaluation
• Feminist evaluation
• Empowerment evaluation
• Collaborative evaluation
• Transformative evaluation
• Developmental evaluation
37
• Contextual
Intelligence:
A Critical
Competency
Matthew R. Kutz &
Anita Bamford-Wade
38
3. Valuing Deep Contextual
Understanding
• Realist Evaluation
Fundamental Issue:
How the World Is Changed
Top-down dissemination of
“proven (RCT) best practice models”
versus
Bottoms-up contextual (qualitative)
adaptation
39
Evidence-based Models
vs. Evidence-based
Effective Principles
40
PRINCIPLES
CONTEXT MATTERS
41
Five Paris Declaration Principles
1. Country ownership
2. Alignment
3. Harmonization
4. Mutual accountability
5. Managing for results
42
CONTEXT MATTERS
Contextual Understanding
43
Evaluating Principles:
Qualitative Cases
44
2. Qualitative Evaluator
as the Instrument:
Experience, Expertise,
Cultural Competence….
45
Former AEA President
Rodney Hopson,
“Language Matters”
Personal Factor
Old age and treachery
Always overcomes youth and skill
Waylon Jennings
46
1. Increased
Purposeful Sampling
Options
47Snowball Sampling
Purposeful vs. Purposive
Sampling
Sampling vs. case selection
48
49
50
Looking Ahead:
Challenges and
Opportunities
51
1. Building qualitative inquiry capacity
2. Interest in and resources to do
serious, triangulated, in-depth
qualitative evaluations
52
3. Commitment to inquire seriously
into
unintended consequences
53
and
Taking Emergence
Seriously
4. Cumulative-Longitudinal
Integration
at the Case and Context Levels
Center for Individualized
Medicine Medicine
54
Creating a healthier
world, one patient at a
time.
Michael Quinn Patton Claremont 2009
Los Angeles | London | New Delhi
Singapore | Washington DC
Michael Quinn Patton
December 2014 #SAGEtalks
While we do our best to answer as many questions as we can, time constraints
may not allows us to answer every question. Thank you for understanding.
Send us your questions!
Using Twitter? Use the
hashtag #SAGEtalks.
Send in your questions
via the Q&A Box
on your screen. →
Los Angeles | London | New Delhi
Singapore | Washington DC
Michael Quinn Patton
December 2014 #SAGEtalks
Webinar recording available on www.sagepub.com/sagetalks.
Top Ten Developments in Qualitative
Evaluation Over the Last Decade
Michael Quinn
Patton
• Twitter
• Facebook
• LinkedIn
To purchase the book for 20% off, please use discount code PATTON20 when purchasing on the website.
Be sure to check our website for updates on our 2015 Spring webinar series!

More Related Content

Viewers also liked

Ithaka S+R 2013 Library Survey Slides
Ithaka S+R 2013 Library Survey SlidesIthaka S+R 2013 Library Survey Slides
Ithaka S+R 2013 Library Survey Slides
SAGE Publishing
 
Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...
Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...
Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...
SAGE Publishing
 
When Science and Politics Collide
When Science and Politics Collide When Science and Politics Collide
When Science and Politics Collide
SAGE Publishing
 
Topnotch tools, tips, and tricks for library success with Gary Price
Topnotch tools, tips, and tricks for library success with Gary PriceTopnotch tools, tips, and tricks for library success with Gary Price
Topnotch tools, tips, and tricks for library success with Gary Price
SAGE Publishing
 

Viewers also liked (20)

From Publication to the Public Expanding your research beyond academia
From Publication to the Public Expanding your research beyond academiaFrom Publication to the Public Expanding your research beyond academia
From Publication to the Public Expanding your research beyond academia
 
Collaborating to Improve Discoverability
Collaborating to Improve DiscoverabilityCollaborating to Improve Discoverability
Collaborating to Improve Discoverability
 
Data for the Non-Data Librarian
Data for the Non-Data LibrarianData for the Non-Data Librarian
Data for the Non-Data Librarian
 
Ithaka S+R 2013 Library Survey Slides
Ithaka S+R 2013 Library Survey SlidesIthaka S+R 2013 Library Survey Slides
Ithaka S+R 2013 Library Survey Slides
 
The Current State of Reference
The Current State of ReferenceThe Current State of Reference
The Current State of Reference
 
Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...
Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...
Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...
 
When Science and Politics Collide
When Science and Politics Collide When Science and Politics Collide
When Science and Politics Collide
 
Successful Qualitative Research: Don't get too comfortable!
Successful Qualitative Research: Don't get too comfortable!Successful Qualitative Research: Don't get too comfortable!
Successful Qualitative Research: Don't get too comfortable!
 
RX for Discovery
RX for DiscoveryRX for Discovery
RX for Discovery
 
Topnotch tools, tips, and tricks for library success with Gary Price
Topnotch tools, tips, and tricks for library success with Gary PriceTopnotch tools, tips, and tricks for library success with Gary Price
Topnotch tools, tips, and tricks for library success with Gary Price
 
Open Access Week Webinar 2014
Open Access Week Webinar 2014Open Access Week Webinar 2014
Open Access Week Webinar 2014
 
Open Access in the Humanities and Social Sciences
Open Access in the Humanities and Social SciencesOpen Access in the Humanities and Social Sciences
Open Access in the Humanities and Social Sciences
 
What’s the Big Deal with Open Access? Traditional Publishing Houses and OA” –...
What’s the Big Deal with Open Access? Traditional Publishing Houses and OA” –...What’s the Big Deal with Open Access? Traditional Publishing Houses and OA” –...
What’s the Big Deal with Open Access? Traditional Publishing Houses and OA” –...
 
Open access futures in the humanities and social sciences a one day confer...
Open access futures in the humanities and social sciences    a one day confer...Open access futures in the humanities and social sciences    a one day confer...
Open access futures in the humanities and social sciences a one day confer...
 
Researching Researchers: Developing Evidence-Based Strategy for Improved Disc...
Researching Researchers: Developing Evidence-Based Strategy for Improved Disc...Researching Researchers: Developing Evidence-Based Strategy for Improved Disc...
Researching Researchers: Developing Evidence-Based Strategy for Improved Disc...
 
How to Protect the Freedom to Read in Your Library
How to Protect the Freedom to Read in Your LibraryHow to Protect the Freedom to Read in Your Library
How to Protect the Freedom to Read in Your Library
 
How to get published presentation Caroline Lock, SAGE
How to get published presentation  Caroline Lock, SAGEHow to get published presentation  Caroline Lock, SAGE
How to get published presentation Caroline Lock, SAGE
 
HIPAA Glossary
HIPAA GlossaryHIPAA Glossary
HIPAA Glossary
 
Finding Common Ground: Bringing Methods and Analysis into Context
Finding Common Ground: Bringing Methods and Analysis into ContextFinding Common Ground: Bringing Methods and Analysis into Context
Finding Common Ground: Bringing Methods and Analysis into Context
 
Libraries and Local Businesses: Best practices for supporting your entreprene...
Libraries and Local Businesses: Best practices for supporting your entreprene...Libraries and Local Businesses: Best practices for supporting your entreprene...
Libraries and Local Businesses: Best practices for supporting your entreprene...
 

Similar to Top Ten Developments in Qualitative Evaluation Over the Last Decade

quality-markers-full
quality-markers-fullquality-markers-full
quality-markers-full
fiona Johnson
 
Advocate - Making an impact on campus
Advocate - Making an impact on campusAdvocate - Making an impact on campus
Advocate - Making an impact on campus
Symplicity Corporation
 

Similar to Top Ten Developments in Qualitative Evaluation Over the Last Decade (20)

The Endless Security Summer - Caveon Webinar 8-22-2012
The Endless Security Summer - Caveon Webinar 8-22-2012The Endless Security Summer - Caveon Webinar 8-22-2012
The Endless Security Summer - Caveon Webinar 8-22-2012
 
Caveon Webinar Series Lessons Learned at NCSA and ITC July 2014
Caveon Webinar Series Lessons Learned at NCSA and ITC July 2014Caveon Webinar Series Lessons Learned at NCSA and ITC July 2014
Caveon Webinar Series Lessons Learned at NCSA and ITC July 2014
 
Caveon Webinar Series: Preventing and Detecting Cheating, Lessons from CCSSO...
Caveon Webinar Series: Preventing and Detecting Cheating,  Lessons from CCSSO...Caveon Webinar Series: Preventing and Detecting Cheating,  Lessons from CCSSO...
Caveon Webinar Series: Preventing and Detecting Cheating, Lessons from CCSSO...
 
Quality Is A Verb: Improving Practice In Youth Programs
Quality Is A Verb:  Improving Practice In Youth ProgramsQuality Is A Verb:  Improving Practice In Youth Programs
Quality Is A Verb: Improving Practice In Youth Programs
 
Nvf slides 4 may 16 final
Nvf slides 4 may 16 finalNvf slides 4 may 16 final
Nvf slides 4 may 16 final
 
Yenssen maharg slides
Yenssen maharg slidesYenssen maharg slides
Yenssen maharg slides
 
Future of-quality asq 042011-govind
Future of-quality asq 042011-govindFuture of-quality asq 042011-govind
Future of-quality asq 042011-govind
 
quality-markers-full
quality-markers-fullquality-markers-full
quality-markers-full
 
Micro-certification Pilot Presentations, Feb 2020 (consolidated)
Micro-certification Pilot Presentations, Feb 2020 (consolidated)Micro-certification Pilot Presentations, Feb 2020 (consolidated)
Micro-certification Pilot Presentations, Feb 2020 (consolidated)
 
Emerging trends in admissions practices
Emerging trends in admissions practicesEmerging trends in admissions practices
Emerging trends in admissions practices
 
White paper: "Human performance improvement"
White paper: "Human performance improvement"White paper: "Human performance improvement"
White paper: "Human performance improvement"
 
Advocate - Making an impact on campus
Advocate - Making an impact on campusAdvocate - Making an impact on campus
Advocate - Making an impact on campus
 
Content Curation – New L&D Mindset & Skill Set
Content Curation – New L&D Mindset & Skill SetContent Curation – New L&D Mindset & Skill Set
Content Curation – New L&D Mindset & Skill Set
 
Solution Tree PLC Luncheon Presentation
Solution Tree PLC Luncheon PresentationSolution Tree PLC Luncheon Presentation
Solution Tree PLC Luncheon Presentation
 
Root cause analysis - tools and process
Root cause analysis - tools and processRoot cause analysis - tools and process
Root cause analysis - tools and process
 
Jisc learning analytics mar2017
Jisc learning analytics mar2017Jisc learning analytics mar2017
Jisc learning analytics mar2017
 
Using case-based methods to assess scalability and sustainability: Lessons fr...
Using case-based methods to assess scalability and sustainability: Lessons fr...Using case-based methods to assess scalability and sustainability: Lessons fr...
Using case-based methods to assess scalability and sustainability: Lessons fr...
 
Panacea H4D Stanford 2019
Panacea H4D Stanford 2019Panacea H4D Stanford 2019
Panacea H4D Stanford 2019
 
Caveon webinar lessons learned at atp and nces
Caveon webinar lessons learned at atp and ncesCaveon webinar lessons learned at atp and nces
Caveon webinar lessons learned at atp and nces
 
ACT Work Ready Communities County Initiative
ACT Work Ready Communities County InitiativeACT Work Ready Communities County Initiative
ACT Work Ready Communities County Initiative
 

More from SAGE Publishing

More from SAGE Publishing (18)

Data Visualisation - A Game of Decisions with Andy Kirk
Data Visualisation - A Game of Decisions with Andy KirkData Visualisation - A Game of Decisions with Andy Kirk
Data Visualisation - A Game of Decisions with Andy Kirk
 
Publishing Innovations in the Age of Big Data
Publishing Innovations in the Age of Big DataPublishing Innovations in the Age of Big Data
Publishing Innovations in the Age of Big Data
 
Advancing Methodologies: A Conversation with John Creswel
Advancing Methodologies: A Conversation with John CreswelAdvancing Methodologies: A Conversation with John Creswel
Advancing Methodologies: A Conversation with John Creswel
 
2017 Charleston Photo Contest
2017 Charleston Photo Contest2017 Charleston Photo Contest
2017 Charleston Photo Contest
 
5 ways to take your entrepreunership teaching to the next level
5 ways to take your entrepreunership teaching to the next level5 ways to take your entrepreunership teaching to the next level
5 ways to take your entrepreunership teaching to the next level
 
From Big Data to the Big Picture
From Big Data to the Big PictureFrom Big Data to the Big Picture
From Big Data to the Big Picture
 
The Power of Stories: Engaging your American Government Students
The Power of Stories: Engaging your American Government StudentsThe Power of Stories: Engaging your American Government Students
The Power of Stories: Engaging your American Government Students
 
Social Science in the Age of Trump: What We'd Like to See
Social Science in the Age of Trump: What We'd Like to See Social Science in the Age of Trump: What We'd Like to See
Social Science in the Age of Trump: What We'd Like to See
 
Little Green Facts
Little Green FactsLittle Green Facts
Little Green Facts
 
Teaching Statistics to People Who (Think They) Hate Statistics: Tips for Over...
Teaching Statistics to People Who (Think They) Hate Statistics: Tips for Over...Teaching Statistics to People Who (Think They) Hate Statistics: Tips for Over...
Teaching Statistics to People Who (Think They) Hate Statistics: Tips for Over...
 
Survey Tips for Librarians
Survey Tips for LibrariansSurvey Tips for Librarians
Survey Tips for Librarians
 
5 Tips for Teaching Introduction to Mass Communication: Engaging Students Liv...
5 Tips for Teaching Introduction to Mass Communication: Engaging Students Liv...5 Tips for Teaching Introduction to Mass Communication: Engaging Students Liv...
5 Tips for Teaching Introduction to Mass Communication: Engaging Students Liv...
 
Battling bannings: Authors discuss intellectual freedom and the freedom to read
Battling bannings: Authors discuss intellectual freedom and the freedom to readBattling bannings: Authors discuss intellectual freedom and the freedom to read
Battling bannings: Authors discuss intellectual freedom and the freedom to read
 
2016 Charleston Photo Contest Winners
2016 Charleston Photo Contest Winners2016 Charleston Photo Contest Winners
2016 Charleston Photo Contest Winners
 
Search, Serendipity & the Researcher Experience
Search, Serendipity & the Researcher ExperienceSearch, Serendipity & the Researcher Experience
Search, Serendipity & the Researcher Experience
 
Washington, D.C. and Social and Behavioral Science: The Picture for 2016
Washington, D.C. and Social and Behavioral Science: The Picture for 2016 Washington, D.C. and Social and Behavioral Science: The Picture for 2016
Washington, D.C. and Social and Behavioral Science: The Picture for 2016
 
Teaching Educational Research Methods: Making it Real & Relevant for Students
Teaching Educational Research Methods: Making it Real & Relevant for StudentsTeaching Educational Research Methods: Making it Real & Relevant for Students
Teaching Educational Research Methods: Making it Real & Relevant for Students
 
Student and faculty engagement with streaming video: Beyond the hype
Student and faculty engagement with streaming video: Beyond the hypeStudent and faculty engagement with streaming video: Beyond the hype
Student and faculty engagement with streaming video: Beyond the hype
 

Recently uploaded

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 

Recently uploaded (20)

Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Philosophy of china and it's charactistics
Philosophy of china and it's charactisticsPhilosophy of china and it's charactistics
Philosophy of china and it's charactistics
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
latest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answerslatest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answers
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 

Top Ten Developments in Qualitative Evaluation Over the Last Decade

  • 1. Los Angeles | London | New Delhi Singapore | Washington DC Michael Quinn Patton December 2014 #SAGEtalks Please be sure to check your settings Make sure your volume is set appropriately Make sure you have followed the instructions on your keypad properly Make sure everything is plugged in properly to assure your devices are working correctly If you continue to have audio or visual difficulties, please let us know via the Q&A box and one of our SAGE employees will be happy to assist you.You can also run a short test webinar to ensure your system settings are up-to-date: http://www.webex.com/test-meeting.html
  • 2. Los Angeles | London | New Delhi Singapore | Washington DC Michael Quinn Patton December 2014 #SAGEtalks Please take a moment to answer a quick question from our presenter. Before we get started…
  • 3. Los Angeles | London | New Delhi Singapore | Washington DC Top Ten Developments in Qualitative Evaluation Over the Last Decade Content and Presentation by Michael Quinn Patton
  • 4. Los Angeles | London | New Delhi Singapore | Washington DC Michael Quinn Patton December 2014 #SAGEtalks Michael Quinn Patton University of Minnesota University of Wisconsin - Madison American Evaluation Association Nicole Elliott Executive Marketing Manager, SAGE
  • 5. Los Angeles | London | New Delhi Singapore | Washington DC Michael Quinn Patton December 2014 #SAGEtalks While we do our best to answer as many questions as we can, time constraints may not allows us to answer every question. Thank you for understanding. Send us your questions! Using Twitter? Use the hashtag #SAGEtalks. Send in your questions via the Q&A Box on your screen. →
  • 6. 6 Michael Quinn Patton Top Ten Developments in Qualitative Evaluation over the Last Decade… and Emergent Challenges
  • 10. 9. Social media as data -- for data collection – and sharing findings 10
  • 11. 11 Complexity concepts are catching on. Under “relationship status” Facebook just added “dynamical” as an option.
  • 12. 8. Ethical challenges, IRB constraints • Anticipating impact on participants • Confidentiality with small sample sizes • Appropriate compensation – principle of reciprocity • IRB constraints 12 “I know your study is important. I’m just not ready to commit to being your case.”
  • 14. 14 Nov. 7, 1926 - Jan. 8, 2013
  • 15. Mixed Methods 571 1138 1459 Qualitative Methods 960 1434 1447 1547 Quantitative Methods 807 1403 1436 1580 2003 2011 2012 2013 AEA TIG Memberships http://www.eval.org/p/cm/ld/fid=101 15
  • 16. 6. 16
  • 17. Viet Nam Helmet Law • Road traffic injuries have long been a leading cause of death and disability in Viet Nam. • 60% of fatalities occur in motorcycle riders and passengers. • Viet Nam has had a partial motorcycle helmet legislation since 1995. However, implementation and enforcement had been limited. • On 15 December 2007, Viet Nam's first comprehensive mandatory helmet law came into effect, covering all riders and passengers on all roads nationwide. Penalties increased ten-fold and cohorts of police were mobilized for enforcement. 17
  • 18. 18
  • 19. 19
  • 20. 20
  • 21. 21
  • 22. 22
  • 23. 23
  • 25. 25
  • 26. 26
  • 27. 27
  • 28. 28
  • 29. 29
  • 30. 30
  • 31. 31
  • 32. Results The Asia Injury Prevention Foundation reported: “Nearly 100% of Vietnam’s motorbike users left home wearing a helmet. It was an unbelievable sight with a near instantaneous effect. Major hospitals report the number of patients admitted for traumatic brain injuries in the two days after the law’s enactment was much lower than on previous weekends. In Ho Chi Minh City alone, serious traffic accident injuries fell by almost 50 percent compared with pre-helmet weekends.” 32
  • 33. 5. Driven by evaluation practice and users’ demands • Doing QE (methods-driven) vs. grounded in theoretical traditions • Short, tight timelines • Large, multi-site studies • Speed 33
  • 34. 34
  • 36. 4. Qualitative Evaluation as an Intervention Process Use 36
  • 37. Qualitative Evaluation as an Intervention • Participatory evaluation • Feminist evaluation • Empowerment evaluation • Collaborative evaluation • Transformative evaluation • Developmental evaluation 37
  • 38. • Contextual Intelligence: A Critical Competency Matthew R. Kutz & Anita Bamford-Wade 38 3. Valuing Deep Contextual Understanding • Realist Evaluation
  • 39. Fundamental Issue: How the World Is Changed Top-down dissemination of “proven (RCT) best practice models” versus Bottoms-up contextual (qualitative) adaptation 39
  • 42. Five Paris Declaration Principles 1. Country ownership 2. Alignment 3. Harmonization 4. Mutual accountability 5. Managing for results 42 CONTEXT MATTERS
  • 45. 2. Qualitative Evaluator as the Instrument: Experience, Expertise, Cultural Competence…. 45 Former AEA President Rodney Hopson, “Language Matters”
  • 46. Personal Factor Old age and treachery Always overcomes youth and skill Waylon Jennings 46
  • 49. 49
  • 51. 51 1. Building qualitative inquiry capacity
  • 52. 2. Interest in and resources to do serious, triangulated, in-depth qualitative evaluations 52
  • 53. 3. Commitment to inquire seriously into unintended consequences 53 and Taking Emergence Seriously
  • 54. 4. Cumulative-Longitudinal Integration at the Case and Context Levels Center for Individualized Medicine Medicine 54 Creating a healthier world, one patient at a time.
  • 55. Michael Quinn Patton Claremont 2009
  • 56. Los Angeles | London | New Delhi Singapore | Washington DC Michael Quinn Patton December 2014 #SAGEtalks While we do our best to answer as many questions as we can, time constraints may not allows us to answer every question. Thank you for understanding. Send us your questions! Using Twitter? Use the hashtag #SAGEtalks. Send in your questions via the Q&A Box on your screen. →
  • 57. Los Angeles | London | New Delhi Singapore | Washington DC Michael Quinn Patton December 2014 #SAGEtalks Webinar recording available on www.sagepub.com/sagetalks. Top Ten Developments in Qualitative Evaluation Over the Last Decade Michael Quinn Patton • Twitter • Facebook • LinkedIn To purchase the book for 20% off, please use discount code PATTON20 when purchasing on the website. Be sure to check our website for updates on our 2015 Spring webinar series!