SlideShare uma empresa Scribd logo
1 de 22
EVOLVING RESEARCH EVALUATION RAE2008 OUTCOMES  AND REF PROSPECTS JONATHAN ADAMS 10 NOVEMBER 2009
Evaluation ,[object Object]
Indicators vs profiles
Decision support, not substitution
What variables are relevant in  ...
Academic
Economic
Policy
Social ... Impact
Objective impact evaluation is constrained by a lack of reference data outside ‘academic’,[object Object]
Sample coverage ,[object Object]
Alberta journal of educational research
American journal of education
Asia Pacific journal of education
Australian journal of early childhood
British educational research journal
Chinese education and society
DidacticaSlovenica - pedagoskaobzorja
Durham and Newcastle research review
Egitimvebilim - education and science
European journal of Dental education All the way through to ,[object Object]
Zeitschrift fur Soziologie der Erziehung und Sozialisation ,[object Object]

Mais conteúdo relacionado

Semelhante a Keynote 4 - Analysis of RAE 2008 and Prospects For REF - Jonathan Adams, Evidence, Thomson Reuters

duncan_ross_-_symposium_tef_presentation.pptx
duncan_ross_-_symposium_tef_presentation.pptxduncan_ross_-_symposium_tef_presentation.pptx
duncan_ross_-_symposium_tef_presentation.pptxsherif1974
 
AUA 2007 League Tables
AUA 2007 League TablesAUA 2007 League Tables
AUA 2007 League TablesPaul Greatrix
 
Exploring the Map of Distance and e-Learning Research - a Bibliographic Analysis
Exploring the Map of Distance and e-Learning Research - a Bibliographic AnalysisExploring the Map of Distance and e-Learning Research - a Bibliographic Analysis
Exploring the Map of Distance and e-Learning Research - a Bibliographic AnalysisEDEN Digital Learning Europe
 
Exploring the map of distance and e-learning research
Exploring the map of distance and e-learning researchExploring the map of distance and e-learning research
Exploring the map of distance and e-learning researchzawacki1972
 
Paper 4: Ranking Universities (Ince)
Paper 4: Ranking Universities (Ince)Paper 4: Ranking Universities (Ince)
Paper 4: Ranking Universities (Ince)Kent Business School
 
Bibliometrics and University Rankings
Bibliometrics and University RankingsBibliometrics and University Rankings
Bibliometrics and University RankingsR Pagell
 
Uses and misuses of quantitative indicators of impact
Uses and misuses of quantitative indicators of impactUses and misuses of quantitative indicators of impact
Uses and misuses of quantitative indicators of impactBerenika Webster
 
Do metrics match peer review
Do metrics match peer reviewDo metrics match peer review
Do metrics match peer reviewAnne-Wil Harzing
 
ARRA presentation ceu_february2011
ARRA presentation ceu_february2011ARRA presentation ceu_february2011
ARRA presentation ceu_february2011arraweb
 
Paper 6: World University's Evaluation (Qiu & Zhao)
Paper 6: World University's Evaluation (Qiu & Zhao)Paper 6: World University's Evaluation (Qiu & Zhao)
Paper 6: World University's Evaluation (Qiu & Zhao)Kent Business School
 
Paper 7: Ranking Methodology of Times Higher Education (Baty)
Paper 7: Ranking Methodology of Times Higher Education (Baty)Paper 7: Ranking Methodology of Times Higher Education (Baty)
Paper 7: Ranking Methodology of Times Higher Education (Baty)Kent Business School
 
Iabc plenary update
Iabc plenary updateIabc plenary update
Iabc plenary updateslinacre
 
British academics from different disciplines: comparing their conceptions of ...
British academics from different disciplines: comparing their conceptions of ...British academics from different disciplines: comparing their conceptions of ...
British academics from different disciplines: comparing their conceptions of ...Sheila Webber
 
Aarhus Research Assessment And Publication Behaviour
Aarhus Research Assessment And Publication BehaviourAarhus Research Assessment And Publication Behaviour
Aarhus Research Assessment And Publication BehaviourResearch Information Network
 
Phil Baty and Jonathan Adams: Rankings Reflection
Phil Baty and Jonathan Adams: Rankings ReflectionPhil Baty and Jonathan Adams: Rankings Reflection
Phil Baty and Jonathan Adams: Rankings ReflectionAmy Hilton
 
Paper 1: Shanghai Ranking (Liu, Nian Cai)
Paper 1: Shanghai Ranking (Liu, Nian Cai)Paper 1: Shanghai Ranking (Liu, Nian Cai)
Paper 1: Shanghai Ranking (Liu, Nian Cai)Kent Business School
 

Semelhante a Keynote 4 - Analysis of RAE 2008 and Prospects For REF - Jonathan Adams, Evidence, Thomson Reuters (20)

Aua 2008 A
Aua 2008 AAua 2008 A
Aua 2008 A
 
duncan_ross_-_symposium_tef_presentation.pptx
duncan_ross_-_symposium_tef_presentation.pptxduncan_ross_-_symposium_tef_presentation.pptx
duncan_ross_-_symposium_tef_presentation.pptx
 
ARWU 2010
ARWU 2010ARWU 2010
ARWU 2010
 
AUA 2007 League Tables
AUA 2007 League TablesAUA 2007 League Tables
AUA 2007 League Tables
 
Exploring the Map of Distance and e-Learning Research - a Bibliographic Analysis
Exploring the Map of Distance and e-Learning Research - a Bibliographic AnalysisExploring the Map of Distance and e-Learning Research - a Bibliographic Analysis
Exploring the Map of Distance and e-Learning Research - a Bibliographic Analysis
 
Exploring the map of distance and e-learning research
Exploring the map of distance and e-learning researchExploring the map of distance and e-learning research
Exploring the map of distance and e-learning research
 
Paper 4: Ranking Universities (Ince)
Paper 4: Ranking Universities (Ince)Paper 4: Ranking Universities (Ince)
Paper 4: Ranking Universities (Ince)
 
Bibliometrics and University Rankings
Bibliometrics and University RankingsBibliometrics and University Rankings
Bibliometrics and University Rankings
 
Uses and misuses of quantitative indicators of impact
Uses and misuses of quantitative indicators of impactUses and misuses of quantitative indicators of impact
Uses and misuses of quantitative indicators of impact
 
Do metrics match peer review
Do metrics match peer reviewDo metrics match peer review
Do metrics match peer review
 
ARRA presentation ceu_february2011
ARRA presentation ceu_february2011ARRA presentation ceu_february2011
ARRA presentation ceu_february2011
 
Paper 6: World University's Evaluation (Qiu & Zhao)
Paper 6: World University's Evaluation (Qiu & Zhao)Paper 6: World University's Evaluation (Qiu & Zhao)
Paper 6: World University's Evaluation (Qiu & Zhao)
 
Paper 7: Ranking Methodology of Times Higher Education (Baty)
Paper 7: Ranking Methodology of Times Higher Education (Baty)Paper 7: Ranking Methodology of Times Higher Education (Baty)
Paper 7: Ranking Methodology of Times Higher Education (Baty)
 
Iabc plenary update
Iabc plenary updateIabc plenary update
Iabc plenary update
 
Alpsp Conf 10 Sep 09
Alpsp Conf 10 Sep 09Alpsp Conf 10 Sep 09
Alpsp Conf 10 Sep 09
 
British academics from different disciplines: comparing their conceptions of ...
British academics from different disciplines: comparing their conceptions of ...British academics from different disciplines: comparing their conceptions of ...
British academics from different disciplines: comparing their conceptions of ...
 
10520130101002
1052013010100210520130101002
10520130101002
 
Aarhus Research Assessment And Publication Behaviour
Aarhus Research Assessment And Publication BehaviourAarhus Research Assessment And Publication Behaviour
Aarhus Research Assessment And Publication Behaviour
 
Phil Baty and Jonathan Adams: Rankings Reflection
Phil Baty and Jonathan Adams: Rankings ReflectionPhil Baty and Jonathan Adams: Rankings Reflection
Phil Baty and Jonathan Adams: Rankings Reflection
 
Paper 1: Shanghai Ranking (Liu, Nian Cai)
Paper 1: Shanghai Ranking (Liu, Nian Cai)Paper 1: Shanghai Ranking (Liu, Nian Cai)
Paper 1: Shanghai Ranking (Liu, Nian Cai)
 

Mais de Mike Blamires

Marti aned education plus sen
Marti aned education plus senMarti aned education plus sen
Marti aned education plus senMike Blamires
 
Educating for Entrepreneurial Mindsets (MESHGuide): A critical consideration ...
Educating for Entrepreneurial Mindsets (MESHGuide): A critical consideration ...Educating for Entrepreneurial Mindsets (MESHGuide): A critical consideration ...
Educating for Entrepreneurial Mindsets (MESHGuide): A critical consideration ...Mike Blamires
 
Wealth Taking or Wealth Making?: What Does The Evidence Tell Us About Effecti...
Wealth Taking or Wealth Making?:What Does The Evidence Tell Us About Effecti...Wealth Taking or Wealth Making?:What Does The Evidence Tell Us About Effecti...
Wealth Taking or Wealth Making?: What Does The Evidence Tell Us About Effecti...Mike Blamires
 
Lsda models of_research_impact
Lsda models of_research_impactLsda models of_research_impact
Lsda models of_research_impactMike Blamires
 
Evaluation of the Communication Aids Project (CAP) DFES (2004) Rr580
Evaluation of the Communication Aids Project (CAP) DFES (2004) Rr580Evaluation of the Communication Aids Project (CAP) DFES (2004) Rr580
Evaluation of the Communication Aids Project (CAP) DFES (2004) Rr580Mike Blamires
 
The Public, the Personal and National Curricula: Reform in England 1988 to 2010
The Public, the Personal and National Curricula: Reform in England 1988 to 2010The Public, the Personal and National Curricula: Reform in England 1988 to 2010
The Public, the Personal and National Curricula: Reform in England 1988 to 2010Mike Blamires
 
ECER 2010: Curriculum Reform in Four Nations: a home international perspective:
ECER 2010: Curriculum Reform in Four Nations: a home international perspective: ECER 2010: Curriculum Reform in Four Nations: a home international perspective:
ECER 2010: Curriculum Reform in Four Nations: a home international perspective: Mike Blamires
 
The School Curriculum in Wales and Devolution: Evidence Informed Policy
The School Curriculum in Wales and Devolution: Evidence Informed PolicyThe School Curriculum in Wales and Devolution: Evidence Informed Policy
The School Curriculum in Wales and Devolution: Evidence Informed PolicyMike Blamires
 
Education reform in Scotland: engagement, consultation and the politics of ch...
Education reform in Scotland: engagement, consultation and the politics of ch...Education reform in Scotland: engagement, consultation and the politics of ch...
Education reform in Scotland: engagement, consultation and the politics of ch...Mike Blamires
 
Policy, Politics and Curriculum and Assessment Change in Northern Ireland
Policy, Politics and Curriculum and Assessment Change in Northern IrelandPolicy, Politics and Curriculum and Assessment Change in Northern Ireland
Policy, Politics and Curriculum and Assessment Change in Northern IrelandMike Blamires
 
Elmis Conference Powerpoint Presentation
Elmis Conference Powerpoint PresentationElmis Conference Powerpoint Presentation
Elmis Conference Powerpoint PresentationMike Blamires
 
Progression At Pupil, School And National Levels
Progression At Pupil, School And National LevelsProgression At Pupil, School And National Levels
Progression At Pupil, School And National LevelsMike Blamires
 
Evaluation Of Virtual School Heads For Looked After Children
Evaluation Of Virtual School Heads For Looked After ChildrenEvaluation Of Virtual School Heads For Looked After Children
Evaluation Of Virtual School Heads For Looked After ChildrenMike Blamires
 
Making The Most Of Longitudinal Data
Making The Most Of Longitudinal DataMaking The Most Of Longitudinal Data
Making The Most Of Longitudinal DataMike Blamires
 
Planning for the Future: How the Data & Statistics Strategy will help us get ...
Planning for the Future: How the Data & Statistics Strategy will help us get ...Planning for the Future: How the Data & Statistics Strategy will help us get ...
Planning for the Future: How the Data & Statistics Strategy will help us get ...Mike Blamires
 
Defining the Eradication of Child Poverty in the Child Poverty Bill
Defining the Eradication of Child Poverty in the Child Poverty BillDefining the Eradication of Child Poverty in the Child Poverty Bill
Defining the Eradication of Child Poverty in the Child Poverty BillMike Blamires
 
STEM: Progression from GCSE to A Level
STEM: Progression from GCSE to A LevelSTEM: Progression from GCSE to A Level
STEM: Progression from GCSE to A LevelMike Blamires
 
Using Tellus data for National and Local Indicators
Using Tellus data for National and Local IndicatorsUsing Tellus data for National and Local Indicators
Using Tellus data for National and Local IndicatorsMike Blamires
 
Tellus4: Delivering the survey
Tellus4: Delivering the surveyTellus4: Delivering the survey
Tellus4: Delivering the surveyMike Blamires
 

Mais de Mike Blamires (20)

Marti aned education plus sen
Marti aned education plus senMarti aned education plus sen
Marti aned education plus sen
 
Educating for Entrepreneurial Mindsets (MESHGuide): A critical consideration ...
Educating for Entrepreneurial Mindsets (MESHGuide): A critical consideration ...Educating for Entrepreneurial Mindsets (MESHGuide): A critical consideration ...
Educating for Entrepreneurial Mindsets (MESHGuide): A critical consideration ...
 
Wealth Taking or Wealth Making?: What Does The Evidence Tell Us About Effecti...
Wealth Taking or Wealth Making?:What Does The Evidence Tell Us About Effecti...Wealth Taking or Wealth Making?:What Does The Evidence Tell Us About Effecti...
Wealth Taking or Wealth Making?: What Does The Evidence Tell Us About Effecti...
 
A
AA
A
 
Lsda models of_research_impact
Lsda models of_research_impactLsda models of_research_impact
Lsda models of_research_impact
 
Evaluation of the Communication Aids Project (CAP) DFES (2004) Rr580
Evaluation of the Communication Aids Project (CAP) DFES (2004) Rr580Evaluation of the Communication Aids Project (CAP) DFES (2004) Rr580
Evaluation of the Communication Aids Project (CAP) DFES (2004) Rr580
 
The Public, the Personal and National Curricula: Reform in England 1988 to 2010
The Public, the Personal and National Curricula: Reform in England 1988 to 2010The Public, the Personal and National Curricula: Reform in England 1988 to 2010
The Public, the Personal and National Curricula: Reform in England 1988 to 2010
 
ECER 2010: Curriculum Reform in Four Nations: a home international perspective:
ECER 2010: Curriculum Reform in Four Nations: a home international perspective: ECER 2010: Curriculum Reform in Four Nations: a home international perspective:
ECER 2010: Curriculum Reform in Four Nations: a home international perspective:
 
The School Curriculum in Wales and Devolution: Evidence Informed Policy
The School Curriculum in Wales and Devolution: Evidence Informed PolicyThe School Curriculum in Wales and Devolution: Evidence Informed Policy
The School Curriculum in Wales and Devolution: Evidence Informed Policy
 
Education reform in Scotland: engagement, consultation and the politics of ch...
Education reform in Scotland: engagement, consultation and the politics of ch...Education reform in Scotland: engagement, consultation and the politics of ch...
Education reform in Scotland: engagement, consultation and the politics of ch...
 
Policy, Politics and Curriculum and Assessment Change in Northern Ireland
Policy, Politics and Curriculum and Assessment Change in Northern IrelandPolicy, Politics and Curriculum and Assessment Change in Northern Ireland
Policy, Politics and Curriculum and Assessment Change in Northern Ireland
 
Elmis Conference Powerpoint Presentation
Elmis Conference Powerpoint PresentationElmis Conference Powerpoint Presentation
Elmis Conference Powerpoint Presentation
 
Progression At Pupil, School And National Levels
Progression At Pupil, School And National LevelsProgression At Pupil, School And National Levels
Progression At Pupil, School And National Levels
 
Evaluation Of Virtual School Heads For Looked After Children
Evaluation Of Virtual School Heads For Looked After ChildrenEvaluation Of Virtual School Heads For Looked After Children
Evaluation Of Virtual School Heads For Looked After Children
 
Making The Most Of Longitudinal Data
Making The Most Of Longitudinal DataMaking The Most Of Longitudinal Data
Making The Most Of Longitudinal Data
 
Planning for the Future: How the Data & Statistics Strategy will help us get ...
Planning for the Future: How the Data & Statistics Strategy will help us get ...Planning for the Future: How the Data & Statistics Strategy will help us get ...
Planning for the Future: How the Data & Statistics Strategy will help us get ...
 
Defining the Eradication of Child Poverty in the Child Poverty Bill
Defining the Eradication of Child Poverty in the Child Poverty BillDefining the Eradication of Child Poverty in the Child Poverty Bill
Defining the Eradication of Child Poverty in the Child Poverty Bill
 
STEM: Progression from GCSE to A Level
STEM: Progression from GCSE to A LevelSTEM: Progression from GCSE to A Level
STEM: Progression from GCSE to A Level
 
Using Tellus data for National and Local Indicators
Using Tellus data for National and Local IndicatorsUsing Tellus data for National and Local Indicators
Using Tellus data for National and Local Indicators
 
Tellus4: Delivering the survey
Tellus4: Delivering the surveyTellus4: Delivering the survey
Tellus4: Delivering the survey
 

Último

Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxDenish Jangid
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfagholdier
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.MateoGardella
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docxPoojaSen20
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Shubhangi Sonawane
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin ClassesCeline George
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...KokoStevan
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.christianmathematics
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 

Último (20)

Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 

Keynote 4 - Analysis of RAE 2008 and Prospects For REF - Jonathan Adams, Evidence, Thomson Reuters

  • 1. EVOLVING RESEARCH EVALUATION RAE2008 OUTCOMES AND REF PROSPECTS JONATHAN ADAMS 10 NOVEMBER 2009
  • 2.
  • 4. Decision support, not substitution
  • 5. What variables are relevant in ...
  • 10.
  • 11.
  • 12. Alberta journal of educational research
  • 13. American journal of education
  • 14. Asia Pacific journal of education
  • 15. Australian journal of early childhood
  • 19. Durham and Newcastle research review
  • 21.
  • 22.
  • 23. Steady but volatile improvement
  • 24. What is used to represent excellent research outcomes?
  • 26. Previously among studies by Evidence HEFCs/UUK – Maintaining Research Excellence Recognition of a peak supported by a research platform Evolution of 3 to 4 to 5 grade units HEFCE – Role of QR funding Strategic significance of the block grant Universities UK – Excellence and Diversity Regional network of research competence Importance of an evidence base for research policy OST/DIUS/BIS Diversity as a critical element in research policy
  • 27. RAE2008 – a novel outcome with dispersed rewards Gareth Roberts’ proposals on research profiling Problem of the ‘cliff edge’ Recognising dynamic excellence in the research base Unexpected differences between panels The problem of interpreting methodology and standards The absence of a commonly understood standard? The dispersed map of reward-able research Decisions about funding allocations 2* = 1 (x 3 to) 3* = 3 (x 2.33 to) 4* = 7 Greater relative rewards for modest gains than for very expensive world-class excellence (cf 2001)
  • 28. How can we explore the spread of excellence? We have Panel outcomes from RAE2008 – but opinions differ, so ... Bibliometric data on a consistent basis from 1981 We split the HE sector into crude groups All HEIs Russell Group 1994 Group Universities with a shorter history of research investment And we created an elite ‘golden triangle’ band Oxford (C12th), Cambridge (1209), UCL (1836), Imperial (C19th) , LSE (1895)
  • 29. Excellence is linked to selectivity
  • 30. And excellence is concentrated
  • 31. The problem with simplistic indicators They don’t really express the complexity of research performance Average impact (e.g. ‘crown indicator’) can be very misleading Research Council studies reveal error of interpretation Skewed data, median much smaller than average Lots of papers are not cited The interesting bit is about how much is really, really cited lots So we we prefer Impact Profiles®
  • 32. UK background and ‘golden triangle’ This is the small but critical excess of really highly cited research output
  • 33. Even smaller differences separate the UK and USA research profiles
  • 34. Excellence extends to other institutions
  • 35. But the differences become very fine
  • 36. And if we distil further, other complexity is revealed
  • 37. Older institutions have no monopoly on quality, but the peak is distinctive For the 1994 Group, there are relatively fewer low-cited papers and relatively more high-cited papers than for many in the Russell Group
  • 38. What does this imply? There is a very concentrated peak of exceptional excellence UK international competitiveness is associated with selectivity that increased concentration There is a regional network of exceptional quality, much in dynamic institutions created in the 1960s The balance that supports diversity & dynamism and the concentrated support of international excellence is very fine Model first, meddle second
  • 39. EVOLVING RESEARCH EVALUATION RAE2008 OUTCOMES AND REF PROSPECTS JONATHAN ADAMS 10 NOVEMBER 2009