SlideShare uma empresa Scribd logo
1 de 112
Baixar para ler offline
Excellence is Bullshit:
Rethinking Research Evaluation for a Networked World
@cameronneylon
http://orcid.org/0000-0002-0068-716X
“[The purpose of bullshit] is to
impress the listener and the reader
with words that communicate that
[…]something is being or has been
done, words that are neither true
nor false, and so obscure the facts of
the matter being discussed”
Harry Frankfurt
“[The purpose of bullshit] is to
impress the listener and the reader
with words that communicate that
[…]something is being or has been
done, words that are neither true
nor false, and so obscure the facts of
the matter being discussed”
Wikipedia
“[The purpose of bullshit] is to
impress the listener and the reader
with words that communicate that
[…]something is being or has been
done, words that are neither true
nor false, and so obscure the facts of
the matter being discussed”
Wikipedia
“[The purpose of bullshit] is to
impress the listener and the reader
with words that communicate that
[…]something is being or has been
done, words that are neither true
nor false, and so obscure the facts of
the matter being discussed”
Wikipedia
“[The purpose of bullshit] is to
impress the listener and the reader
with words that communicate that
[…]something is being or has been
done, words that are neither true
nor false, and so obscure the facts of
the matter being discussed”
Wikipedia
“[The purpose of bullshit] is to
impress the listener and the reader
with words that communicate that
[…]something is being or has been
done, words that are neither true
nor false, and so obscure the facts of
the matter that should be discussed”
My work is excellent…
This talk is excellent…
“[…a] commitment
to excellence and
advancement on merit”
“[…a] commitment
to excellence and
advancement on merit”
University College London
“[…a] commitment
to excellence and
advancement on merit”
University College London
What do we mean when we use the word…
“excellence”?
Pursuit of excellence:
We strive
for excellence, seeking
to apply the highest
standards to benefit…
University of Queensland
The university pursues
academic excellence
through the creation,
preservation…
University of San Diego
…to strive
for excellence and
distinction…
Curtin University
We prize excellence
Cape Peninsula
University of Technology
We demand excellence
University of Westminster
…with world-
class excellence
across all of its
departments
Princeton
As a world-leading centre of
academic excellence we aim…
University of Edinburgh
The university counts the diversity of
its community as […] integral to its
mission of excellence, and it is
committed to diversity and
inclusiveness in both educational…
University of Maryland
“[…a] commitment
to excellence and
advancement on merit…
Fairness and equality…
Diversity University College London
excellence in…?
excellence in professionally
relevant teaching
University of Westminster
excellence in research
and education
Indiana University
excellence in research,
education and knowledge
exchange
Strathclyde University
excellence in teaching,
research, and public
engagement
Cornell University
…a center of
excellence for cultural,
athletic and other events
University of Toledo
…internationally recognized
excellence in information
technology services and
infrastructure.
Indiana University
What do we mean when we use the word…
“excellence”?
How can we determine or measure…
“excellence”?
We prize
academic excellence at UC Davis.
More than 500 of our faculty have
earned prestigious [..] honors[..]
rank[ings]. UC Davis
Pursuing excellence means being
satisfied with no less than the
highest goals we can envision.
University of Missouri
Pursuing excellence involves being
informed by regional, national and
global standards, as well as our
personal expectations. University of Missouri
“excellence” is the holy
grail of academic life
Michèle Lamont
How Professors Think
excellence is produced and
defined in a multitude of sites
and by an array of actors
Michèle Lamont
How Professors Think
excellence is produced and
defined in a multitude of sites
and by an array of actors
Michèle Lamont
How Professors Think
excellence is produced and
defined in a multitude of sites
and by an array of actors
Michèle Lamont
How Professors Think
excellence is produced and
defined in a multitude of sites
and by an array of actors
Michèle Lamont
How Professors Think
“excellence” tells us nothing
about how important the science is
and everything about who decides.
Jack Stilgoe
Against Excellence
Using the word
excellence
is a way of avoiding
a difficult conversation
Using the word
excellence
is a way of saying
something is being or
has been done
Using the word
excellence
is a way of using words
that are neither true
nor false
Using the word
excellence
is a way of obscuring
the facts of the matter
that should be discussed
Using the word
excellence
is a way of
bullshitting ourselves
Using the word
excellence
is a way of avoiding
talking about values
Impact
Research
Economic
Cultural
Education
Health
Environment
Impact
Research
Economic
Cultural
Education
Health
Environment
excellence
Impact
Research
Economic
Cultural
Education
Health
Environment
Impact
Research
Economic
Cultural
Education
Health
Environment
impact
Impact
Research
Economic
Cultural
Education
Health
Environment
quality
Impact
Research
Economic
Cultural
Education
Health
Environment
innovation
Impact
Research
Economic
Cultural
Education
Health
Environment
Impact
Research
Economic
Cultural
Education
Health
Environment
Impact
Research
Economic
Cultural
Education
Health
Environment
Impact
Research
Economic
Cultural
Education
Health
Environment
Impact
evaluation
…what we may be doing […]
when we make [a] value
judgement of a […] work...
Barbara Herrnstein Smith
Contingencies of Value
…articulating an estimate of
how well that work will serve
implicitly defined functions…
Barbara Herrnstein Smith
Contingencies of Value
…for an
implicitly defined audience…
Barbara Herrnstein Smith
Contingencies of Value
…experiencing the work under
implicitly defined conditions…
Barbara Herrnstein Smith
Contingencies of Value
…the work
of evaluation is to make these
implicit factors explicit.
Impact
Research
Economic
Cultural
Education
Health
Environment
Impact
There is some good news…
http://www.flickr.com/photos/verzo/8020565592/ CC	
  BY
https://www.flickr.com/photos/see-­‐through-­‐the-­‐eye-­‐of-­‐g/5392290809	
  CC	
  BY
https://www.flickr.com/photos/jenny-­‐pics/3239638494	
  CC	
  BY
Citation
Bookmark
Citation
Bookmark
Citation
Social	
  media
conversation
Bookmark
Citation
Previous	
  
co-­‐authorship
Conference
co-­‐attendance
Social	
  media
conversation
Impact
There is some bad news…
Impact
“excellence” becomes a performance
Impact
…performance of
“excellence”
Impact
…in the place of
excellent performance
“[…a] commitment
to excellence and
advancement on merit…
Fairness and equality…
Diversity University College London
Impact
Change the narrative…
Impact
“soundness”
Impact
“practice”
“social practice”
Impact
Impact
Answers are easy…
Impact
…it’s the questions that are hard
Impact
How do we evaluate whether we are
“achieving maximum positive social,
environmental and economic
benefit”?
Impact
How do we evaluate whether we are
“[d]eveloping future generations of
leaders in scholarship, research, the
learned professions, the public sector,
business and innovation”?
Impact
How do we hold ourselves to values of
“fairness and equality, diversity,
collegiality and community-building,
inclusiveness, openness, ethically
acceptable standards of conduct…”
@cameronneylon
http://orcid.org/0000-0002-0068-716X
Slides: https://t.co/vNkQ9ZMhwm
Excellence is Bullshit

Mais conteúdo relacionado

Semelhante a Excellence is Bullshit

Knowledge Sharing 2.0
Knowledge Sharing 2.0Knowledge Sharing 2.0
Knowledge Sharing 2.0
UNU-ViE
 
Plagarism + Turnitin Bus Induction Feb 2010
Plagarism + Turnitin   Bus Induction Feb 2010Plagarism + Turnitin   Bus Induction Feb 2010
Plagarism + Turnitin Bus Induction Feb 2010
esyin
 

Semelhante a Excellence is Bullshit (20)

Grant, Thoughts on the need for continuous learning and reskilling in librari...
Grant, Thoughts on the need for continuous learning and reskilling in librari...Grant, Thoughts on the need for continuous learning and reskilling in librari...
Grant, Thoughts on the need for continuous learning and reskilling in librari...
 
Knowledge Sharing 2.0
Knowledge Sharing 2.0Knowledge Sharing 2.0
Knowledge Sharing 2.0
 
Sentinel Event Case Study
Sentinel Event Case StudySentinel Event Case Study
Sentinel Event Case Study
 
A Story of Hype and Hope: Breaking Free of the Technology Bungy
A Story of Hype and Hope: Breaking Free of the Technology BungyA Story of Hype and Hope: Breaking Free of the Technology Bungy
A Story of Hype and Hope: Breaking Free of the Technology Bungy
 
Fit For 21st Century
Fit For 21st CenturyFit For 21st Century
Fit For 21st Century
 
Imagining a Smithsonian Commons - Gilbane 2008 slides
Imagining a Smithsonian Commons - Gilbane 2008 slidesImagining a Smithsonian Commons - Gilbane 2008 slides
Imagining a Smithsonian Commons - Gilbane 2008 slides
 
Changing Face of Higher Education: How Online, Blended and Open Learning is C...
Changing Face of Higher Education: How Online, Blended and Open Learning is C...Changing Face of Higher Education: How Online, Blended and Open Learning is C...
Changing Face of Higher Education: How Online, Blended and Open Learning is C...
 
The Quality Challenge: An Inconvenient Truth About e-Learning
The Quality Challenge: An Inconvenient Truth About e-LearningThe Quality Challenge: An Inconvenient Truth About e-Learning
The Quality Challenge: An Inconvenient Truth About e-Learning
 
Top 5 Universities In The World.pdf
Top 5 Universities In The World.pdfTop 5 Universities In The World.pdf
Top 5 Universities In The World.pdf
 
Professor Mark Brown "Flipping Quality Teaching"
Professor Mark Brown "Flipping Quality Teaching"Professor Mark Brown "Flipping Quality Teaching"
Professor Mark Brown "Flipping Quality Teaching"
 
Flipping Quality Teaching: Licking, Tasting and Sustaining Innovation
Flipping Quality Teaching: Licking, Tasting and Sustaining InnovationFlipping Quality Teaching: Licking, Tasting and Sustaining Innovation
Flipping Quality Teaching: Licking, Tasting and Sustaining Innovation
 
Venturefest 2016 Cyber Security Innovation
Venturefest 2016 Cyber Security InnovationVenturefest 2016 Cyber Security Innovation
Venturefest 2016 Cyber Security Innovation
 
Michael Edson @ Potomac Forum: Relevance is in the Eyes of the Beholder
Michael Edson @ Potomac Forum: Relevance is in the Eyes of the BeholderMichael Edson @ Potomac Forum: Relevance is in the Eyes of the Beholder
Michael Edson @ Potomac Forum: Relevance is in the Eyes of the Beholder
 
A BOLD New Future: The Changing Face of University Education
A BOLD New Future: The Changing Face of University EducationA BOLD New Future: The Changing Face of University Education
A BOLD New Future: The Changing Face of University Education
 
I Need An Example Of A Reflective Journal In Thi
I Need An Example Of A Reflective Journal In ThiI Need An Example Of A Reflective Journal In Thi
I Need An Example Of A Reflective Journal In Thi
 
VRA 2009
VRA 2009VRA 2009
VRA 2009
 
The 10 best institutions for higher education in australia 2018
The 10 best institutions for higher education in australia 2018The 10 best institutions for higher education in australia 2018
The 10 best institutions for higher education in australia 2018
 
Plagarism + Turnitin Bus Induction Feb 2010
Plagarism + Turnitin   Bus Induction Feb 2010Plagarism + Turnitin   Bus Induction Feb 2010
Plagarism + Turnitin Bus Induction Feb 2010
 
Internationalising the Curriculum: Teaching and Learning for the Digital World
Internationalising the Curriculum: Teaching and Learning for the Digital WorldInternationalising the Curriculum: Teaching and Learning for the Digital World
Internationalising the Curriculum: Teaching and Learning for the Digital World
 
1 final rawson_alt-post_msu
1 final rawson_alt-post_msu1 final rawson_alt-post_msu
1 final rawson_alt-post_msu
 

Mais de Cameron Neylon

Will we still know ourselves? Identity and Community in a Transforming Knowle...
Will we still know ourselves? Identity and Community in a Transforming Knowle...Will we still know ourselves? Identity and Community in a Transforming Knowle...
Will we still know ourselves? Identity and Community in a Transforming Knowle...
Cameron Neylon
 
Beyond Open: Culture and Scaling in the Making of Knowledge
Beyond Open: Culture and Scaling in the Making of KnowledgeBeyond Open: Culture and Scaling in the Making of Knowledge
Beyond Open: Culture and Scaling in the Making of Knowledge
Cameron Neylon
 
Openness in Scholarship: A return to core values?
Openness in Scholarship: A return to core values?Openness in Scholarship: A return to core values?
Openness in Scholarship: A return to core values?
Cameron Neylon
 
No stories without evidence, no evidence without stories
No stories without evidence, no evidence without storiesNo stories without evidence, no evidence without stories
No stories without evidence, no evidence without stories
Cameron Neylon
 

Mais de Cameron Neylon (20)

OA Advocacy Today
OA Advocacy TodayOA Advocacy Today
OA Advocacy Today
 
Open Knowledge Institutions: Is there a future for the university in a networ...
Open Knowledge Institutions: Is there a future for the university in a networ...Open Knowledge Institutions: Is there a future for the university in a networ...
Open Knowledge Institutions: Is there a future for the university in a networ...
 
Network Enabled Research: Connectivity, groups and growth in the production o...
Network Enabled Research: Connectivity, groups and growth in the production o...Network Enabled Research: Connectivity, groups and growth in the production o...
Network Enabled Research: Connectivity, groups and growth in the production o...
 
Open Science Needs Open Indicators
Open Science Needs Open IndicatorsOpen Science Needs Open Indicators
Open Science Needs Open Indicators
 
The Power of Infrastructures and the Infrastructures of Power
The Power of Infrastructures and the Infrastructures of PowerThe Power of Infrastructures and the Infrastructures of Power
The Power of Infrastructures and the Infrastructures of Power
 
Will we still know ourselves? Identity and Community in a Transforming Knowle...
Will we still know ourselves? Identity and Community in a Transforming Knowle...Will we still know ourselves? Identity and Community in a Transforming Knowle...
Will we still know ourselves? Identity and Community in a Transforming Knowle...
 
Beyond Open: Culture and Scaling in the Making of Knowledge
Beyond Open: Culture and Scaling in the Making of KnowledgeBeyond Open: Culture and Scaling in the Making of Knowledge
Beyond Open: Culture and Scaling in the Making of Knowledge
 
From Cycles to Networks
From Cycles to NetworksFrom Cycles to Networks
From Cycles to Networks
 
Where next for Open Scholarship?
Where next for Open Scholarship?Where next for Open Scholarship?
Where next for Open Scholarship?
 
Openness in Scholarship: A return to core values?
Openness in Scholarship: A return to core values?Openness in Scholarship: A return to core values?
Openness in Scholarship: A return to core values?
 
Interpreting Shadows on the Elephant in the Room
Interpreting Shadows on the Elephant in the RoomInterpreting Shadows on the Elephant in the Room
Interpreting Shadows on the Elephant in the Room
 
Sustaining Scholarly Infrastructures through Collective Action: The lessons t...
Sustaining Scholarly Infrastructures through Collective Action: The lessons t...Sustaining Scholarly Infrastructures through Collective Action: The lessons t...
Sustaining Scholarly Infrastructures through Collective Action: The lessons t...
 
Sustainable Futures for Research Communication
Sustainable Futures for Research CommunicationSustainable Futures for Research Communication
Sustainable Futures for Research Communication
 
Warning
WarningWarning
Warning
 
Investing in Scholarly Futures
Investing in Scholarly FuturesInvesting in Scholarly Futures
Investing in Scholarly Futures
 
No stories without evidence, no evidence without stories
No stories without evidence, no evidence without storiesNo stories without evidence, no evidence without stories
No stories without evidence, no evidence without stories
 
From research life cycle to networks: The role of the library
From research life cycle to networks: The role of the libraryFrom research life cycle to networks: The role of the library
From research life cycle to networks: The role of the library
 
CENDI - Impact
CENDI - ImpactCENDI - Impact
CENDI - Impact
 
Project Credit - Overview and Summary
Project Credit - Overview and SummaryProject Credit - Overview and Summary
Project Credit - Overview and Summary
 
Real Choices, False Colors
Real Choices, False ColorsReal Choices, False Colors
Real Choices, False Colors
 

Último

Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Sérgio Sacani
 
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cherry
 
POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.
Cherry
 
PODOCARPUS...........................pptx
PODOCARPUS...........................pptxPODOCARPUS...........................pptx
PODOCARPUS...........................pptx
Cherry
 
The Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptxThe Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptx
seri bangash
 
CYTOGENETIC MAP................ ppt.pptx
CYTOGENETIC MAP................ ppt.pptxCYTOGENETIC MAP................ ppt.pptx
CYTOGENETIC MAP................ ppt.pptx
Cherry
 
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
Scintica Instrumentation
 

Último (20)

Genome sequencing,shotgun sequencing.pptx
Genome sequencing,shotgun sequencing.pptxGenome sequencing,shotgun sequencing.pptx
Genome sequencing,shotgun sequencing.pptx
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
 
Selaginella: features, morphology ,anatomy and reproduction.
Selaginella: features, morphology ,anatomy and reproduction.Selaginella: features, morphology ,anatomy and reproduction.
Selaginella: features, morphology ,anatomy and reproduction.
 
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
 
Genetics and epigenetics of ADHD and comorbid conditions
Genetics and epigenetics of ADHD and comorbid conditionsGenetics and epigenetics of ADHD and comorbid conditions
Genetics and epigenetics of ADHD and comorbid conditions
 
Role of AI in seed science Predictive modelling and Beyond.pptx
Role of AI in seed science  Predictive modelling and  Beyond.pptxRole of AI in seed science  Predictive modelling and  Beyond.pptx
Role of AI in seed science Predictive modelling and Beyond.pptx
 
Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate ProfessorThyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
 
Plasmid: types, structure and functions.
Plasmid: types, structure and functions.Plasmid: types, structure and functions.
Plasmid: types, structure and functions.
 
POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.
 
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIA
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIACURRENT SCENARIO OF POULTRY PRODUCTION IN INDIA
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIA
 
Genome organization in virus,bacteria and eukaryotes.pptx
Genome organization in virus,bacteria and eukaryotes.pptxGenome organization in virus,bacteria and eukaryotes.pptx
Genome organization in virus,bacteria and eukaryotes.pptx
 
PODOCARPUS...........................pptx
PODOCARPUS...........................pptxPODOCARPUS...........................pptx
PODOCARPUS...........................pptx
 
FAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical ScienceFAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical Science
 
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryFAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
 
Terpineol and it's characterization pptx
Terpineol and it's characterization pptxTerpineol and it's characterization pptx
Terpineol and it's characterization pptx
 
The Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptxThe Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptx
 
CYTOGENETIC MAP................ ppt.pptx
CYTOGENETIC MAP................ ppt.pptxCYTOGENETIC MAP................ ppt.pptx
CYTOGENETIC MAP................ ppt.pptx
 
Site specific recombination and transposition.........pdf
Site specific recombination and transposition.........pdfSite specific recombination and transposition.........pdf
Site specific recombination and transposition.........pdf
 
Concept of gene and Complementation test.pdf
Concept of gene and Complementation test.pdfConcept of gene and Complementation test.pdf
Concept of gene and Complementation test.pdf
 
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
 

Excellence is Bullshit