SlideShare uma empresa Scribd logo
1 de 16
Peer Review
Terminology
Anna Jester
0000-0002-8543-0311
June 2022
What is the Peer Review
Terminology?
An ANSI/NISO standard which will
support the industry in ensuring
greater transparency and
openness in peer review.
Session 3B: Community Standards and Recommendations
Supporting Open Scholarship: A Host of Benefits for All 2
Drivers
• Innovative review models, including those
called open, have evolved
• Definitions for each term relating to peer
review are unclear
• Transparency is crucial in science
• Use makes peer review more transparent
and allow researches to compare the
processes in use across journals
3
Timeline
STM Association founds
Working Group
Early 2020
Draft provided for public
input
July 2020
Adapted based on comments
Sep 2020
•Journal and Article level Pilot
January 2021
NISO Working Group
announced to formalize as
ANSI/NISO standard
July 2021
Piloting the terminology with
150 journals through
September
Now
Session 3B: Community Standards and Recommendations Supporting Open Scholarship: A Host of Benefits for All 4
Working Group Members
5
Steve Pinchotti. Altum, Inc.
Lois Jones. American Psychological Association (APA)
Caroline Webber. Aries Systems Corporation
Nick Taylor. ATYPON
Naseem Naqvi. British Blockchain Association
Alison Paskins. Cambridge University Press
Trevor Lane. Committee on Publication Ethics (COPE)
Anna Jester. eJournalPress
Andy Collings. eLife
Oliver Rickard. HighWire Press
Alison Larkin. IEEE
Kim Eggleton. IOP Publishing
Michael Willis. John Wiley & Sons, Ltd.
Nettie Lagace. NISO
Nick Lindsay. Massachusetts Institute of Technology (MIT)
Gabe Stein. Massachusetts Institute of Technology (MIT)
Dr. Michelle Urberg. Music Library Association
Jill Reilly. National Agricultural Library
Dr. Bahar Mehmani. Elsevier
Katrina Pickersgill. SAGE Publishing
Jon Speilburg. SPIE
Virginia Mercer. Springer Nature
Tim Shipley. Springer Nature
Sabina Alam. Taylor & Francis Group
Tony Alves. HighWire Press
Lisa Hinchliffe. University of Illinois atUrbana-Champaign
Joris van Rossum. STM (Chair) (rossum@stm-assoc.org)
Mapped Elements of the Peer
Review Process
• IDENTITY TRANSPARENCY
• REVIEWER INTERACTS WITH
• REVIEW INFORMATION PUBLISHED
• WHETHER POST-PUBLICATION COMMENTING TAKES PLACE
Session 3B: Community Standards and Recommendations Supporting Open Scholarship: A Host of Benefits for All 6
Identity
Transparency
• Single Anonymized
• Double Anonymized
• Triple Anonymized (Editors making
decision also don’t know who the
reviewers are)
• Visible (everyone knows who everyone
is during peer review)
Session 3B: Community Standards and Recommendations Supporting Open
Scholarship: A Host of Benefits for All 8
• Editor
• Editor and other
Reviewer(s)
• Author and Editor
• Editor, other
Reviewer(s) and
Author
Reviewer Interacts With
Review information Published
9
• None
• Review summaries
• Review reports
• Review reports, author opt in
• Review reports, reviewer opt in
• Submitted manuscript
• Submitted manuscript, author opts in
• Author/editor communication
• Reviewer Identities
• Reviewer Identities, reviewer opt in
• Editor identities
Each Not
Mutually
Exclusive!
Whether Post-publication Commenting
Takes Place
Session 3B: Community Standards and Recommendations Supporting Open Scholarship: A Host of Benefits for All 10
• Registered commentors
• Unregistered commentors
• Editor-selected commentors
Use of Terminology
Session 3B: Community Standards and Recommendations Supporting Open Scholarship: A Host of Benefits for All 11
Use of Terminology
Session 3B: Community Standards and Recommendations Supporting Open Scholarship: A Host of Benefits for All 12
Example Journal A
13
Example Journal B
14
Questions?
15
Thank You
Anna Jester
ajester@ejpress.com
@anna_jester
16

Mais conteúdo relacionado

Semelhante a Jester "Peer Review Terminology"

Crafting the literature review
Crafting the literature reviewCrafting the literature review
Crafting the literature review
Ahmed Hamdy
 
Best practices for presentation of e journals part 2
Best practices for presentation of e journals part 2Best practices for presentation of e journals part 2
Best practices for presentation of e journals part 2
Andrea Twiss-Brooks
 
Spotlight Webinar: AMSTAR 2
Spotlight Webinar: AMSTAR 2Spotlight Webinar: AMSTAR 2
how_to_get_published_-_eifl_training.pptx
how_to_get_published_-_eifl_training.pptxhow_to_get_published_-_eifl_training.pptx
how_to_get_published_-_eifl_training.pptx
ssuseraf1f22
 
NCCMT Spotlight Webinar: MetaQAT
NCCMT Spotlight Webinar: MetaQATNCCMT Spotlight Webinar: MetaQAT

Semelhante a Jester "Peer Review Terminology" (20)

Development of specific definitions for alternative assessment metrics Mike...
Development of specific definitions for alternative assessment metrics  	Mike...Development of specific definitions for alternative assessment metrics  	Mike...
Development of specific definitions for alternative assessment metrics Mike...
 
NISO Apr 29 Virtual Conference: Development of specific definitions for alter...
NISO Apr 29 Virtual Conference: Development of specific definitions for alter...NISO Apr 29 Virtual Conference: Development of specific definitions for alter...
NISO Apr 29 Virtual Conference: Development of specific definitions for alter...
 
Publication Bias
Publication Bias Publication Bias
Publication Bias
 
Publication bias- Chris Graf 2018
Publication bias- Chris Graf 2018Publication bias- Chris Graf 2018
Publication bias- Chris Graf 2018
 
2015 12 ebi_ganley_final
2015 12 ebi_ganley_final2015 12 ebi_ganley_final
2015 12 ebi_ganley_final
 
How can we ensure research data is re-usable? The role of Publishers in Resea...
How can we ensure research data is re-usable? The role of Publishers in Resea...How can we ensure research data is re-usable? The role of Publishers in Resea...
How can we ensure research data is re-usable? The role of Publishers in Resea...
 
Crafting the literature review
Crafting the literature reviewCrafting the literature review
Crafting the literature review
 
The role of new information and communication technologies in information and...
The role of new information and communication technologies in information and...The role of new information and communication technologies in information and...
The role of new information and communication technologies in information and...
 
Best practices for presentation of e journals part 2
Best practices for presentation of e journals part 2Best practices for presentation of e journals part 2
Best practices for presentation of e journals part 2
 
Spotlight Webinar: AMSTAR 2
Spotlight Webinar: AMSTAR 2Spotlight Webinar: AMSTAR 2
Spotlight Webinar: AMSTAR 2
 
PUBLISHING AGRICULTURAL DEVELOPMENT RESEARCH IN SOCIAL SCIENCE JOURNALS
PUBLISHING AGRICULTURAL DEVELOPMENT RESEARCH IN SOCIAL SCIENCE JOURNALSPUBLISHING AGRICULTURAL DEVELOPMENT RESEARCH IN SOCIAL SCIENCE JOURNALS
PUBLISHING AGRICULTURAL DEVELOPMENT RESEARCH IN SOCIAL SCIENCE JOURNALS
 
how_to_get_published_-_eifl_training.pptx
how_to_get_published_-_eifl_training.pptxhow_to_get_published_-_eifl_training.pptx
how_to_get_published_-_eifl_training.pptx
 
Research Ethics - Summary
Research Ethics - SummaryResearch Ethics - Summary
Research Ethics - Summary
 
NISO-Altmetrics-NFAIS-Virtual-Conf-March-2014
NISO-Altmetrics-NFAIS-Virtual-Conf-March-2014NISO-Altmetrics-NFAIS-Virtual-Conf-March-2014
NISO-Altmetrics-NFAIS-Virtual-Conf-March-2014
 
NCCMT Spotlight Webinar: MetaQAT
NCCMT Spotlight Webinar: MetaQATNCCMT Spotlight Webinar: MetaQAT
NCCMT Spotlight Webinar: MetaQAT
 
Jay patel Open Access TIPPA Midwest presentation june 2013
Jay patel Open Access TIPPA Midwest presentation june 2013Jay patel Open Access TIPPA Midwest presentation june 2013
Jay patel Open Access TIPPA Midwest presentation june 2013
 
Publishing in academic journals: Tips to help you succeed - Taylor and Franci...
Publishing in academic journals: Tips to help you succeed - Taylor and Franci...Publishing in academic journals: Tips to help you succeed - Taylor and Franci...
Publishing in academic journals: Tips to help you succeed - Taylor and Franci...
 
Presentation of NISO Altmetrics RP - Charleston Library Conference
Presentation of NISO Altmetrics RP - Charleston Library ConferencePresentation of NISO Altmetrics RP - Charleston Library Conference
Presentation of NISO Altmetrics RP - Charleston Library Conference
 
Overview to: BBSRC Oxford Doctoral Training Partnership - Dr Sansone - July 2014
Overview to: BBSRC Oxford Doctoral Training Partnership - Dr Sansone - July 2014Overview to: BBSRC Oxford Doctoral Training Partnership - Dr Sansone - July 2014
Overview to: BBSRC Oxford Doctoral Training Partnership - Dr Sansone - July 2014
 
Rubriq: Independent Peer Review & Journal Matching ISMTE 2012
Rubriq: Independent Peer Review & Journal Matching   ISMTE 2012Rubriq: Independent Peer Review & Journal Matching   ISMTE 2012
Rubriq: Independent Peer Review & Journal Matching ISMTE 2012
 

Mais de National Information Standards Organization (NISO)

Mais de National Information Standards Organization (NISO) (20)

Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Bazargan "NISO Webinar, Sustainability in Publishing"
Bazargan "NISO Webinar, Sustainability in Publishing"Bazargan "NISO Webinar, Sustainability in Publishing"
Bazargan "NISO Webinar, Sustainability in Publishing"
 
Rapple "Scholarly Communications and the Sustainable Development Goals"
Rapple "Scholarly Communications and the Sustainable Development Goals"Rapple "Scholarly Communications and the Sustainable Development Goals"
Rapple "Scholarly Communications and the Sustainable Development Goals"
 
Compton "NISO Webinar, Sustainability in Publishing"
Compton "NISO Webinar, Sustainability in Publishing"Compton "NISO Webinar, Sustainability in Publishing"
Compton "NISO Webinar, Sustainability in Publishing"
 
Mattingly "AI & Prompt Design: Large Language Models"
Mattingly "AI & Prompt Design: Large Language Models"Mattingly "AI & Prompt Design: Large Language Models"
Mattingly "AI & Prompt Design: Large Language Models"
 
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
 
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
 
Mattingly "Text and Data Mining: Building Data Driven Applications"
Mattingly "Text and Data Mining: Building Data Driven Applications"Mattingly "Text and Data Mining: Building Data Driven Applications"
Mattingly "Text and Data Mining: Building Data Driven Applications"
 
Mattingly "Text and Data Mining: Searching Vectors"
Mattingly "Text and Data Mining: Searching Vectors"Mattingly "Text and Data Mining: Searching Vectors"
Mattingly "Text and Data Mining: Searching Vectors"
 
Mattingly "Text Mining Techniques"
Mattingly "Text Mining Techniques"Mattingly "Text Mining Techniques"
Mattingly "Text Mining Techniques"
 
Mattingly "Text Processing for Library Data: Representing Text as Data"
Mattingly "Text Processing for Library Data: Representing Text as Data"Mattingly "Text Processing for Library Data: Representing Text as Data"
Mattingly "Text Processing for Library Data: Representing Text as Data"
 
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
 
Ross and Clark "Strategic Planning"
Ross and Clark "Strategic Planning"Ross and Clark "Strategic Planning"
Ross and Clark "Strategic Planning"
 
Mattingly "Data Mining Techniques: Classification and Clustering"
Mattingly "Data Mining Techniques: Classification and Clustering"Mattingly "Data Mining Techniques: Classification and Clustering"
Mattingly "Data Mining Techniques: Classification and Clustering"
 
Straza "Global collaboration towards equitable and open science: UNESCO Recom...
Straza "Global collaboration towards equitable and open science: UNESCO Recom...Straza "Global collaboration towards equitable and open science: UNESCO Recom...
Straza "Global collaboration towards equitable and open science: UNESCO Recom...
 
Lippincott "Beyond access: Accelerating discovery and increasing trust throug...
Lippincott "Beyond access: Accelerating discovery and increasing trust throug...Lippincott "Beyond access: Accelerating discovery and increasing trust throug...
Lippincott "Beyond access: Accelerating discovery and increasing trust throug...
 
Kriegsman "Integrating Open and Equitable Research into Open Science"
Kriegsman "Integrating Open and Equitable Research into Open Science"Kriegsman "Integrating Open and Equitable Research into Open Science"
Kriegsman "Integrating Open and Equitable Research into Open Science"
 
Mattingly "Ethics and Cleaning Data"
Mattingly "Ethics and Cleaning Data"Mattingly "Ethics and Cleaning Data"
Mattingly "Ethics and Cleaning Data"
 
Mercado-Lara "Open & Equitable Program"
Mercado-Lara "Open & Equitable Program"Mercado-Lara "Open & Equitable Program"
Mercado-Lara "Open & Equitable Program"
 

Último

1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 

Último (20)

Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 

Jester "Peer Review Terminology"

  • 2. What is the Peer Review Terminology? An ANSI/NISO standard which will support the industry in ensuring greater transparency and openness in peer review. Session 3B: Community Standards and Recommendations Supporting Open Scholarship: A Host of Benefits for All 2
  • 3. Drivers • Innovative review models, including those called open, have evolved • Definitions for each term relating to peer review are unclear • Transparency is crucial in science • Use makes peer review more transparent and allow researches to compare the processes in use across journals 3
  • 4. Timeline STM Association founds Working Group Early 2020 Draft provided for public input July 2020 Adapted based on comments Sep 2020 •Journal and Article level Pilot January 2021 NISO Working Group announced to formalize as ANSI/NISO standard July 2021 Piloting the terminology with 150 journals through September Now Session 3B: Community Standards and Recommendations Supporting Open Scholarship: A Host of Benefits for All 4
  • 5. Working Group Members 5 Steve Pinchotti. Altum, Inc. Lois Jones. American Psychological Association (APA) Caroline Webber. Aries Systems Corporation Nick Taylor. ATYPON Naseem Naqvi. British Blockchain Association Alison Paskins. Cambridge University Press Trevor Lane. Committee on Publication Ethics (COPE) Anna Jester. eJournalPress Andy Collings. eLife Oliver Rickard. HighWire Press Alison Larkin. IEEE Kim Eggleton. IOP Publishing Michael Willis. John Wiley & Sons, Ltd. Nettie Lagace. NISO Nick Lindsay. Massachusetts Institute of Technology (MIT) Gabe Stein. Massachusetts Institute of Technology (MIT) Dr. Michelle Urberg. Music Library Association Jill Reilly. National Agricultural Library Dr. Bahar Mehmani. Elsevier Katrina Pickersgill. SAGE Publishing Jon Speilburg. SPIE Virginia Mercer. Springer Nature Tim Shipley. Springer Nature Sabina Alam. Taylor & Francis Group Tony Alves. HighWire Press Lisa Hinchliffe. University of Illinois atUrbana-Champaign Joris van Rossum. STM (Chair) (rossum@stm-assoc.org)
  • 6. Mapped Elements of the Peer Review Process • IDENTITY TRANSPARENCY • REVIEWER INTERACTS WITH • REVIEW INFORMATION PUBLISHED • WHETHER POST-PUBLICATION COMMENTING TAKES PLACE Session 3B: Community Standards and Recommendations Supporting Open Scholarship: A Host of Benefits for All 6
  • 7. Identity Transparency • Single Anonymized • Double Anonymized • Triple Anonymized (Editors making decision also don’t know who the reviewers are) • Visible (everyone knows who everyone is during peer review)
  • 8. Session 3B: Community Standards and Recommendations Supporting Open Scholarship: A Host of Benefits for All 8 • Editor • Editor and other Reviewer(s) • Author and Editor • Editor, other Reviewer(s) and Author Reviewer Interacts With
  • 9. Review information Published 9 • None • Review summaries • Review reports • Review reports, author opt in • Review reports, reviewer opt in • Submitted manuscript • Submitted manuscript, author opts in • Author/editor communication • Reviewer Identities • Reviewer Identities, reviewer opt in • Editor identities Each Not Mutually Exclusive!
  • 10. Whether Post-publication Commenting Takes Place Session 3B: Community Standards and Recommendations Supporting Open Scholarship: A Host of Benefits for All 10 • Registered commentors • Unregistered commentors • Editor-selected commentors
  • 11. Use of Terminology Session 3B: Community Standards and Recommendations Supporting Open Scholarship: A Host of Benefits for All 11
  • 12. Use of Terminology Session 3B: Community Standards and Recommendations Supporting Open Scholarship: A Host of Benefits for All 12