SlideShare uma empresa Scribd logo
1 de 12
Wikipedia as a source of scientific
          information




                   Tim Vickers
          Washington University, St Louis

                 Michael Laurent
       Katholieke Universiteit Leuven, Belgium
Scientific literacy is low

• 60% believe they have not eaten GM foods.
• 54% heard "nothing at all" about nanotechnology.
• 70% either "not very clear" or "not clear at all" on difference
  between reproductive and therapeutic cloning.
• 9% can say what a stem cell is
                            National Science Board's Science and Engineering Indicators 2008



• Funding dependent on public support
• Issues hard to discuss without background
    • Evolution
    • Animal testing
    • Viruses and antibiotics

• Internet and TV sources of science information
Wikipedia: a prominent information source
• 4th most-accessed website
• Search engines
• Wikipedia has high visibility
  • 3,600 keywords, in first
    10 results in 80% of
    cases
• Free access.
• Over 270 languages

                                  Laurent MR, Vickers TJ. “Seeking health information
                                  online: does Wikipedia matter?” J. Am. Med. Inform.
                                  Assoc. (2009)
H1N1 influenza
                                                                          Swine influenza article access
• WHO announcement                                           1400000

  about H1N1 S-OIV on 24th                                   1200000
  April.                                                                                   1.3 million per day




                                  Article requests per day
                                                             1000000

• Traffic spiked on 29th April,                              800000
  levelled off at 30,000 per
                                                             600000
  day.
                                                             400000
• By end of May total of 6.3
                                                             200000
  million readers.
                                                                  0
• In June 2009 vitiligo was                                            April       May
  most-accessed medicine
  article, with 74,000 hits
  per day.
Up-to-date: “2009 swine flu outbreak”
• Created April 25th.
• One day later, article contained:
   • 22,000 words and 44 references
   • Mostly news articles
• Rapidly updated:
   • Dawood et. al. “Emergence of a novel
     swine-origin influenza A (H1N1) virus
     in humans.” NEJM on-line May 7.
   • Cited in article on same day.           2009 H1N1 S-OIV

• Articles as summaries of the literature.
• Puts current research into context.
Coverage in depth
• About 18,000 medicine articles and 19,000 cell biology articles
    • Range from 2-acetolactate mutase, adipokines to asprin
• Articles on every enzyme, most human genes, ncRNAs
• Approx 60-70% of diseases have articles (ICD-10 codes)

• News media main
  alternative to internet
• Difficult to treat science
  in depth
• What does H1N1
  mean? What is a
  pandemic? What are
  “flu-like symptoms”?
Articles form a web of information
• Blue links to another article, defines terms, gives background.
Articles form a web of information
                               Swine influenza

                 Virus                                         2009 flu pandemic


     RNA virus                      Influenza                       Influenza pandemic



 RNA                           Influenza vaccine                     1918 flu pandemic

         Immune system
                                                   Vaccine

Paul Ehrlich                                                          Vaccination policy
                         Influenza treatment

        Amantadine                                 Antiviral drug
Articles for a diverse audience
• Detailed background or            Introduction to genetics
  technical terms discussed in
  sub-articles.
                                             DNA
• Each article part of a nested
  hierarchy, general to technical
  content.
                                        DNA structure
• Readers find level they can
  understand.
• Includes even technical and           DNA supercoil
  specialist topics.


                                       Linking number
Articles vary in size and quality
• Majority of articles are short, but important topics discussed
  in more depth.                         Quality versus importance of
                                                Molecular and cell biology articles
• "Influenza“, good, 7,900 words.
• "M2 protein“, poor, 385 words.

• Studies assessing accuracy
  • Giles “Internet encyclopaedias go head to
    head” Nature, 2005
  • Devgan et al “Wiki-Surgery? Internal
    validity of Wikipedia as a medical and
    surgical reference” J Am Coll Surg, 2007
    (35 articles)
  • Clansom et al “Scope, Completeness, and
    Accuracy of Drug Information in
    Wikipedia.” Ann Pharmacother, 2008 (80
    questions)
Summary
• High visibility
• Rapidly updated
• Interlinked articles
   • Background
   • Nested structure
• Articles generally accurate, but many short or incomplete
• Expert contributors needed
Acknowledgments

Wikimedia Foundation

Michael Laurent

National Institutes of Health

Mais conteúdo relacionado

Semelhante a 2009 NIH Talk on Wikipedia

Clinical microbiology and molecular techniques
Clinical microbiology and molecular techniquesClinical microbiology and molecular techniques
Clinical microbiology and molecular techniquesIndhra Yogaesh
 
Scientific search for everyone
Scientific search for everyoneScientific search for everyone
Scientific search for everyonepetermurrayrust
 
MLSC 417 HISTORY OF MICROBIOLOGY.ppt
MLSC 417 HISTORY OF MICROBIOLOGY.pptMLSC 417 HISTORY OF MICROBIOLOGY.ppt
MLSC 417 HISTORY OF MICROBIOLOGY.pptBiswadipMukherjee1
 
MLSC 417 HISTORY OF MICROBIOLOGY.ppt
MLSC 417 HISTORY OF MICROBIOLOGY.pptMLSC 417 HISTORY OF MICROBIOLOGY.ppt
MLSC 417 HISTORY OF MICROBIOLOGY.pptGounderKirthika2
 
Webinar 5: Designing Your Future: WHAT'S COMING NEXT?
Webinar 5: Designing Your Future: WHAT'S COMING NEXT?Webinar 5: Designing Your Future: WHAT'S COMING NEXT?
Webinar 5: Designing Your Future: WHAT'S COMING NEXT?Louis Cady, MD
 
1 intro and history (bio 211)vo
1  intro and history (bio 211)vo1  intro and history (bio 211)vo
1 intro and history (bio 211)voSam Smith
 
The Deeply Quantified Self: A Case Study
The Deeply Quantified Self: A Case StudyThe Deeply Quantified Self: A Case Study
The Deeply Quantified Self: A Case StudyLarry Smarr
 
HealthXL: "If you live long enough, the future changes"
HealthXL: "If you live long enough, the future changes"HealthXL: "If you live long enough, the future changes"
HealthXL: "If you live long enough, the future changes"e-Patient Dave deBronkart
 
Shot(s) Happen: The Importance of Childhood Vaccines in the 21st Century
Shot(s) Happen: The Importance of Childhood Vaccines in the 21st CenturyShot(s) Happen: The Importance of Childhood Vaccines in the 21st Century
Shot(s) Happen: The Importance of Childhood Vaccines in the 21st CenturySummit Health
 
Microorganisms in biological warfare
Microorganisms in biological warfareMicroorganisms in biological warfare
Microorganisms in biological warfareNeha Agarwal
 
Nigel Ten Fleming | Adventura Capital | THE MICROBIOME, GENETICS, BIG DATA A...
Nigel Ten Fleming | Adventura Capital | THE MICROBIOME, GENETICS, BIG DATA  A...Nigel Ten Fleming | Adventura Capital | THE MICROBIOME, GENETICS, BIG DATA  A...
Nigel Ten Fleming | Adventura Capital | THE MICROBIOME, GENETICS, BIG DATA A...Smash Tech
 
Rabid presentation for Medical students
Rabid presentation for Medical studentsRabid presentation for Medical students
Rabid presentation for Medical studentssiderits
 
Global one health and global threats
Global one health and global threats  Global one health and global threats
Global one health and global threats Nawfal Aldujaily
 
Bio303 Lecture 1 The Global Burden of Infection and an Old Enemy, Malaria
Bio303 Lecture 1 The Global Burden of Infection and an Old Enemy, MalariaBio303 Lecture 1 The Global Burden of Infection and an Old Enemy, Malaria
Bio303 Lecture 1 The Global Burden of Infection and an Old Enemy, MalariaMark Pallen
 

Semelhante a 2009 NIH Talk on Wikipedia (20)

Clinical microbiology and molecular techniques
Clinical microbiology and molecular techniquesClinical microbiology and molecular techniques
Clinical microbiology and molecular techniques
 
Epidemiology
EpidemiologyEpidemiology
Epidemiology
 
Scientific search for everyone
Scientific search for everyoneScientific search for everyone
Scientific search for everyone
 
MLSC 417 HISTORY OF MICROBIOLOGY.ppt
MLSC 417 HISTORY OF MICROBIOLOGY.pptMLSC 417 HISTORY OF MICROBIOLOGY.ppt
MLSC 417 HISTORY OF MICROBIOLOGY.ppt
 
MLSC 417 HISTORY OF MICROBIOLOGY.ppt
MLSC 417 HISTORY OF MICROBIOLOGY.pptMLSC 417 HISTORY OF MICROBIOLOGY.ppt
MLSC 417 HISTORY OF MICROBIOLOGY.ppt
 
Webinar 5: Designing Your Future: WHAT'S COMING NEXT?
Webinar 5: Designing Your Future: WHAT'S COMING NEXT?Webinar 5: Designing Your Future: WHAT'S COMING NEXT?
Webinar 5: Designing Your Future: WHAT'S COMING NEXT?
 
1 intro and history (bio 211)vo
1  intro and history (bio 211)vo1  intro and history (bio 211)vo
1 intro and history (bio 211)vo
 
107 satellife
107 satellife107 satellife
107 satellife
 
The Deeply Quantified Self: A Case Study
The Deeply Quantified Self: A Case StudyThe Deeply Quantified Self: A Case Study
The Deeply Quantified Self: A Case Study
 
HealthXL: "If you live long enough, the future changes"
HealthXL: "If you live long enough, the future changes"HealthXL: "If you live long enough, the future changes"
HealthXL: "If you live long enough, the future changes"
 
Shot(s) Happen: The Importance of Childhood Vaccines in the 21st Century
Shot(s) Happen: The Importance of Childhood Vaccines in the 21st CenturyShot(s) Happen: The Importance of Childhood Vaccines in the 21st Century
Shot(s) Happen: The Importance of Childhood Vaccines in the 21st Century
 
Microorganisms in biological warfare
Microorganisms in biological warfareMicroorganisms in biological warfare
Microorganisms in biological warfare
 
Microbiology
MicrobiologyMicrobiology
Microbiology
 
Classroom without Walls
Classroom without WallsClassroom without Walls
Classroom without Walls
 
WNV
WNV WNV
WNV
 
Nigel Ten Fleming | Adventura Capital | THE MICROBIOME, GENETICS, BIG DATA A...
Nigel Ten Fleming | Adventura Capital | THE MICROBIOME, GENETICS, BIG DATA  A...Nigel Ten Fleming | Adventura Capital | THE MICROBIOME, GENETICS, BIG DATA  A...
Nigel Ten Fleming | Adventura Capital | THE MICROBIOME, GENETICS, BIG DATA A...
 
Bioterrorism
BioterrorismBioterrorism
Bioterrorism
 
Rabid presentation for Medical students
Rabid presentation for Medical studentsRabid presentation for Medical students
Rabid presentation for Medical students
 
Global one health and global threats
Global one health and global threats  Global one health and global threats
Global one health and global threats
 
Bio303 Lecture 1 The Global Burden of Infection and an Old Enemy, Malaria
Bio303 Lecture 1 The Global Burden of Infection and an Old Enemy, MalariaBio303 Lecture 1 The Global Burden of Infection and an Old Enemy, Malaria
Bio303 Lecture 1 The Global Burden of Infection and an Old Enemy, Malaria
 

Último

Q-Factor General Quiz-7th April 2024, Quiz Club NITW
Q-Factor General Quiz-7th April 2024, Quiz Club NITWQ-Factor General Quiz-7th April 2024, Quiz Club NITW
Q-Factor General Quiz-7th April 2024, Quiz Club NITWQuiz Club NITW
 
How to Make a Duplicate of Your Odoo 17 Database
How to Make a Duplicate of Your Odoo 17 DatabaseHow to Make a Duplicate of Your Odoo 17 Database
How to Make a Duplicate of Your Odoo 17 DatabaseCeline George
 
Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4JOYLYNSAMANIEGO
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Seán Kennedy
 
Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfPatidar M
 
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...DhatriParmar
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptxmary850239
 
MS4 level being good citizen -imperative- (1) (1).pdf
MS4 level   being good citizen -imperative- (1) (1).pdfMS4 level   being good citizen -imperative- (1) (1).pdf
MS4 level being good citizen -imperative- (1) (1).pdfMr Bounab Samir
 
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...DhatriParmar
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxlancelewisportillo
 
Transaction Management in Database Management System
Transaction Management in Database Management SystemTransaction Management in Database Management System
Transaction Management in Database Management SystemChristalin Nelson
 
Measures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataMeasures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataBabyAnnMotar
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmStan Meyer
 
ClimART Action | eTwinning Project
ClimART Action    |    eTwinning ProjectClimART Action    |    eTwinning Project
ClimART Action | eTwinning Projectjordimapav
 
ROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxVanesaIglesias10
 
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITWQ-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITWQuiz Club NITW
 
Narcotic and Non Narcotic Analgesic..pdf
Narcotic and Non Narcotic Analgesic..pdfNarcotic and Non Narcotic Analgesic..pdf
Narcotic and Non Narcotic Analgesic..pdfPrerana Jadhav
 
Reading and Writing Skills 11 quarter 4 melc 1
Reading and Writing Skills 11 quarter 4 melc 1Reading and Writing Skills 11 quarter 4 melc 1
Reading and Writing Skills 11 quarter 4 melc 1GloryAnnCastre1
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfVanessa Camilleri
 

Último (20)

Q-Factor General Quiz-7th April 2024, Quiz Club NITW
Q-Factor General Quiz-7th April 2024, Quiz Club NITWQ-Factor General Quiz-7th April 2024, Quiz Club NITW
Q-Factor General Quiz-7th April 2024, Quiz Club NITW
 
How to Make a Duplicate of Your Odoo 17 Database
How to Make a Duplicate of Your Odoo 17 DatabaseHow to Make a Duplicate of Your Odoo 17 Database
How to Make a Duplicate of Your Odoo 17 Database
 
Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...
 
Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdf
 
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx
 
MS4 level being good citizen -imperative- (1) (1).pdf
MS4 level   being good citizen -imperative- (1) (1).pdfMS4 level   being good citizen -imperative- (1) (1).pdf
MS4 level being good citizen -imperative- (1) (1).pdf
 
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
 
Transaction Management in Database Management System
Transaction Management in Database Management SystemTransaction Management in Database Management System
Transaction Management in Database Management System
 
Measures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataMeasures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped data
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and Film
 
ClimART Action | eTwinning Project
ClimART Action    |    eTwinning ProjectClimART Action    |    eTwinning Project
ClimART Action | eTwinning Project
 
ROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptx
 
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITWQ-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
 
Narcotic and Non Narcotic Analgesic..pdf
Narcotic and Non Narcotic Analgesic..pdfNarcotic and Non Narcotic Analgesic..pdf
Narcotic and Non Narcotic Analgesic..pdf
 
prashanth updated resume 2024 for Teaching Profession
prashanth updated resume 2024 for Teaching Professionprashanth updated resume 2024 for Teaching Profession
prashanth updated resume 2024 for Teaching Profession
 
Reading and Writing Skills 11 quarter 4 melc 1
Reading and Writing Skills 11 quarter 4 melc 1Reading and Writing Skills 11 quarter 4 melc 1
Reading and Writing Skills 11 quarter 4 melc 1
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdf
 

2009 NIH Talk on Wikipedia

  • 1. Wikipedia as a source of scientific information Tim Vickers Washington University, St Louis Michael Laurent Katholieke Universiteit Leuven, Belgium
  • 2. Scientific literacy is low • 60% believe they have not eaten GM foods. • 54% heard "nothing at all" about nanotechnology. • 70% either "not very clear" or "not clear at all" on difference between reproductive and therapeutic cloning. • 9% can say what a stem cell is National Science Board's Science and Engineering Indicators 2008 • Funding dependent on public support • Issues hard to discuss without background • Evolution • Animal testing • Viruses and antibiotics • Internet and TV sources of science information
  • 3. Wikipedia: a prominent information source • 4th most-accessed website • Search engines • Wikipedia has high visibility • 3,600 keywords, in first 10 results in 80% of cases • Free access. • Over 270 languages Laurent MR, Vickers TJ. “Seeking health information online: does Wikipedia matter?” J. Am. Med. Inform. Assoc. (2009)
  • 4. H1N1 influenza Swine influenza article access • WHO announcement 1400000 about H1N1 S-OIV on 24th 1200000 April. 1.3 million per day Article requests per day 1000000 • Traffic spiked on 29th April, 800000 levelled off at 30,000 per 600000 day. 400000 • By end of May total of 6.3 200000 million readers. 0 • In June 2009 vitiligo was April May most-accessed medicine article, with 74,000 hits per day.
  • 5. Up-to-date: “2009 swine flu outbreak” • Created April 25th. • One day later, article contained: • 22,000 words and 44 references • Mostly news articles • Rapidly updated: • Dawood et. al. “Emergence of a novel swine-origin influenza A (H1N1) virus in humans.” NEJM on-line May 7. • Cited in article on same day. 2009 H1N1 S-OIV • Articles as summaries of the literature. • Puts current research into context.
  • 6. Coverage in depth • About 18,000 medicine articles and 19,000 cell biology articles • Range from 2-acetolactate mutase, adipokines to asprin • Articles on every enzyme, most human genes, ncRNAs • Approx 60-70% of diseases have articles (ICD-10 codes) • News media main alternative to internet • Difficult to treat science in depth • What does H1N1 mean? What is a pandemic? What are “flu-like symptoms”?
  • 7. Articles form a web of information • Blue links to another article, defines terms, gives background.
  • 8. Articles form a web of information Swine influenza Virus 2009 flu pandemic RNA virus Influenza Influenza pandemic RNA Influenza vaccine 1918 flu pandemic Immune system Vaccine Paul Ehrlich Vaccination policy Influenza treatment Amantadine Antiviral drug
  • 9. Articles for a diverse audience • Detailed background or Introduction to genetics technical terms discussed in sub-articles. DNA • Each article part of a nested hierarchy, general to technical content. DNA structure • Readers find level they can understand. • Includes even technical and DNA supercoil specialist topics. Linking number
  • 10. Articles vary in size and quality • Majority of articles are short, but important topics discussed in more depth. Quality versus importance of Molecular and cell biology articles • "Influenza“, good, 7,900 words. • "M2 protein“, poor, 385 words. • Studies assessing accuracy • Giles “Internet encyclopaedias go head to head” Nature, 2005 • Devgan et al “Wiki-Surgery? Internal validity of Wikipedia as a medical and surgical reference” J Am Coll Surg, 2007 (35 articles) • Clansom et al “Scope, Completeness, and Accuracy of Drug Information in Wikipedia.” Ann Pharmacother, 2008 (80 questions)
  • 11. Summary • High visibility • Rapidly updated • Interlinked articles • Background • Nested structure • Articles generally accurate, but many short or incomplete • Expert contributors needed