Managing Scholarly Research Output The Smithsonian Institution Experience: An Introduction to Smithsonian Research Online. Martin R. Kalfatovic with Alvin Hutchinson and Richard Naples. Mpala Research Centre and Wildlife Foundation, Laikipia County, Kenya. 22 May 2017.

1. Managing Scholarly Research Output
The Smithsonian Institution Experience
An Introduction to Smithsonian Research Online
Martin R. Kalfatovic
Richard Naples and Alvin Hutchinson
Mpala Research Centre and Wildlife
Foundation
22 May 2017 | Laikipia County, Kenya

2. ADVANCING KNOWLEDGE AT HOME AND AROUND THE WORLD
Visit us at library.si.edu
Alvin Hutchinson
Richard
Naples
Scott Miller
Suzanne Pilsk
Thanks to these
Smithsonian Staff
for assistance in
this presentation

3. 19 Museums, 9 Research Centers,
171 Affiliates Around the World
7 Art Museums/Galleries
1 Art Research Center
•
• 9 History & Culture Museums
• 3 History & Culture Programs
•
• 2 Science Museums
• 5 Science Research Centers
•
• 2 Other (Castle & A&I) Museums
• 2 Other Research Centers
AND
MORE!
The 3 History & Culture programs are Center for Folklife, Smithsonian
Latino Center, and Smithsonian Asian Pacific American Center

4. 156 Million Objects & Specimens

5. Anacostia Community Museum Library
National Air and Space Museum Library
National Museum of African American History & Culture Library
National Museum of American History Library
National Postal Museum Library
Smithsonian Institution Libraries Research Annex
The Vine Deloria, Jr. Library, National Museum of the American Indian
History and Culture
Smithsonian American Art / Portrait Gallery Library
Cooper-Hewitt Smithsonian Design Library
Freer and Sackler Galleries Library
Hirshhorn Museum and Sculpture Garden Library
Warren M. Robbins Library, National Museum of African Art
Art and Design
Botany and Horticulture Library
John Wesley Powell Library of Anthropology
Museum Support Center Library
National Museum of Natural History Library
National Zoological Park Library
Smithsonian Environmental Research Center Library
Earl Tupper Library, Smithsonian Tropical Research Institute
Sciences
Dibner Library of the History of Science and Technology
Joseph F. Cullman 3rd Library of Natural History
Special Collections
library.si.edu
Smithsonian Libraries

6. Supporting
Research
Taxonomy
library.si.edu

7. Supporting
Research
Ecology

8. Supporting
Research
Keeping Pandas Alive

9. Olinguito
(Bassaricyon neblina)
First carnivore species
discovered in Americas
in 35 years.
library.si.edu

10. Scholarly Communications

11. SCHOLARLY PUBLISHING
EXPONENTIAL GROWTH OF ARTICLES
Global scientific output
doubles every nine years
Source: http://blogs.nature.com/news/2014/05/global-
scientific-output-doubles-every-nine-years.html
library.si.edu

12. SMITHSONIAN SCHOLARLY PUBLISHING
WHAT WE HAVE IN RESEARCH ONLINE
library.si.edu
0
10
20
30
40
50
60
70
80
90
Thousands
Growth of annual number of publications by Smithsonian authors in Research Online (from 1843-2016)
OVER 80K PUBLICATIONS SINCE 1843

13. SMITHSONIAN RESEARCH ONLINE
RESEARCH.SI.EDU
 80K records
1843-present
 25K records
2006-present
 75% of recent have DOI
library.si.edu
Research Bibliography –
metadata only
research.si.edu

14. library.si.edu
Institutional
Repository
Digital Repository
- Mostly PDF but also
metadata, datasets,
mobi/epub
repository.si.edu

15. library.si.edu
Staff Pages
data reuse

16. SCIENCE
HISTORY &
CULTURE
ART
OTHER
What We Publish
Lots of Science, sure.
But enough of the “other
stuff” to cause
headaches
12,115 publications since 2012
79,846 total publications since 1846
library.si.edu

17. NATURAL
HISTORY
MUSEUM
ASTROPHYSICAL
OBSERVATORY
TROPICAL
RESEARCH
INSTITUTE
NATIONAL
ZOO
ENVIRONMENTAL
RESEARCH CENTER
MUSEUM
CONSERVATION
INSTITUTE
Science
Publications in
Research Online
From astrophysics to
zebra reproduction,
10:1 journal articles to
everything else
9,834 Science publications since 2012 library.si.edu

18. AIR & SPACE
MUSEUM
AMERICAN
HISTORY
MUSEUM
POSTAL
MUSEUM
FOLKLIFE
AMERICAN
INDIAN
ANACOSTIA
AFRICAN AMERICAN
HISTORY AND CULTURE
ASIAN PACIFIC
AMERICAN CENTER
1,376 History & Culture publications since 2012
History & Culture
Publications in
Research Online
25% book & book
chapters, 25% blog posts,
%50 journal articles
library.si.edu

19. AMERICAN ART MUSEUM
FREER & SACKLER
PORTRAIT GALLERY
COOPER HEWITT
HIRSHHORN
AFRICAN
ART
350 Art publications since 2012
Art Publications in
Research Online
More than half are books or
book chapters
library.si.edu

20. SCHOLARLY
PRESS
CASTLE
OFFICE OF
POLICY &
ANALYSIS
ARCHIVES
SMITHSONIAN
LIBRARIES
GARDENS
Other Publications in
Research Online
Interdisciplinary and support
organizations, including our
publications arm.
60% books & chapters
411 Other publications since 2012 library.si.edu

21. WEB OF
SCIENCE
8.4K
RESEARCH
ONLINE
11.8K
OVERLAP ?
5K
(MATCH ON DOI)
Web of Science
vs. Research
Online
Much of our publishing
goes on outside of WoS
Indexed sources
(this is a back of the envelope calculation) library.si.edu

22. Research
Areas
InCites
library.si.edu

23. Research
Areas
InCites
(excluding
Smithsonian
Astrophysical
Observatory)
library.si.edu

24. Capturing Scholarly
Communications: Workflow

25. Research Online Workflow
Manual Entry &
Bulk Uploads
Webform
submissions
REPOSITORY.SI.EDU
RESEARCH.SI.EDU
PROFILES.SI.EDU
Publisher
Alerts (email)
Author PDF
contributions
Staff profile pages &
internal dashboards &
Altmetric.com

26. library.si.edu
Public Access
Workflow

27. Bibliometrics

28. Our Big Questions:
• Metrics: How do we
measure use and impact?
• Our workflows: How to we
capture and analyze data?
• Documentation:
Reproducible data is better
data

29. Bibliometrics in Service of ..

30. BIBLIOMETRICS AT THE SMITHSONIAN
REPORTING EXAMPLES
library.si.edu
 Explain metrics that
are available and
commonly used
 Show what is
possible for further
investigations

31. BIBLIOMETRICS AT THE SMITHSONIAN
REPORTING EXAMPLES
library.si.edu
More in-depth – impact of Evolution of Terrestrial Ecosystems
CITATION ANALYSIS, PRODUCTIVITY, CLARIVATE INCITES, ALTMETRICS

32. BIBLIOMETRICS AT THE SMITHSONIAN
REPORTING EXAMPLES
library.si.edu
Impact of Evolution of Terrestrial Ecosystems
 Can show information
textually, via common
tools like PowerPoint,
Word, etc.

33. BIBLIOMETRICS AT THE SMITHSONIAN
REPORTING EXAMPLES
library.si.edu
Impact of Evolution of Terrestrial Ecosystems
 Charts can be made on Excel & related basic tools

34. BIBLIOMETRICS AT THE SMITHSONIAN
REPORTING EXAMPLES
library.si.edu
 Relying on existing tools like InCites (Clarivate) is fine
Impact of Evolution of Terrestrial Ecosystems

35. BIBLIOMETRICS AT THE SMITHSONIAN
REPORTING EXAMPLES
library.si.edu
Impact of Evolution of Terrestrial Ecosystems
 InCites & Excel but with a common look

36. BIBLIOMETRICS AT THE SMITHSONIAN
REPORTING EXAMPLES
library.si.edu
Smithsonian’s 9 Research Centers – Articles in top publications*
* Keep in mind, this is for internal use and is not meant for decision making.
 Tables are Powerful, too

37. BIBLIOMETRICS AT THE SMITHSONIAN
REPORTING EXAMPLES
library.si.edu
Sci2 - https://sci2.cns.iu.edu/
Strategic Planning – Network Analysis for National Museum of Natural History
CiteSpace - http://cluster.cis.drexel.edu/~cchen/citespace/

38. Bibliometrics: Some Tools

39. TOOLS AT THE SMITHSONIAN
WHAT WE HAVE AVAILABLE
 Smithsonian Research Online – our research
bibliography & digital repository
 Subscription to Web of Science (Clarivate) including InCites
and Journal Citation Reports
 Altmetric for Institutions (Altmetric.com)
 Free or easily available tools: including Excel, rawgraphs.io,
VOSviewer, Sci2, CiteSpace, Scholarometer, Access or other
database software, Notepad++
library.si.edu

40. DATA TOOLS
RESOURCES
 Notepad++, SublimeText, and other text editors
 Excel – (where I’m most comfortable)
 Microsoft Access & other Databases (MsSQL via Squirrel
SQL for us)
 Open Refine (openrefine.org)
 Regular Expressions (regexr.com) & coding
library.si.edu

41. BASIC VISUALIZATION TOOLS
RESOURCES
 Excel – (chart chooser at labs.juiceanalytics.com has nice
templates)
 Visualization platforms like Tableau (or similar tools)
 Google Charts
 Online sites like RAWGraphs (rawgraphs.io)
library.si.edu

42. BIBLIOMETRIC TOOLS
RESOURCES
 For Google Scholar – Publish or Perish, Scholarometer
(www.harzing.com/resources/publish-or-perish | scholarometer.indiana.edu)
 Products from Scopus and Web of Science
 Networking Software like Pajek, Gephi, GUESS
 Toolsets like Sci2, VOSViewer, CiteSpace
(sci2.cns.iu.edu | vosviewer.com | cluster.cis.drexel.edu/~cchen/citespace)
library.si.edu

43. Bibliometrics: Use Case
Smithsonian Environmental Research
Center

44. library.si.edu
SMITHSONIAN ENVIRONMENTAL RESEARCH CENTER
UNDERSTANDING ECOSYSTEMS FOR A SUSTAINABLE FUTURE
serc.si.edu
Chesapeake Bay
Edgewater, MD
30 miles east of DC,
6 miles south of Annapolis

45.  Web of Science’s citation report
SMITHSONIAN ENVIRONMENTAL RESEARCH CENTER

46.  Word Co-occurrence - VOSviewer.com
SMITHSONIAN ENVIRONMENTAL RESEARCH CENTER

47.  Co-Author Network – Sci2
SMITHSONIAN ENVIRONMENTAL RESEARCH CENTER

48. Altmetrics … a brief note

49. WHAT IS ALTMETRIC?
THE COMPANY, NOT THE CONCEPT
library.si.edu
Altmetric (not plural) is a Digital Science company that
tracks and analyzes the online activity around scholarly
research outputs.
Competitors:
Plum Analytics (plumanalytics.com)
Impact Story (impactstory.org)
General article-level metrics (journal based – e.g. PLoS)

50. ALTMETRIC – THE COMPANY
WHAT THEY OFFER & WHY WE CHOSE THEM
library.si.edu
Altmetric tracks 10.6 million outputs. Of these 7.6 million
have mentions. Altogether, Altmetric has tracked 45.7
million total mentions in its database.
They offer embeddable Altmetric Badges, a free
bookmarklet, and access to their API for research.

51. TRACKING RESEARCH
HOW ALTMETRICS WORK
library.si.edu
IDENTIFIER
Like a DOI, PMID,
URI, etc. attached
to the output
SOURCE
Where the output
is being
mentioned
OUTPUT
Such as an
article, book, or
dataset, etc.

52. ALTMETRIC SOURCES
WHAT OUTLETS ALTMETRIC.COM WATCHES
library.si.edu
OUTPUT
News outlets &
Blogs
• Over 2000 news
sites
• Global coverage
• 9,000+ Blogs
Social media
Twitter, Facebook,
Google+,
Public posts only
Reference
managers
• Mendeley,
Citeulike etc
• Reader counts
Other sources
Scopus Citations
Wikipedia
YouTube
Reddit
F1000
Q&A
Post-publication
peer review
Publons
Pubpeer
Policy documents
• NICE Evidence
• Intergovernmental
Panel on Climate
Change
• & Many more…

53. ALTMETRIC ATTENTION SCORE
WHAT INFLUENCES THE SCORE
library.si.edu
OUTPUT
VOLUME
SCORES RISE
AS MENTIONS
INCREASE
SOURCES
EACH SOURCE
CATEGORY IS
WEIGHTED
DIFFERENTLY
AUTHORS
WHO MENTIONS
AN OUTPUT? A
PUBLISHER OR
INFLUENTIAL
ACADEMIC?
the score represents a weighted approximation of tracked attention
More: www.altmetric.com/blog/scoreanddonut

54. THE ALTMETRIC BADGE
WHAT EACH COLOR IN THE DONUT REPRESENTS

55. library.si.edu
Altmetric
Explorer
data reuse

56. library.si.edu
Top Altmetric-
scoring Publications
Altmetric Explorer

57. library.si.edu
Top Altmetric-
scoring Publications
Altmetric Explorer

58. library.si.edu
Top Altmetric-
scoring Publications
Altmetric Explorer

59. Profiles: Bringing it all Together?

60. library.si.edu
Smithsonian
Profiles
An expertise
locator using the
VIVO software

61. library.si.edu
Smithsonian
Profiles
An expertise
locator using the
VIVO software

62. library.si.edu
Smithsonian
Profiles
An expertise
locator using the
VIVO software

63. library.si.edu
Smithsonian
Profiles
An expertise
locator using the
VIVO software

64. library.si.edu
Smithsonian
Profiles
An expertise
locator using the
VIVO software

65. library.si.edu
Smithsonian
Profiles
An expertise
locator using the
VIVO software

66. Mpala in Smithsonian Research
Online

67. Mpala in Smithsonian Research Online
library.si.edu
The following publications
reside in the Smithsonian
Research Bibliography,
research.si.edu. They include
publications listed on the
Mpala Research Center
bibliography, as well as other
publications we have
identified as having a
relationship to the MRC.

68. Mpala in Smithsonian Research Online
library.si.edu

69. In Closing ...

70. Most research organizations, as well as
agencies who regulate research, are struggling
with the challenges of tracking and making
available the results of research. The tools
that Smithsonian Research Online, adapted
from readily available sources, can serve as a
model and adapted for use by some of these
organizations.

71. The library community is working to help
researchers, administrators, funders,
and others understand the value of the
research within the research community
and individual institutions, and the
return on investment of research
funding. that will need them simply to
survive.

72. Perhaps most importantly, helping the
general public understand the broader
societal impacts of scholarly research
may create a sympathetic environment
for facts in a world that will need them
simply to survive.

73. Questions?
ADVANCING KNOWLEDGE AT HOME AND AROUND THE WORLD
Visit us at library.si.edu

74. Asante Sana!
ADVANCING KNOWLEDGE AT HOME AND AROUND THE WORLD
Visit us at library.si.edu