This is a quick-start guide to the insights that may be gained from article-level metrics of scholarly papers. This presentation was authored by Jean Liu (jean@altmetric.com), with data from Euan Adie. Examples from the Altmetric blog (http://www.altmetric.com/blog) are shown. For more information, visit Altmetric (http://www.altmetric.com).
2. Every researcher is a communicator
Within academia
Presentations and seminars
Funding and ethics applications
Journal articles and posters
Term papers and essays
Meetings and conferences
Correspondence
Within society
Speaking at public events
Press
Social media
Blogs
How can we measure both
academic and societal research impact?
3. Download counts
Page views
Mentions in news reports
Mentions in social media
Mentions in blogs
Reference manager readers
… etc.
Journal Impact Factor
Citation counts
New perspectives of impact
ACADEMIC IMPACT SOCIETAL IMPACT
Alternative metrics
“altmetrics”
+
Traditional metrics
4. Each day, scholarly
articles receive ~12,000
new mentions across
social media, news, and
blogs.
That’s 1 mention
every 7 seconds!
Each week,
~20,000
unique articles are
shared.
Mentions range in
complexity, from
quick shares to
comprehensive reviews.
Article-level metrics are
worth paying attention to.
5. “Altmetrics” are…
o “alternative metrics”
o new ways of measuring different, non-traditional forms of impact.
o “alternative to only using citations”, not “alternative to citations”.
o complementary to traditional citation-based analysis.
Article-level metrics have come to refer to the altmetrics surrounding
a scholarly article.
6. What does Altmetric do?
§ We measure the online attention
surrounding journal articles and
datasets.
§ We collect and deliver article-level
metrics to publishers, libraries,
repositories, researchers, and
more.
Social media
News
Online reference
managers
You
7. 1
2
3
1
2
3
Altmetric Data: Details Pages
Visualise the impact with the Altmetric score.
Monitor news mentions with the News Tracker.
See all the conversations and mentions.
See article-level metrics and a
score of attention below.
8. The Altmetric Explorer
The Altmetric Explorer web app can be used to filter and browse through attention for
over 1,000,000 scholarly articles.
Browse through altmetrics data
for all mentioned papers.
Use built-in analytic tools to
compare journals.
9. The Altmetric Bookmarklet
The free Altmetric Bookmarklet lets you instantly retrieve Altmetric details for any article.
Altmetrics data will appear on the right-
hand side of your page.
Installation instructions:
http://www.altmetric.com/bookmarklet.php
Altmetric it!
Click the “Altmetric it” button brings up
a paper’s altmetrics.
11. 3
2
1
You can use article-level metrics to…
Track an article’s uptake within a community.
Assess the overall impact of a body of
scholarly work.
Characterise reader communities.
4 Discover new articles to read.
12. Did a specific article reach the community it was intended for?
Track an article’s uptake within a community1
TWITTER
• 48% of tweets mentioning the
paper were sent from the US.
• 21% of tweets were sent by
practitioners.
• Tweeted by several professional
organisations with many
followers.
NEWS
• Mentioned in 2 articles on
Forbes.
BLOGS
• Discussed in-depth on 4
medical/physician-led blogs.
EXAMPLE: Position paper by the American College of
Physicians (ACP) and the Federation of State Medical Boards
(FSMB), on physicians’ use of social media
Target audience: American physicians who use social media
Altmetric details page:
http://altmetric.com/details.php?citation_id=1363338
Example from the Altmetric blog post “The Doctor is Online”:
http://altmetric.com/blog/interactions-the-doctor-is-online
13. Filter papers by:
• Journal
• DOI prefix
• Publisher
Assess the impact of a body of scholarly work2
Pick what you want to look at and
filter the rest out.
Use the powerful filters of the Altmetric Explorer.
14. Find specific papers by entering their
unique identifiers, then look at their
Altmetric scores.
Assess the impact of a body of scholarly work2
Use the powerful filters of the Altmetric Explorer.
Publications by MSF staff.
EXAMPLE: Altmetric conducted an analysis of the
social impact of recent papers authored by
Médecins Sans Frontières (MSF) staff. To retrieve the
altmetrics data, we searched for a known set of DOIs
and PubMed IDs.
A graph from our altmetrics
analysis of MSF papers.
15. Characterise reader communities3
Many distinct online communities come together to discuss papers.
EXAMPLE: Nurses on
Reddit, speaking about a
2011 paper published in
Critical Care.
16. Characterise reader communities3
Where are the readers?
Who are the readers?
What is the online reach of
the community?
View Twitter follower numbers.
Altmetric article details pages show:
• Demographics of the readers
• A paper’s online reach
Identify details about reader
communities using Altmetric data.
17. Characterise reader communities
Attention surrounding a single paper can reveal the
existence of a large online community.
3
EXAMPLE: The bench scientists’
blogosphere was revealed by an essay on
the importance of stupidity in scientific
research
2008 J Cell Sci 121, 1771.
• The article was extremely popular with
bench scientists on social media
(Twitter, Reddit) and blogs.
• Lots of scientists responded by
sharing their own experiences.
• Follows the trend of the bench
scientists blogosphere, which often
talks about:
• New scientific articles
• Their own publications
• Lab/career experiences
BLOGS
Altmetric details page:
http://altmetric.com/details.php?citation_id=174125
Example from the Altmetric blog post “It’s OK, Scientific Stupidity is Normal”:
http://altmetric.com/blog/interactions-its-ok-scientific-stupidity-is-normal
18. Characterise reader communities
Attention surrounding a single paper can reveal the
existence of a large online community.
3
EXAMPLE: The concern of members of
the Japanese public was revealed by the
attention surrounding an article on the
biological impacts of the Fukushima
nuclear accident.
TWITTER:
• 68% of tweets were sent from Japan.
• 77% of tweeters were members of the public.
• 18% of tweeters were scientists.
• Twitter had been used to share news alerts during
the Fukushima disaster – now it was being used as a
scientific news engine.
Altmetric details page:
http://www.altmetric.com/details.php?citation_id=880007
Example from the Altmetric blog post “Conversations About Disaster”:
http://altmetric.com/blog/interactions-conversations-about-disaster
2012, Scientific Reports 2, 570
19. Discover new articles to read4
Note: The MEDLINE subject filter only applies to journal classifications. We’re working on developing
a way to determine the subjects of individual articles.
EXAMPLE: Filter by MEDLINE subject “neurology”
Use the Altmetric Explorer to rank articles by
attention and find interesting papers.
20. Discover new articles to read4
EXAMPLE: Filter by recently-mentioned articles on arXiv
Use the Altmetric Explorer to find interesting pre-prints.
22. Interested? Let’s talk.
E-mail Jean: jean@altmetric.com
Visit us on the web: www.altmetric.com
Read our blog: www.altmetric.com/blog
Follow us on Twitter: @altmetric