The document introduces ARIA (Altmetrics for Research Impact Actuation), a prototype developed by NTU to measure research impact using altmetrics and bibliometrics. ARIA collects publication data and metrics from various sources for over 4,000 NTU researchers. It provides visualizations of metrics at researcher, school, and university levels over time. The document describes ARIA's data sources and extraction methodology, as well as screenshots of the researcher and admin dashboards, artifact pages, and cross-metric explorer feature. It also announces an upcoming altmetrics workshop at NTU in January 2018.
1. Altmetrics for Research Impact Actuation (ARIA)
Aarthy Nagarajan, Aravind Sesagiri Raamkumar, Feiheng Luo, Harsha
Vijayakumar, Mojisola Erdt, Edie Rasmussen, Yin-Leng Theng
Altmetrics Project of Centre for HEalthy & Sustainable CitieS (CHESS)
Wee Kim Wee School of Communication & Information
27 September 2017
1
2. Introduction to ARIA
• Main Objectives:
– To develop a prototype called “Altmetrics for Research
Impact Actuation” (ARIA) to measure research impact
for researchers, universities, research institutes and
policy-makers
– To compute cross-metric validation between traditional
metrics and altmetrics for the “hard sciences”
disciplines, the “non-hard sciences” disciplines, and
“innovation and commercialization”
2
3. ARIA Data Sources
3
Social Media Sources:
Academic Sources:
Data collection frequency is currently once a month
4. ARIA Data Extraction Methodology
1. Public Scopus API: Publications metadata extracted from
Scopus using NTU Affiliation ids
2. Public Crossref API: Publications metadata extracted using
Scopus DOIs. Crossref provides all author names from each
publication
3. Restricted WoS API: Basic citations data extracted using
Scopus DOIs
4. Google Scholar Profiles: Basic citations data scraped from
profiles with NTU affiliation
5. Restricted Altmetric.com: Altmetrics data extracted using
Scopus DOIs
6. Public PlumX API: Altmetrics data extracted using Scopus
DOIs
5. ARIA Dataset for NTU Researchers
Data collection
• 4,207 teaching and research staff
• 2,637 researchers with publications (mainly Scopus)
• Approximately 86K publications extracted
• Metrics only for publications with DOIs
• Use of in-house author name disambiguation algorithm
for identifying relevant publications
6. ARIA Metadata and Metrics
Paper Metadata
• Paper Title
• Publication Timestamp
• Publication Venue
• Author(s)
• Paper Type
• References Count
• Affiliation
Bibliometrics
• Publications Count
• Scopus Citation Count
• QS Citation Count
• WoS Citation Count
• Journal Impact
Factor/Quartiles
Altmetrics
• Tweet Count
• Views Count
• Downloads Count
• Mendeley Readers Count
• Altmetric Attention Score
Frequency
• Monthly
• Quarterly
• Half-Yearly
• Yearly
Aggregation Level/Metrics
• School
• Research Centre
• Top 5%, 10%, 20% (Average)
• Bottom 5%, 10%, 20% (Average)
7. ARIA Researcher Profile
• A researcher account has a
researcher dashboard
• This profile will have access to
own artifacts, bibliometric and
altmetric visualizations
• This profile can cross-compare
metrics as a time-series chart, for
various time intervals
7
ARIA Admin Profile
• Has access to both researcher
and admin dashboards
• Has access to own artifacts,
bibliometric and altmetric
visualizations from the
researcher dashboard
• Can also view the artifacts and
metric visualizations at
college/school/university level
from the admin dashboard
• This profile can cross-compare
metrics as a time-series chart,
for various time intervals at
both researcher and admin
level
32. AROSIM 2018 Workshop@NTU
• Our team is conducting an international workshop on Altmetrics for Research
Outputs Measurement and Scholarly Information Management (AROSIM 2018)
on January 26th 2018
• Workshop Theme: "The best of both worlds: cross-metric exploration and
validation of Altmetrics and Bibliometrics“
• Participants include researchers, librarians, publishers and research agency
personnel
• Keynote Speakers: 1) Dr. Mike Thelwall, University of Wolverhampton
2) Stacy Konkiel, Altmetric.com
• Submission deadline is 10th October 2017
32
For more information, please visit www.altmetrics.ntuchess.com/AROSIM2018/
33. 33
This project is supported by NRF SRIE Grant: NRF2014-
NRF-SRIE001-019