O slideshow foi denunciado.
Utilizamos seu perfil e dados de atividades no LinkedIn para personalizar e exibir anúncios mais relevantes. Altere suas preferências de anúncios quando desejar.

Stephanie Faulkner - Using Metrics Beyond Citations to Demonstrate the Impact of SciELO Books

53 visualizações

Publicada em

The academic book is one of the classic types of scientific literature. Although present in all areas of knowledge, its relevance in research communication is highlighted with more emphasis in the areas of social sciences, literature, and arts. In the other fields, communication is almost exclusively dominated by journal articles or conference and congress proceedings. This fact is evidenced by the thematic composition of the collections of books indexed and published by the SciELO Books program, by international bibliographic indexes and by the distribution of citations from SciELO journal articles.

Besides commercial publishing houses, the vast majority of universities and research and development institutes and a minority of scientific societies and professional associations in the SciELO Network countries operate publishers that, in addition to textbooks and popular science books, publish works that communicate research results. At the same time, the national systems of scientific output evaluation rely on books assessment systems or methodologies complementing those of journals. On a smaller scale than journals’, the publication of scholarly books is also an integral part of research infrastructures.

The online publication of academic books and their indexing radically increase their visibility in relation to the paper version, which contributes to increase their use and impact by citations. One of the positive consequences of online publishing and indexing is to enable the insertion and interoperability of academic books into the flow of scientific communication. Particularly, the SciELO Program has as one of its functions to maximize the interoperability between researches, which requires, besides the journals, the online availability of books meeting international standards.

The scope of this working group is to analyze the relevance of the academic book in research communication, the current state and trends of online publication and indexing of academic books in the SciELO Network countries and the challenges for adopting standards that maximize their visibility, use and impact.

Publicada em: Ciências
  • Seja o primeiro a comentar

  • Seja a primeira pessoa a gostar disto

Stephanie Faulkner - Using Metrics Beyond Citations to Demonstrate the Impact of SciELO Books

  1. 1. | www.plumanalytics.com1 Using Metrics Beyond Citations to Demonstrate the Impact of SciELO Books 24 September 2018 Stephanie Faulkner | Product Manager S.Faulkner@Elsevier.com | +1.732.216.5104
  2. 2. | www.plumanalytics.com2 Supporting and developing metrics for the full lifecycle of research We strive for broader use of open metrics that can be used by everyone responsibly. Research Metrics at Elsevier 2 Our Approach
  3. 3. | www.plumanalytics.com3 Defining altmetrics • Altmetrics = Alternative ways of measuring the use and impact of scholarship • Altmetrics combine traditional impact measures (citation counts) with non-traditional measures • Altmetrics = ALL METRICS “Altmetrics are measures of scholarly impact mined from activity in online tools and environments” – Jason Priem, Co-Founder, ImpactStory Using Altmetrics to Illustrate the Impact of Open Access on Graduate Student Research (Barnett, Collister, Chan 2014)
  4. 4. | www.plumanalytics.com4 USAGE (clicks, downloads, views, library holdings, video plays) CAPTURES (bookmarks, code forks, favorites, readers, watchers) MENTIONS (blog/news posts, comments, reviews, Wikipedia links) SOCIAL MEDIA (tweets, likes, shares, comments) CITATIONS (citation indexes, patent citations, clinical citations) Metrics Categories
  5. 5. | www.plumanalytics.com5 USAGE Library holdings, Clicks, Downloads, Views, Video plays • Is anyone reading our work? • Which libraries have our book in their collections? • Usage is the #1 stat researchers want to know after Citation counts • PlumX is the only product that includes Usage
  6. 6. | www.plumanalytics.com6 CAPTURES Readers,Exports/Saves, Favorites, Followers • Captures indicate that someone wants to come back to the work • How many time has a book citation been exported • The number of times a citation/abstract has been saved, emailed or printed • Early indicator of future citations
  7. 7. | www.plumanalytics.com7 MENTIONS Blog posts, News posts, Book reviews, Wikipedia references • This category measures people truly engaging with your research • Automatically uncover the conversations about your research • Discover feedback, opinions, etc.
  8. 8. | www.plumanalytics.com8 SOCIAL MEDIA Shares, likes, & comments, Tweets • Social media measures how well a publisher or researcher is promoting their work • Track the buzz and attention around your research output • This is especially important for early career researchers to measure and understand
  9. 9. | www.plumanalytics.com9 CITATIONS Citation Indexes, Patent Citations, Clinical Citations, Policy Citations • Citations still a standard of long-term impact • Including citations enables side-by-side analysis with other metrics categories
  10. 10. | www.plumanalytics.com10 Visualizing Impact: Plum Print • Includes the 5 categories of metrics • Circles dynamically change size based on metrics in each category
  11. 11. | www.plumanalytics.com11 • Articles • Blog posts • Book chapters • Books • Cases • Clinical Trials • Conference Papers • Data Sets • Figures • Grants • Interviews • Letters • Media • Patents • Posters • Presentations • Reports • Source Code • Theses / Dissertations • Videos • Web Pages ALL Types of Research Artifacts
  12. 12. | www.plumanalytics.com12 ACI Amazon Airiti bepress bit.ly CABI CrossRef Dryad dSpace DynaMed Plus EBSCO ePrints Facebook figshare Github Goodreads Google+ Mendeley NICE (UK) OJS Journals PLOS PubMed PubMed Central Reddit RePEc SciElo Scopus SlideShare SourceForge SSRN Stack Exchange Twitter USPTO Vimeo Wikipedia Worldcat YouTube http://plumanalytics.com/learn/about-metrics/ D MP Scholarly Data Exhaust – Data Source Examples
  13. 13. | www.plumanalytics.com13 Identifying Research Tracking anything is a challenge. To track a piece of research you need a way to identify it. The Digital Object Identifier (DOI) has been widely adopted to identify articles. But what about non-article output? Or articles that do not have a DOI? Plum Analytics tracks as many identifiers as possible, including ISBNs for books, SlideShare IDs for presentations, YouTube IDs for videos and so much more.
  14. 14. | www.plumanalytics.com14 START END >20 URLS & 3 IDENTIFIERS URL http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0054922 http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0054922 PMCID PMC3566209 PMID 23405137 Repository URL http://d-scholarship.pitt.edu/17881/ URL http://dx.doi.org/10.1371/journal.pone.0055344 URL http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3602431/ URL http://www.ncbi.nlm.nih.gov/pubmed/23526927 DOI 10.1371/journal.pone.0055344
  15. 15. | www.plumanalytics.com15 Books Matter How many libraries hold this book? Books are often the seminal work of researchers in Humanities and Social Sciences. Yet, citations do not do them justice – they never have and never will. This puts researchers from these disciplines at a disadvantage. Luckily, there are other ways to measure the impact of books. How many Wikipedia articles reference this book? What are the reviews on Amazon about this book? How many people added this book to their bookshelves? How many abstract views, downloads, and clicks did this eBook get? How many books & book chapters? 15,121,312
  16. 16. | www.plumanalytics.com16 Measuring the impact of books is challenging • In a 2016 study, several bibliometricians analyzed over 70,000 books, collecting and comparing traditional and non-traditional (PlumX) metrics. • Metrics varied across types of books and content • They concluded there isn’t one measure that captures the impact of books across all types -- you need to look a multiple or different measures including: • Social Media Mentions • Downloads • Readers • Viewers • As well as Citations • They also concluded that it is important for publishers to utilize social media to raise awareness to their books (including text books). Halevi, G., Nicolas, B., & Bar-Ilan, J. (2016). The Complexity of Measuring the Impact of Books. Publishing Research Quarterly, 32(3), 187-200. doi:10.1007/s12109-016-9464-5
  17. 17. | www.plumanalytics.com17 Most frequently mentioned in social media
  18. 18. | www.plumanalytics.com18 Most frequently viewed & downloaded books Most frequently mentioned in social media
  19. 19. | www.plumanalytics.com19 Most frequently mentioned in reviews
  20. 20. | www.plumanalytics.com20 Book reviews
  21. 21. | www.plumanalytics.com21 PlumX links directly to Goodreads • See reviews and ratings • See individuals who have read or want to read the book
  22. 22. | www.plumanalytics.com22 Uncover the conversations the author was not even aware of. References
  23. 23. | www.plumanalytics.com23 Usage
  24. 24. | www.plumanalytics.com24 Finding insights through the PlumX Dashboard Organized by Publisher Export raw metrics Filter and analyze
  25. 25. | www.plumanalytics.com25 Quickly find which book has the most metrics in a specific category Each metric column can be sorted (publication year and title, too!)
  26. 26. | www.plumanalytics.com26 PlumX artifact page
  27. 27. | www.plumanalytics.com27 Analytics – Metrics by publication year
  28. 28. | www.plumanalytics.com28 Analytics – Metrics by publication year
  29. 29. | www.plumanalytics.com29 Overall Impact Working from the middle out, find the largest section in the third ring to see the book with the most combined impact.
  30. 30. | www.plumanalytics.com31 Summary • Tracking over 67 research artifact types such as articles, presentations, patents, books, book chapters, datasets, videos, musical scores, thesis and dissertations and more, from over a 50 different sources. • Comprehensive metric data grouped into five key categories, vetted by our partners and librarians including – Usage, Captures, Mentions, Social Media and Citations. We are the only provider including article level usage statistics. Sources of book specific metrics are extensive and coverage growing. • Measured versions? Artifact (journal, book, book chapter, datasets, etc.) level of measurement includes not only the Publisher (Gold), but, also Green Open Access, Preprint, Aggregated versions and Abstracting & Index versions. • We currently have metrics for over 70+ million artifacts in our PlumX index and these numbers continue to grow—-covering a wide breadth of the world’s research output.
  31. 31. | www.plumanalytics.com32 Questions?
  32. 32. Thank You s.faulkner@elsevier.com +1.732.216.5104 Stephanie Faulkner Find out more information at: http://www.plumanalytics.com