O slideshow foi denunciado.
Utilizamos seu perfil e dados de atividades no LinkedIn para personalizar e exibir anúncios mais relevantes. Altere suas preferências de anúncios quando desejar.

Beyond the shelves e brown

  • Seja o primeiro a comentar

  • Seja a primeira pessoa a gostar disto

Beyond the shelves e brown

  1. 1. Beyond the shelves:Measuring Impact with InstitutionalAssessment ToolsElizabeth BrownBinghamton University LibrariesJune 10, 2013Next Generation Sci-Tech Librarians:Helping Institutions and Researchers IncreaseTheir Impact2013 SLA Annual Conference
  2. 2. Our Users see us this way:Source: https://blogs.binghamton.edu/index.php/gallery/
  3. 3. We see ourselves supporting:URLs: http://futurepath.org/digital-information-presevation/; http://www.nationalgalleries.org/object/GMAA42/2/GKL1012;http://metalink.binghamton.edu:8332/V/DIURBR94GJBKS1C3TBKAGBQ19XQQQ4DBVYRJHJKGH2ADLG2D3Y-08701?func=native-link&resource=BNG05356Print Archives and CollectionsElectronic ContentResearch Data, supplementary researchmaterials
  4. 4. Our library databases fit and the campusinformation ecosystemLibrary journal indexes/databasesArticle citations, references and co-authors; Subject coverageResearch analytical toolsProgram, research and individual researcher/faculty strengthsInformal scholarshipReadership, contacts, outreach and discussion of work
  5. 5. Tools are evolving to move seamlessly between thesesources of personal and collective data
  6. 6. Indexing / Abstracting Databases• Scifinder Scholar• Scopus• Web of Science• Journal Citation Reports• Google Scholar Citations*• SciImago**Freely available sourceProvide analytical data from individual pieces of research output, plussome collective data
  7. 7. Scifinder ScholarLimited citationcountsorting, analysisSource: Scifinder Scholar, March 2012Get cited documentsCitation Sort
  8. 8. Web of Science/Web of KnowledgeSource: Web of Science , March 2012Impact over timeHigh Impact Articles
  9. 9. Journal Citation Report showsindividual journal performanceSource: Journal Citation Reports, Thomson Reuters, May 2013Impact Factor
  10. 10. Google Scholar Citations - Personal ProfilesSource: Google Scholar Citations, May 2013, URL: http://scholar.google.com/citations?user=xmQS420AAAAJ
  11. 11. SciImago (University of Granada)Source: SciImago web site, March 2012. URL: http://www.scimagojr.com/
  12. 12. Research Analytical Tools• Scival Spotlight• Academic Analytics• InCites• Microsoft Academic Search*Examine research productivity to identify• Current, emerging and interdisciplinary campus researchstrengths• Potential collaborators and peers• Unmet collections needs
  13. 13. SciVal Spotlight gives a visual image of researchoutput from citation and journal article dataData Source: SciVal Spotlight Global Data (2006-2010); Scopus citation data (2006-2010)Uses:Clustered Scopus citation datato create research profilegroupings and summariesCollexis’ semantic technologypurchased by Elsevier13“Wheel of Research” shows avisual map of:Normalized citation analysisof research outputSubject-identified researchareas Interdisciplinary research liescloser to the wheel’s center
  14. 14. SciVal Spotlight Faculty Peer RankingsLocate peers within specific research areas:Identify institutional peers from author listsTarget international recruitment to key peers and collaboratorsData Source: SciVal Spotlight Global Data (2005-2009); Scopus citation data (2005-2009)
  15. 15. High-Impact Research LeadersRankAuthors Department(s) Research Area(s)#pubs#cites1Wu N.E.; Klir G.J.; Zacks S. EE; SSIE; MathSignal Processing; Fuzzy Sets; Computer-AidedProcess Planning 44 178.82Spear N.E.; Miller R.R.; Arias C.M. PsychPsychopharmacology; Consciousness;Neurotoxicology 134 671.35Meng W.; Zhao H.; Gupta C. Comp Sci Data Mining 14 32.67Younis M.I.; Alsaleem F.M. MESensors & Actuators; Semiconducting Materials;Nanotechnology 48 1379Fridrich J.; Filler T.; Kodovský J. EE Data Mining; Image Processing 39 214.210Yammarino F.J.; Dionne S.D.; Gooty J. SOMLeadership & Organizational Behavior; StrategicManagement 22 37.311Zhong C.J.; Luo J.P.; Wang L. ChemSensors & Actuators; Nanotechnology;Electrochemistry 56 426.114Fordham B.O.; Cingranelli D.L.; ClarkD.H. Poli Sci International Conflict; Political Studies 12 10.919Zhou J.; Zhang Y.; Braiotta L.B SOM Financial Accounting 10 28.722Wilson D.S.; Dlugos M.J. Biol, EVoS Molecular Ecology; Consciousness; Bioethics 15 126.425Long B.; Zhang Z.M. Comp Sci Machine Learning; Data Mining 15 40.7Data Sources: SciVal Spotlight Global Data (2006-2010), Scopus Citation Data (2006-2010)Faculty research impacting future collections growthHigher priority research data to preserveInterdisciplinary strengths and relationships
  16. 16. SciVal Spotlight Faculty, Program ComparisonsFaculty rank, productivity and representation in Spotlightcompetencies shows loci of future high-impact researchRankAvg Pub/DateRangeAvg % of art incomp.Professor 57 78%Professor 16 34%Professor 30 25%Associate 40 24%Professor 37 21%Associate 29 17%Professor 13 8%Professor 15 2%Distinguished 21 0%Rank Avg Pub/Date Range Avg % of art in comp.Associate 34 90%Assistant 13 85%Distinguished 18 51%Distinguished 65 51%Research 12 43%Assistant 16 39%Distinguished Teaching 14 29%Associate 34 22%Associate 21 11%Associate 35 3%Professor 18 0%Mature Department Newer, growing DepartmentSources: SciVal Spotlight (2004-2010), Binghamton University Campus Directory andDepartment Web Site data, July 2011
  17. 17. 2005-2009 SciVal Subject Categories% of Binghamton Collections Budget(2008-2009)Biology 11%Earth Sciences 6%Engineering 8%Chemistry 9%Math + Physics 14%Computer Science 4.1%Social Studies 26%Brain Research 7%Health Sciences 5%Medical SpecialtiesHumanities 10.5%Source: SciVal Spotlight Data, (2005-2009), BU Libraries Collections Budget Data (2009)SciVal competencies and library budget support
  18. 18. SciVal Spotlight Collections DataJournal (Proceeding)Ave #pub/5yearsLibraryAvailabilityLecture Notes in Computer Science 57 PrintProceedings of SPIE - The International Society for Optical Engineering 48 NoMaterials Research Society Symposium - Proceedings 26 PrintAlcoholism: Clinical and Experimental Research 24 Print/ElecProceedings - Electronic Components and Technology Conference 24 Yes*ASME International Mechanical Engineering Congress and Exposition, Proceedings 17 Yes*Langmuir 16 Print/ElecPhysical Review B - Condensed Matter and Materials Physics 15 Print/ElecJournal of Experimental Psychology: Animal Behavior Processes 15 Print/ElecDevelopmental Psychobiology 13 Print/Elec2006 IIE Annual Conference and Exhibition 13 NoPharmacology, Biochemistry and Behavior 13 Print/ElecJournal of Electronic Packaging, Transactions of the ASME 12 Print/Elec2010 12th IEEE Intersociety Conference, ITherm 2010 12 ElecData Sources: SciVal Spotlight Global Data (2006-2010); Scopus Citation Data (2006-2010); Library Catalog Holdings, 1/2012Aggregated publication lists identify key journals, proceedings andbooks to strategically build the Libraries’ collections18
  19. 19. SciVal PeerInstitutionAnalysisVerdict: Binghamton maysuffer from Aspirational PeerSyndromeUniversity of Delaware UC, Santa BarbaraCollege of William and Mary Binghamton (SUNY)Data Source: SciVal Spotlight Global Data (2006-2010); Scopus citation data (2006-2010)Indicates:Quantity of researchExtent of interdisciplinaryresearchAreas of researchstrengths
  20. 20. Academic Analytics uses additional variables tocompare academic programsSource: Copyright © 2012, Academic Analytics, LLC; Binghamton University Graduate School report, 2012Doctoral Program # Faculty PercentileBehavioral Neuroscience 12 88Electrical Engineering 15 79Political Science 18 76Clinical Psychology 10 74Materials Science &Engineering 23 70Mechanical Engineering 16 70History 28 68Chemistry 16 67Art History 7 64Binghamton’s 2009 reportGrantFundingAwardsArticle CitationsBook AuthorshipArticle Authorship
  21. 21. Microsoft Academic SearchSource: Microsoft Academic Search website, March 2012, URL:http://academic.research.microsoft.com/Comparison?entitytype=7&id1=16846&id2=5302&topdomainid=5Analytical data comparisons are possible, plus author comparisons and conferenceadvisory tools
  22. 22. Conclusions• Research Analytical Tools provide comprehensive data on facultyperformance and impact• Library Databases show article and journal-level impact and providesome analytical data• Alternative metrics complement and provide additional informationto licensed products• Need to provide both personal and collective performance metrics
  23. 23. Future Directions / Predictions• Faculty Productivity Data Collection• Further analysis of Academic Analytics data• Identify specialized reports /data from InCites andSciVal to complement Academic Analytics
  24. 24. Sources• Angela van Barneveld, Kimberly E. Arnold and John Campbell, Analytics in Higher Education:Establishing a Common Language, ELI Paper 1: January 2012, URL:http://www.educause.edu/Resources/AnalyticsinHigherEducationEsta/245405• Using Bibliometrics: A Guide to Evaluating Research Performance with Citation Data, ThomsonReuters, 2008. URL: http://ip-science.thomsonreuters.com/news/2008-07/8465001/• Co-Citation Analysis: The Methodology of SciVal Spotlight, Elsevier, June 2009. URL:http://www.info.scival.com/resource-library/white-paper-co-citation-analysis-methodology-scival-spotlight• Kristen Fisher Ratan, Metrics: The New Black?, PLoS, NFAIS 2012. URL:http://www.slideshare.net/kristenratan/metrics-the-new-black.• Jennifer Howard, Tracking Scholarly Influence Beyond the Impact Factor, Chronicle of HigherEducation, February 28, 2012. URL: http://chronicle.com/blogs/wiredcampus/tracking-scholarly-influence-beyond-the-impact-factor/35565• Advanced Computing Infrastructure: Vision and Strategic Plan, National Science FoundationCyberinfrastructure for 21st Century Science and Engineering (CIF21), February 2012. URL:http://www.nsf.gov/publications/pub_summ.jsp?ods_key=nsf12051• Paul Wouters and Rodrigo Costas, Users, Narcissism and Control – tracking the impact of scholarlypublications in the 21st Century, SURFfoundation, February 2012. URL: http://www.cni.org/news/surf-report-users-narcissism-and-control/.• Social Media and research workflow, CIBER, University College London, December 14, 2010. URL:www.ucl.ac.uk/infostudies/research/ciber/social-media-report.pdf.
  25. 25. Thank You!• Binghamton University Libraries• Dean John M. Meador• Senior Vice Provost Michael McGoff• Binghamton University Graduate SchoolElizabeth Brownebrown@binghamton.eduTwitter: eabrown25Slideshare: http://www.slideshare.net/ebrown