Greg Gordon - Building trust into altmetrics Lightning talk at NISO Altmetrics Initiative Brainstorming conference in San Francisco, CA on October 9, 2013
5. 537,000
1,210,000
1,730,000
2,200,000
2,800,000 2,950,000
3,400,000
4,950,000
6,850,000
7,900,000
8,400,000
9,300,000
11,000,000
2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012
SSRN Downloads
Ranking Accounting Ph.D. Programs and Faculties Using Social Science Research Network Downloads
Lawrence D. Brown
Ranking Law Schools: Using SSRN to Measure Scholarly Performance
Bernard S. Black and Paul L. Caron
Ranking Journals Using Social Science Research Network Downloads
Lawrence D. Brown
Assessing the SSRN-Based Law School Rankings
Theodore Eisenberg
12. To attain knowledge, add things every day.
To attain wisdom, subtract things every day.
- Lao Tzu
Notas do Editor
NISO to Develop Standards and Recommended Practices for AltmetricsGrant from Sloan Foundation will fund community-informed effort to standardize collection and use of alternative metrics measuring research impactBaltimore, MD - June 20, 2013 - The National Information Standards Organization (NISO) announces a new two-phase project to study, propose, and develop community-based standards or recommended practices in the field of alternative metrics. Assessment of scholarship is a critical component of the research process, impacting everything from which projects get funded to who gains promotion and tenure to which publications gain prominence. Since Eugene Garfield's pioneering work in the 1960s, much of the work on research assessment has been based upon citations, a valuable measure but one that has failed to keep pace with online reader behavior, network interactions with content, social media, and online content management. Exemplified by innovative new platforms like ImpactStory, a new movement is growing to develop more robust alternative metrics—called altmetrics—that complement traditional citation metrics. NISO will first hold several in-person and virtual meetings to identify critical areas where altmetrics standards or recommended practices are needed and then convene a working group to develop consensus standards and/or recommended practices. The project is funded through a $207,500 grant from the Alfred P. Sloan Foundation."Citation analysis lacks ways to measure the newer and more prevalent ways that articles generate impact such as through social networking tools like Twitter, Facebook, or blogs," explains Nettie Lagace, NISO's Associate Director for Programs. "Additionally, new forms of scholarly outputs, such as datasets, software tools, algorithms, or molecular structures are now commonplace, but they are not easily—if at all—assessed by traditional citation metrics. These are two among the many concerns the growing movement around altmetrics is trying to address.""For altmetrics to move out of its current pilot and proof-of-concept phase, the community must begin coalescing around a suite of commonly understood definitions, calculations, and data sharing practices," states Todd Carpenter, NISO Executive Director. "Organizations and researchers wanting to apply these metrics need to adequately understand them, ensure their consistent application and meaning across the community, and have methods for auditing their accuracy. We must agree on what gets measured, what the criteria are for assessing the quality of the measures, at what granularity these metrics are compiled and analyzed, how long a period the altmetrics should cover, the role of social media in altmetrics, the technical infrastructure necessary to exchange this data, and which new altmetrics will prove most valuable. The creation of altmetrics standards and best practices will facilitate the community trust in altmetrics, which will be a requirement for any broad-based acceptance, and will ensure that these altmetrics can be accurately compared and exchanged across publishers and platforms.""Sensible, community-informed, discipline-sensitive standards and practices are essential if altmetrics are to play a serious role in the evaluation of research," says Joshua M. Greenberg, Director of the Alfred P. Sloan Foundation's Digital Information Technology program. "With its long history of crafting just such standards, NISO is uniquely positioned to help take altmetrics to the next level."The first phase of the project will gather two groups of invited experts in altmetrics research, traditional publishing, bibliometrics, and faculty assessment for in-person discussions with the goal of identifying key altmetrics issues and those that can best be addressed through standards or recommended practices. This input will form the basis of two virtual meetings open to the public to further refine and prioritize the issues. Additional community input will be sought through an array of electronic and social mechanisms and events coordinated with major community conferences. A report summarizing this input will identify the specific areas where NISO should develop standards or recommended practices, which will be undertaken by a working group convened in phase two. The complete project from initial meetings to publication of standards is expected to take two years. Information about the meetings and other methods for participation will be announced on the NISO website (www.niso.org) and in the monthly Newsline e-newsletter (www.niso.org/publications/newsline/).
18 month backlog for 2 journals
There are problems, there are issues and the evangelists on both sides aren’t going to resolve them THUS the need for THIS discussion – for STANDARDS
LIMIT THE SCOPE OF YOUR GREATNESS – What did you say NO to today?Jobs said in an interview with Betsy Morris in 2008, "People think focus means saying 'yes' to the thing you've got to focus on. But that's not what it means at all. It means saying 'no' to the hundred other good ideas that there are. You have to pick carefully. I'm actually as proud of the things we haven't done as the things we have done.”