HuMetricsHSS is an initiative for rethinking humane indicators of excellence in academia, focused particularly on the humanities and social sciences (HSS). Comprised of individuals and organizations from the academic, commercial, and non-profit sectors, HuMetricsHSS endeavors to create and support a values-based framework for understanding and evaluating all aspects of the scholarly life well-lived and for promoting the nurturing of these values in scholarly practice. We are currently in the initial, exploratory phase of the project.
HuMetricsHSS takes the approach that metrics should only be used to measure a scholar’s progress toward embodying five values that our initial research suggests are central to all HSS disciplines:
- COLLEGIALITY, which can be described as the professional practices of kindness, generosity, and empathy toward other scholars and oneself;
- QUALITY, a value that demonstrates one’s originality, willingness to push boundaries, methodological soundness, and the advancement of knowledge both within one’s own discipline and among other disciplines and with the general public, as well;
- EQUITY, or the willingness to undertake study with social justice, equitable access to research, and the public good in mind;
- OPENNESS, which includes a researcher’s transparency, candor, and accountability, in addition to the practice of making one’s research OPEN ACCESS at all stages; and
- COMMUNITY, the value of being engaged in one’s community of practice and with the public at large and also in practicing principled leadership.
With generous funding from the Andrew W. Mellon Foundation, over the coming 18 months the HuMetricsHSS team expects to accomplish the following goals on its way toward bettering evaluation in the academy:
- Articulate values common to scholarly practice in the HSS disciplines to create a proposed “humane” evaluation framework;
- Integrate previous work done in values, metrics, and evaluation in the HSS into the HuMetricsHSS values-based evaluation framework;
- Create a small set of use cases for applying values-based evaluation practices (e.g., creating a syllabus, contributing to an annotation);
- Solicit community feedback from a wide variety of stakeholders across HSS disciplines on the proposed values framework;
- Organize a small pilot cohort of framework adopters (i.e., organizations that pledge to apply the framework in their own evaluation practices);
- Iteratively improve the framework based upon cohort feedback and continued consultation with the community and external evaluation experts; and
- Seek widespread adoption of the HuMetrics values-based framework by HSS funding agencies, departments, research institutes, and scholarly societies.
HuMetricsHSS is led by a core team of individuals with diverse backgrounds who share the common goal of cultivating excellence in HSS:
- Nicky Agate, Head of Digital Initiatives, Modern Language Association
- Rebecca Kennison, Executive Director and Principal, K|N Consultants; Co-Founder, Open Access Network
- Stacy Konkiel, Director of Research & Education, Altmetric
- Christopher Long, Dean of College of Arts & Letters and Professor of Philosophy, Michigan State University
- Jason Rhody, Director of the Digital Culture Program, Social Science Research Council (SSRC)
- Simone Sacchi, European Union Projects Manager, LIBER (Ligue des Bibliothèques Européennes de Recherche – Association of European Research Libraries)
MSU HuMetricsHSS Steering Committee:
Media Mentions and Citations
[listed in chronological order]:
- Kaplan, Isaac. “The way we judge humanities professors is broken—This initiative could fix it.” Artsy, July 2017. https://www.artsy.net/article/artsy-editorial-way-judge-humanities-professors-broken-initiative
- Scutari, Isaac. “Can humanities grants to universities be a bridge to something bigger?” Inside Philanthropy, July 30, 2017. https://www.insidephilanthropy.com/home/2017/7/30/mellon-grants-humanities-careers-communities.
- Wulf, Karin. “Metrics. Human-made, but humane?” The Scholarly Kitchen, November 2, 2017. https://scholarlykitchen.sspnet.org/2017/11/02/metrics-human-made-but-humane/
- Bessette, Lee. “Weekend reading: Valuing the syllabus edition.” Profhacker [Chronicle of Higher Education], March 9, 2018. https://www.chronicle.com/blogs/profhacker/weekend-reading-valuing-syllabus-edition/65161
Ellis, Lindsay. “As Scholars Are Driven to Less Prestigious Journals, New Measures of Quality Emerge.” The Chronicle of Higher Education, February 17, 2019. https://www.chronicle.com/interactives/Trend19-OpenAccess-Side.
Articles and Conference Presentations
- Alperin, Juan Pablo, Carol Muñoz Nieves, Lesley A. Schimanski, Gustavo E. Fischman, Meredith T. Niles, and Erin C. McKiernan. “How significant are the public dimensions of faculty work in review, promotion, and tenure documents?” eLife 8 (2019): e42254. DOI: 10.7554/eLife.42254
- Altman, Micah, Chris Bourg, Philip Cohen, G. Sayeed Choudhury, Charles Henry, Sue Kriegsman, Mary Minow, Daisy Selematsela, Anasuya Sengupta, Peter Suber, Ece Turnator, Suzanne Wallen, Trevor Owens, and David Weinberger. “A grand challenges-based research agenda for scholarly communication and information science.” Grand Challenges Summit, March 2018, Cambridge, MA.
- Duller, Matthias, Philipp Korom, Rafael Y. Schögler, and Christian Fleck. “Scholars as European public intellectuals? Media interventions in the 2014 European Parliament election campaign.” European Societies 20.2 (2018): 322-353. DOI: 10.1080/14616696.2017.1402119
- Haak, Laurel L., Alice Meadows, and Josh Brown. “Using ORCID, DOI, and other open identifiers in research evaluation.” Frontiers in Research Metrics and Analytics 3 (2018): Article 28. doi: 10.3389/frma.2018.00028
- Hatherill, Jeanette. “Questioning bibliometrics and research impact.” Bibliometrics and Research Impact Conference 2018. http://hdl.handle.net/10393/38100
- Kear, Robin. “A brief view of the International Federation of Library Associations and Institutions World Library & Information Congress (IFLA WLIC 2017) in Wroclaw, Poland.” International Information & Library Review 49.4 (2017): 316–320, DOI: 10.1080/10572317.2017.1389562
- Konkiel, Stacy. “Approaches to creating ‘humane’ research evaluation metrics for the humanities.” UKSG Insights, November 2018. dx.doi.org/10.1629/uksg.445/
- Lamberti , Adrienne P. “Navigating a tangled intersection: Agricultural communication as public meeting space among the humanities, social sciences, and the digital.” Open Library of Humanities 5.1 (2019): 11. DOI: 10.16995/olh.360
- Long, Christopher P. “Reshaping the tenure and promotion process so that it becomes a catalyst for innovative and invigorating scholarship.” LSE Impact of Social Sciences, November 1, 2017. https://blogs.lse.ac.uk/impactofsocialsciences/2017/11/01/reshaping-the-tenure-and-promotion-process-so-that-it-becomes-a-catalyst-for-innovative-and-invigorating-scholarship/.
- Mudditt, Alison. “Opening the monograph: Lessons from Luminos.” Journal of Scholarly Publishing 49:1 (2017): 41–52. DOI: 10.3138/jsp.49.1.41
- Staines, H. R. “Digital open annotation with Hypothes.is: Supplying the missing capability of the web.” Journal of Scholarly Publishing 49.3 (2018): 345-365.
- Watkinson, Charles. “The academic eBook ecosystem reinvigorated: A perspective from the USA.” Learned Publishing 31.S1 (2018). 280–287. DOI: 10.1002/leap.1185
- Watkinson, Charles. “Academy/ic-led publishing: Some thoughts from North America.” OASPA Webinar, Academic Publishing Day, February 7, 2019. Presentation link: http://bit.ly/UMP-OASPA
- Doctoral Thesis
Macedo, Denise Silva. Mercantilização do discurso público: Universidades brasileiras. 2018. 256 f., il. Tese (Doutorado em Linguística. Universidade de Brasília, Brasília, 2018.
Fitzpatrick, Kathleen. Generous Thinking: A Radical Approach to Saving the University. Johns Hopkins University Press, 2019. 225–226.
Glass, Erin, and Micah Vandegrift. “Public scholarship in practice and philosophy.” Preprint in Humanities Commons: http://dx.doi.org/10.17613/g64d-gd16
- Fitzpatrick, Kathleen, and Rebecca Kennison. Altmetrics in Humanities and Social Sciences. 30
October 2017. Web: http://dx.doi.org/10.17613/M6MW28D5J
- Maron, Nancy, and Rebecca Kennison. ACRL Research Agenda for Scholarly Communications and the Research Environment: Draft for Public Comment [final version due in March 2019]. 18 December 2018. Web: https://bit.ly/2LSpCMS
[listed in chronological order]:
- Trott, Adriel. “HuMetricsHSS: Can (should) we develop humane metrics for the humanities?” 8 Oct 2017: https://adrieltrott.com/2017/10/08/humetricshss-can-should-we-develop-humane-metrics-for-the-humanities/
- Harris, Katherine D. “Moving up the professional ladder – Promotion narrative for full professor.” 12 January 2018: https://triproftri.wordpress.com/2018/01/12/moving-up-professional-ladder/
- Mattern, Shannon. “Making knowledge available: The media of generous scholarship.” March 2018: http://www.publicseminar.org/2018/03/making-knowledge-available/
- Graves Wolf, Leigh. “Reflection: #hssvalues valuing the syllabus as scholarship.” 5 March 2018: https://www.leighgraveswolf.com/2018/03/05/reflection-hssvalues-valuing-the-syllabus-as-scholarship/
- Johnson, Annie. ”All about impact factors.” 29 June 2018: https://sites.temple.edu/scholarlycommunication/2018/06/29/all-about-impact-factors/
- Johns Hopkins University https://guides.library.jhu.edu/metrics
- Graduate Institute of Geneva http://libguides.graduateinstitute.ch/metrics/controversies
- The Liberal Arts Endeavor Podcast (MSU CAL) #21