Posts tagged with Assessment

A subcommittee of the Library Diversity Council was charged to evaluate and interrogate the role of policing in the University of Michigan Library. This post explores the evaluation and decision-making processes, while identifying the labor that goes into projects dealing with anti-racist culture change. The group’s research resulted in several recommendations shared with library leadership.

The University of Michigan Press sought to better understand what its monograph authors care about when choosing a publisher and their experiences in being published. A survey completed in Fall 2024 reveals insight into scholarly publishing trends and what authors value in working with a university press.

As we approach five years since the drastic shutdown and isolation techniques due to the COVID-19 pandemic, it seems appropriate to reflect on an assessment project conducted during 2020-2021. As librarians and students attempted to pivot to an all online learning and teaching experience, research service providers quickly needed to know more about our research consultation service. Struggling with a crisis, we also learned how to conduct assessment work in sensitive and empathetic ways.

Working with large-scale datasets to understand the effect of library resources on student success raises a number of concerns around individual privacy, data security, and analysis. This blog post, summarizing a recent article in College & Research Libraries, describes a recent grant-funded project at the University of Michigan, discusses the steps we took to address those concerns, and some of the lessons we learned.

The findings from a qualitative study on users of open access (OA) books reveal a wide range of needs and impacts. The data comes from two collections: one of OA books published by Lever Press (https://www.leverpress.org/) and the other of backlist books turned OA by the Big Ten Open Books project (https://bigtenopenbooks.org/). While the samples are small, the findings highlight the importance of qualitative approaches to capturing the variety of reader and, more broadly, user experiences.

We know very little about how authors and readers experience the impact of open-access (OA) books. Usage metrics and citations obscure their humanity. In Fall 2023, we interviewed authors and readers of monographs published as OA by the University of Michigan Press. Our qualitative research project documented their experiences, used AI to discover patterns in their responses, and provided evidence-based recommendations for improving OA book publishing.

The U-M Library UX + Design Team conducted a benchmark survey in late 2022 aiming to understand people’s experience with Library Search. Objectives included measuring user satisfaction, identifying audience needs, and comparing results with Harvard University’s survey using the same methodology. Survey findings guided the development of the Library Search Product Statement as well as user centered improvements such as implementing LibKey Direct-to-PDF API, and refining catalog results filters.

For the past year, U-M Library Digital Collections have been undergoing some big design changes. This blog post tells the story of launching and evaluating the usability of collections containing a new type of media: audio and moving images (AMI). In a research study consisting of a heuristic evaluation and 50 usability tests with a diverse group of users, the team uncovered over 20 mostly minor usability issues, recommended improvements to the interface that will be implemented in 2024 and beyond, and learned a lot about the complexity of library products along the way.

User research is best performed as an iterative process, where each round of testing provides valuable insights to lead to the next stage of development. The recent uplift on the University of Michigan Library’s Image Digital Collections offers a prime example of iterative user research, as it included testing phases for early mockups, plug-in image viewers, and an interactive coded version of the site. By continuously testing, we were able to identify potential issues early and to refine the site to better meet user needs.

Collaboration with students on library assessment projects is rewarding, both for the student and for the library. Student learning is front and center during any assessment project where the student is involved as a fully engaged team member. This post shares some thoughts about teaming up with students on assessment efforts.