Introduction

Impact and value of digitized collections are concepts that are both being brought to real life through users. Any metrics and criteria that would try to capture impact and value have to factor in first how individual users (or user communities) benefit from the digitized resources in question.

Thus, one specific difficulty in measuring impact and value is the subjective and quickly changing user-related component of the valorization process. How exactly could we find out whether a digital resource had an impact on users? What value propositions have resource creators intended to convey to their target audiences? How well did these target audiences understand the message – is the value they see in the resource and surrounding services identical to what its producers had in mind? This chapter presents a description of user evaluation methodologies, and discusses how user considerations can be factored into the digitization process. It presents a case study describing user involvement in projects on digitization of audiovisual materials.

The user paradox: users are valuable in digitization policies but not sufficiently involved

As the volume of digitized resources grows, so does the number of studies and publications on user studies within the digital library domain, although these have been limited in scope, as noted recently by Michael Khoo and colleagues: ‘In the case of digital library researchers, the focus of research is often on technical issues (e.g., information retrieval methods, software architecture, etc.) rather than on user-centered issues’ (Khoo, Buchanan and Cunningham, 2009).

In fact, we are currently witnessing a paradox: major institutions from the cultural heritage sector clearly emphasize the place of user evaluation and feedback in digitizationrelated policies. But in reality, decisions about aspects of digitization that impact users are frequently taken without direct user involvement.

For example, the National Library of Australia Collection Digitisation Policy (National Library of Australia, 2008) states that: ‘The Library's digitisation activities take account of user evaluation and feedback. Users are encouraged to provide feedback and make suggestions through the Digital Collections user feedback form or other ways.’