Hostname: page-component-5db58dd55d-jhf8m Total loading time: 0 Render date: 2026-07-09T00:23:54.577Z Has data issue: false hasContentIssue false

Digital collections explorer: An open-source, multimodal viewer for searching digital collections

Published online by Cambridge University Press:  17 November 2025

Ying-Hsiang Huang
Affiliation:
Information School, University of Washington , USA
Benjamin Charles Germain Lee*
Affiliation:
Information School, University of Washington , USA
*
Corresponding author: Benjamin Charles Germain Lee; E-mail: bcgl@uw.edu
Rights & Permissions [Opens in a new window]

Abstract

We present Digital Collections Explorer, a web-based, open-source exploratory search platform that leverages Contrastive Language-Image Pre-training for enhanced visual discovery of digital collections. Our Digital Collections Explorer can be installed locally and configured to run on a visual collection of interest on disk in just a few steps. Building upon recent advances in multimodal search techniques, our interface enables natural language queries and reverse image searches over digital collections with visual features. This article describes the system’s architecture, implementation and application to various cultural heritage collections, demonstrating its potential for democratizing access to digital archives, especially those with impoverished metadata. We present case studies with maps, photographs and PDFs extracted from web archives in order to demonstrate the flexibility of the Digital Collections Explorer, as well as its ease of use. We demonstrate that the Digital Collections Explorer scales to hundreds of thousands of images on a MacBook Pro with an M4 chip. Lastly, we host a public demo of Digital Collections Explorer.

Information

Type
Software Paper
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (https://creativecommons.org/licenses/by-nc-nd/4.0), which permits non-commercial re-use, distribution, and reproduction in any medium, provided that no alterations are made and the original article is properly cited. The written permission of Cambridge University Press must be obtained prior to any commercial use and/or adaptation of the article.
Open Practices
Open materials
Copyright
© The Author(s), 2025. Published by Cambridge University Press
Figure 0

Figure 1. An overview of the Digital Collections Explorer, showing the central components: 1) the developer input, 2) the embedding process, 3) user input, 4) the web front-end interface, and 5) the API server.

Figure 1

Figure 2. The directory layout of the Digital Collections Explorer codebase, showing the high-level organization into data, src/frontend and src/backend, which correspond to distinct functional layers of the system.

Figure 2

Figure 3. The component-based front-end architecture of the Digital Collections Explorer. The parent (App.jsx) component acts as a stateful controller, mediating between the reusable UI and an abstracted layer (api.js).

Figure 3

Figure 4. Examples of the landing page for the photographs collection interface, which presents an end-user with two options for searching: text search via natural language (Figure 4a) and image search (Figure 4b).

Figure 4

Figure 5. An example of the historical maps gallery view rendered by the SearchResult.jsx component in response to a user query “arctic ocean.” The component’s responsibility is to render a grid with thumbnails of the maps.

Figure 5

Figure 6. The lightbox view, built into the maps collection interface, enables detailed inspection of a historical map. This modal interface provides tools for zooming and panning, allowing for a detailed examination of a map’s features.

Figure 6

Table 1. Embedding generation times with a 2024 MacBook Pro M4 Chip with 10-Core CPU, 10-Core GPU and 16-GB Unified Memory (*=reported by Mahowald and Lee (2024) using similar hardware).

Figure 7

Table 2. Total processing times (including parsing, thumbnails generation and embeddings generation) with a 2024 MacBook Pro M4 Chip with 10-Core CPU, 10-Core GPU and 16-GB Unified Memory.

Figure 8

Figure 7. Search results for two different natural language queries across the 1,000 Library of Congress .gov PDFs demonstrating the effectiveness of semantic retrieval: (a) “redacted documents” and (b) “multicolor graphs.” The filenames shown refer to the PDF filenames (given by the hash in the Library of Congress web archives).

Figure 9

Figure 8. Searches against the 562,842 map images from the Library of Congress API. (a) shows a natural language search of “tattered and worn map” and (b) shows a reverse image search with a panoramic map of 1888 Bridgerton, Maine, from the Library of Congress’s collections (http://hdl.loc.gov/loc.gmd/g3734b.pm002434). These results can be reproduced in our demo: https://www.digital-collections-explorer.com.

Submit a response

Rapid Responses

No Rapid Responses have been published for this article.