Hostname: page-component-76d6cb85b7-rxvq6 Total loading time: 0 Render date: 2026-07-15T17:01:52.966Z Has data issue: false hasContentIssue false

A few notes on the scalar foundations of foundation models

Published online by Cambridge University Press:  22 January 2026

Ranjodh Singh Dhaliwal*
Affiliation:
Faculty of Humanities and Social Sciences, University of Basel, Basel, Switzerland
Rights & Permissions [Opens in a new window]

Abstract

Foundation models are many things and encompass several modalities; they use text, images, sound, and more recently, action or inference units. But all of these forms share one thing in common: the (massive) scale. The “large” in large language models has been well studied by scholars in critical data, AI and archive studies, with several experts pointing at how these models are environmentally harmful, technically opaque and corporationally monopolistic primarily because of their scale. This piece discusses questions of technical and cultural scale – in the material, archival and procedural senses – within the contemporary technical and discursive landscape. At stake here is the role of critical and design studies within academic, artistic and para-academic worlds. It suggests that instead of corporate chatbots that aspire to pass the Turing test through multipurpose, encyclopedic service, we may be better served by playing with local models and reaching for small-scale AI development. This epistemological shift, in fact, may also provide some creative and critical potential that more effectively gets at the strangeness of machine learning systems while consciously and carefully handling the scalar environmental and social impacts of big AI.

Information

Type
Reflection
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NC
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial licence (http://creativecommons.org/licenses/by-nc/4.0), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original article is properly cited. The written permission of Cambridge University Press or the rights holder(s) must be obtained prior to any commercial use.
Copyright
© The Author(s), 2026. Published by Cambridge University Press.