While the desire for “One Nation, One Language” has played a key role in language policies around the world, I argue that it is not really what drives the English-only movement in the United States. Some previous work on language and power oversimplifies how power works, since a policy seeming quaint and innocuous (and therefore impervious to criticism) can be just as powerful as a policy framed in terms of nationalism or globalization. Instead, drawing on Jan Blommaert’s theory of “upscaling,” I argue that downscaling plays just as pivotal a role in the English-only movement, and I examine examples that cut across my interviews, archival research, observations, and policy documents. I begin by analyzing examples of downscaling on its own, then turn toward situations where people engage in both upscaling and downscaling in a single text or interaction. Ultimately, scaling in either direction can be a way to claim linguistic authority. At the same time, sometimes policymakers do not walk this tightrope successfully, and there can be discursive dissonance. I argue that this sort of dissonance played a role in the eventual downfall of Frederick County’s Official English ordinance.