The grazing of livestock on arid and hyper-arid rangelands is the dominant land use across much of the Arabian Peninsula, and is a human activity of large historical, cultural, and economical importance. In this perspective, we outline the historical trajectory of pastoralism in the Arabian Peninsula, examine its transformation over the past century, and propose a framework for sustaining this practice amid contemporary environmental and social pressures. Our context is the seven countries that make up the Peninsula, but with an emphasis on the Kingdom of Saudi Arabia, given its size and geopolitical influence. A substantial part of Arabian rangelands is severely degraded due to overgrazing by goats, sheep and camels. This degradation has been accompanied by declines in customary pastoral and social practices such as al hima, which allowed rangelands to be grazed and managed sustainability for more than a thousand years. Major transformation in current pastoral practices is needed to ensure that Arabian rangelands continue to sustain people and ecosystems into the next century. An important need is to build capacity and capability in organisations and individuals charged with managing rangelands. This requires the establishment of programmes that include, but are not limited to, a greater investment in the science and management of pastoralism, including the need to develop and promote systems to monitor environmental change under different grazing practices. Rangeland management and conservation programmes should also aim to incorporate elements of traditional pastoral systems such as al hima, managed by local herders, to promote a more sustainable utilisation of rangeland resources. Together, it is hoped that these actions will create a core group of local scientists working on local solutions, with a reduced reliance on international experts. Finally, we advocate for a greater strengthening of communal governance of rangeland resources. This should include greater support for pastoral groups to ensure that land management is socially grounded, and co-investment in conservation and pastoralism. By linking science, tradition, and local empowerment, the Arabian Peninsula has the potential to lead a new era of sustainable pastoralism in the world’s arid and hyper-arid rangelands.