Successful organic farming requires crop varieties that are resilient to environmental variability. Assessing variety performance across the range of conditions represented on working farms is vital to developing such varieties; however, data collected from on-farm, participatory trials can be difficult to both collect and interpret. To assess the utility of data arising from participatory trialing efforts, we examined the performance of butternut squash (Cucurbita moschata L.), broccoli (Brassica oleracea L.) and carrot (Daucus carota L.) varieties grown in diverse organic production environments in participatory trials in Oregon, Washington, Wisconsin and New York using adaptability analysis (regression of variety means on environmental index). Patterns of adaptation varied across varieties, with some demonstrating broad adaptation and others showing specific adaptation to low- or high-yielding environments. Selection of varieties with broad vs specific adaptation should be guided by farmers’ risk tolerance and on-farm environmental variation. Adaptability analysis was appropriate for continuous variables (e.g., yield traits), but less so for ordinal variables and quality traits such as flavor and appearance, which can be vitally important in organic vegetable crop variety selection. The relative advantages of adaptability analysis and additive main effects and multiplicative interactions are also discussed in relation to on-farm trial networks. This work demonstrated the unique challenges presented by extensive participatory vegetable trialing efforts, which, as compared to grain crops, require novel approaches to facilitating farmer participation as well as data collection and analysis. Efficient, precise and reliable methods for evaluating quality related traits in these crops would allow researchers to assess stability and adaptation across a wider range of traits, providing advantages for effective plant breeding and trialing activities within the organic sector.