Hostname: page-component-68c7f8b79f-mq4xt Total loading time: 0 Render date: 2026-01-17T15:29:21.780Z Has data issue: false hasContentIssue false

Improving issue representation with candidate‐level voting advice applications

Published online by Cambridge University Press:  02 January 2026

Micha Germann*
Affiliation:
Department of Politics, Languages & International Studies, University of Bath, UK
Fernando Mendez
Affiliation:
Center for Democracy Studies, University of Zurich, Switzerland
Jonathan Wheatley
Affiliation:
School of Law and Social Sciences, Oxford Brookes University, UK
Constantinos Djouvas
Affiliation:
Department of Communication and Internet Studies, Cyprus University of Technology, Cyprus
Roula Nezi
Affiliation:
Department of Politics, University of Surrey, UK
Matthew Wall
Affiliation:
Department of Politics, Philosophy and International Relations, Swansea University, UK
*
Address for correspondence: Micha Germann, Department of Politics, Languages & International Studies, University of Bath, Bath, BA2 7AY, UK.Email: m.germann@bath.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

Voting advice applications (VAAs) have proliferated in recent years. However, most VAAs only match their users with parties, at least in part because creating a VAA matching voters to individual candidates tends to be more labour‐intensive. This could be an important missed opportunity. Candidates may deviate from the party line, but voters are often unaware of the policy platforms of individual candidates and therefore rarely hold them accountable for their issue positions in candidate‐based elections. VAAs providing information on issue congruence with individual candidates could help to rectify this. We evaluate the potential of candidate‐level VAAs by integrating a randomized experiment into a real‐world VAA whereby users were exposed either to candidate‐level VAA advice or to more standard party‐level VAA advice. Our results suggest that candidate‐level VAAs are worth the extra effort: they help voters distinguish candidates from parties and cast votes that are more in line with their policy preferences.

Information

Type
Research Note
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © 2025 The Author(s). European Journal of Political Research published by John Wiley & Sons Ltd on behalf of European Consortium for Political Research.

Introduction

One of the key functions of elections is that voters can influence the future direction of policy (Enelow & Hinich, Reference Enelow and Hinich1984). However, research suggests that voters often have limited knowledge of the policy positions of political elites (Bartels, Reference Bartels1996; Delli Carpini & Keeter, Reference Delli Carpini and Keeter1996; Grand & Tiemann, Reference Grand and Tiemann2013). As a result, voters often cast votes that do not match their policy preferences – a finding that applies across electoral contexts (Lau et al., Reference Lau, Patel, Fahmy and Kaufman2014), but especially in candidate‐based elections (Bovitz & Carson, Reference Bovitz and Carson2006; Hanretty et al., Reference Hanretty, Mellon and English2021; Highton, Reference Highton2019; Rogers, Reference Rogers2017; Vivyan & Wagner, Reference Vivyan and Wagner2012; von Schoultz & Papageorgiou, Reference Schoultz and Papageorgiou2021; Wheatley & Germann, Reference Wheatley and Germann2024). Recent decades have seen an increasing trend towards the personalization of electoral systems and an increasing number of democracies now allow voters to express preferences not just for parties, but also for individual candidates (Renwick & Pilet, Reference Renwick and Pilet2016). Common examples of such candidate‐based electoral systems include first‐past‐the‐post elections, open‐list proportional representation, mixed‐member systems and single transferable vote. Yet, while providing voters with more choice, candidate‐based elections also increase informational complexity.

Voters' choices in candidate‐based elections have been shown to be significantly influenced by the policy platforms of the parties with which candidates are affiliated (Rahn, Reference Rahn1993). In addition, voters are known to consider several readily observable characteristics of individual candidates, such as their incumbency status, roots in the local community, gender, race or celebrity status (Arter, Reference Arter2014; Fisher et al., Reference Fisher, Heath, Sanders and Sobolewska2015; Gelman & King, Reference Gelman and King1990; McElroy & Marsh, Reference McElroy and Marsh2010; Shugart et al., Reference Shugart, Valdini and Suominen2005). Finally, some voters also consider candidates' policy stances; however, the effects of candidates' policy positions on vote choice are often small and limited to voters with high political interest (Hanretty et al., Reference Hanretty, Mellon and English2021; Rogers, Reference Rogers2017; Wheatley & Germann, Reference Wheatley and Germann2024). At least in part, this is likely because candidate‐based elections create significant additional informational complexity. Individual candidates can and do adopt policy positions that differ from those of their party (Carey, Reference Carey2007; Isotalo et al., Reference Isotalo, Mattila and Schoultz2020; von Schoultz & Papageorgiou, Reference Schoultz and Papageorgiou2021). Therefore, voters need not just learn about the platforms of parties as a whole (which tend to be covered comparatively well by the media) but also individual candidates (which often are not). Against this background, it is then maybe not surprising that the policy positions of individual candidates often play a relatively limited role in candidate‐based elections.

In this article, we consider a digital democratic innovation that could help to improve the correspondence between voters' issue preferences and their choices in candidate‐based elections: candidate‐level voting advice applications (VAAs). VAAs are online voter information tools that are typically launched in the run‐up to elections and have become increasingly popular in recent years (Germann & Gemenis, Reference Germann and Gemenis2019). Upon accessing a VAA, users are prompted to indicate their preferences on a series of policy issues. The application then compares users' stated policy preferences with those of parties or candidates and returns a visual output indicating the extent of issue congruence between a user and the various election contenders (Garzia & Marschall, Reference Garzia, Marschall and Thompson2019). Most prominent VAAs are entirely party‐based, that is, match voters exclusively to parties (e.g., the German Wahl‐o‐Mat or the Dutch Stemwijzer). However, some VAAs also, or even exclusively, match users to individual candidates. Well‐known examples include the Swiss smartvote (Pianzola, Reference Pianzola2014), the Irish WhichCandidate (Costello et al., Reference Costello, Toshkov, Bos and Krouwel2021), and the Finnish Vaalikon (Kauppinen, Reference Kauppinen, Suojanen and Talponen2007).

Both candidate‐ and party‐level VAAs provide voters with easily accessible, personalized information on issue congruence, and therefore have the potential to improve issue representation (Pianzola et al., Reference Pianzola, Trechsel, Vassil, Schwerdt and Alvarez2019; Walgrave et al., Reference Walgrave, Aelst and Nuytemans2008). However, candidate‐level VAAs offer more precise voting advice in elections where voters (also) cast votes for individual candidates as they provide issue congruence estimates specific to candidates. Unlike party‐level VAAs, candidate‐level VAAs therefore capture deviations of candidates from the party line and should, at least in theory, have greater capacity to enhance issue representation in candidate‐based elections compared to purely party‐based VAAs.Footnote 1 However, to what extent this theoretical advantage is realized in practice remains uncertain.

To address this gap, we evaluate the relative effects of candidate‐ and party‐level VAA advice on voters' candidate preferences in the 2021 elections to the Welsh Senedd (i.e., the Welsh Parliament). We do so by integrating a randomized experiment into a real‐world VAA whereby Welsh VAA users were exposed either to candidate‐level VAA advice or to more standard party‐level VAA advice. Our design allows us to, for the first time, test the following hypothesis:

H: Exposure to candidate‐level VAA advice increases the congruence between the policy positions of electoral candidates and voters' candidate preferences compared to party‐level VAA advice.

Our hypothesis and experimental design provide a critical test of the value of candidate‐level VAAs. There is growing observational (Alvarez et al., Reference Alvarez, Levin, Mair and Trechsel2014; Kleinnijenhuis et al., Reference Kleinnijenhuis, Pol, Hoof and Krouwel2019; Walgrave et al., Reference Walgrave, Aelst and Nuytemans2008) and experimental (Germann et al., Reference Germann, Cioroianu, Mendez and Djouvas2025; Garry et al., Reference Garry, Tilley, Matthews, Mendez and Wheatley2019; Germann et al., Reference Germann, Mendez and Gemenis2023) evidence suggesting that party‐level VAAs affect their users' party preferences. The evidence regarding candidate‐level VAAs is more limited, but points in the same direction: voters tend to update their candidate preferences after usage of a candidate‐level VAA (Benesch et al., Reference Benesch, Heim, Schelker and Schmid2023; Tromborg & Albertsen, Reference Tromborg and Albertsen2023). However, while providing useful insights about the effects of VAA usage compared to non‐usage, this literature cannot tell us how the effects of candidate‐level VAAs compare to those of party‐level VAAs. We argue that this question is key for evaluations of the value of candidate‐level VAAs since (1) candidate‐level VAAs tend to be more complex to set up and (2) the advice provided in candidate‐ and party‐level VAAs tends to be highly correlated.

Candidate‐level VAAs tend to be more complex to set up than party‐level VAAs because they multiply the logistical effort in terms of measurement, information retrieval and programming. VAAs are typically deployed before legislative elections, which often feature hundreds or even thousands of candidates. As a result, the set‐up of a candidate‐level VAA tends to require the measurement of the policy positions of many more political actors compared to party‐level VAAs. To manage the resulting logistical effort, the developers of candidate‐level VAAs often resort to candidate surveys, which are more easily scalable compared to their main alternative: expert coding based on publicly available materials such as manifestos or speeches (Gemenis, Reference Gemenis2013). Still, candidate surveys make it necessary to locate contact information for large numbers of candidates, inviting them to participate in the survey, sending reminders, and not uncommonly engaging with candidates on an individual basis to address questions and clarify details. As a result, the measurement process tends to be more labour‐intensive and time‐consuming in candidate‐level VAAs. What is more, candidate‐level VAAs often also require the collection of several pieces of supplementary information that are not needed in party‐level VAAs, such as candidate photos, statements and bios. Finally, programming costs are likely to be higher as candidate‐level VAAs frequently need to generate advice tailored to specific electoral districts (since candidates differ between electoral districts). By contrast, in party‐level VAAs it is generally sufficient to provide a single country‐ or region‐wide policy match, rendering them less complex to set up.

The higher costs associated with candidate‐level VAAs would be worth it if they provided significant additional value. However, it is not clear that this is the case. While candidate‐level VAAs provide more precise advice, the substantive differences to party‐level VAA advice are often relatively minor. Candidates sometimes deviate from their parties, including on highly consequential issues. However, most candidates align with their parties on the majority of issues (Hanretty et al., Reference Hanretty, Mellon and English2021; Vivyan & Wagner, Reference Vivyan and Wagner2012). As a result, the voting advice in candidate and party VAAs is likely to be highly correlated. When considering that the effects of VAA usage observed in previous studies tend to be relatively small to begin with, this raises the question whether the differences between candidate and party VAAs are substantial enough to meaningfully change their users' voting preferences. If yes, then this would mean that candidate VAAs are able to deliver on their promise of enhancing issue representation. But if the answer were no, then this would suggest that the more standard party‐level VAAs provide similar value at lower cost.

Experimental design

To assess the relative performance of candidate‐level VAAs, we integrated a randomized experiment into a real‐world VAA called MyVoteChoice. MyVoteChoice was deployed in Wales on 16 April 2021 and remained freely available until the Welsh Senedd election on 6 May 2021. The basic design of MyVoteChoice was analogous to other VAAs (Garzia & Marschall, Reference Garzia, Marschall and Thompson2019). First, users were asked to answer a few general questions about themselves (e.g., their sex, age and level of education) and then to indicate their opinions on 28 policy statements (e.g., ‘There should be no private sector involvement in the NHS in Wales'). The 28 statements were carefully selected by an expert panel to reflect the most salient policy issues at stake in the election (see Online Appendix Section 1 for the complete list). Users were asked to provide their answers on 5‐point Likert scales ranging from ‘completely disagree’ to ‘completely agree’. Users also had a ‘no opinion’ option. Subsequently, users were exposed to estimates of issue congruence (the ‘voting advice') based on their answers to the 28 policy statements. However, MyVoteChoice differed from many other VAAs in that it not only offered users personalized information on what parties are closest to them on policy issues, but also on which individual candidates are closest to them.

Wales offers an ideal context for our experiment due to the electoral system in place for the 2021 Senedd elections. Specifically, the Senedd was elected using a mixed‐member system, broadly similar to that of Germany or New Zealand. This meant that voters cast two votes: the first was to elect a single representative for each of 40 territorial constituencies and used the Westminster (first‐past‐the‐post) system; the second was to elect 20 additional members based on a proportional top‐up system in which voters vote for regional (closed) party lists. Expressed differently, the first vote was for a single candidate; and the second effectively for a party (Jones & Scully, Reference Jones and Scully2006; Larner et al., Reference Larner, Wyn Jones, Poole, Surridge and Wincott2022). As a result, both the candidate‐ and the party‐level VAA advice were meaningful to Welsh voters. The candidate‐level advice, which featured constituency candidates but not additional candidates from the closed party lists, was most directly relevant for the constituency elections. The party‐level advice, on the other hand, was most directly relevant for the second, proportional vote. However, most candidates belong to parties, so the party‐level advice also had some relevance for the constituency elections.

The experimental manipulation consisted of whether users were first exposed to the candidate‐ or the party‐level advice (see Figure 1). By randomizing which type of advice users saw first, we are able to test whether the candidate‐level advice increases the match between users’ voting preferences in the constituency elections and candidates’ policy preferences. To implement this test, users were asked about their vote intentions in the constituency elections immediately after seeing either the candidate‐ or the party‐level advice on the next screen. Specifically, voters were presented with four ‘propensity to vote’ (PTV) questions asking how likely it is that they would vote for the constituency candidates from the four major parties in Wales (Labour, Conservatives, Plaid Cymru and Liberal Democrats) on a scale from 0 to 10. In combination, candidates from those four parties garnered 91.1 per cent of the constituency votes and they were the only parties to gain representation in the Senedd. Finally, users could proceed to the full set of VAA results including both party‐ and candidate‐level bar charts. Online Appendix Section 2 contains screenshots of an example run through the VAA.

Figure 1. Experimental design.

Both the candidate‐ and the party‐level VAA advice took the form of a bar chart which, respectively, ranked the candidates or parties according to the degree of issue congruence. The underlying issue congruence scores were designed with a theoretical range from ‐100 (complete disagreement) to +100 (complete agreement). In practice, congruence scores below −70 or above 80 were rarely achieved. The party‐level advice featured the name of the parties and party logos, while the candidate‐level advice featured candidate names and photos. Issue congruence was calculated using a standard algorithm, which takes into account proximity on issues, preference intensity and the number of ‘no opinions’ (Mendez, Reference Mendez2012).

To identify the policy positions of political parties and constituency candidates, we independently contacted (1) party headquarters and (2) constituency candidates and invited them to provide their positions on each of the 28 issue statements. Candidates and party headquarters were informed that their answers would only be considered if they answered all 28 policy statements and, unlike application users, did not have a ‘no opinion’ option. All four major parties participated in the survey as did another four smaller parties (Greens, UKIP, Abolish the Welsh Assembly, and GWLAD). We manually coded the positions of a ninth party (Reform UK) based on the party's manifesto and leaders' speeches. At the same time, 85 of 309 constituency candidates participated in the candidate survey (28 per cent). Among the major party candidates we study below, the response rate was somewhat better (37 per cent). While a higher response rate would have been desirable, response rates between 20 per cent and 50 per cent are relatively standard in candidate surveys (CCS, 2016, 2022). Users assigned to the control group were shown a ranking of all nine parties while users assigned to the treatment group saw a ranking of 4–10 candidates, depending on the number of candidates in a user's constituency. A majority of users (70 per cent) saw between five and seven candidates. Importantly, if a candidate did not participate in the survey, the ranking was based on the positions of their party. Independent candidates and candidates from tiny parties not included in the party survey were dropped entirely if they did not participate in the candidate survey.

MyVoteChoice was broadly advertised on Welsh news websites and promoted through paid advertisements on Google, Facebook and Instagram. Around 18,000 voters ended up using the application, approximately 10,000 of whom were exposed to the experimental manipulation described above. A little over 6500 users answered at least one PTV question and are, therefore, included in the analyses reported below. We exclude suspected repeated attempts by the same individuals and other invalid entries from all analyses (see Online Appendix Section 3).

VAA samples tend not to be representative of the broader voter population (Marschall & Schmidt, Reference Marschall, Schmidt, Farrell and Schmitt‐Beck2008; Van de Pol et al., Reference Van de Pol, Holleman, Kamoen, Krouwel and De Vreese2014). Our sample is no exception in this regard and, in particular, overrepresents younger and more highly educated voters (see Table 1). Sampling biases such as these are quite typical of VAAs, which should improve confidence that our results can be generalized to VAA user populations in other contexts. Finally, Table 1 shows that there are no statistically significant differences between the treatment and the control groups in terms of key demographics, as we would expect under random assignment.

Table 1. Sample descriptives including population reference figures

Note: Population figures are drawn from the 2021 census and official voting records.

Results

As a preliminary step, we begin by briefly exploring differences between the positions of candidates and their parties, and what they mean for the voting advice that is, respectively, provided by the candidate and party VAAs. We only summarize our findings here; see Online Appendix Sections 4 and 5 for the full discussion. In short, we find that Welsh constituency candidates (unsurprisingly) often follow the party line. Still, Welsh parties are not monolithic blocks. The average correlation between the positions of constituency candidates and their parties across all 28 issues included in the VAA is around 0.60 – a high value, but a significant step away from full intra‐party consensus. Candidates were particularly likely to deviate from the party line on selected issues, such as the centralization of emergency services in large hospitals or whether Wales should exercise its power to set income tax rates.

Given the strong correlations between candidate and party positions, it should not come as a surprise that the party‐ and candidate‐level VAAs often suggested similar conclusions. At r = 0.90, the ranking of candidates in the candidate‐level VAA is very highly correlated with the ranking of parties in the party‐level VAA. The correlation decreases somewhat, but remains strong, when restricting the sample to candidates who participated in the candidate survey, and for whom the policy positions were therefore potentially different from their party's (r = 0.73). The underlying continuous advice scores are even more strongly correlated.

Still, despite these high correlations, the candidate‐ and the party‐level VAAs provided substantially different advice to some VAA users. Most notably, we observe significant differences when it comes to the most important element of a VAA: who comes first in the ranking. Specifically, we find that the top‐ranked choice was different for 30 per cent of users. In other words, for about every third user, the candidate‐level VAA recommended candidate A from party B as the closest policy match while the party‐level VAA recommended party C. This share increases in districts where more candidates participated in the candidate survey.

Are those differences substantial enough to alter users' candidate preferences? We begin to test the effect of exposure to candidate‐level versus party‐level VAA advice by running a linear regression explaining VAA users' propensity to vote for a candidate. Since users were presented with four PTV questions, we stack our data in this and all other analyses reported below such that there are four observations per user: one each for the candidate from Labour, the Conservatives, Plaid Cymru and the Liberal Democrats. The unit of analysis is therefore always the user × candidate combination.

We establish the relative effect of exposure to candidate‐level VAA advice by interacting our treatment group indicator with the level of issue congruence between a user and a candidate. The treatment group indicator is coded 1 if a user was exposed to candidate‐level VAA advice and 0 if a user was exposed to party‐level VAA advice. We measure candidate‐level issue congruence using the ranking of candidates in the candidate‐level VAA. We use factorized ranks (i.e., introduce separate binary variables for the closest, second‐closest, third‐closest, etc. candidate) so as to flexibly estimate treatment effects across different levels of issue congruence. Since only the treatment group actually saw the candidate ranking while the control group saw a party ranking, the interactions between treatment status and the factorized ranks reflect the relative effect of exposure to candidate‐level VAA advice. Measuring candidate‐level issue congruence using the continuous −100 to +100 congruence scores instead of factorized ranks leads to substantively similar results (see Online Appendix Section 6). To improve precision, we include candidate fixed effects as well as several covariates, including users' gender, age, educational attainment, interest in the election and past vote choice (see Online Appendix Section 7 for details on measurement). All covariates were measured pre‐treatment (i.e., before exposure to any VAA advice). We cluster standard errors at the user level to account for intra‐user dependencies and use listwise deletion to deal with missing values.

Model 1 in Table 2 shows the regression results while Figure 2 visualizes the implied marginal effects. We find that being exposed to candidate‐ instead of party‐level VAA advice has an effect on users' candidate evaluations. Specifically, we find that exposure to the information that a candidate is one's closest match increases a user's propensity to vote for that candidate by 0.25 points on a 0–10 scale (p<>0.05) relative to users of the party‐level VAA (see the blue estimates in the left panel of Figure 2). We also observe some differences for lower‐ranked candidates; however, those differences are smaller and lack statistical significance.

Table 2. Regression models estimating the effects of exposure to candidate‐level VAA advice versus exposure to party‐level VAA advice on candidate preferences

Note: The table shows linear regression coefficients with standard errors clustered by VAA user in parentheses. PTV = propensity to vote for a candidate; Vote intention = intention to vote for a candidate.

+ p < >0.10 , p<>0.05, p<>0.01, p<>0.001.

Figure 2. Marginal effects of candidate‐level versus party‐level VAA advice on candidate preferences.

Note: The figure shows the implied marginal effects of exposure to candidate‐level versus party‐level VAA advice in models 1–3 in Table 2 (left panel) and models 4–6 in Table 2 (right panel). The spikes represent 95 per cent confidence intervals.

Our findings suggest that candidate‐level VAA advice increases the match between a user's policy and candidate preferences. Next, we ask what causal mechanism(s) are driving this result. As noted in the introduction, candidate‐level VAAs could improve issue representation because they show substantively different information (i.e., different issue congruence estimates and rankings). However, it is also possible that voters are more likely to follow candidate‐level VAA advice simply due to presentational differences: candidate‐level VAAs show candidate names and photos instead of party names and logos, which voters may see as more relevant when evaluating candidates. Our set‐up allows us to test the relative importance of these two potential mechanisms by subsetting the sample. First, in Model 2 in Table 2 we restrict the sample to candidates who participated in the candidate survey. For these candidates, the policy positions potentially differed from those of their party, and the candidate‐ and party‐level VAA advice therefore also potentially differed. Second, in Model 3 we restrict the sample to candidates who did not participate in the candidate survey. For those candidates, the policy positions were the same as those of their party and the rankings therefore much more similar. However, the presentation was still different.

The results point to the importance of substantive differences in the policy positions of candidates and their parties. When only those candidates are included who participated in the candidate survey, the effect of learning that a candidate constitutes one's best policy match doubles in size to +0.5 points (see the red estimates in Figure 2, left panel). This represents an increase of approximately 15 per cent of a standard deviation – a substantial effect size, especially when considering that previous studies comparing the effects of party‐level VAA advice versus no exposure to VAA advice at all have found effects in the same range (Garry et al., Reference Garry, Tilley, Matthews, Mendez and Wheatley2019; Germann et al., Reference Germann, Mendez and Gemenis2023). Meanwhile, the effects for lower‐ranked candidates also increase in size, but remain statistically insignificant. By contrast, when only candidates who did not participate in the candidate survey are included, most effects decrease in size and the effect of learning that a candidate constitutes one's best policy match can no longer be statistically distinguished from zero (see the estimates in green). These results suggest that it is the differences in policy positions that are driving the relative effect of candidate‐level versus party‐level VAA advice and not the different display format.

So far, we have considered the effects of different types of VAA advice on users' propensity to vote for different candidates and, therefore, their full set of candidate preferences. However, voters ultimately cast a vote for a single candidate in Welsh constituency elections. Arguably, what matters most is therefore whether exposure to candidate‐level VAA advice affects what users consider to be their most‐preferred candidate. In Models 4–6 in Table 2, we therefore repeat the above analysis but estimate the effects on users' binary vote intention. We code the vote intention variable with 1 for the candidate a user assigned the highest propensity to vote for, and 0 for all other candidates.

The results suggest that exposure to candidate‐level VAA advice significantly increases the intention to vote for the candidate that is closest in policy terms. Specifically, when considering all candidates (including those that did not participate in our candidate survey), we find that exposure to candidate‐level VAA advice increases the intention to vote for the top‐ranked candidate from around 60 per cent in the control condition to around 63 per cent in the treatment condition, a difference of about 3 percentage points (p<>0.05). This effect increases to +6 percentage points (p<>0.01) when only considering candidates who participated in the candidate survey and for whom the policy positions therefore potentially differed from those of their party (see the right panel in Figure 2). This suggests that exposure to candidate‐level instead of party‐level VAA advice increases voters' probability of voting for the candidate that is closest to them in policy terms by about 10 per cent. Meanwhile, learning that a candidate constitutes the second‐ or third‐best match does not significantly alter users' vote intention. Finally, we again do not find any significant effects when looking at candidates who did not participate in the candidate survey.

We report several additional robustness checks in Online Appendix Section 6 (besides the above‐mentioned check of using continuous instead of ranked congruence scores). First, for better visibility, the above analysis combined candidates ranked 5th to 10th. As a robustness check, we re‐estimate all models with lower‐ranked candidates separately included. Second, we re‐estimate all models while not including any covariates. Third, we drop speeders, defined as users who completed the VAA in less than half of the average completion time. Fourth, we re‐estimate the vote intention models using logistic instead of linear regression. Finally, we re‐estimate the vote intention models while dropping users with tied vote intentions. The results are always substantively similar.

Conclusion

This study assessed the value of candidate‐level VAAs. Contrary to previous studies, we did not estimate the effect of using a candidate‐level VAA relative to non‐usage, but compared the effects of receiving candidate‐level VAA advice with the effects of receiving party‐level VAA advice. We argued that this represents a critical test of the value of candidate‐level VAAs since they tend to be significantly more labour‐intensive to produce than party‐level VAAs, but often suggest qualitatively similar voting advice. This was borne out in our analysis, where we observed high correlations between party‐ and candidate‐level VAA advice. Still, for a significant minority of users, the advice provided was substantively different, and our experimental findings suggest that these differences were sufficient to cause substantially sized changes in VAA users' candidate evaluations.

Our results point to the value of candidate‐level VAAs as a mechanism to strengthen issue representation in candidate‐based elections. Elections in which voters can express preferences not just for political parties but also for individual candidates have become increasingly common in recent decades (Renwick & Pilet, Reference Renwick and Pilet2016). However, a consistent finding from previous research is that issue representation is particularly low in candidate‐based elections. One likely explanation is that information about candidates' issue stances can be hard to find. Candidate‐level VAAs significantly reduce the cost to voters of acquiring information about candidates' issue stances, and the results of this study suggest that exposure to this kind of information can significantly increase issue representation. The provision of candidate‐level VAA advice instead of, or in addition to, party‐level VAA advice, helps voters avoid voting for ideologically more distant candidates, if they so wish.

Our results are based on a randomized experiment (thus strengthening internal validity) which we integrated into a real‐world VAA (thus strengthening external validity) and draw on a large sample (thus mitigating concerns related to statistical power). That said, an important limitation of our experimental design is that we can only measure short‐term effects. Ultimately, all participants are exposed to both party‐ and candidate‐level VAA advice in our set‐up, preventing us from establishing longer term effects. Therefore, future research should explore the durability of the effects we report. There are, however, grounds for optimism. Existing studies of the effects of VAA usage relative to non‐usage suggest that voters remember VAA advice several weeks after usage and that it affects their behaviour at the ballot box (Germann et al., Reference Germann, Cioroianu, Mendez and Djouvas2025; Kleinnijenhuis et al., Reference Kleinnijenhuis, Pol, Hoof and Krouwel2019). Analogously, it seems likely that the relative effects of candidate‐level VAA advice are at least somewhat durable.

Our evidence also pertains to a specific electoral context: Wales. While additional studies are necessary to establish the generalizability of our result, we would argue that it is unlikely that Wales represents a singular case. Welsh voters may have a limited understanding of the policy positions of individual candidates (Wheatley & Germann, Reference Wheatley and Germann2024). But Wales hardly represents an outlier in that regard (Hanretty et al., Reference Hanretty, Mellon and English2021; Rogers, Reference Rogers2017; von Schoultz & Papageorgiou, Reference Schoultz and Papageorgiou2021). If candidate‐level VAAs improve issue representation in Wales, they should therefore principally be able to do the same elsewhere. In particular, candidate‐level VAAs may have advantages in electoral contexts where many candidates compete for the same seats and informational complexity is therefore high. Furthermore, the advantages of candidate‐level VAAs are likely to be pronounced in electoral systems where candidates from the same parties are in competition with each other and, therefore, have incentives to develop a distinct policy profile. Prominent examples of this include open‐list proportional representation (e.g., Finland) or the single transferable vote (e.g., Ireland).

Finally, a key challenge suggested by our study is the achievement of a high response rate in candidate surveys. Despite our best efforts, we ‘only’ achieved a response rate of 28 per cent. While consistent with response rates in other candidate surveys, a higher response rate would clearly be desirable. Fortunately, cross‐country evidence suggests that significantly higher response rates are possible. A striking example is the Swiss VAA smartvote, which regularly achieves response rates of 75–85 per cent in candidate surveys. A key difference between our VAA and smartvote is the lack of precedent in our case while smartvote has been continuously available before major Swiss elections since 2003. Furthermore, smartvote is used by a larger portion of the electorate, providing candidates with stronger incentives to participate in the candidate survey. This suggests that candidate‐level VAAs are best approached with continuity in mind rather than as one‐off projects.

Acknowledgements

For their helpful contributions to the development and dissemination of the MyVoteChoice application, we would like to thank Roger Awan‐Scully, Jonathan Bradbury, Anwen Elias, Jac Larner, Huw Lewis and Laura McAllister. Thank you also to Wales Online for sharing MyVoteChoice on their website and Llyr ab Einion for translating the content of the platform into Welsh. We are indebted to Louis Bromfield for excellent research assistance. An earlier version of this paper was presented at a workshop at the University of Konstanz. Thank you to all participants for their valuable comments and suggestions. We gratefully acknowledge funding from the British Academy (SRG20\200273) and the UK Economic and Social Research Council (ES/W000598/1).

Conflicts of interest statement

We do not have any conflict of interest.

Data availability statement

All data and statistical code necessary for replicating the analyses reported in this paper can be accessed in the Harvard Dataverse at https://doi.org/10.7910/DVN/47XXEN.

Ethics statement

This study was approved by Oxford Brookes University's Research Ethics Committee (L19183).

Table A1: MyVoteChoice issue statements

Figure A1: Example Screenshots

Table A2: Data cleaning

Figure A2: Level of agreement between candidates and their parties on 28 policy issues

Figure A3: Heat maps comparing party‐ and candidate‐ level VAA advices cores

Figure A4: Non‐linear interactions

Table A3: No rank cap

Figure A5: Marginal effects (no rank cap)

Table A4: Models without covariates

Figure A6: Marginal effects (no covariates)

Table A5: Models without speeders

Figure A7: Marginal effects (no speeders)

Table A6: Logistic regressions

Figure A8: Marginal effects (logistic regressions)

Table A7: Removing tied vote intentions

Figure A9: Marginal effects (PTV ties removed)

Footnotes

1 In theory, VAA users may also perceive candidate‐level VAAs as more relevant in the context of candidate‐based elections because of visual cues (e.g., the presence of candidate names and pictures). However, as we show below, visual cues alone did not make voters more likely to follow the advice of candidate‐level VAAs in our study.

References

Alvarez, R. M., Levin, I., Mair, P., & Trechsel, A. H. (2014). Party preferences in the digital age: The impact of voting advice applications. Party Politics, 20(2), 227236.10.1177/1354068813519960CrossRefGoogle Scholar
Arter, D. (2014). Clowns, ‘alluring ducks’, and ‘Miss Finland 2009’: The value of ‘celebrity candidates’ in an open‐list PR voting system. Representation, 50(4), 453470.10.1080/00344893.2014.982693CrossRefGoogle Scholar
Bartels, L. M. (1996). Uninformed votes: Information effects in presidential elections. American Journal of Political Science, 40(1), 194230.CrossRefGoogle Scholar
Benesch, C., Heim, R., Schelker, M., & Schmid, L. (2023). Do voting advice applications change political behavior? Journal of Politics, 85(2), 684700.10.1086/723020CrossRefGoogle Scholar
Bovitz, G. L., & Carson, J. L. (2006). Position‐taking and electoral accountability in the U.S. House of Representatives. Political Research Quarterly, 59(2), 297312.10.1177/106591290605900211CrossRefGoogle Scholar
Carey, J. M. (2007). Competing principals, political institutions, and party unity in legislative voting. American Journal of Political Science, 51(1), 92107.10.1111/j.1540-5907.2007.00239.xCrossRefGoogle Scholar
CCS (2016). Comparative Candidates Survey Module I – 2005–2013 [Dataset ‐ Cumulative File]. Distributed by FORS, Lausanne.Google Scholar
CCS (2022). Comparative Candidates Survey Module II – 2013–2018 [Dataset ‐ Cumulative File]. Distributed by FORS, Lausanne.Google Scholar
Costello, R., Toshkov, D., Bos, B., & Krouwel, A. (2021). Congruence between voters and parties: The role of party‐level issue salience. European Journal of Political Research, 60(1), 92113.10.1111/1475-6765.12388CrossRefGoogle Scholar
Delli Carpini, M., & Keeter, S. (1996). What Americans know about politics and why it matters. Yale University Press.Google Scholar
Enelow, J. M., & Hinich, M. J. (1984). The spatial theory of voting: An introduction. Cambridge University Press.Google Scholar
Fisher, S. D., Heath, A. F., Sanders, D., & Sobolewska, M. (2015). Candidate ethnicity and vote choice in Britain. British Journal of Political Science, 45(4), 883905.CrossRefGoogle Scholar
Garry, J., Tilley, J., Matthews, N., Mendez, F., & Wheatley, J. (2019). Does receiving advice from voter advice applications (VAAs) affect public opinion in deeply divided societies? Evidence from a field experiment in Northern Ireland. Party Politics, 25(6), 854861.10.1177/1354068818818789CrossRefGoogle Scholar
Garzia, D., & Marschall, S. (2019). Voting advice applications. In Thompson, W. (Ed.), Oxford Research Encyclopedia. Oxford University Press. https://doi.org/10.1093/acrefore/9780190228637.013.620Google Scholar
Gelman, A., & King, G. (1990). Estimating incumbency advantage without bias. American Journal of Political Science, 34(4), 11421164.10.2307/2111475CrossRefGoogle Scholar
Gemenis, K. (2013). Estimating parties' positions through voting advice applications: Some methodological considerations. Acta Politica, 48, 268295.10.1057/ap.2012.36CrossRefGoogle Scholar
Germann, M., Cioroianu, I., Mendez, F., & Djouvas, C. (2025). The effects of voting advice applications: New experimental evidence (Mimeo). University of Bath.Google Scholar
Germann, M., & Gemenis, K. (2019). Getting out the vote with voting advice applications. Political Communication, 36(1), 149170.10.1080/10584609.2018.1526237CrossRefGoogle Scholar
Germann, M., Mendez, F., & Gemenis, K. (2023). Do voting advice applications affect party preferences? Evidence from field experiments in five European countries. Political Communication, 40(5), 596614.10.1080/10584609.2023.2181896CrossRefGoogle Scholar
Grand, P., & Tiemann, G. (2013). Projection effects and specification bias in spatial models of European Parliament elections. European Union Politics, 14(4), 497521.CrossRefGoogle Scholar
Hanretty, C., Mellon, J., & English, P. (2021). Members of parliament are minimally accountable for their issue stances (and they know it). American Political Science Review, 115(4), 12751291.10.1017/S0003055421000514CrossRefGoogle Scholar
Highton, B. (2019). Issue accountability in U.S. House elections. Political Behavior, 41(2), 349367.10.1007/s11109-018-9454-8CrossRefGoogle Scholar
Isotalo, V., Mattila, M., & vonSchoultz, s. (2020). Ideological mavericks or party herd? The effect of candidates' ideological positions on intra‐party success. Electoral Studies, 67, 102187.10.1016/j.electstud.2020.102187CrossRefGoogle Scholar
Jones, R. W., & Scully, R. (2006). Devolution and electoral politics in Scotland and Wales. Publius: The Journal of Federalism, 36(1), 115134.10.1093/publius/pji034CrossRefGoogle Scholar
Kauppinen, T. (2007). Vaalikoneiden tekninen toteutus. In Suojanen, M. & Talponen, J. (Eds.), Vallaton vaalikone (pp. 127156). Minerva Kustannus Oy.Google Scholar
Kleinnijenhuis, J., van dePol, J., vanHoof, A. M., & Krouwel, A. P. (2019). Genuine effects of vote advice applications on party choice: Filtering out factors that affect both the advice obtained and the vote. Party Politics, 25(3), 291302.CrossRefGoogle Scholar
Larner, J. M., Wyn Jones, R., Poole, E. G., Surridge, P., & Wincott, D. (2022). Incumbency and identity: The 2021 Senedd Election. Parliamentary Affairs, 76(4), 857878.10.1093/pa/gsac012CrossRefGoogle Scholar
Lau, R. R., Patel, P., Fahmy, D. F., & Kaufman, R. R. (2014). Correct voting across thirty‐three democracies: A preliminary analysis. British Journal of Political Science, 44(2), 239259.10.1017/S0007123412000610CrossRefGoogle Scholar
Marschall, S., & Schmidt, C. (2008). Preaching to the converted or making a difference? Mobilizing effects of an internet application at the German General Election 2005. In Farrell, D. & Schmitt‐Beck, R. (Eds.), Non‐party actors in electoral politics (pp. 259278). Nomos.10.5771/9783845206639-259CrossRefGoogle Scholar
McElroy, G., & Marsh, M. (2010). Candidate gender and voter choice: Analysis from a multimember preferential voting system. Political Research Quarterly, 63(4), 822833.CrossRefGoogle Scholar
Mendez, F. (2012). Matching voters with political parties and candidates: An empirical test of four algorithms. International Journal of Electronic Governance, 5, 264278.10.1504/IJEG.2012.051316CrossRefGoogle Scholar
Pianzola, J. (2014). Swing voting due to smartvote use? Evidence from the 2011 Swiss Federal Elections. Swiss Political Science Review, 20(4), 651677.10.1111/spsr.12120CrossRefGoogle Scholar
Pianzola, J., Trechsel, A. H., Vassil, K., Schwerdt, G., & Alvarez, R. M. (2019). The impact of personalized information on vote intention: Evidence from a randomized field experiment. Journal of Politics, 81(3), 833847.10.1086/702946CrossRefGoogle Scholar
Rahn, W. M. (1993). The role of partisan stereotypes in information processing about political candidates. American Journal of Political Science, 37(2), 472496.10.2307/2111381CrossRefGoogle Scholar
Renwick, A., & Pilet, J.‐B. (2016). Faces on the ballot: The personalization of electoral systems in Europe. Oxford University Press.10.1093/acprof:oso/9780199685042.001.0001CrossRefGoogle Scholar
Rogers, S. (2017). Electoral accountability for state legislative roll‐calls and ideological representation. American Political Science Review, 111(3), 555571.10.1017/S0003055417000156CrossRefGoogle Scholar
Shugart, M. S., Valdini, M. E., & Suominen, K. (2005). Looking for locals: Voter information demands and personal vote‐earning attributes of legislators under proportional representation. American Journal of Political Science, 49(2), 437449.Google Scholar
Tromborg, M. W., & Albertsen, A. (2023). Candidates, voters, and voting advice applications. European Political Science Review, 15(4), 582599.CrossRefGoogle Scholar
Van de Pol, J., Holleman, B., Kamoen, N., Krouwel, A., & De Vreese, C. (2014). Beyond young, highly educated males: A typology of VAA users. Journal of Information Technology & Politics, 11(4), 397411.10.1080/19331681.2014.958794CrossRefGoogle Scholar
Vivyan, N., & Wagner, M. (2012). Do voters reward rebellion? The electoral accountability of MPs in Britain. European Journal of Political Research, 51(2), 235264.CrossRefGoogle Scholar
vonSchoultz, s., & Papageorgiou, A. (2021). Policy or person? The electoral value of policy positions and personal attributes in the Finnish open‐list system. Party Politics, 27(4), 767778.10.1177/1354068819891048CrossRefGoogle Scholar
Walgrave, S., vanAelst, P., & Nuytemans, M. (2008). ‘Do the vote test’: The electoral effects of a popular vote advice application at the 2004 Belgian Elections. Acta Politica, 43(1), 5070.10.1057/palgrave.ap.5500209CrossRefGoogle Scholar
Wheatley, J., & Germann, M. (2024). Do candidates' policy positions matter in regional elections? Evidence from the 2021 elections to the Welsh Senedd. Regional & Federal Studies. Advance online publication. https://doi.org/10.1080/13597566.2024.2399694CrossRefGoogle Scholar
Figure 0

Figure 1. Experimental design.

Figure 1

Table 1. Sample descriptives including population reference figures

Figure 2

Table 2. Regression models estimating the effects of exposure to candidate‐level VAA advice versus exposure to party‐level VAA advice on candidate preferences

Figure 3

Figure 2. Marginal effects of candidate‐level versus party‐level VAA advice on candidate preferences.Note: The figure shows the implied marginal effects of exposure to candidate‐level versus party‐level VAA advice in models 1–3 in Table 2 (left panel) and models 4–6 in Table 2 (right panel). The spikes represent 95 per cent confidence intervals.