What Makes a Good Review
As editors of the American Political Science Review, we are very grateful to our reviewers for the invaluable service they provide when reviewing submitted manuscripts. We appreciate all the excellent reviews we receive from our reviewers, and recognize that they are taking time out of their busy schedules to provide constructive criticism to our authors. Because reviews have two audiences—the journal’s editor and the author of the reviewed manuscript—reviewers may sometimes find it difficult to strike the right balance. What makes a good review? In this blog, we provide some advice to potential reviewers about what we hope your review will accomplish for our authors and for us.
Because we primarily use reviews to inform our decisions about whether to accept or reject articles and letters, we read the feedback reviewers provide to authors very carefully. The best reviews discuss the merits and shortcomings of manuscripts, focusing on their main arguments, theoretical contribution, research design, quality of the analysis, and organization and writing.
Excellent reviews explain whether the author(s) have clearly stated their research question(s) and their central thesis; whether they meaningfully engaged relevant literature(s); situated their contribution in a way that makes evident what it adds to extant debates; framed the topic to highlight its significance; and detailed the implications of their argument. They assess the manuscript’s theoretical contribution and, when applicable, its research design and methodology. Is the theoretical contribution novel and compelling? Is the research design appropriate and well executed? Are there methodological errors that should preclude publication? Is the analysis sound, and are the central claims and arguments persuasive?
Last but not least, an excellent review advises the editors about the article’s potential to make an important contribution to political scientists’ understanding of the political world. In other words, what “big” contribution does the paper make? Is it novel? Is it pathbreaking? Does it significantly advance our knowledge about politics, broadly construed? These qualities are the hallmarks of an APSR article.
While many of these questions have yes/no answers on the surface, the best reviewers go above and beyond by providing a “no, but” response. A savvy reviewer sometimes sees a contribution that the manuscript’s author may not have recognized, or can recommend modest shifts in research design, framing, or execution that can make a promising but not wholly successful article significantly stronger. Even if a manuscript is not ultimately destined for publication in the APSR, a critical but constructive review that advises an author on how to strengthen the manuscript or on how to frame or attack the problem can help to make the process worthwhile for the author.
Although only a small percentage of papers submitted to the APSR are published in the journal, detailed and constructive criticism helps authors improve their work, and very often papers that receive a “reject” decision go on, in revised form, to be published elsewhere, thanks in no small part to our reviewers. Regardless of whether we issue a rejection or an invitation to revise and resubmit, you will be notified of the result, and you will also receive a copy of the editors’ decision letter, along with all of the manuscripts’ reviews.
If the manuscript receives an invitation to revise and resubmit, the editors usually send the revised manuscript, along with a memo from the author(s) detailing the changes they have made, to the reviewers of the first draft. Occasionally, one of the original reviewers may be unable to continue in the review process. When this happens, we invite another reviewer with similar expertise to join the review process. In these cases, the new reviewer will read the original manuscript and reviews, along with the revised submission. During the second round of reviews, the editors are interested in determining whether the authors have adequately addressed the reviewers’ concerns. It is particularly helpful if you evaluate the revised manuscript holistically, considering not only whether the authors addressed your concerns, but also whether they addressed the key concerns of the other reviewers, and more generally whether the paper is above the bar for publication in our discipline’s flagship journal. It is not uncommon for authors to receive a second invitation to revise and resubmit. Sometimes reviewers recommend that a paper should be rejected after revision, perhaps because it still needs extensive revisions, or perhaps because the reviewer believes the authors, despite their efforts, cannot address important flaws in the work. If this is the case, the reviewers should say so, and explain their concerns, so that the editors can decide whether to continue to proceed with the manuscript.
We are particularly grateful to reviewers who provide detailed comments on both the manuscripts that they recommend for possible publication and those that they recommend be rejected. Often negative reviews are more thorough and extensive than positive reviews. However, because the editors rely on expert reviewers for advice, we appreciate positive evaluations that explain why the manuscript merits publication. If we receive very cursory comments, we sometimes consult with additional editors on our team, additional reviewers, and/or members of our editorial board. If a reviewer is impressed with a manuscript and feels strongly that it should move forward, a detailed account of why that is the case helps the editorial team fully appreciate the positive evaluation. Reviewers should also not be concerned that an article they believe would make an important contribution to the field might suffer in the review process if they nonetheless take the time to provide detailed advice that will strengthen the article. We always appreciate reviews that engage a manuscript in the spirit of wanting to help the author achieve their full potential, especially when a reviewer is enthusiastic about the article’s prospects for making a major contribution.
Again, we want to acknowledge and express gratitude for our reviewers’ hard work and their expertise. Reviewers are essential to the success of the journal and the research it publishes.
If you are interested in being a reviewer for the APSR, please contact our Managing Editor at apsr@apsanet.org.
If you are interesting in learning more about the peer review process, please see the APSR “instructions for peer reviewers” or CUP’s “A Guide to Peer Reviewing Journal Articles.