Experimentation in the Study of Religion and Politics
- Paul A. DjupePaul A. DjupeDepartment of Political Science, Denison University
- and Amy Erica SmithAmy Erica SmithDepartment of Political Science, Iowa State University
Experiments in religion and politics model a communication system with three elements: who (the sample) is exposed to what (the treatment) and with what potential effect (the outcome). Most experiments in religion and politics focus on one of three types of samples: clergy, the faithful within certain religious groups, or all citizens within a polity. At the core of the experiment is the randomized treatment: an independent variable that the researcher manipulates and randomly assigns to treatment groups that are supposed to be equivalent in all other respects. Certain kinds of treatments tend to be associated with certain kinds of hypothesized outcomes. That is, most experiments in religion and politics involve investigating either (a) how a randomized treatment related to religion affects a political outcome or (b) how a randomized treatment related to politics affects a religious outcome.
There are several types of religious treatments that closely mirror the actual insertion of religion into public life: manipulating candidates’ religious affiliations, behavior, and rhetoric; manipulating appeals attributed to religious elites and institutions; priming subjects’ own religious or political beliefs or manipulating other religious attributes of subjects; manipulating the characteristics of other citizens; and manipulating religious institutional cues received by clergy.
Experimental methods are everywhere now in the study of religion and politics and provide clear benefits for understanding how religion and politics interact. Perhaps most importantly, the method imposes intellectual rigor, helping scholars pin down theoretically and empirically the precise mechanisms involved in the mutual impact between religion and politics. In addition, experimental control enables scholars to assert more confidently the direction of influence among variables that in the real world plausibly influence each other.
In almost every corner of the world’s politics, one feels the robust presence of religion. As citizens display their religious identities and expound religious arguments, bystanders within the public sphere are almost inevitably exposed to a dizzying variety of religious stimuli, which in turn activate and perhaps influence the bystanders’ own religious beliefs, values, and arguments. In fact, the public square engages and affects so many facets of religion that it is often difficult to make sense of it all. And trying to tell tales from empirical observations opens research up to countless counternarratives that are challenging to sort through. There are strong reasons to turn to experimentation.
The benefits of experimentation for studying how religion and politics interact are clear. Perhaps most importantly, the method imposes intellectual rigor. Driven by the dictates of experimental design, the researcher has to simplify the forces under study. This helps scholars pin down theoretically and empirically the precise mechanisms involved in the mutual impact between religion and politics. In addition, experimental control enables scholars to assert more confidently the direction of influence among variables that in the real world plausibly influence each other.
Experimental methods are everywhere now in the study of religion and politics. Appearing at every level of outlet from top-ranked to bottom-ranked and appearing in all of the social sciences, experiments are almost expected features of social scientific research on religion. This article counts almost 80 pieces of research on religion and politics containing at least one experiment, almost all in the past decade.1 Figure 1 shows the distribution of articles over time, documenting the veritable explosion of experimental research after 2009. In the mid-2010s, about 10 articles were being published a year. It was enough of a flow that editors Paul Djupe and Angelia Wilson filled an entire issue of Politics and Religion with experimental work in 2016 (issue 3).
A perfunctory examination of these studies reveals tremendous diversity in the ways religion and politics are studied in experimental environments. How can this variety be categorized and understood? In essence, experiments in religion and politics model a communication system. These systems have three elements: who (the sample) is exposed to what (the treatment) and with what potential effect (the outcome).
At the core of the experiment is the randomized treatment: an independent variable that the researcher manipulates and randomly assigns to treatment groups that are supposed to be equivalent in all other respects. Often in the experiments reviewed here, that treatment is related to religion. Sometimes, though, experimenters randomize other aspects of the communication system.
The outcomes studied take two basic forms: political or religious. Some of the political outcomes include vote choice, partisanship, policy attitudes, cooperation and trust, political tolerance and threat, evaluations of political elites and parties, political participation, and others. The religious outcomes include worship attendance, religious identity, religious authority, reliance on religious sources, and more. Certain kinds of treatments tend to be associated with certain kinds of outcomes. That is, most experiments in religion and politics involve investigating either (a) how a randomized treatment related to religion affects a political outcome or (b) how a randomized treatment related to politics affects a religious outcome.
Finally, determining the appropriate sample involves careful considerations of external validity. That is, in the real world, who is typically exposed to the religious or political “treatments,” or stimuli? Are the religious/political messages under investigation directed toward particular audiences? Are other politically relevant audiences unintentionally exposed to those same messages? Sample considerations are not completely separable from treatments, as some treatments only apply to clergy, for instance. Most experiments in religion and politics focus on one of three types of samples: clergy, the faithful within certain religious groups, or all citizens within a polity.
The next section discusses the wide array of manipulations scholars are using. The following section further explores the diverse samples employed by scholars. Throughout both of those sections, we discuss the outcome variables most commonly associated with different treatments and samples. The penultimate section briefly discusses best practices for scholars designing their own experiments, while the concluding section discusses future directions in experimentation in religion and politics.
The “what” refers to the stimulus, or “treatment,” to which people are exposed. But how to manipulate religion? It was not long ago that the notion of randomizing exposure to religion was regarded as a curious concern. Religion was thought a fixture, something that accreted over time beginning with a solid base of socialization in youth. If religion is “traditional,” then it makes little sense to think about variable treatments or to imagine that political choices would fluctuate in the instant following some simple exposure.
This notion that religion cannot—or at least should not—be manipulated persists in a new guise. In a recent essay, Nielsen (2015, p. 2) asks, “Is it ethical to change the religiosity of experimental subjects to learn how religiosity affects political attitudes and behaviors?” He argues “for a distinction: experimental manipulations that allow measurement of an individual’s religious beliefs, practice, or experience are generally ethical, while manipulations that change an individual’s religious beliefs, practice, or experience are more likely to be unethical” (2015, p. 2). Such treatments might include “telling subjects new information that affects their beliefs and attitudes” (2015, p. 5).
For many religion and politics scholars, this is far too restrictive. The notion of religion as a slowly accreting solid base of beliefs off-limits to research fundamentally mistakes the way religion is inserted into the public sphere and individuals’ daily lives. Wholesale conversion from one religious affiliation to another may indeed be relatively rare, momentous life events. Nonetheless, individuals’ religious beliefs and practices are continuously shifting in slight and subtle ways in response to environmental stimuli. Religious and political actors regularly seek to shape and prime religious considerations. Many citizens receive dozens of messages mixing religious and political content in the course of a week.
In such a context, many experimental treatments are no more invasive than reading the newspaper. For instance, the authors of this article believe it is ethical to inform participants that the Christian Right is active in elections even if the information decreases some participants’ reported religiosity as a result, since such information is widely available in the public sphere. However, providing specific, false, or damaging information would be unethical (e.g., attributing specific views or behaviors to the subject’s own pastor). The subsections that follow describe several types of religious treatments that closely mirror the actual insertion of religion into public life.
Experiments Manipulating Candidates’ Religious Affiliations, Behavior, and Rhetoric
One of the oldest and largest branches of experimentation in religion and politics involves manipulating voter information about or perceptions of candidates’ religious characteristics.2 These scholars have drawn on social psychological theories elucidating how individuals perceive and evaluate each other. The dependent variables involved in candidate studies have been diverse. Most often, the intention has been to understand electoral behavior. Sometimes the goal is simply to gauge prejudice against candidates from particular religious out-groups, especially Muslims, Mormons, Jews, and atheists. Other work focuses on how candidate information shapes voters’ inferences about those candidates—including their ideology and party, competence and intelligence, as well as trustworthiness, patriotism, or religious affiliation itself.
The conceptually simplest experiments manipulating candidate religion aim simply to measure voter preferences for candidates from some religious groups over others. These experiments maintain a relatively static view of religion as a label ascribed to elites. Beginning in the early 2000s, and continuing through the present, scholars have been asking “what if?”: what would happen if an atheist ran for president? a Jew? These questions have in part been driven by the increasing religious diversity of the candidate pool in the United States. For instance, in the wake of Mitt Romney’s 2008 and 2012 presidential campaigns, scholars explored the extent to which American voters might discriminate against Mormon candidates (Calfano, Friesen, & Djupe, 2013; Campbell, Green, & Monson, 2012); Joe Lieberman’s historic vice presidential nomination led Kane, Craig, and Wald (2004) to investigate discrimination against Jewish candidates.
List experimental studies have asked, would voters discriminate against “Religious Outgroup X” if they thought no one was watching (as is the case in the privacy of the polling booth)? Respondents are randomly assigned to receive one of two lists of items and asked to report the number of items with which they agree. For instance, interviewers in Kane et al.’s (2004) study of Americans’ discrimination against Jewish candidates read control group respondents the following prompt:
Now I’m going to read you FOUR things that sometimes make people angry or upset. After I read all four statements, just tell me how many of them upset you. I don’t want to know which ones, just how many:
One: the way gasoline prices keep going up.
Two: professional athletes getting million-plus salaries.
Three: requiring seat belts be used when driving.
Four: large corporations polluting the environment. (p. 284)
Interviewers gave respondents in the treatment group not four but five items; the fifth item read, “Five: a Jewish candidate running for vice president” (p. 284).3
In list experiments, the difference in the number of items reported in the two groups is the key finding of the research; for instance, if respondents in the control condition report on average 2.0 items and respondents in the treatment report on average 2.4 items, researchers deduce that 40 percent of respondents in the treatment chose the experimental item. Researchers can further analyze the differences between treatment and control in varying subpopulations—for instance, testing if levels of discrimination are higher among evangelical Christians. Hence, list experiments enable researchers to estimate population and subpopulation average levels of discrimination, but they do not allow for finer-grained, multivariate analysis of the factors associated with greater or lesser levels of discrimination. Using their list experiment, Kane et al. (2004) found minimal levels of discrimination against Jewish candidates. Nearly a decade later, however, Benson, Merolla, and Geer (2011) found substantial discrimination against atheist and Muslim candidates in a list experimental study.
Most other candidate-related experiments have involved creating fake candidate profiles, holding all aspects of the candidate constant in treatment and control groups, except for key traits that are varied. To explore voter discrimination, researchers gauge how different candidate religious affiliations affect respondents’ reported support for and self-reported likelihood of voting for those candidates. For instance, using such methods, Calfano, Friesen, et al. (2013) found that U.S. voters discriminate against Mormon candidates under some circumstances, which can be mitigated by religious value priming. Outside the United States, Smith (2019) showed that Brazilian evangelical voters are more likely to vote for fake candidates described as evangelical, while Campbell and Cowley (2014) found that giving British parliamentary candidates stereotypically Muslim and Jewish names slightly reduced voter support for those candidates.
Moving beyond religious affiliation, scholars have manipulated other religious characteristics of fake candidates. Boas (2014), for example, explored voter evaluation of evangelical pastor candidates in Brazil (see also Boas, 2016). Meanwhile, many studies manipulate a candidate’s level of religiosity, often without explicitly specifying the candidate’s religious affiliation; in these cases, it seems safe to assume, as Sumaktoyo, Ottati, and Untoro (2016) argue, that voters typically impute the local majority religion to the candidates. Similarly, reminding voters about the candidate’s religious affiliation and the historical voting patterns of the religious group help to reinforce the voting coalition (Boas, 2015).
Benstead, Jamal, and Lust (2015) used photos as the treatment, manipulating the religious/secular dress of fake candidates in Tunisia. More typically, scholars have varied candidates’ supposed levels of religiosity using textual cues (Castle, Layman, Campbell, & Green, 2017; Clifford & Gaskins 2016; McLaughlin & Wise 2014; Smith, 2019; Sumaktoyo et al., 2016).4 McLaughlin and Wise, for instance, found that telling American respondents that the religious candidate had decided to run for office after “prayerful consideration” alienated many voters yet attracted religious voters’ support. Meanwhile, also studying the United States, Castle and coauthors manipulated both the fake candidate’s ascribed level of church engagement and the religious content of his language; more religious candidates were found to attract Republican voters, while more secular candidates attracted Democrats.
In many of the studies discussed until this point, the goal has been to understand approval or support for candidates with different religious characteristics. However, an important group of studies has gone further, exploring how cues regarding candidates’ religious traits can serve as heuristics that voters use to draw inferences about a candidate’s ideology and partisanship (Campbell, Green, & Layman, 2011; McDermott, 2007, 2009; McLaughlin & Thompson, 2016; McLaughlin & Wise, 2014), trustworthiness (Clifford & Gaskins, 2016), and patriotism (Braman & Sinno, 2009).5 One of the earliest studies took as inspiration the erroneous perception that Ted Kennedy was pro-life in 1980 when he was running for president (Granberg, 1985). To understand the cross-sectional results, Granberg primed respondents by asking them for the religious affiliation of the candidates, and those choosing Catholic were more likely to attribute a pro-life stance to Kennedy. In one innovative study, Berinsky and Mendelberg (2005) showed that priming “discredited stereotypes” that respondents rejected (“Jews are shady”) could cue them to rely more strongly on socially acceptable stereotypes (“Jews are liberal”) in evaluating candidate positions.
A related body of work drills into how candidates use religious language or “God talk” to shape the ways voters perceive them. This work goes beyond the black box of religion as a label others ascribe to an individual to consider strategic religious speech. Several authors have shown that using religious rhetoric can boost candidate support, particularly among religious conservatives (Calfano & Djupe, 2009; Chapp, 2012; Sumaktoyo et al., 2016) and those with high levels of “external religious motivation” (Jennings, 2016). Such language can sometimes serve as an effective “dog whistle”—signaling shared religious background to evangelicals while conveying little to religious liberals and the nonreligious (Albertson, 2014). It can also reduce voter prejudice against candidates who are members of religious or racial outgroups (Calfano, Friesen, et al., 2013; Calfano & Paolino, 2010). Finally, God talk not only affects candidate support; it also—perhaps not surprisingly—effectively signals candidate ideology (Calfano, Djupe, & Wilson, 2013; Weber & Thornton, 2012). Conversely, Djupe, Lewis, Jelen, and Dahan (2014) discover that “rights talk”—framing claims with religious implications in the language of rights, rather than religion—signals politicians’ ideological moderation and helps build support for religious liberty for evangelical dissenters (Djupe, Lewis, & Jelen, 2016).
Some of the most interesting work manipulating candidates’ religious traits and language has taken an intersectional approach. A few scholars have asked how candidates’ religious traits intersect with other attributes such as their race and gender. For instance, do U.S. voters evaluate religious African American candidates differently than they evaluate religious White candidates (McLaughlin & Thompson, 2016)? Does religiosity affect Tunisians’ evaluations of female candidates differently from the way it affects their evaluations of male candidates (Benstead et al., 2015)? Or do voters evaluate female candidates differently from male ones, or Black candidates differently from White ones, when they use God talk (Calfano & Djupe 2011; Calfano & Paolino, 2010)? In all cases, the answer is yes—voter perceptions of candidates depend on the complex intersection of candidates’ religion, race, and gender.
Finally, one striking study explored how describing a candidate in various ways could affect the inferences voters drew about his religious affiliation itself (as Muslim or Christian). Studying the U.S. 2008 election, Layman, Kalkan, and Green (2014) sought to understand the widespread but false belief that Barack Obama was Muslim (he is actually Christian). Though the researchers were ethically constrained to present only true information, they manipulated the way Obama was described: with or without his middle name “Hussein” and focusing or not on his family background and childhood exposure to Islam. They found that both respondent ideology and political awareness affected the extent to which the treatment led respondents to report falsely that Obama was Muslim.
Yet the dependent variable in candidate experiments does not always need to be related to candidate inferences or preferences. A new and rapidly growing body of literature reverses the causal arrow, examining how politics affects citizens’ religious affiliations. Thus one intriguing recent study examined whether candidate information—in particular, exposure to fake candidates who exhibited varying levels of religiosity—affected respondents’ own secular orientations (Campbell, Layman, Green, & Sumaktoyo, 2018).
Experiments Manipulating Appeals Attributed to Religious Elites and Institutions
Another approach to experimentation grew from a finding that directly challenged the notion that religion was stable, socialized, and united. Studying the United States, Smith (2008) and Djupe and Gilbert (2009) found that the political speech of Catholic and Protestant (respectively) clergy had essentially no discernable effect on congregants—clergy political opinions and speech patterns were largely uncorrelated with congregant opinions. Instead, Djupe and Gilbert found evidence of defensiveness—disagreement drove down accurate perception of clergy cues. Yet in other contexts, research discussed later indicates that the political positions of clergy do sometimes directly affect congregants’ attitudes. Such mixed findings have motivated scholars to analyze clergy–congregant communications to understand when clergy are able to circumvent congregants’ defenses.
Beyond political messages, researchers have also examined the impact of clergy speech on religious topics. While congregants might be motivated to ignore clergy political speech, few would deny their clergy the role of articulating and interpreting religious messages. Importantly, there is no shortage of religious values (regarding how the world should work and how individuals should act), religious beliefs (regarding how the world works and is constituted), or religious behaviors that may have political effects. Of course, there is no need to explicitly attribute religious cues to religious elites; religious messages can be manipulated experimentally without attributing them to any particular messenger, as if in a vacuum. But it is important to consider theory in which those cues are at least implicitly offered by religious elites in the context of religious institutions (or at least in some context). Those elites have different attributes (e.g., men vs. women in some denominations), and people have often complicated histories with both the elites and their institutions. Or, put another way, would religious messages have the same influence coming from any source in any other context? It is likely or perhaps just plausible that people think about their own clergy and congregation when primed with religious cues of some sort. Fortunately, some research has begun to disentangle these threads and highlight the leverage that can be gained by making the elite or institutional source explicit.
A few experiments have manipulated the physical appearance of the elite source, comparing clergy to other authority figures. Condra, Isaqzadeh, and Linardi (2019) randomly assigned Afghan clerics to wear religious or civilian dress, comparing the effects on charitable donations; they also manipulated the use of a scriptural appeal versus a common good message. They found that clerics were able to induce higher compliance rates but not to increase the size of donations, while including scriptural messages in the cleric condition also increased donations. They concluded that clergy can induce norm compliance, but religious messages are more powerful in inducing generosity than the particular source conveying that message. Similarly, in a lab-in-the-field experiment in Ghana, McCauley (2014b) compared subjects’ cooperation with a Pentecostal preacher versus various forms of a regional “strong man”—the same experimental confederate but dressed and described differently. Examining giving in a dictator game, he found evidence to suggest “Pentecostal exclusivity, excessive allegiance to leaders, and a shift away from ethnic-based patronage to Pentecostal patronage” (p. 761).
Most experimental work in this area manipulates not the physical manifestation of a clergyperson but his or her political or religious speech and opinions. Clergy influence on key public issues has been confirmed across a wide variety of studies, each offering some complications that make aggregation difficult. In the Brazilian context, Boas and Smith (2015; also Smith, 2019) find that campaign-related messages from (hypothetical) evangelical clergy can shift vote choice. And a number of studies examine immigration attitudes in the United States. For instance, there is some evidence that pro-immigration messages from in-group clergy (from the same denomination) are able to move Americans’ opinion on immigration, though the degree of influence depends on the religiosity of the recipient (Wallsten & Nteta, 2016). Similarly, Margolis (2018a, 2018b) finds that American evangelicals’ attitudes on immigration shifted in response to the advertised messages of the Evangelical Immigration Table, though immigration reform opponents were demobilized by them. More general messages of tolerance also seem to work. Respondents exposed to a clergy’s argument to be respectful of all people expressed warmer feelings toward immigrants and more liberal immigration attitudes as a result (Djupe, Neiheisel, & Olson, 2015).
However, other work has found effects conditional to time—evangelicals exposed to anti-Trump messages from a credible religious elite in the 2016 election expressed less warmth toward the Republican nominee in September, but similar messages did nothing a week before the election (Djupe & Calfano, 2018). In the case of evangelical support for Trump, partisanship appears to dominate religious considerations.
Likewise, other work finds that in-groups are not necessarily ready consumers of whatever arguments are proffered to them. Evangelicals have always lagged behind others in their support for environmental protection, which made the National Association of Evangelicals’ shift to support for taking action on climate change in 2003 potentially highly influential. Experimental evidence suggested that the particular justification clergy offered for the decision mattered (Djupe & Gwiasda, 2010). Using an evangelical decision-making process (through reflection and prayer) was influential for evangelicals, but only among those who were not personally invested in the issue (captured through low issue importance). Another study affirmed the mechanism—that credibility and trust go up when arguments are accompanied by a trusted decision process language (Djupe & Calfano, 2009; see also Djupe et al., 2016).
A good amount of other work has found religious elite influence bounded by other considerations. In their study of reactions to extreme proposals calling for stripping rights and liberties from an opponent, Calfano and Djupe (2015) found that participants summarily dismissed and ignored clergy advocating for gay rights. They judged anti-gay rights clergy, especially evangelical clergy, as credible, and more so when the clergy expressed intolerant opinions (stripping rights from those they disagreed with—in this case lesbian, gay, bisexual, and transgender activists). Adoption of their arguments depended on in-group status, and intolerant appeals only received less support from non-evangelicals. That is, evangelicals supported the in-group clergyperson, even when they called for a clearly unconstitutional “law to stop homosexuals from lobbying for their immoral agenda.”
Other work offers almost painful complications to theories of clergy credibility. For instance, McCauley (2014a) finds that the effectiveness of postconflict prejudice reduction strategies in the Ivory Coast depends on the religious group. Muslims react well to theological messages regardless of the religious or political source delivering them, while Christians react well to politicians delivering an anti-bias message regardless of whether it has theological content. Adkins, Layman, Campbell, and Green (2013) find that when religious and nonreligious leaders’ stances are presented in opposing pairs, those stances primarily tend to move liberals, Democrats, and secular respondents away from religious leaders’ positions, and especially those attributed to evangelical leaders—thus more out-group rejection than in-group embrace of positions. In contrast, Robinson (2010) finds evangelical activists are more likely to embrace a religious elite’s argument when the elite is plausibly within the Christian conservative movement than when the elite is outside the movement (Catholics vs. mainline Protestants in this case), especially when the activists have had greater contact with that group.
To summarize, a large body of research demonstrates that religious elites’ political and religious positions can affect citizens’ attitudes and behavior on a very wide array of public issues. However, clergy do not always fulfill their potential. The barriers to religious elite influence depend in part on whether clergy adopt behavior and communication strategies that send signals of credibility to adherents. Even more importantly, though, clergy influence also depends on the broader social and political context—including the strength of partisan and ethnic ties, the dominant political and secular norms, and the strength of messages citizens received from other, nonreligious, social and political elites.
Yet it is important to note that the contextual limits on religious influence apply to religious influence on politics more broadly—they do not only inhibit clergy influence in particular. For instance, in the Brazilian context, Smith (2019) finds that citizen adherence to secular norms conditions their responses to information about candidate religiosity. Citizens more strongly committed to separation of church and state are turned off by candidates who advertise their religiosity, while those who favor the intermixing of church and state are attracted to candidates who publicize their own religiosity. In short, context and norms likely always impose limits on the scope of religious influence on politics.
Experiments Priming Subjects’ Own Religious or Political Beliefs or Manipulating Other Religious Attributes of Subjects
Can researchers randomize whether citizens are, say, Buddhists or Christians? As discussed earlier, experiments involving religion face a natural limit: it is probably impossible to randomly assign individuals to one religious tradition or another. Even if it were possible, most people would likely consider doing so unethical. Yet creative researchers have found partial workarounds. In one shrewd approach, Clingingsmith, Khwaja, and Kremer (2009) studied the effects of an actual lottery drawing for Pakistanis to participate in the annual Hajj (pilgrimage) to Mecca. The scholars concluded that performing Hajj attaches participants to the international form of the religion and less to the localized forms.
It is also possible to create a sense of religious experiences. Throughout research in this area, there is a tight connection between observational research and experimentation. Hirsh, Walberg, and Peterson (2013) ask, if religious people tend to be conservative and “spiritual” people tend to be liberal, why? The researchers induced subjects to complete a four-minute, guided meditation exercise delivered by video, expecting that spiritualism that involves the “dissolution of self-boundaries and an enhanced sense of connection with the world” (p. 15) would lead to more liberal orientations. Indeed, the treatment reduced participants’ levels of social dominance orientation, an orientation closely linked to conservative political attitudes and identity.
Yet more commonly, scholars seeking to test the impact of subjects’ religious experiences prime participants with religious elements of their own traditions. In effect, they offer a reminder of some message citizens have likely been exposed to before. Priming is the act of raising a consideration in memory so that future decisions may draw upon that consideration. The essential logic is that people have a wide variety of considerations that compete for their attention and that, over time, religious messages get buried by secular ones. The exhortation from Christian clergy that religion is not just a Sunday practice explicitly acknowledges the need to keep religion “at the top of the mind.”
There are now several strands of priming work: some prime respondents’ beliefs and behaviors, some prime their religious identity, and others prime religious values. This section takes them up in turn.
Perhaps the simplest type of prime stimulates respondents to ponder words associated with their own religious tradition. Scholars might give respondents puzzles that induce them to reflect on words such as “God,” “Jesus,” “Mohammed,” or “karma.” For example, Shariff and Norenzayan (2007) asked randomly selected respondents to unscramble sentences that included five target words: spirit, divine, God, sacred, and prophet. Such studies provide evidence that religious reminders affect behavior, promoting trust and cooperation and inhibiting social defection, perhaps because the primes remind subjects that God is watching and will punish noncompliance (e.g., Gervais & Norenzayan, 2012; Shariff & Norenzayan, 2007). Word primes also affect broader social and political dispositions. It turns out that priming Buddhist respondents with Buddhist concepts decreases ethnic prejudice in most cases (Clobert, Saroglou, & Hwang, 2015)—the opposite finding of priming Christian respondents with basic concepts from their own religion (Johnson, Rowatt, & LaBouff, 2010).
A surprisingly uncommon approach is to prime particular religious beliefs. When Be’ery and Ben-Nun Bloom (2015) primed the message that God is in control, it served to elevate support for the welfare state, not opposition to it as cross-sectional studies have found from those with higher religiosity. Likewise, priming the self-affirming message of the “God-given potential” citizens possess (emphasis in original) in Nairobi, Kenya, led to greater political participation (McClendon & Riedl, 2015). And studying Italy, France, Ireland, and Turkey, Warner, Kilinc, Hale, Cohen, and Johnson (2015) primed subjects’ own religious beliefs by asking them to write an essay on one of six topics: “duty to God, community expectations, similarity, deservedness, and God’s Grace.” They found that priming these varying religious messages affected charitable contributions.
Another approach has been to prime respondents’ own religious beliefs, identity, and practices by randomly varying the placement of relevant survey questions on those topics. In a series of papers, Ben-Nun Bloom and Arikan (2013; Ben-Nun Bloom, Arikan, & Courtemanche, 2015) primed citizens’ religious beliefs by asking about belief in God, life after death, heaven, hell, and the existence of a soul before asking about support for democracy, though it is effectively a measure of political tolerance. In both cases, priming belief undercut democratic stances, either with a generalized measure (Ben-Nun Bloom & Arikan, 2013) or involving immigrants specifically (Ben-Nun Bloom et al., 2015). Priming belief systems, they argue, serves as an instrument of mental closure around the group, akin to dogmatism (see also Sagioglou & Forstmann 2013; see Albertson  for an implicit attitudes context).
In those same studies, Ben-Nun Bloom and Arikan (2013) also used question ordering experiments to prime religious behavior (worship attendance) and found the exact opposite pattern. Compared to the control, those primed to consider the communal worship experience expressed greater support for democracy (tolerance) and decreased prejudice. In this case, consideration of the diverse set of people in the pews and the difficulty of collective action with them has a direct logical extension to democratic processes and norms.
The boundaries between the self/group and others are probed more directly in a series of studies by Djupe and Calfano (2013a, 2013b, 2013c). Their inspiration comes from the religious economies approach, which arrays religious groups on a scale from inclusive to exclusive as a way to differentiate their offerings (Stark & Finke, 2000). While this takes form in the practices of houses of worship, clergy will also communicate these commitments as values—commands of how to engage the world. Priming inclusive values, where believers are encouraged to reach out and involve/engage new people and reduce group boundaries, while priming exclusion, where believers are encouraged to keep to themselves and protect the in-group, should enhance boundaries with the world.
This is just what Djupe and Calfano (2013c) found in a range of experiments. In Springfield, Missouri, they found that priming inclusive values weakened threat perceived by a least liked group and thereby enhanced tolerance. In another study (Djupe & Calfano, 2013a) that involved religious adherents from a range of religious traditions sitting in their home pews, they found that priming inclusive values did not affect attitudes on American foreign intervention since they are effectively chronically accessible as measured through clergy’s self-reports. Instead priming exclusive values augmented support for go-it-alone military interventions and reduced support for cooperative (United Nations) interventions. And, lastly, they found that priming these values affected immigration attitudes in consistent ways—inclusion boosts support for immigration reform, while exclusive values undercuts support (Djupe & Calfano, 2013b). Hsiung and Djupe (2018) used these values, along with some other information, as part of religious worldviews that, when primed, affect social and political trust. The key revelation is that these values are expected to vary across time as the needs of the congregation change and thus lead to a range of potential policy attitude outcomes even as general patterns obtain.
Finally, a related approach primes religious identity directly. Of course, reminders about participants’ beliefs and behaviors could prime identity, so the separation between these various strands is not a clean one (e.g., Ben-Nun Bloom & Arikan, 2013; Ben-Nun Bloom et al., 2015). But McCauley (2014c) takes a different tack in studies of Ghana and Ivory Coast, priming religious versus ethnic identity by mentioning religious (as opposed to ethnic) groups in society in the context of five-minute radio broadcast treatments. He finds that priming religious identity leads respondents to prioritize society-wide policy, rather than an emphasis on “club goods” produced by priming ethnic identity.
Experiments Manipulating the Characteristics of Other Citizens
Yet another type of experiment does not manipulate the attributes/behavior of clergy or the respondent but rather varies how fellow citizens are described. The aim of such studies is generally to test how those varying descriptions affect respondents’ out-group attitudes. For instance, Karpowitz, Monson, and Patterson (2016) conducted an online study of norms toward derogatory speech regarding religious out-groups. Respondents read the following prompt:
While discussing religion and politics on a national television news program, a political commentator recently made the following statement, “People don’t know much about [Mormons/Catholics/Jews/Muslims/evangelicals/Mitt Romney]. When they find out, they are amazed at how weird they (he) really are (is). They’re (He’s) just not normal. What a strange group (guy)—they’re (he’s) disgusting, really.”(Karpowitz, Monson, & Patterson, 2016, p. 518)
The authors sought to understand how varying the identity of the target group affected respondents’ levels of discomfort with the derogatory speech, using a battery of items such as “People should be reprimanded for making statements like this” and “I feel uncomfortable when I read comments like this.” They also assessed how the varying identity of the out-group affected respondents’ perceptions of the commentator as prejudiced (or not). Results revealed that both Democrats and Republicans exhibited the highest level of unease when the negative comments were made toward Jews. By contrast, there were very large partisan differences in perceptions of derogatory speech about Muslims. While Democrats were nearly as protective of Muslims as of Jews, Republicans exhibited the lowest levels of unease toward negative speech about Muslims of any target group.
Note that randomizing the target group was critical. If each respondent had been presented with negative comments toward all six targets, respondents with strong norms of fairness might have been inclined to self-censor, aligning responses to reduce the perception that they were being unfair or inconsistent (see also Ben-Nun Bloom et al., 2015). Similar dynamics played out in Aarøe’s (2012) study of Europeans’ tolerance toward religious displays. Her study used the following prompt: “Do you agree or disagree that a ban should be introduced prohibiting judges from wearing a [necklace with a Christian cross/necklace with a Muslim crescent/Muslim headscarf] at work?” She found that respondent opposition to the religious display was affected both by the religious group under consideration and by the prominence of the display.
Alternatively, researchers could randomize not the target out-group but the way a single out-group is described. For instance, Calfano, Djupe, Cox, and Jones (2016) examined how descriptions of Muslim Americans as patriotic or unpatriotic affected anti-Muslim attitudes. They found that among respondents who trust the Fox News Channel, positive descriptions of Muslims actually led to a backlash in which respondents expressed more negative views toward Muslims.
Others have manipulated how other countries are described in religious terms. Focused on the public’s role in foreign policymaking through their attitudes, Lacina and Lee (2013) explored whether opinion shifted in response to learning the regime type (democratic vs. nondemocratic) and the dominant religious affiliation (Islam vs. Christian), finding that religious affiliation was the dominant force shaping trust and threat perceptions. Isani and Silverman (2016) elaborate on these findings, exploring how the way that Islam is conveyed to people matters to their response: exposure to a message involving “shari’a” invokes fear, especially among conservatives, and more Islamic cues produce additive effects. On the flip side, religious Americans show “my brother’s keeper” effects, meaning a willingness to intervene in other nations’ affairs in order to protect fellow Christians (Wu & Knuppe, 2016).
Experiments Manipulating Religious Institutional Cues Received by Clergy
One last set of experiments in religion and politics seeks to understand the behavior of a narrow but important set of actors: clergy. Several recent studies explore how varying institutional cues affect the political behavior and attitudes of clergy using question order experiments. A question order experiment randomly varies the order in which questions are presented in the survey as a means of influencing what clergy are thinking about at the moment they answer the question or questions that serve as the dependent variable. The questions the clergy receive immediately before the dependent variable serve as a prime to consider certain influences.
Thus Calfano and Oldmixon (2016) surveyed Roman Catholic priests in the United States, asking them which of various entities (the bishop, Church doctrine, etc.) was the most important source of guidance in their decision making. One-third of respondents received the dependent variable (i.e., the question about sources of guidance) immediately after receiving an “institutional cue”: a four-question battery of Likert-type agree/disagree statements designed to make priests think about the institutional demands they faced. Another third received the dependent variable immediately after receiving an “interpersonal cue” designed only to make them think about pressures within their own parishes. The last third received neither prime before answering the dependent variable. The researchers discovered that priming priests to think about the Catholic Church hierarchy pushed them to rely on guidance from their bishop in discharging their responsibilities (see also Calfano, Michelson, & Oldmixon, 2017).
Other studies have followed a similar pattern. Smith (2016, 2019) included a question order experiment in her survey of clergy in Brazil, which served to prime feelings of market pressure from other churches for congregants. Studying Roman Catholic priests in Ireland and Northern Ireland, Calfano, Oldmixon, and Suiter (2014) found that institutional primes led priests to adopt more populist economic attitudes and more conservative cultural attitudes, relative to interpersonal primes or no primes. They argued that both types of attitudes were “(religious) establishment preferences” (p. 397).
Experimentation forces researchers to think carefully about the appropriate sample (the “who”). What is the relevant population? That is, in the real world that the study seeks to imitate under controlled conditions, who might reasonably be exposed to such a stimulus? In broad strokes, religion and politics experiments typically target one of three types of populations: adherents to specific religious traditions, clergy within specific religious traditions, and general national samples.
Attention to the sample is particularly important when the treatment involves phenomena to which individuals are usually exposed in specific, segmented religious communities: for instance, clergy messages or religious beliefs and practices. Researchers could expose people to all sorts of religious elements to discern their effect, but it often makes little sense to do so. Treating a group of Sikhs with a Christian communion ritual would only induce confusion or perhaps anger. Instead, within a reasonable potential outcomes framework (Holland, 1986), religion and politics scholars need to experiment with treatments that people would likely be exposed to in their own social worlds. In the best of all possible worlds, the researcher would also have a sense of the actual distribution of exposure to those elements.
For instance, McClendon and Riedl (2015) observed sermons in Pentecostal churches in Nairobi, Kenya, that told believers they could achieve anything they set their faith to. Though the message was ubiquitous only in certain churches, people in Nairobi tended to attend various churches, so it was plausible that any Christian could reasonably be exposed to prosperity gospel-style messages. Hence their sample was composed of Christian identifiers in that city.
Likewise, Djupe and Calfano (2013b, 2013c) studied the effect of exposure to inclusive and exclusive values in the United States, following Stark and Finke’s (2000) definition of different church models. Based on clergy survey data that showed variation in the presentation of the two value sets, they decided that the appropriate population involved all religious people who attended worship services and so conducted their experiment in actual houses of worship in one instance.
Often the appropriate sample is the general adult (eligible voter) population within a country. This is particularly the case with studies manipulating candidate traits. Such experiments can illuminate how citizens respond to cues that are relatively rare in the real world. Sometimes, everyone is exposed to a religious cue precisely because it is unexpected, alienating, or simply disliked. So how do people respond to a Catholic candidate (McDermott, 2009)? Are Floridians willing to vote for a Jewish candidate (Kane et al., 2004)? Under what conditions do voters attribute undesirable motives (e.g., support for terrorists) to a Muslim candidate (Braman & Sinno, 2009)?
Sometimes scholars run experiments after finding a relationship in a cross-sectional data set based on a national sample. Many times that observational correlation is from very high quality data (e.g., the American National Election Study or the General Social Survey), but the researchers seek causal confirmation of the hypothesized processes. Under those circumstances, the experimenter often turns to a lower cost sample to run an online experimental study. There is a continuing debate about the usefulness of Mechanical Turk (MTurk), the Amazon worker-for-hire platform. Even though the distribution of religious identification is heavily skewed toward nonaffiliation, Lewis et al. (2015) find that some basic relationships between religious items and ideology are comparable to those found in the General Social Survey. However, others who compared experimental treatments in probability samples to MTurk opt-in samples have found disjunctures (Krupnikov & Levine, 2014).
Another consideration relates to heterogeneity in treatment effects across different populations or subpopulations. When multiple identity groups are exposed to a stimulus, do they respond differently? Many experimental studies assess how treatment effects vary by respondent-level traits such as partisanship or religious affiliation; however, scholars have, with a few exceptions, largely ignored the possibility of country-level heterogeneity. Only a handful of studies take place in multiple countries: among them, Warner et al. (2015), Sumaktoyo et al. (2016), Ben-Nun Bloom et al. (2015), and Calfano et al. (2017). This is an unfortunate oversight. Many research questions in religion and politics seem to have an obvious comparative angle. To name one example, do voters respond more negatively to religious cues in countries with stronger separation of religion and state? Or are clergy more responsive to institutional political cues in countries with weaker separation of religion and state and higher regulation from the state?
Best Practices in the Study of Religion and Politics
So what should a scholar interested in conducting an experiment in religion and politics do? Given the tremendous diversity in approaches reviewed in this article, it is not possible to develop a single checklist detailing the steps to effective experimentation. Nonetheless, a series of best practices can improve experimental design.
First, observe. The most efficacious research often seems to begin with observational study—both qualitative and quantitative—to describe religious phenomena in the real world. Observational research should establish both the nature and the distribution of exposure to certain stimuli.
Second, simplify. An effective experiment radically simplifies reality. It sheds what child psychologist William James once called the “buzzing, blooming confusion” of the real world to create a mental model involving a small number of variables—often as few as two (i.e., the treatment and the outcome). And then the experimenter must figure out how to randomize exposure to one of those variables and to measure the other. This advice may seem obvious, but in the anecdotal experience of the authors of this article, the simplification stage is often where scholars new to experimentation stumble. Young researchers often have a hard time either developing a sufficiently simple mental model or designing an experiment that manipulates the hypothesized treatment and only the hypothesized treatment.
Third, complicate. All effective experiments begin by dramatically paring down reality. However, the most interesting studies often strategically bring a bit of complexity back in. One type of complexity involves randomizing exposure to multiple treatments—for instance, by using a “two-by-two” design that randomizes exposure to fake candidates who vary in both race and their use of religious language. Another type of complexity could entail examining the heterogeneity of treatment effects across different populations.
To some degree, the growth in experimentation in religion and politics work has tracked (with a bit of lag) political science’s concerns about causality and growth in experimentation generally. The goal of social scientific work is to explain and predict, and that demands a causal explanation with a solid understanding of the mechanism of influence. Experimentation is not absolutely necessary to accomplish those aims, but scholarly understanding is certainly greatly facilitated by employing experiments.
Aside from the general trajectory of political science, the other move that cleared the way for experimentation is a shift in theoretical perspective within the social science of religion. Given the lack of detailed measures available in the omnibus surveys that supported most research in American religion and politics, scholars generated theories that best fit the data—seeing religious attachments as long-standing, socialized connections that shaped political attachments through instruction, absorption, and selection (Green & Guth, 1993). As Kellstedt and Green (1993) memorably described the measurement of religious affiliation, “It has never been clear whether such [denominational] measures refer to ethnic histories, doctrinal beliefs, social status, or social group attachments, and such measures have often been characterized by imprecision and social desirability effects as well” (p. 53). The literature has demonstrated over and over that making inferences about influence based on correlations between such measures and political dependent variables is fraught at best.
The shift away from this perspective sought both to redress these deep-seated problems and to explain why religious influence often worked. In psychology, scholars often treated religion as a concept to be primed. For instance, the search for a mechanism that promoted cooperation and reduced defection led psychologists to uncover the belief in surveillance (“God is watching”). In political science, researchers focused on modeling the communication system described at the outset of this article. Understanding religious influence depended on making connections, often but not always explicit (as in priming), between religious beliefs, dictates, identities, or simply information and some political outcome or behavior. Capturing the extent and distribution of exposure to religious communications in observational research is difficult, and experimentation affords the necessary degree of control to standardize experience. Helpfully, this exposure/adoption framework (Djupe & Calfano, 2013b) follows the influential receive/accept/sample system for understanding public opinion (Zaller, 1992). Notably, religion can influence not only what people are exposed to but also how they react to stimuli, which provides a simple but fruitful model for designing experiments in religion and politics.
There is no single right next step for experimentation, except to conduct more experiments. However, one promising direction will be to reflect more carefully on the contexts in which religious influence might and might not work. That context may vary by the extent of threat, majoritarian status, the degree to which religious freedom operates, or other characteristics.
- Holland, P. W. (1986). Statistics and causal inference. Journal of the American Statistical Association, 81(396), 945–960.
- Krupnikov, Y., & Levine, A. S. (2014). Cross-sample comparisons and external validity. Journal of Experimental Political Science, 1(1), 59–80.
- Lewis, A. R., Djupe, P. A., Mockabee, S. T., & Wu, J. S.-Y. (2015). The (non) religion of mechanical Turk workers: A research note. Journal for the Scientific Study of Religion, 54(2), 419–428.
- Zaller, J. R. (1992). The nature and origins of mass opinion. Cambridge, UK: Cambridge University Press.
- Aarøe, L. (2012). Does tolerance of religion in the public space depend on the salience of the manifestation of religious group membership? Political Behavior, 34(4), 585–606.
- Adkins, T., Layman, G. C., Campbell, D. E., & Green, J. C. (2013). Religious group cues and citizen policy attitudes in the United States. Politics & Religion, 6, 235–263.
- Albertson, B. L. (2011). Religious appeals and implicit attitudes. Political Psychology, 32, 109–130.
- Albertson, B. L. (2014). Dog-whistle politics: Multivocal communication and religious appeals. Political Behavior, 37(1), 3–26.
- Be’ery, G., & Ben-Nun Bloom, P. (2015). God and the welfare state—substitutes or complements? An experimental test of the effect of belief in God’s control. PLoS ONE, 10(6).
- Ben-Nun Bloom, P., & Arikan, G. (2013). Priming religious belief and religious social behavior affects support for democracy. International Journal of Public Opinion Research, 25(3), 368–382.
- Ben-Nun Bloom, P., Arikan, G., & Courtemanche, M. (2015). Religious social identity, religious belief, and anti-immigration sentiment. American Political Science Review, 109(2), 203–221.
- Benson, B. V., Merolla, J. L., & Geer, J. G. (2011). Two steps forward, one step back? Bias in the 2008 presidential election. Electoral Studies, 30(4), 607–620.
- Benstead, L. J., Jamal, A. A., & Lust, E. (2015). Is it gender, religiosity or both? A role congruity theory of candidate electability in transitional Tunisia. Perspectives on Politics, 13(1), 74–94.
- Berinsky, A. J., & Mendelberg, T. (2005). The indirect effects of discredited stereotypes in judgments of Jewish leaders. American Journal of Political Science, 49(4), 845–864.
- Boas, T. C. (2014). Pastor Paulo vs. Doctor Carlos: Professional titles as voting heuristics in Brazil. Journal of Politics in Latin America, 6(2), 39–72.
- Boas, T. C. (2016). Pastors for Pinochet: Authoritarian stereotypes and voting for evangelicals in Chile. Journal of Experimental Political Science, 3, 197–205.
- Boas, T. C., & Smith, A. E. (2015). Religion and the Latin American voter. In R. E. Carlin, M. Singer, & E. Zechmeister (Eds.), The Latin American voter (pp. 99–121). Ann Arbor: University of Michigan Press.
- Braman, E., & Sinno, A. H. (2009). An experimental investigation of causal attributions for the political behavior of Muslim candidates: Can a Muslim represent you? Politics & Religion, 2, 247–276.
- Calfano, B. R., & Djupe, P. A. (2009). God talk: Religious cues and electoral support. Political Research Quarterly, 62(2), 329–339.
- Calfano, B. R., & Djupe, P. A. (2011). Not in His image: The moderating effect of gender on religious appeals. Politics & Religion, 4(3), 338–354.
- Calfano, B. R., & Djupe, P. A. (2015). Going to extremes: The conditional response to proposed constitutional violations by religious elites. In P. A. Djupe (Ed.), Religion and political tolerance in America: Advances in the state of the art. Philadelphia, PA: Temple University Press.
- Calfano, B. R., Djupe, P. A., Cox, D., & Jones, R. (2016). Muslim mistrust: The resilience of negative public attitudes after complimentary information. Journal of Media and Religion, 15(1), 29–42.
- Calfano, B. R., Djupe, P. A., & Wilson, A. R. (2013). God save this “broken” land: The efficacy of closed-circuit voter targeting in a U.K. election. Politics & Religion, 6(1), 50–73.
- Calfano, B. R., Friesen, A. J., & Djupe, P. A. (2013). Mitigating Mormonism: Overcoming religious identity challenges with targeted appeals. PS: Political Science & Politics, 46, 562–568.
- Calfano, B. R., Michelson, M. R., & Oldmixon, E. A. (2017). A matter of discretion: The politics of Catholic priests in the United States and Ireland. Lanham, MD: Rowman & Littlefield.
- Calfano, B. R., & Oldmixon, E. A. (2016). Remembering to ask the boss: Priming and the dynamics of priest reliance on bishop cues. Religions, 7(3), 21.
- Calfano, B. R., Oldmixon, E. A., & Suiter, J. (2014). Who and what affects the First Estate? An analysis of clergy attitudes on cultural and economic issues. Politics, 34(4), 391–404.
- Calfano, B. R., & Paolino, P. (2010). An Alan Keyes effect? Examining anti-Black sentiment among White Evangelicals. Political Behavior, 32(1), 133–156.
- Campbell, D. E., Green, J. C., & Layman, G. C. (2011). The party faithful: Partisan images, candidate religion, and the electoral impact of party identification. American Journal of Political Science, 55, 42–58.
- Campbell, D. E., Green, J. C., & Monson, J. Q. (2012). The stained glass ceiling: Social contact and Mitt Romney’s “religion problem.” Political Behavior, 34(2), 277–299.
- Campbell, D. E., Layman, G. C., Green, J. C., & Sumaktoyo, N. G. (2018). Putting politics first: The impact of politics on American religious and secular orientations. American Journal of Political Science, 62(3), 551–565.
- Campbell, R., & Cowley, P. (2014). What voters want: Reactions to candidate characteristics in a survey experiment. Political Studies, 62(4), 745–765.
- Castle, J. J., Layman, G. C., Campbell, D. E., & Green, J. C. (2017). Survey experiments on candidate religiosity, political attitudes, and vote choice. Journal for the Scientific Study of Religion, 56(1), 143–161.
- Chapp, C. B. (2012). Religious rhetoric and American politics: The endurance of civil religion in electoral campaigns. Ithaca, NY: Cornell University Press.
- Clifford, S., & Gaskins, B. (2016). Trust me, I believe in God: Candidate religiousness as a signal of trustworthiness. American Politics Research, 44(6), 1066–1097.
- Clingingsmith, D., Khwaja, A. I., & Kremer, M. (2009). Estimating the impact of The Hajj: Religion and tolerance in Islam’s global gathering. Quarterly Journal of Economics, 124(3), 1133–1170.
- Clobert, M., Saroglou, V., & Hwang, K.-K. (2015). Buddhist concepts as implicitly reducing prejudice and increasing prosociality. Personality and Social Psychology Bulletin, 41(4), 513–525.
- Condra, L. N., Isaqzadeh, M., & Linardi, S. (2019). Clerics and scriptures: Experimentally disentangling the influence of religious authority in Afghanistan. British Journal of Political Science, 49, 401–419.
- Djupe, P. A., & Calfano, B. R. (2009). Justification not by faith alone: Clergy generating trust and certainty by revealing thought. Politics & Religion, 2(1), 1–30.
- Djupe, P. A., & Calfano, B. R. (2013a). Divine intervention? The influence of religious values on support for U.S. interventionism. Political Behavior, 35(4), 643–663.
- Djupe, P. A., & Calfano, B. R. (2013b). God talk: Experimenting with the religious causes of public opinion. Philadelphia, PA: Temple University Press.
- Djupe, P. A., & Calfano, B. R. (2013c). Religious value priming, threat, and political tolerance. Political Research Quarterly, 66(4), 767–779.
- Djupe, P. A., & Calfano, B. R. (2018). Evangelicals were on their own in the 2016 elections. In P. A. Djupe & R. L. Claassen (Eds.), The evangelical crackup? The future of the evangelical-Republican coalition. Philadelphia, PA: Temple University Press.
- Djupe, P. A., & Gilbert, C. P. (2009). The political influence of churches. New York, NY: Cambridge University Press.
- Djupe, P. A., & Gwiasda, G. W. (2010). Evangelizing the environment: Decision process effects in political persuasion. Journal for the Scientific Study of Religion, 49(1), 73–86.
- Djupe, P. A., Lewis, A. R., & Jelen, T. G. (2016). Rights, reflection, and reciprocity: Implications of the same-sex marriage debate for tolerance and the political process. Politics & Religion, 9(3), 630–648.
- Djupe, P. A., Lewis, A. R., Jelen, T. G., & Dahan, C. (2014). Rights talk: The opinion dynamics of rights framing. Social Science Quarterly, 95(3), 652–668.
- Djupe, P. A., Neiheisel, J. R., & Olson, L. R. (2015). Carriers of the creed: The effect of urging tolerance on persuasion. In P. A. Djupe (Ed.), Religion and political tolerance in America: Advances in the state of the art. Philadelphia, PA: Temple University Press.
- Gervais, W. M., & Norenzayan, A. (2012). Like a camera in the sky? Thinking about God increases public self-awareness and socially desirable responding. Journal of Experimental Social Psychology, 48(1), 298–302.
- Granberg, D. (1985). An anomaly in political perception. Public Opinion Quarterly, 49(4), 504–516.
- Green, J. C., & Guth, J. L. (1993). From lambs to sheep: Denominational change and political behavior. In D. C. Leege & L. A. Kellstedt (Eds.), Rediscovering the religious factor in American politics. Armonk, NY: M. E. Sharpe.
- Hirsh, J. B., Walberg, M. D., & Peterson, J. B. (2013). Spiritual liberals and religious conservatives. Social Psychological and Personality Science, 4(1), 14–20.
- Hsiung, B. O., & Djupe, P. A. (2018). Religion and the extension of trust. Political Behavior.
- Isani, M., & Silverman, D. (2016). Foreign policy attitudes toward Islamic actors: An experimental approach. Political Research Quarterly, 69(3), 571–582.
- Jennings, J. T. (2016). Mixed reactions: How religious motivation explains responses to religious rhetoric in politics. Political Research Quarterly, 69(2), 295–308.
- Johnson, M. K., Rowatt, W. C., & LaBouff, J. (2010). Priming Christian religious concepts increases racial prejudice. Social Psychological and Personality Science, 1(2), 119–126.
- Kane, J. G., Craig, S. C., & Wald, K. D. (2004). Religion and presidential politics in Florida: A list experiment. Social Science Quarterly, 85, 281–293.
- Karpowitz, C. F., Monson, J. Q., & Patterson, K. D. (2016). Who’s in and who’s out: The politics of religious norms. Politics & Religion, 9(3), 508–536.
- Kellstedt, L. A., & Green, J. C. (1993). Knowing God’s many people: Denominational preference and political behavior. In D. C. Leege & L. A. Kellstedt (Eds.), Rediscovering the religious factor in American politics. Armonk, NY: M. E. Sharpe.
- Lacina, B., & Lee, C. (2013). Culture clash or democratic peace? Results of a survey experiment on the effect of religious culture and regime type on foreign policy opinion formation. Foreign Policy Analysis, 9, 143–170.
- Layman, G. C., Kalkan, K. O., & Green, J. C. (2014). A Muslim president? Misperceptions of Barack Obama’s faith in the 2008 presidential campaign. Journal for the Scientific Study of Religion, 53(3), 534–555.
- Margolis, M. F. (2018a). From politics to the pews: How partisanship and political identity shape religious identity. Chicago, IL: University of Chicago Press.
- Margolis, M. F. (2018b). How far does social group influence reach? Elites, evangelicals, and immigration attitudes. Journal of Politics, 80(3), 772–785.
- McCauley, J. F. (2014a). Measuring and reducing religious bias in post-conflict zones: Evidence from Côte d’Ivoire. Political Psychology, 35(2), 267–289.
- McCauley, J. F. (2014b). Pentecostalism as an informal political institution: Experimental evidence from Ghana. Politics & Religion, 7(4), 761–787.
- McCauley, J. F. (2014c). The political mobilization of ethnic and religious identities in Africa. American Political Science Review, 108(4), 801–816.
- McClendon, G., & Riedl, R. B. (2015). Religion as a stimulant of political participation: Experimental evidence from Nairobi, Kenya. Journal of Politics, 77(4), 1045–1057.
- McDermott, M. L. (2007). Voting for Catholic candidates: The evolution of a stereotype. Social Science Quarterly, 88, 953–969.
- McDermott, M. (2009). Religious stereotyping and voter support for evangelical candidates. Political Research Quarterly, 62, 340–354.
- Mckeown, B., & Carlson, J. M. (1987). An experimental study of the influence of religious elites on public opinion. Political Communication, 4(2), 93–102.
- McLaughlin, B., & Thompson, B. A. (2016). Conditioned by race: How race and religion intersect to affect candidate evaluations. Politics & Religion, 9(3), 605–629.
- McLaughlin, B., & Wise, D. (2014). Cueing God: Religious cues and voter support. Politics & Religion, 7, 366–394.
- Nielsen, R. A. (2015). Ethics for experimental manipulation of religion. In S. Desposato (Ed.), Ethics and experiments: Problems and solutions for social scientists and policy professionals. New York, NY: Routledge.
- Robinson, C. (2010). Cross-cutting messages and political tolerance: An experiment using evangelical protestants. Political Behavior, 32(4), 495–515.
- Sagioglou, C., & Forstmann, M. (2013). Activating Christian religious concepts increases intolerance of ambiguity and judgment certainty. Journal of Experimental Social Psychology, 49(5), 933–939.
- Shariff, A. F., & Norenzayan, A. (2007). God is watching you: Supernatural agent concepts increase prosocial behavior in an anonymous economic game. Psychological Science, 18, 803–809.
- Smith, A. E. (2016). When clergy are threatened: Catholic and Protestant leaders and political activism in Brazil. Politics & Religion, 9(3), 431–455.
- Smith, A. E. (2019). Religion and Brazilian democracy: Mobilizing the people of God. New York, NY: Cambridge University Press.
- Smith, G. A. (2008). Politics in the parish: The political influence of Catholic priests. Washington, DC: Georgetown University Press.
- Stark, R., & Finke, R. (2000). Acts of faith: Explaining the human side of religion. Berkeley: University of California Press.
- Sumaktoyo, N. G., Ottati, V., & Untoro, V. (2016). The paradoxical religiosity effect: Religion and politics in Indonesia and the United States. Politics & Religion, 9(3), 481–507.
- Wallsten, K., & Nteta, T. M. (2016). For you were strangers in the land of Egypt: Clergy, religiosity, and public opinion toward immigration reform in the United States. Politics & Religion, 9, 566–604.
- Warner, C. M., Kilinc, R., Hale, C. W., Cohen, A. B., & Johnson, K. A. (2015). Religion and public goods provision: Experimental and interview evidence from Catholicism and Islam in Europe. Comparative Politics, 47(2), 189–209.
- Weber, C., & Thornton, M. (2012). Courting Christians: How political candidates prime religious considerations in campaign ads. Journal of Politics, 74, 400–413.
- Wu, J. S.-Y., & Knuppe, A. J. (2016). My brother’s keeper? Religious cues and support for foreign military intervention. Politics & Religion, 9(3), 537–565.
1. Including “cooperation” as a political outcome, the number of articles is much higher, since there are a huge number of experiments by psychologists and economists playing behavioral economic games. In this article, such behavioral economic games are set aside as close kin.
2. The exceptions are Granberg (1985), which manipulated the salience of religion to explore perceptions of Ted Kennedy, and Mckeown and Carlson (1987), who played televangelist excerpts for undergraduates to assess the power of the Christian Right.
3. In a second study reported in the same paper, Kane, Craig, and Wald (2004) asked about a Jewish candidate for president.
4. Sumaktoyo, Ottati, and Untoro (2016) also manipulated the fake candidate’s policy views toward state involvement with religion.
5. Braman and Sinno (2009) also manipulated the religious composition of the fake politician’s district.