1-20 of 28 Results

  • Keywords: experiments x
Clear all

Article

Matthew A. Shapiro, Toby Bolsen, and Anna McCaghren Fleming

Public opinion plays a central role in determining the feasibility of efforts to transform energy systems in the coming years, yet scholarship on communication effects and public opinion about clean energy and energy efficiency seems to have expanded only relatively recently. There is a growing body of work that explores how targeted and strategically framed messages affect individuals’ beliefs and motivations to act on matters affecting household energy choices as well as energy policies. One must attend particularly to the principal communication-based factors that shape the public’s understanding of clean energy sources and promote efficiencies in energy use. To better understand the communication vehicles for improving both household energy efficiency and conservation, two research foci are most relevant: (1) field experiments that primarily assess how household energy consumption shifts after receiving energy consumption reports and (2) surveys/laboratory experiments that focus on the nuances of energy-related communications, paying particular attention to the role of politics and ideology. This bimodal classification of clean energy and efficiency communication research genres is not exhaustive but can be synthesized into two major contributions. First, providing households with information about specific benefits that would result from a greater reliance on clean energy may increase support for its development and move individuals toward energy efficiency outcomes; however, exposure to counter-messages that emphasize costs associated with clean energy and the associated policies can negate the effects of pro-clean energy messages. Second, there is still no reprieve from the politicization of energy, and thus the role of partisanship and motivated reasoning must be accounted for when assessing how individuals modify their decision-making processes regarding energy efficiency.

Article

Empirical media effects research involves associating two things: measures of media content or experience and measures of audience outcomes. Any quantitative evidence of correlation between media supply and audience response—combined with assumptions about temporal ordering and an absence of spuriousness—is taken as evidence of media effects. This seemingly straightforward exercise is burdened by three challenges: the measurement of the outcomes, the measurement of the media and individuals’ exposure to it, and the tools and techniques for associating the two. While measuring the outcomes potentially affected by media is in many ways trivial (surveys, election outcomes, and online behavior provide numerous measurement devices), the other two aspects of studying the effects of media present nearly insurmountable difficulties short of ambitious experimentation. Rather than find solutions to these challenges, much of collective body of media effects research has focused on the effort to develop and apply survey-based measures of individual media exposure to use as the empirical basis for studying media effects. This effort to use survey-based media exposure measures to generate causal insight has ultimately distracted from the design of both causally credible methods and thicker descriptive research on the content and experience of media. Outside the laboratory, we understand media effects too little despite this considerable effort to measure exposure through survey questionnaires. The canonical approach for assessing such effects: namely, using survey questions about individual media experiences to measure the putatively causal variable and correlating those measures with other measured outcomes suffers from substantial limitations. Experimental—and sometimes quasi-experimental—methods provide definitely superior causal inference about media effects and a uniquely fruitful path forward for insight into media and their effects. Simultaneous to this, however, thicker forms of description than what is available from close-ended survey questions holds promise to give richer understanding of changing media landscape and changing audience experiences. Better causal inference and better description are co-equal paths forward in the search for real-world media effects.

Article

The field of political science is experiencing a new proliferation of experimental work, thanks to a growth in online experiments. Administering traditional experimental methods over the Internet allows for larger and more accessible samples, quick response times, and new methods for treating subjects and measuring outcomes. As we show in this chapter, a rapidly growing proportion of published experiments in political science take advantage of an array of sophisticated online tools. Indeed, during a relatively short period of time, political scientists have already made huge gains in the sophistication of what can be done with just a simple online survey experiment, particularly in realms of inquiry that have traditionally been logistically difficult to study. One such area is the important topic of social interaction. Whereas experimentalists once relied on resource- and labor-intensive face-to-face designs for manipulating social settings, creative online efforts and accessible platforms are making it increasingly easy for political scientists to study the influence of social settings and social interactions on political decision-making. In this chapter, we review the onset of online tools for carrying out experiments and we turn our focus toward cost-effective and user-friendly strategies that online experiments offer to scholars who wish to not only understand political decision-making in isolated settings but also in the company of others. We review existing work and provide guidance on how scholars with even limited resources and technical skills can exploit online settings to better understand how social factors change the way individuals think about politicians, politics, and policies.

Article

Political scientists are increasingly using experiments to study African politics. Experimental methods help scholars to overcome two central research challenges: potential bias in responses to survey questions (social desirability bias), and establishing the effect of X on Y (causality). Regarding survey response bias, experimental methods have been used to study sensitive topics such as ethnic favoritism, clientelism, corruption, and vote buying. In terms of causality, experiments have helped to estimate the effects of programs aimed at enhancing the quality of democracy or public service delivery. Identifying the causes of the political behavior is critical to understanding the “nuts and bolts” of African politics. For policymakers, knowledge of what works to promote democratic accountability ensures the efficient allocation of scarce resources.

Article

Haluk Soydan

This entry regards intervention research as an essential part of social work as a profession and research discipline. A brief history of intervention research reveals that use of intervention research for the betterment of human conditions is contemporary with the genesis of modern social science. Advances in intervention research are attributed to the comprehensive social programs launched during the 1960s in the United States. A contemporary and generic model of intervention research is described. It is argued that it is ethical to use intervention research and unethical not to use it. Assessment of some of the recent advances in policy making and science gives an optimistic picture of the future of intervention research.

Article

Paul A. Djupe and Amy Erica Smith

Experiments in religion and politics model a communication system with three elements: who (the sample) is exposed to what (the treatment) and with what potential effect (the outcome). Most experiments in religion and politics focus on one of three types of samples: clergy, the faithful within certain religious groups, or all citizens within a polity. At the core of the experiment is the randomized treatment: an independent variable that the researcher manipulates and randomly assigns to treatment groups that are supposed to be equivalent in all other respects. Certain kinds of treatments tend to be associated with certain kinds of hypothesized outcomes. That is, most experiments in religion and politics involve investigating either (a) how a randomized treatment related to religion affects a political outcome or (b) how a randomized treatment related to politics affects a religious outcome. There are several types of religious treatments that closely mirror the actual insertion of religion into public life: manipulating candidates’ religious affiliations, behavior, and rhetoric; manipulating appeals attributed to religious elites and institutions; priming subjects’ own religious or political beliefs or manipulating other religious attributes of subjects; manipulating the characteristics of other citizens; and manipulating religious institutional cues received by clergy. Experimental methods are everywhere now in the study of religion and politics and provide clear benefits for understanding how religion and politics interact. Perhaps most importantly, the method imposes intellectual rigor, helping scholars pin down theoretically and empirically the precise mechanisms involved in the mutual impact between religion and politics. In addition, experimental control enables scholars to assert more confidently the direction of influence among variables that in the real world plausibly influence each other.

Article

Reflexivity, a recursive process of turning back, occurs throughout science. Back-and-forth reflexive processes transpire when the scientist executes self-regard and whenever human science theory incorporates the researcher’s actions. Reflexive processes occur too in the myriad, unavoidable ways that observations of the world depend on scientists’ prior understandings of the world. The multiple forms and complexities of reflexivity pose challenges for all science, yet the challenges are especially pronounced in a science, like psychology, that generates knowledge about human nature. Confronting reflexivity is further impeded by psychology’s markedly scientific (not human scientific) goals to achieve objectivity and value neutrality, and to maintain naturalist assumptions about reality. Yet over the lifespan of scientific psychology some psychologists have faced these challenges and recommended means to acknowledge reflexivity. Their investigations have located, named, and analyzed a set of fallacies associated with disregarding reflexivity. The fallacies include assuming that the psychologist’s conception of cognitive processes are the same as their subject’s; that the psychologist can fully bracket their presuppositions from their observations; that psychological theories need not be relevant to their own scientific thoughts and behaviors; that psychology’s prescribed language for reporting findings accurately describes the phenomenon under investigation; and that psychological knowledge has no consequential effects on the world it predicts and explains. Addressing such fallacies and taking steps to remove them through sustained reflexive awareness is essential to attaining an empirically robust, veridical, and dynamic science. Taken together, the efforts of psychologists who have faced reflexivity and the fallacies related to its denial comprise a productive working template for developing a science that benefits from engaging with reflexive processes instead of disregarding them.

Article

Kevin Arceneaux and Martin Johnson

Since the mid-20th century, communication researchers have recognized that audience members selectively expose themselves to information and opinions congenial to their pre-existing views. While this was a controversial idea during the broadcast era of mass media, the expansion of media choice on television and use of information communication technology has brought increased attention to selectivity among audience members. Contemporary scholarship investigates the extent to which people select proattitudinal information or avoid counterattitudinal information and the role these choices play in the effects of media messages on viewers. While selective exposure is a broader phenomenon, this article substantively focuses on the use of politically partisan media, especially the research methods used to investigate media selectivity and its effects. This literature manifests an increased attention to measurement, especially how we measure the core concept of media exposure, novel experimental designs intended to allow investigators to directly view individual choice behavior in complex media environments, and attention to new sources of large-scale data from social media and large text samples. Scholars agree that partisan websites and cable networks provide content politically distinct enough to allow viewers to segregate themselves into liberal and conservative audiences for news but that this kind of polarized viewing is only part of how viewers use media today. A nuanced picture of selectivity shows audiences selecting congenial content but employing broader media use repertoires as well. The mechanisms and effects of media selectivity are psychologically complex and sensitive to contextual factors such as the political issue under consideration.

Article

Students of public opinion tend to focus on how exposure to political media, such as news coverage and political advertisements, influences the political choices that people make. However, the expansion of news and entertainment choices on television and via the Internet makes the decisions that people make about what to consume from various media outlets a political choice in its own right. While the current day hyperchoice media landscape opens new avenues of research, it also complicates how we should approach, conduct, and interpret this research. More choices means greater ability to choose media content based on one’s political preferences, exacerbating the severity of selection bias and endogeneity inherent in observational studies. Traditional randomized experiments offer compelling ways to obviate these challenges to making valid causal inferences, but at the cost of minimizing the role that agency plays in how people make media choices. Resent research modifies the traditional experimental design for studying media effects in ways that incorporate agency over media content. These modifications require researchers to consider different trade-offs when choosing among different design features, creating both advantages and disadvantages. Nonetheless, this emerging line of research offers a fresh perspective on how people’s media choices shapes their reaction to media content and political decisions.

Article

Aubrey Westfall and Özge Çelik Russell

Religion is a central and comprehensive identity for billions of people all over the world. Politicians and other political actors recognize the vitality of religion and use it for political purposes, deliberately signaling religion, religiosity, or religious values and connecting them to political outcomes or behaviors in an effort to influence the political preferences of religious practitioners. The most efficient way to make the connection between religion and politics is through religious cues. Religious cues create information shortcuts linking religious identity or values with a political candidate or issue. Religious cues are used by political and religious actors in secular and religious contexts and are typically one of two general types: identity cues, which engage an individual’s religious identity and activate an in-group/out-group effect, and linkage cues, which link religious values or beliefs with an issue or candidate. Identity cues are particularly tricky to use in secular contexts because they have been shown to have strong alienating effects on nonreligious people, thereby defeating the intended purpose of the cue sender. For this reason, coded religious language called “implicit cues” is used with greater frequency in political discourse where only the religious cue receiver recognizes the religious cue for what it is. This strategy allows a political candidate to reap the benefits of the cue without risking alienation. While scholars have made substantial progress in using experimental methods to disentangle the ways religious cues influence political behavior, there is ample opportunity for more research exploring different types of religious cues and the way they interact with other forms of cues and identities. Furthermore, most of the research on religious cues has focused on Christian cues in the United States, and a more diverse range of religions and contexts should be explored to understand the way religious cues influence political behavior. Researchers should also expand the definition of “religious practitioners” to explore how religious cues influence the growing number of people who do not affiliate with a religion or engage in practices traditionally associated with religiosity but do identify as religious. This would help to expand conceptualization of political behavior to more accurately reflect lived political experiences. Embracing these opportunities will allow the scholarly community to gain a better understanding of the varied political dynamics of religious cueing, which offers insights into how fundamental identities and attitudes are linked, thereby shedding more light on the complex dynamics of political behavior.

Article

This essay explores the contributions of Deleuze and Guattari with a focus on teacher education. Like Deleuze and Guattari, who write about messiness and unpredictability, this essay takes an unconventional approach and is structured rhizomatically, with an emphasis on Deleuze and Guattari’s contributions to modes of thought that problematize, conceptualize and challenge normativity. Problematization and conceptualization create opportunities for experimentation in teacher education, and this article references several research studies that propose different modes of thought. This essay is formulated as a kind of intermezzo, a space of becoming, with the aim of problematizing normativity through different modes of thought and concepts emerging in teacher education.

Article

It can be difficult for political scientists and economists to know when to use laboratory experiments in their research programs. There are longstanding concerns in economics and political science about the external invalidity of laboratory results. Making matters worse, a number of prominent academics recommend using field experiments instead of laboratory experiments to learn about human behavior because field experiments do not have the same external invalidity problems that plague laboratory experiments. The criticisms of laboratory experiments as externally invalid, however, overlook the many advantages of laboratory experiments that derive from their external invalidity. Laboratory experiments are preferable to field experiments at examining hypothetical scenarios (e.g., When automated vehicles dominate the roadways, what principles do people want their automobiles to rely on?), at minimizing erroneous causal inferences (e.g., Did a treatment produce the reaction researchers are studying?), and at replicating and extending previous studies. Rather than being a technique that should be abandoned in favor of field experiments, political scientists and economists should embrace laboratory experiments when testing theoretically important but empirically unusual scenarios, tracing experimental processes, and reproducing and building on prior experiments.

Article

Deborah J. Street and Rosalie Viney

Discrete choice experiments are a popular stated preference tool in health economics and have been used to address policy questions, establish consumer preferences for health and healthcare, and value health states, among other applications. They are particularly useful when revealed preference data are not available. Most commonly in choice experiments respondents are presented with a situation in which a choice must be made and with a a set of possible options. The options are described by a number of attributes, each of which takes a particular level for each option. The set of possible options is called a “choice set,” and a set of choice sets comprises the choice experiment. The attributes and levels are chosen by the analyst to allow modeling of the underlying preferences of respondents. Respondents are assumed to make utility-maximizing decisions, and the goal of the choice experiment is to estimate how the attribute levels affect the utility of the individual. Utility is assumed to have a systematic component (related to the attributes and levels) and a random component (which may relate to unobserved determinants of utility, individual characteristics or random variation in choices), and an assumption must be made about the distribution of the random component. The structure of the set of choice sets, from the universe of possible choice sets represented by the attributes and levels, that is shown to respondents determines which models can be fitted to the observed choice data and how accurately the effect of the attribute levels can be estimated. Important structural issues include the number of options in each choice set and whether or not options in the same choice set have common attribute levels. Two broad approaches to constructing the set of choice sets that make up a DCE exist—theoretical and algorithmic—and no consensus exists about which approach consistently delivers better designs, although simulation studies and in-field comparisons of designs constructed by both approaches exist.

Article

Matteo M. Galizzi and Daniel Wiesen

The state-of-the-art literature at the interface between experimental and behavioral economics and health economics is reviewed by identifying and discussing 10 areas of potential debate about behavioral experiments in health. By doing so, the different streams and areas of application of the growing field of behavioral experiments in health are reviewed, by discussing which significant questions remain to be discussed, and by highlighting the rationale and the scope for the further development of behavioral experiments in health in the years to come.

Article

In the study of crime media and popular culture, researchers have a wide range of research methodologies at their disposal. Each methodology or standardized practice for producing knowledge involves an epistemological foundation and rules of evidence for making a claim, as well as a set of practices for generating evidence of the claim. The research methodology chosen is contingent upon the question being studied, as each methodology has strengths and weaknesses. As the most stringent research design, experiments are unique because they are the only methodology able to establish causality. This is because experimental design’s major advantage is that researchers can control the environment, conditions, and variables that are being studied. However, experiments suffer from a major disadvantage as well: the precision and control utilized in experiments make it difficult to apply the findings to the real world, referred to as generalizability. This is especially poignant in crime media and popular culture studies where researchers are often interested in exploring how the criminal justice system, participants, and processes are socially constructed and how the mediated images impact our conceptualization of criminality and appropriate criminal justice system responses.

Article

Micah Dillard and Jon C.W. Pevehouse

Scholarship in international relations has taken a more quantitative turn in the past four decades. The field of foreign policy analysis was arguably the forerunner in the development and application of quantitative methodologies in international relations. From public opinion surveys to events data to experimental methods, many of the earliest uses of quantitative methodologies can be found in foreign policy analysis. On substantive questions ranging from the causes of war to the dynamics of public opinion, the analysis of data quantitatively has informed numerous debates in foreign policy analysis and international relations. Emerging quantitative methods will be useful in future efforts to analyze foreign policy.

Article

Jiawei Liu and Dietram A. Scheufele

There is a dichotomy in framing research that can be traced back to its multidisciplinary origins in psychology and sociology. Definitions of framing rooted in psychology are concerned with the differential presentation of the otherwise identical information and are often referred to as equivalence framing. Definitions rooted in more sociological traditions investigate how a message can be constructed with different sets of information to highlight contrasting perspectives on the same issue. The latter is typically referred to as emphasis framing. Although often subsumed under the same label, equivalence framing and emphasis framing are systematically different, both conceptually and operationally. Therefore, the two traditions need to be carefully distinguished in terms of their origins, conceptualization and operationalization of frames, underlying mechanisms, cognitive outcomes, and their relationships with other media effects theories. Categorizing existing studies revealed two major pitfalls in framing effects literatures. First, many political communication studies to date have adopted the emphasis framing approach. However, as substantial manipulation of information introduces confounding variables making it difficult for researchers to attribute the effect on the audience to the change of frames, this approach has relatively low internal validity in experiments and can hardly be distinguished from other cognitive media effects models, such as agenda setting and priming. Thus, the bias toward emphasis framing needs to be addressed by conducting research with equivalence frames so that a more concrete causal relationship between message framing and its effects can be established. In addition, little attention has been given to visuals in framing effects research so far. Considering that people consume information in a multimedia environment online, visual frames and verbal-visual interactions need to be further investigated.

Article

Public diplomacy has become an essential subject for both practitioners of foreign policy and scholars of international relations/world politics. The more the term achieves popularity and is used in policy papers, magazines, academic books, and articles, the greater the number of different definitions of the concept. Unfortunately, no universally agreed-upon definition exists. With regard to the international relations debate on the “-isms,” some researchers claim that public diplomacy is part of constructivism. Yet, while it may be appropriate to categorize public diplomacy as constructivist for norm-oriented reputation politics such as “naming and shaming,” many realists working from the rationalist paradigm have recognized the importance of public diplomacy in international relations. Recently, beyond discussions on definitions and scope of public diplomacy, many data-oriented, empirical studies have been published on the subject. For instance, moves have been made to rank which state can achieve the greatest level of soft power through the effective practice of public diplomacy. Moreover, quantitative text analysis (QTA) or content analysis frameworks have frequently been utilized to study how international media focus on controversial diplomatic issues between states. Even tweets and social networks are being studied to reveal what types of international diplomatic communications are supported and opposed by third-party domestic audiences. Rapid developments continue to be made in the methodological sophistication of public diplomacy studies.

Article

Michael Domínguez

Emerging in the learning sciences field in the early 1990s, qualitative design-based research (DBR) is a relatively new methodological approach to social science and education research. As its name implies, DBR is focused on the design of educational innovations, and the testing of these innovations in the complex and interconnected venue of naturalistic settings. As such, DBR is an explicitly interventionist approach to conducting research, situating the researcher as a part of the complex ecology in which learning and educational innovation takes place. With this in mind, DBR is distinct from more traditional methodologies, including laboratory experiments, ethnographic research, and large-scale implementation. Rather, the goal of DBR is not to prove the merits of any particular intervention, or to reflect passively on a context in which learning occurs, but to examine the practical application of theories of learning themselves in specific, situated contexts. By designing purposeful, naturalistic, and sustainable educational ecologies, researchers can test, extend, or modify their theories and innovations based on their pragmatic viability. This process offers the prospect of generating theory-developing, contextualized knowledge claims that can complement the claims produced by other forms of research. Because of this interventionist, naturalistic stance, DBR has also been the subject of ongoing debate concerning the rigor of its methodology. In many ways, these debates obscure the varied ways DBR has been practiced, the varied types of questions being asked, and the theoretical breadth of researchers who practice DBR. With this in mind, DBR research may involve a diverse range of methods as researchers from a variety of intellectual traditions within the learning sciences and education research design pragmatic innovations based on their theories of learning, and document these complex ecologies using the methodologies and tools most applicable to their questions, focuses, and academic communities. DBR has gained increasing interest in recent years. While it remains a popular methodology for developmental and cognitive learning scientists seeking to explore theory in naturalistic settings, it has also grown in importance to cultural psychology and cultural studies researchers as a methodological approach that aligns in important ways with the participatory commitments of liberatory research. As such, internal tension within the DBR field has also emerged. Yet, though approaches vary, and have distinct genealogies and commitments, DBR might be seen as the broad methodological genre in which Change Laboratory, design-based implementation research (DBIR), social design-based experiments (SDBE), participatory design research (PDR), and research-practice partnerships might be categorized. These critically oriented iterations of DBR have important implications for educational research and educational innovation in historically marginalized settings and the Global South.

Article

Field experiments allow researchers on political behavior to test causal relationships between mobilization and a range of outcomes, in particular, voter turnout. These studies have rapidly increased in number since 2000, many assessing the impact of nonpartisan Get-Out-the-Vote (GOTV) campaigns. A more recent wave of experiments assesses ways of persuading voters to change their choice of party or alter their social and political attitudes. Many studies reveal positive impacts for these interventions, especially for GOTV. However, there are far fewer trials carried out outside the United States, which means it is hard to confirm external validity beyond the U.S. context, even though many comparative experiments reproduce U.S. findings. Current studies, both in the United States and elsewhere, are growing in methodological sophistication and are leveraging new ways of measuring political behavior and attitudes.