Chapter 23 Politics from the Perspective of Minority Populations

Dennis Chong and Jane Junn
There are too few studies yet to constitute a research program, but the initial forays have successfully featured the advantages of experimental design and distinct perspectives of minority groups. We review the methodology and findings of these experimental studies to highlight their contributions and limitations and to make several general observations and suggestions about future directions in this field. As we show, randomization and control strengthen the internal validity of causal inferences drawn in experiments; however, of equal importance, the interpretation and significance of results depends on additional considerations, including the measurement of variables, the external validity of the experiment, and the theoretical coherence of the research design.

1. Racial Priming

Priming Racial Considerations among Blacks
The dynamics of racial appeals are likely to be different among blacks because racial messages aimed at blacks often promote group interests without raising conflicting considerations between race and equality. Therefore, in contrast to white respondents, blacks should be more likely to evaluate an issue using racial considerations when primed with either explicit or implicit racial cues.
To test the idea that explicit and implicit messages affect blacks and whites differently, White (2007) designed an experiment using news articles to manipulate the verbal framing of two issues: the Iraq War and social welfare policy. The sample included black and white college students and adults not attending college. Participants were randomly assigned to one of the treatments or to a control group that read an unrelated story. For each issue, one of the frames explicitly invoked black group interests to justify the position taken in the article, a second frame included cues that implicitly referred to blacks, and a third frame included nonracial reasons. In the welfare experiment, there were two implicit frame conditions in which the issue was associated with either “inner-city Americans” or “poor Americans” on the assumption that these references would stimulate racial resentment among whites and group interests for blacks. Similarly, the implicit racial cue in the Iraq War experiment referred to how the war drained money from social spending.
As in prior studies of white opinion, the experiments confirmed that resentment of blacks among whites was strongly related to support for the war and opposition to welfare spending only in the implicit condition. Among blacks, racial identification was strongly related to support in the explicit condition on both issues, but, surprisingly, was unrelated in the implicit condition. Thus, explicitness of the cue has differential effects among blacks and whites, roughly as predicted by the theory.
There are some oddities, however. Racial resentment among whites significantly reduces support for the war in the racially explicit condition, when the unequal burden of the war on blacks is emphasized. The racial priming theory predicts that explicit statements should weaken the relationship between resentment and support for the war, but not reverse its direction. In the welfare experiment, egalitarian values are also strongly primed among whites in the implicit racial condition, in addition to out-group resentments. This means that egalitarian considerations potentially counteract racial resentment, even in the implicit case, contrary to expectations. Finally, in contrast to past research (Kinder and Sanders 1996; Kinder and Winter 2001), blacks do not respond racially to the implicit message that war spending reduces social spending or to the implicit cues used to describe the welfare issue.
The anomalies of an experimental study can sometimes yield as much theoretical and methodological insight as the confirmatory findings. In this case, anomalies force us to reconsider the appropriate test of the priming hypothesis. A possible explanation for the weak effect of implicit cues among blacks is that the treatment affects the overall level of support for policies, in addition to the strength of the relationship between racial predispositions and policy preferences. A flat slope coefficient between racial identification and policy positions does not eliminate the possibility that levels of support or opposition – reflected in the intercept term – change among both strong and weak identifiers in response to the treatment. The priming hypothesis therefore requires an examination of both intercepts and slopes.
Furthermore, the imprecise definition and operationalization of explicit and implicit cues raises measurement issues. In the welfare experiment, two implicit cues referring to “inner-city Americans” and “poor Americans” were incorporated in arguments made in support of welfare programs. Likewise, the implicit racial condition in the Iraq War experiment refers to the war taking attention away from “domestic issues,” including “poverty,” “layoffs,” “inadequate health care,” and “lack of affordable housing.” Without explicitly mentioning blacks, both treatments refer to issues that are associated with blacks in the minds of many Americans. However, the “nonracial” condition in the welfare experiment also refers to “poor” Americans or “working” Americans losing food stamps, Medicaid, and health care and falling into poverty, which are the same kinds of domestic policy references used in the implicit conditions in the two experiments. As we elaborate shortly, the imprecise definition of explicit and implicit cues raises general issues of measurement and pre-testing of treatments that are central to experimentation.
The Media's Crime Beat
A second priming study worth exploring in detail for the substantive contributions and methodological issues it raises is Gilliam and Iyengar's (2000) study of the influence of local crime reporting in the Los Angeles media. Whereas White's study investigated how priming affects the dimensions or considerations people use to evaluate an issue, Gilliam and Iyengar focus on attitude change in response to news stories that stimulate racial considerations underlying those attitudes.
Gilliam and Iyengar (2000) hypothesize that the typical crime script used in local television reporting (especially its racial bias against blacks) has had a corrosive effect on viewers’ attitudes toward the causes of crime, law enforcement policies, and racial attitudes. They designed an experiment in which participants recruited from the Los Angeles area were randomly assigned to one of four conditions. In the control condition, participants watched a news video that did not include a crime story. In the three other conditions, participants viewed a crime story in which the race of the alleged perpetrator was manipulated. In one of the crime stories, there was no description of the murder suspect. In the other two conditions, digital technology was used to change the race (black or white) of the suspect shown in a photograph.
Gilliam and Iyengar (2000) found that whites who were exposed to a crime story (regardless of the race of the suspect) tended to be more likely to give dispositional explanations of crime, prefer harsh penalties, and express racially prejudiced attitudes. Black respondents, in contrast, either were unmoved by the treatments or were moved in the opposite direction as whites, toward less punitive and prejudiced attitudes. The limited variance (within racial groups) across treatments is partially explained by one of the more fascinating and disconcerting findings of the study. A large percentage (sixty-three percent) of the participants who viewed the video that did not mention a suspect nonetheless recalled seeing a suspect, and most of them (seventy percent) remembered seeing a black suspect. This suggests that the strong associations between crime and race in people's minds led participants to fill in missing information using their stereotypes. In effect, the “no suspect” condition served as an implicit racial cue for many participants, reducing the contrast between the “black suspect” and “no suspect” conditions. This finding reinforces the need to pre-test stimuli to determine whether treatments (and nontreatments) are working as desired.
Yet, their treatment produces large effects. For example, exposure to the treatment featuring a black suspect increases scores on the new racism scale by twelve percentage points. Compare that amount to the difference between survey respondents who hardly ever watched the local news and those who watched the news on a daily basis: the most frequent viewers scored twenty-eight percentage points higher on the new racism scale. It is puzzling how a single exposure to a subtle manipulation can produce an effect that is almost fifty percent of the effect of regular news watching. Perhaps the decay of effects is rapid and the magnitude of the experimental treatment effect varies across participants depending on their pre-treatment viewing habits. Both the experiment and the survey indicate that the style of local television coverage of crime in Los Angeles has had a detrimental effect on viewers’ attitudes toward race and crime. However, to reconcile the results of the two studies, we need more evidence of how viewers’ attitudes are shaped over time when they are chronically primed (with variable frequency) by media exposure.

2. Attitude Change

Important studies by Bobo and Johnson (2004), Hurwitz and Peffley (2005), and Peffley and Hurwitz (2007) employ survey experimental methods on national samples to study the malleability of black and white attitudes under different framing conditions. A comparison of the results from these studies highlights the variable effects of similar experimental treatments. Bobo and Johnson hypothesize that because blacks are more likely to believe that the criminal justice system is racially biased, they are more likely to be influenced by frames accentuating bias in the system when they are asked their opinion of the death penalty and other sentencing practices. For each survey experiment, respondents were randomly assigned to receive one of several framed versions of a question about the criminal justice system (the treatment groups) or an unframed question (the control group).
Most of the tests revealed surprisingly little attitude change among either blacks or whites in response to frames emphasizing racial biases on death row, racial disparities in the commission of crimes, and wrongful convictions. The only frame that made a slight difference emphasized the greater likelihood that a killer of a white person would receive the death penalty than a killer of a black person. This manipulation significantly lowered support for the death penalty among blacks, but not among whites (although the percentage shifts are modest).
Attitudes toward drug offenses proved to be more malleable and responsive, specifically to frames emphasizing racial bias in sentencing. Attempts to change views of capital punishment may yield meager results, but efforts to reframe certain policies associated with the war on drugs may have substantial effects on opinion.
Peffley and Hurwitz (2007) also test whether capital punishment attitudes are malleable among blacks and whites in response to arguments about racial biases in sentencing and the danger of executing innocent people. In contrast to Bobo and Johnson (2004), they find that both arguments reduce support for the death penalty among blacks. However, the most shocking result is that the racial bias argument causes support to increase significantly among whites. Peffley and Hurwitz explain that the racial bias argument increases support for the death penalty among prejudiced individuals by priming their racial attitudes. This priming effect is made more surprising if we consider the racial bias argument to be an explicit racial argument that might alert white respondents to guard against expressing prejudice.
Peffley and Hurwitz (2007) do not reconcile their findings with the contrary results in Bobo and Johnson's (2004) survey experiment beyond speculating that the racial bias frames in the other survey may have been harder to comprehend. Among other possible explanations is that Bobo and Johnson's use of an Internet sample overrepresented individuals with strong prior opinions about the death penalty who were inoculated against framing manipulations. Bobo and Johnson, however, conclude that the frames are resisted irrespective of the strength of prior opinions because they find no differences in the magnitude of framing effects across educational levels.1
Two other anomalies in the Peffley and Hurwitz (2007) study are worth mentioning briefly, and we return to them in the general discussion of this body of research. First, “consistent with our expectations, blacks apparently need no explicit prompting to view questions about the death penalty as a racial issue. Their support for the death penalty, regardless of how the issue is framed, is affected substantially by their belief about the causes of black crime and punishment” (1005). Although Peffley and Hurwitz anticipated this result, it might be viewed as being somewhat surprising in light of White's (2007) demonstration that racial attitudes are related to public policies only when they are explicitly framed in racial terms. Second, among both black and white respondents, racial arguments do not increase the accessibility of other racial attitudes, such as stereotypical beliefs about blacks.
Framing Affirmative Action Decisions
Clawson, Kegler, and Waltenburg's (2003) study of the framing of affirmative action illustrates the sensitivity of results to the sample of experimental participants. They used a two-by-two design in which participants received one of four combinations of frames embedded in a media story about a recent Supreme Court decision limiting affirmative action. The decision was described either as a decision barring preferential treatment for any group or as a major blow to affirmative action and social justice; in each media story, there was either a critical comment about Justice Clarence Thomas or no comment about Justice Thomas’ conservative vote on the issue.
The participants were 146 white and black students from a large Midwestern university. Comparisons of the sample to the American National Election Studies and National Black Election Study samples revealed, as expected, that both black and white participants were younger, better educated, and wealthier than blacks and whites in the national sample. Black participants were also much more interested in politics than was the national black sample.
The dominant finding for black participants is that they (in contrast to white participants) have firm positions on affirmative action regardless of how a recent conservative court ruling is framed. Among blacks, only their attitude toward blacks (measured by racial resentment items) and gender predicted their attitude toward affirmative action; the frames were irrelevant.
The insignificance of framing in this experiment illustrates the difficulty of generalizing beyond the experimental laboratory participants to the general population. Affirmative action is likely to be a more salient issue to African Americans, and attitudes on salient issues are likely to be stronger and more resistant to persuasion. Whether this is true for only a small subset of the black population or for most blacks can only be settled with a more representative sample.

3. Racial Cues and Heuristics

The next set of studies we review involves experimental tests of the persuasiveness of different sources and messages. These studies focus on minority responses to consumer and health messages, but they are relevant for our purposes because their findings on how racial minorities use racial cues in processing information can be extrapolated to political choices.
In the basic experimental design, participants (who vary by race and ethnicity) are randomly assigned to receive a message from one of several sources that vary by race or ethnicity and expertise. The primary hypothesis is that sources that share the minority participant's race or ethnicity will be evaluated more highly along with their message. A second hypothesis is that the impact of shared race or ethnicity will be moderated by the strength of the participant's racial identity. Finally, these studies test whether white participants favor white sources and respond negatively to minority sources.
Appiah (2002) found that black audiences recalled more information delivered by a black source than a white source in a videotaped message. This study also found that white participants’ recall of information about individuals on a videotape was unaffected by the race of those individuals. White subjects’ evaluation of sources was based on social (occupation, physical appearance, social status) rather than racial features, perhaps because race is less salient to individuals in the majority.
Wang and Arpan (2008) designed an experiment to study how race, expertise, and group identification affected black and white audiences' evaluations of a public service announcement (PSA). The participants for the experiments were black and white undergraduate students recruited from a university in the southeastern United States and from a historically black college in the same city.
Black respondents not only rated a black source more highly than a white source, but also reacted more positively toward the PSA when it was delivered by a black source. However, the effect of the source on blacks and whites was again asymmetric. Race did not bias white respondents’ evaluations in the same way; instead, whites were more affected in their evaluation of the message by the expertise (physician or nonphysician) of the source than were blacks. Contrary to expectations, strength of racial identity did not moderate the effect of the race of the source.
The favoritism that blacks show toward a black source in a public health message is also demonstrated in an experiment by Herek, Gillis, and Glunt (1998) on the factors influencing evaluation of AIDS messages presented in a video. Blacks evaluated a black announcer as more attractive and credible than a white announcer, but these in-group biases were not manifest among whites. Blacks also favored videos that were built around culturally specific messages, in contrast to multicultural messages. The manipulations in this experiment affected proximate evaluations of the announcer and the message, but did not affect attitudes, beliefs, and behavioral intentions regarding AIDS.
Whittler and Spira's (2002) study of consumer evaluations hypothesizes that source characteristics will serve as peripheral cues, but can also motivate cognitive elaboration of messages. Studies have shown that whites sometimes focus more heavily on the content of the message when the source is black (White and Harkins 1994; Petty, Fleming, and White 1999). The sample consisted of 160 black adults from a southeastern city assigned to a 2 × 2 experimental design. Participants received a strong or weak argument from either a black or white speaker advertising a garment bag.
The evidence in the Whittler and Spira (2002) study is mixed. Participants overlooked the quality of arguments and rated the product and advertising more favorably if it was promoted by a black source, but this bias was evident only among participants who identified strongly with black culture. Identification with the black source appeared to generate more thought about the speaker and the advertisement; however, because additional thinking was also biased by identification, greater thought did not lead to discrimination between strong and weak arguments.
Forehand and Deshpande (2001) argue that group-targeted ads will be most effective on audiences that have been ethnically primed. Same-ethnicity sources or group-targeted messages may not have a significant impact on audiences unless ethnic self-awareness is initially primed to make the audience more receptive to the source.
The subjects in the Forehand and Deshpande (2001) study were Asian American and white students from a West Coast university. Advertisements were sandwiched between news segments on video, with ethnic primes preceding advertisements aimed at the ethnic group. Similar results were obtained in both experiments. Exposure to the ethnic prime caused members of the target audience to respond more favorably to the ethnic ad. However, the magnitude of the effect of the ethnic prime was not magnified by strong ethnic identification, so the expectation of an interaction with enduring identifications was not met. This is a surprising result because we would expect strong identifiers to be more likely both to recognize the ethnic prime and to base their judgment on it. Exposure to the ethnic prime among members of the nontarget market (whites in the experiment) resulted in less favorable responses, but the magnitudes were statistically insignificant. Once again, it does not appear that an ethnic prime has a negative effect on individuals who do not share the same ethnicity.
Extensions to Vote Choice
An obvious extrapolation from these studies is to examine how variation in the race or ethnicity of a politician influences political evaluations and choices. Kuklinski and Hurley (1996) conducted one of the few experimental studies in political science along these lines. African Americans recruited from the Chicago metropolitan region were randomly assigned to one of four treatments or to a control group. Each treatment presented a common statement about the need for self-reliance among African Americans, but the statement was attributed to a different political figure in each of the four conditions: George Bush, Clarence Thomas, Ted Kennedy, or Jesse Jackson. If the statement was attributed to Bush or Kennedy, then participants were more likely to disagree with it, but if the observation originated from Jackson or Thomas, then they were significantly more likely to agree. As in the case of the aforementioned Whittler and Spira study, some respondents relied entirely on the (peripheral) racial cue to form their judgment, but even those respondents who gave more attention to the substance of the message construed it in light of the source.
Surprisingly, we did not discover any experimental research using this basic design to analyze the effect of race and ethnicity on minority voter choice. An innovative experimental study by Terkildsen (1993) examined the effects of varying the race (black or white) and features (light or dark skin tone) of candidates, but only on the voting preferences of white respondents (who evaluated the white candidate significantly more positively than either of the two black candidates.).
Abrajano, Nagler, and Alvarez (2005) took advantage of an unusual opportunity in Los Angeles County to disentangle ethnicity and issue distance as factors in voting. In this natural experiment using survey data, Abrajano et al. analyzed the electoral choices of voters in two open city races involving Latino candidates running against white candidates. In the mayoral race, the white candidate was more conservative than the Latino candidate, but the white candidate was the more liberal candidate in the city attorney election. They found that Latino voters were more affected by the candidates’ ethnicity and much less affected by their issue positions than were white voters.

4. Political Mobilization: Get Out the Vote

Aside from laboratory and survey research on persuasion and information processing, the study of political mobilization is the other area in which there has been sustained experimental research on minority groups.2 Field research on the political mobilization of minorities comes with special challenges because it requires investigators to go beyond standard methodologies for data collection in the midst of electoral campaigns. Researchers must take care to locate the target populations for study, provide multilingual questionnaires and interviewers in some cases, and design valid and reliable treatments appropriate to minority subjects.
Garcia Bedolla and Michelson (2009) report on a field experimental study of a massive effort to mobilize voters through direct mail and telephone calls in California during primary and general election phases of the 2006 election. The content of the direct mail included a get out the vote (GOTV) message, but varied in terms of procedural information such as the voter's polling place and a photo included in the mailer that was adjusted “to be appropriate to each national-origin group” (9). The authors found no significant impact of direct mail and a positive effect of a phone call on voting turnout among the Asian American subjects contacted (with considerable variance across groups classified by national origin). Considering the extremely low base rate of voting in the target population, the treatment had a large proportional impact. The authors’ conclusions from this set of experiments and other GOTV studies in California and elsewhere point to the significance of a personal invitation to participate. At the same time, however, they admitted, “We do not have a well-defined theoretical understanding of why an in-person invitation would be so effective, or why it could counteract the negative effect of low voter resources” (271).
The results from the Garcia Bedolla and Michelson (2009) field experiments are consistent with earlier studies of Latinos, Asian Americans, and African Americans that have shown direct mail to be ineffective and personal contact to be effective interventions with minority voters. In a large-scale national field experiment with African American voters during the 2000 election, Green (2004) found no significant effects on turnout with a mailing and small but statistically significant effects from a telephone call. In another large field experiment during the 2002 election, Ramirez (2005) analyzed results from attempted contact with nearly a half-million Latinos by the National Association of Latino Elected and Appointed Officials. Neither the robo-calling nor the direct mail had a discernible and reliable influence on voter turnout among Latinos, but the live telephone calls did have a positive effect on mobilizing voters.
Trivedi (2005) attempted to discern whether distinctive appeals to ethnic group solidarity among Indian Americans would increase voter turnout. Despite three alternative framings with racial and ethnic cues, there were no significant effects on voter turnout of any of the three groups that received the mailing. Wong's (2005) field experiment during the 2002 election included a postcard mailing or a phone call for randomly assigned Asian American registered voters in Los Angeles County who resided in high-density Asian American areas. In contrast to other studies that show no effect from direct mail, Wong found positive effects for both mobilization stimuli on Asian American voter turnout.
Finally, Michelson (2005) reports on a series of field experiments with Latino subjects in central California. Her results show that Latino Democrats voted at a higher rate when contacted by a coethnic canvasser. Michelson suggests possible social and cognitive mechanisms that explain why “coethnic” contacts may stimulate higher levels of participation: “Latino voters are more likely to be receptive to appeals to participate when those appeals are made by coethnics and copartisans.…In other words, if the messenger somehow is able to establish a common bond with the voter – either through shared ethnicity or through shared partisanship – then the voter is more likely to hear and be affected by the mobilization effort” (98–99).
Taken together, none of the field experiments shows strong or consistent positive effects from direct mailings, regardless of content, format, or presentation of the information in a language assumed to be most familiar to the subject. Second, personal contact with a live person in a telephone call has a modest absolute effect, and potentially a greater effect if the contact occurs in person, especially if that individual is a “coethnic” canvasser. Third, effective methods for mobilizing specifically minority voters are essentially the same as those found to work on majority group populations. Personal contacts, unscripted communications, and face-to-face meetings provide more reliable boosts to turnout than do more automated, remote techniques (Gerber and Green 2000).
To the extent that field experimental research on the mobilization of minority voters is distinct from studies of white voters, it is due to the nascent hypothesis that identifications and social relationships based on race and ethnicity ought to moderate the impact of mobilization treatments. This intuition or hunch lies behind experimental manipulations that try to stimulate group identification using racial or ethnic themes or imagery in communications. A Latino voter, for example, is told his or her vote will help empower the ethnic community, or an Asian American is shown a photograph of Asian Americans voting out of duty as U.S. citizens.
The prediction that treatments will elevate racial and ethnic awareness and thereby increase one's motivation to vote is based on several assumptions about both the chronic accessibility of social identifications and the durability of treatment effects. Some observations drawn previously from our review of political psychology research should lower our expectations about the impact of such efforts to manipulate racial identities. In communications experiments on racial priming, participants are often college students who are unusually attentive to experimental treatments; volunteers who agree to participate are eager to cooperate with the experimenter's instructions and pay close attention to any materials they are asked to read or view. This combination of higher motivation and capacity means the laboratory subject receives what amounts to an especially large dosage of the treatment. Finally, if we assume the treatment to be not only fast acting but also fast fading – like a sugar rush – then its effects will only be detected if we measure them soon after it is administered.
The typical GOTV field experiment deviates from these conditions in each instance. Attention to the treatment and interest in politics are low (indeed, sometimes the participants are selected on this basis), and comprehension may be impaired because of language difficulties or inability. Furthermore, the ad hoc design of the ethnic cues makes them equivalent to an untested drug whose effects have not heretofore been demonstrated in pre-testing. Unlike laboratory experiments in which effects are measured promptly, the GOTV treatments are expected to influence behavior (not simply attitudes) days or weeks later, so it is perhaps not surprising that they have proved to be anemic stimulants.

5. General Observations and Future Directions

In our review, we considered not only whether a treatment had a significant effect in a particular study, but also the interpretation of those effects (does the explanation accurately reflect what occurred in the experiment?) and the consistency of experimental effects across related studies (are the results of different studies consistent with a common theory?). We elaborate in this section by discussing how to strengthen the internal and external validity of experiments through improvements in measurement, design, and theory building.
Generalizing from a Single Study
The variability of results across studies recommends careful extrapolation from a single study. For example, the failure of a framed argument to move opinion may be explained by the imperviousness of participants on the issue or by the weakness of the frames. Bobo and Johnson (2004) chose the former interpretation in arguing that “with respect to the death penalty, our results point in the direction of the relative fixity of opinion” (170). However, they also concluded from their survey experiment that reframing the war on drugs as “racially biased” might significantly reduce support for harsh sentencing practices among both blacks and whites.
Importance of Pre-Testing Measures
The internal validity of a study depends on reliable and valid measures. A general lesson drawn from the experiments on persuasion and information processing, as well as the GOTV studies, is the need to pre-test stimuli to establish that treatments have the characteristics attributed to them. These pre-tests will be sample dependent and should be administered to individuals who do not participate in the main experiment.
Our review provided several instances where progress on the effects of racial priming and framing would be aided by more clearly defined measures of explicit and implicit messages. Mendelberg (2001) classifies visual racial cues as implicit messages and direct verbal references to race as explicit messages. White (2007) distinguishes between explicit cues that mention race and implicit verbal cues that allude to issues and terms that are commonly associated with race. However, a domestic issue cue that is assumed to be an implicit racial cue in one experiment is defined as a nonracial cue in another experiment. Bobo and Johnson (2004) and Peffley and Hurwitz (2007) introduce frames that refer directly to the disproportionate treatment of blacks under the criminal justice system, but do not interpret their respondents’ reactions to these frames using the implicit–explicit theoretical framework.
This conceptual task is made more difficult because the dividing line between explicit and implicit varies across audiences. Different audiences, owing to differences in past learning experiences, will draw different connotations from the same message. Certain messages are so blunt that they obviously draw attention to racial considerations. Other messages allude indirectly to race and can be interpreted in racial terms only by those who are able to infer racial elements from ostensibly nonracial words or symbols because of common knowledge that such symbols or words connote racial ideas (Chong 2000). Of course, if the common knowledge is so widespread as to be unambiguous, then even the implicit message becomes explicit to everyone in the know. Thus, there is supposedly a sweet spot of ambiguity wherein lie messages that cause people to think in racial terms either without their knowing it or without their having to admit it because there is a plausible nonracial interpretation of the message.
We do not have a ready solution for distinguishing between explicit and implicit messages. One possibility is that the location of a message on a continuum ranging from more to less explicit will correspond to the balance of racial and nonracial interpretations and thoughts that are spontaneously mentioned when interpreting the message (Feldman and Zaller 1992). However, individuals who are careful to monitor their public behavior may not candidly report their spontaneous thoughts, especially if those thoughts are racial in nature.
A covert method of eliciting the same information uses subliminal exposure to a given message followed by tests of reaction times to racial and nonracial stimuli. More explicit messages may be expected to produce quicker reactions to racial stimuli than implicit messages. Lodge and Taber (in press) provide a convincing demonstration of how implicit testing of competing theoretical positions can shed light in the debate over the rationales underlying support for symbolic racial political values (for a review, see Sears, Sidanius, and Bobo 2000). A racial issue (e.g., affirmative action) is used as a prime (presented so briefly on the screen that it registers only subconsciously), and the words automatically activated by this issue (determined by the speed of recognizing them) are interpreted to be the considerations raised by an issue. Coactivation of concepts is said to represent habits of thought, reflecting how individuals routinely think about the issue. Using this method, Lodge and Taber show that, among supporters of affirmative action, ideology and racial considerations were activated or facilitated by the affirmative action issue prime. However, among opponents, only racial words were activated (e.g., gang, afro). Therefore, it appears that the liberal position on the issue drew on more principled considerations, whereas the conservative position rested on racial considerations.
Adding Realism through Competition and Over-Time Designs
In the framing studies we examined, participants were exposed to arguments on only one side of the issue under investigation. In contrast, competition between frames and arguments reflects the reality of political debate in democratic systems. Multiple frames increase the accessibility of available considerations, and competition between frames can motivate more careful deliberation among alternatives (Chong and Druckman 2007). Framing effects produced by a one-sided frame are often not sustained in competitive environments (Sniderman and Theriault 2004; Chong and Druckman 2007; cf. Chong and Druckman 2008).
The theory of implicit and explicit messages, in particular, would benefit from a competitive experimental design because racial priming describes an inherently dynamic process in which strategic political messages are transmitted and countered and subject to claims and counterclaims about the meaning of the message and the intent of the messenger. The essence of an intrinsic racial message is that it can be defended against attacks that it is a racial (and perhaps racist) message. How the originator of the message parries these attacks undoubtedly has much to do with the success of the original strategy. Despite the theory, all testing has been essentially static and limited to a one-time administration of one-sided information.
Another way to increase the realism of designs is to examine communications processes over time (Chong and Druckman 2008). The persuasion and information processing studies we reviewed were one-shot studies in which the magnitudes of communication effects were measured immediately following exposure to the treatment. The design of these laboratory experiments contrasts with conditions in the real world, where individuals typically receive streams of messages and act on them at the end of a campaign. The interpretation of a one-shot experiment should therefore take account of the previous experiences of participants and the subsequent durability of any observed effects. A treatment may have a larger impact if it is received early rather than late in a sequence of communications because the effect of a late treatment may be dulled by past messages. In addition, we want to measure the durability of effects in the post-treatment period. A significant treatment effect may decay rapidly either on its own accord or under the pressure of competing messages. Ultimately, the effect of a treatment will be time dependent.
The importance of taking account of participants’ pre-treatment experiences is evident in the study of death penalty frames. The effectiveness of arguments against the death penalty likely depends on whether participants have previously heard and factored these arguments into their attitudes on the issue (Gaines, Kuklinski, and Quirk 2007). A paradox in this regard is the sizable effects generated by Gilliam and Iyengar's (2000) “subtle” media crime news intervention, which led us to wonder why experimental participants who have been “pre-treated” with everyday exposure to crime news coverage would nevertheless remain highly sensitive to the experimental treatment. If one-shot experimental exposure to crime stories produces an effect that is fifty percent of the effect of chronic real-world exposure, how much of this short-term effect decays and how much endures in the long-term effect? To disentangle these processes of learning and decay of opinion, we need to move from one-shot experimental designs to panel experiments, in which we measure attitude change in response to a series of exposures to treatments over time (Chong and Druckman 2008). A panel design would allow us to determine how the size and durability of effects are moderated by past experiences, the passage of time, and subsequent exposure to competing messages.
Integrating Theory and Design
Although experiments are well suited to testing whether an arbitrary treatment has an impact on an outcome variable (in the absence of a theoretically derived hypothesis), such a theory is ultimately required to explain and bring coherence to disparate results. Otherwise, experiments are at risk of being a series of one-off exercises.
The theoretical challenge of specifying the meaning and measurement of racial group identification and its relationship to political behavior and attitudes is one of the most significant hurdles in research on the political psychology and behavior of minorities. GOTV studies have tested whether stimulating racial identification can increase turnout in elections, but this research has not been guided explicitly by a theory of the mechanisms that activate racial identification or of the factors that convert identification to action. As noted, the failure of efforts to motivate voter turnout by using racial or ethnic appeals can be explained in large part by the superficial nature of the treatments. GOTV experiments might draw on the results of past survey research on racial identification, which showed that the connection between group identification and political participation is mediated by perceptions of group status, discontent with the status quo, and beliefs about the origins of group problems and efficacy of group action (Miller et al. 1981; Shingles 1981; Marschall 2001; Chong and Rogers 2005). This model of racial identification suggests that experimental manipulation of racial awareness by itself will have little effect on political participation without the constellation of intervening cognitive factors that motivate individuals to participate.
A fruitful theory of racial identification provides testable hypotheses of the conditions in which voters can be more easily mobilized on the basis of their race or ethnicity. Minority voters should be more responsive to racial cues when electoral candidates and issues place group interests at stake, and collective action is an effective means to obtain group goals (Chong 2000). The selection of future sites of GOTV field experiments therefore might exploit political contexts in which minority voters are likely to be especially susceptible to messages and contacts that prime their racial identification.3 Contact by coethnic organizers, which has proved effective in past studies, may have even greater impact in these circumstances, especially if campaign workers are drawn from the voter's social network. When political opportunities for gain present themselves, monitoring within the group – verified to be one of the most powerful influences on voting in GOTV research (Gerber, Green, and Larimer 2008) – would apply added social pressure on individuals to contribute to public goods.
The importance of theoretical development to experimental design applies to the areas of research that we cover. Although we group the persuasion, priming, and framing research as a “set” of studies that addresses common issues, they are not unified theoretically. This inhibits development of a research program in which there is consensus around certain theoretical concepts and processes that serve as a framework for designing new experimental studies.
The communications research we discuss here can be interpreted in terms of existing dual process theories of information processing (Petty and Cacioppo 1986; Petty and Wegener 1999; Fazio and Olson 2003). According to this theory, individuals who have little motivation or time to process information will tend to rely on economical shortcuts or heuristic rules to evaluate messages. Attitude change along this “peripheral” route, however, can be transitory, leading to short-term reversion to past beliefs.
Conversely, individuals who are motivated and able to think more deeply about a subject, due to incentives or predispositions to do so, will process information along a “central” route by giving closer attention to the quality of arguments in the message. Individuals who hold strong priors on the subject are more likely to ignore or resist contrary information and to adhere to their existing attitudes. In some cases, the cognitive effort they expend will end up bolstering or strengthening their attitudes. However, if the arguments are judged to be strong and persuasive, they can lead to attitude change that is enduring.
A variety of additional studies can be built around the dynamics of dual process theories as they pertain to racial identities and attitudes. The motivation and opportunities of participants can be manipulated to determine the conditions that increase or reduce the salience of race. We can experiment with manipulating information processing modes by varying the speed of decision making, the stakes of the decision, and increasing personal accountability to see whether central or peripheral routes are followed. Explicit racial messages, for example, should exert less influence on people who have had sufficient opportunity and motivation to engage in self-monitoring of their responses to the racial cue (Terkildsen 1993). Cognitive elaboration, of course, should not be expected to ensure attitude change. As the Whittler and Spira (2002) study discovered, racial identities can anchor viewpoints (akin to party identification) through motivated reasoning and biased information processing.

6. Conclusion

Experimental research on the political perspectives of minorities holds much promise for advancing our understanding of U.S. politics. Indeed, the insights generated by experimental studies of framing, persuasion, racial priming, and political mobilization in both majority and minority populations have made it difficult to think of these topics outside the experimental context. Observational studies of these subjects are hampered by selection biases in the distribution and receipt of treatments and lack of control over the design of treatments. One of the most important advantages of experimental over traditional observational or behavior methods is the promise of greater internal validity of the causal inferences drawn in the experiment. We can test the impact of alternative treatments without strong priors about the mechanism that explains why one treatment will be more effective than another.
The range of possible studies is exciting. For example, we can randomly manipulate the background characteristics of hypothetical candidates for office in terms of their partisanship, race, or ideology and estimate the impact of these differences on candidate preference among voters. Similarly, experiments could be designed to highlight or frame specific features of candidates or issues to observe the effect of such manipulations on voter preferences. The salience of the voter's racial and ethnic identity can be heightened or reduced to see how group identity and campaign messages interact to change voter preferences or increase turnout. Efforts to embed research designs and studies in a theory of information processing may yield the most fruitful set of results. In experimental designs, the dynamics of dual process theories can be exploited to manipulate participants’ motivation and opportunity to evaluate information in order to reveal the conditions that systematically influence the salience of race.
At the same time, experimentation cannot be regarded as a substitute for theory building. Results across studies are often conflicting, illustrating the sensitivity of results to variations in measurement and the sample of experimental participants. In the context of research on racial and ethnic minorities, we discuss how theory is essential for conceptual development, designing treatments, interpreting results, and generalizing beyond particular studies. We also identify what we believe to be promising directions to address the external validity of experimental designs, including the incorporation of debate and competition, use of over-time panel designs, and greater attention to the interaction between treatments and political contexts.

References

Abrajano, Marisa A., Jonathan Nagler, and R. Michael Alvarez. 2005. “A Natural Experiment of Race-Based and Issue Voting: The 2001 City of Los Angeles Elections.” Political Research Quarterly 58: 203–18.
Appiah, O. 2002. “Black and White Viewers’ Perception and Recall of Occupational Characters on Television.” Journal of Communications 52: 776–93.
Barreto, Matt A. 2007. “Si Se Puede! Latino Candidates and the Mobilization of Latino Voters.” American Political Science Review 101: 425–41.
Bobo, Lawrence, and Frank Gilliam. 1990. “Race, Sociopolitical Participation and Black Empowerment.” American Political Science Review 84: 379–93.
Bobo, Lawrence D., and Devon Johnson. 2004. “A Taste for Punishment: Black and White Americans’ Views on the Death Penalty and the War on Drugs.” DuBois Review 1: 151–80.
Chong, Dennis. 2000. Rational Lives: Norms and Values in Politics and Society. Chicago: The University of Chicago Press.
Chong, Dennis, and James N. Druckman. 2007. “Framing Public Opinion in Competitive Democracies.” American Political Science Review 101: 637–55.
Chong, Dennis, and James N. Druckman. 2008. “Dynamic Public Opinion: Framing Effects over Time.” Paper presented at the annual meeting of the American Political Science Association, Boston.
Chong, Dennis, and Dukhong Kim. 2006. “The Experiences and Effects of Economic Status among Racial and Ethnic Minorities.” American Political Science Review 100: 335–51.
Chong, Dennis, and Reuel Rogers. 2005. “Racial Solidarity and Political Participation.” Political Behavior 27: 347–74.
Clawson, Rosalee A., Elizabeth R. Kegler, and Eric N. Waltenburg. 2003. “Supreme Court Legitimacy and Group-Centric Forces: Black Support for Capital Punishment and Affirmative Action.” Political Behavior 25: 289–311.
Dawson, Michael. 1994. Behind the Mule Race and Class in African American Politics. Princeton, NJ: Princeton University Press.
Fazio, Russell H., and Olson, Michael A. 2003. “Attitudes: Foundations, Functions, and Consequences.” In The Handbook of Social Psychology, eds. Michael A. Hogg and Joel M. Cooper. London: Sage, 139–60.
Feldman, Stanley, and John Zaller. 1992. “The Political Culture of Ambivalence: Ideological Responses to the Welfare State.” American Journal of Political Science 36: 268–307.
Forehand, Mark R., and Rohit Deshpande. 2001. “What We See Makes Us Who We Are: Priming Ethnic Self-Awareness and Advertising Response.” Journal of Marketing Research 38: 336–48.
Gaines, Brian J., James H. Kuklinski, and Paul J. Quirk. 2007. “Rethinking the Survey Experiment.” Political Analysis 15: 1–21.
Garcia Bedolla, Lisa, and Melissa R. Michelson. 2009. “What Do Voters Need to Know? Testing the Role of Cognitive Information in Asian American Voter Mobilization.” American Politics Research 37: 254–74.
Gerber, Alan S., and Donald P. Green. 2000. “The Effects of Canvassing, Telephone Calls, and Direct Mail on Voter Turnout: A Field Experiment.” American Political Science Review 94: 653–63.
Gerber, Alan S., Donald P. Green, and Christopher W. Larimer. 2008. “Social Pressure and Voter Turnout: Evidence from a Large-Scale Field Experiment.” American Political Science Review 102: 33–48.
Gilens, Martin. 1999. Why Americans Hate Welfare: Race, Media, and the Politics of Anti-Poverty Policy. Chicago: The University of Chicago Press.
Gilliam, Frank D., Jr., and Shanto Iyengar. 2000. “Prime Suspects: The Impact of Local Television News on the Viewing Public.” American Journal of Political Science 44: 560–73.
Green, Donald P. 2004. “Mobilizing African-American Voters Using Direct Mail and Commercial Phone Banks: A Field Experiment.” Political Research Quarterly 57: 245–55.
Huber, Gregory A., and John S. Lapinski. 2008. “Testing the Implicit–Explicit Model of Racialized Political Communication.” Perspectives on Politics 6: 125–34.
Hurwitz, Jon, and Mark Peffley. 2005. “Explaining the Great Racial Divide: Perceptions of Fairness in the U.S. Criminal Justice System.” Journal of Politics 67: 762–83.
Iyengar, Shanto, and Donald R. Kinder. 1987. News That Matters: Television and American Opinion. Chicago: The University of Chicago Press.
Kinder, Donald R., and Lynn M. Sanders. 1996. Divided by Color: Racial Politics and Democratic Ideals. Chicago: The University of Chicago Press.
Kinder, Donald R., and Nicholas Winter. 2001. “Exploring the Racial Divide: Blacks, Whites, and Opinions on National Policy.” American Journal of Political Science 45: 439–56.
Kuklinski, James H., and Norman L. Hurley. 1996. “It's a Matter of Interpretation.” In Political Persuasion and Attitude Change, eds. Diana C. Mutz, Paul M. Sniderman, and Richard A. Brody. Ann Arbor: University of Michigan Press, 125–44.
Lien, Pei-te. 2001. The Making of Asian America through Political Participation. Philadelphia: Temple University Press.
Lodge, Milton, and Charles Taber. in press. The Rationalizing Voter. New York: Cambridge University Press.
Marschall, Melissa. 2001. “Does the Shoe Fit? Testing Models of Participation for African-American and Latino Involvement in Local Politics.” Urban Affairs Review 37: 227–48.
Mendelberg, Tali M. 2001. The Race Card: Campaign Strategy, Implicit Messages and the Norm of Equality. Princeton, NJ: Princeton University Press.
Michelson, Melissa R. 2005. “Meeting the Challenge of Latino Voter Mobilization.” Annals of the American Academy of Political and Social Science 601: 85–101.
Miller, Arthur, Patricia Gurin, Gerald Gurin, and Oksana Malanchuk. 1981. “Group Consciousness and Political Participation.” American Journal of Political Science 25: 494–511.
Peffley, Mark, and Jon Hurwitz. 2007. “Persuasion and Resistance: Race and the Death Penalty in America.” American Journal of Political Science 51: 996–1012.
Petty, Richard E., and John T. Cacioppo. 1986. Communication and Persuasion: Central and Peripheral Routes to Attitude Change. New York: Springer-Verlag.
Petty, Richard E., Monique A. Fleming, and P. H. White. 1999. “Stigmatized Sources and Persuasion: Prejudice as a Determinant of Argument Scrutiny.” Journal of Personality and Social Psychology 76: 19–34.
Petty, Richard E., and D. T. Wegener. 1999. “The Elaboration Likelihood Model: Current Status and Controversies.” In Dual Process Theories in Social Psychology, eds. Shelly Chaiken and Yaacov Trope. New York: Guilford Press, 41–72.
Ramirez, Ricardo. 2005. “Giving Voice to Latino Voters: A Field Experiment on the Effectiveness of a National Nonpartisan Mobilization Effort.” Annals of the American Academy of Political and Social Science 601: 66–84.
Sears, David O., Jim Sidanius, and Lawrence Bobo, eds. 2000. Racialized Politics: The Debate about Racism in America. Chicago: The University of Chicago Press.
Shingles, Richard D. 1981. “Black Consciousness and Political Participation: The Missing Link.” American Political Science Review 75: 76–91.
Sniderman, Paul M., and Sean M. Theriault. 2004. “The Structure of Political Argument and the Logic of Issue Framing.” In Studies in Public Opinion: Attitudes, Nonattitudes, Measurement Error, and Change, eds. Willem E. Saris and Paul M. Sniderman. Princeton, NJ: Princeton University Press, 133–65.
Tate, Katherine. 1994. From Protest to Politics: The New Black Voters in American Elections. Cambridge, MA: Harvard University Press.
Terkildsen, Nayda. 1993. “When White Voters Evaluate Black Candidates: The Processing Implication of Candidate Skin Color, Prejudice, and Self-Monitoring.” American Journal of Political Science 37: 1032–53.
Trivedi, Neema. 2005. “The Effect of Identity-Based GOTV Direct Mail Appeals on the Turnout of Indian Americans.” Annals of the American Academy of Political and Social Science 601: 115–22.
Wang, Xiao, and Laura M. Arpan. 2008. “Effects of Race and Ethnic Identity on Audience Evaluation of HIV Public Service Announcements.” Howard Journal of Communications 19: 44–63.
White, Ismail K. 2007. “When Race Matters and When It Doesn't: Racial Group Differences in Response to Racial Cues.” American Political Science Review 101: 339–54.
White, Paul H., and Stephen G. Harkins. 1994. “Race of Source Effects in the Elaboration Likelihood Model.” Journal of Personality and Social Psychology 67: 790–807.
Whittler, Tommy E., and Joan Scattone Spira. 2002. “Model's Race: A Peripheral Cue in Advertising Messages?” Journal of Consumer Psychology 12: 291–301.
Wong, Janelle S. 2005. “Mobilizing Asian American Voters: A Field Experiment.” Annals of the American Academy of Political and Social Science 601: 102–14.
We are grateful to Xin Sun, Caitlin O’Malley, and Thomas Leeper for research assistance on this project.
1 Their explanation assumes that the strength of attitudes toward the death penalty is positively correlated with education.
2 A full review of GOTV experiments is provided by Michelson and Nickerson's chapter in this volume.
3 There is a risk that the individuals in these more racialized political contexts may have already been activated by the ongoing campaign prior to the experimental manipulation. This pre-treatment of respondents may dampen the impact of any further experimental treatment that duplicates what has already occurred in the real campaign.