C93 | Macro Paper Warehouse

Do The Effects of Nudges Persist? Theory and Evidence from 38 Natural Field Experiments

Mon, 01 Jan 0001 00:00:00 +0000

This paper asks why the Home Energy Report (HER) — a widely deployed social-comparison nudge that shows households how their electricity consumption compares to their neighbors — produces behavioral changes that persist long after the nudge is discontinued, while analogous nudges in other domains (charitable giving, financial savings, voter turnout, tax compliance) fade almost entirely within a year or two. The authors formalize a research design to decompose the HER’s long-run effectiveness into two channels: technology adoption (a change in the stock of energy-efficient capital in the home) and habit formation (a change in the stock of habits or skills in the resident).

The identifying strategy exploits the administrative rule that when the initial resident in an HER experiment moves out, HER mailings stop immediately — but electricity consumption in the home continues to be observed as new residents occupy it. Under three assumptions — (1) treatment assignment did not influence the initial resident’s decision to move; (2) treatment assignment did not influence the type of resident who moved in; and (3) energy-efficient technology adopted in response to the HER remained in the home after the move — the post-move HER effect identifies the fraction of the long-run treatment effect attributable to technology adoption (ATK), and the remainder identifies the fraction attributable to habit formation (ATH).

Data come from 38 natural field experiments administered by Opower between 2008 and 2013 across 21 U.S. residential energy providers, comprising 61,310,166 electricity bills for 1,810,096 homes. The mover sample, restricted to homes where the initial resident deactivated service at or after the receipt of their fourth HER, contains 5,890,855 bills for 139,908 homes. Treatment and control homes enter the mover sample at statistically indistinguishable rates and have similar baseline electricity consumption.

The main findings: the HER reduced electricity consumption by 2.1 percent in the long run (the pre-move ATE). After the initial resident moved and the HER was discontinued, 1.1 percent of the reduction persisted in the home — attributable to technology. The habit channel accounts for the remaining 1.0 percent reduction. Normalizing by the ATE, 51.4 percent (s.e. = 13.1) of the long-run effectiveness is attributable to technology adoption and 48.6 percent to habit formation. The persistence of the post-move effect is robust across alternative specifications, different HER-receipt cutoffs, balanced panels, and exclusion of low-consumption move-period homes. A falsification test using rental homes — where tenants do not typically own appliances and the technology channel is therefore shut down — yields a null post-move effect, consistent with the balanced-habits assumption.

The authors use these results to explain a broader empirical pattern: one year after discontinuation, social comparison nudges targeting compliance, charitable giving, savings, and voter turnout retain on average only 4 percent of their initial effect, while nudges targeting energy and water conservation retain 65 percent. The paper argues this divergence reflects the relative abundance of enabling technologies in conservation contexts versus their absence in compliance or voting contexts. The findings also have cost-benefit implications: ignoring HER-induced technology adoption overstates net benefits by as much as 65 percent, depending on assumed technology cost per kWh saved (ranging from $0.03 per kWh saved per Gillingham et al. 2018 to $0.12 per kWh saved per Billingsley et al. 2014).

Scope conditions: results are specific to electricity-consumption nudges in the U.S. residential sector; the technology channel identification requires that adopted equipment stays in the home after a move; the decomposition rests on a linear production function for outcomes in habits and technology.

Q: What is the Home Energy Report and how was it administered in these experiments? A: The HER is a mailed social-comparison report that contrasts a household’s electricity consumption with that of similar neighbors. In each of the 38 waves, homes were observed for a 12-month baseline, then randomly assigned to treatment (receiving HERs) or control. HERs were mailed monthly, bimonthly, or quarterly; generation ceased when the initial resident deactivated electricity service.

Q: What is the paper’s central identification strategy? A: The authors exploit a discontinuity created when the initial treated resident moves out: HER mailings stop, but the home’s electricity consumption continues to be measured as new residents move in. Under three assumptions about non-interference of treatment with moving decisions, balanced habits of subsequent residents, and stability of adopted technology, the post-move HER effect point-identifies the technology-adoption component (ATK) of the long-run average treatment effect (ATE). The habit-formation component (ATH) is then inferred as ATE minus ATK.

Q: What are the three identifying assumptions and how are they tested? A: Assumption 1 (no effect of treatment on moving rates) and Assumption 2 (balanced habits of subsequent residents) are tested with the data; treatment and control homes enter the mover sample at statistically indistinguishable rates and have similar baseline consumption, supporting Assumption 1. The rental-home falsification test supports Assumption 2: rental homes show a null post-move effect, consistent with renters having balanced habits because the technology channel is inactive in rentals. Assumption 3 (stable technology after a move) is untestable from the data; the authors note that violation of this assumption would imply the post-move effect is a lower bound on ATK, making the technology-adoption estimate conservative.

Q: What are the main quantitative estimates of the decomposition? A: The pre-move (long-run) ATE is -2.1 percent of baseline electricity consumption. The post-move effect (ATK) is -1.1 percent, and the habit-formation component (ATH) is -1.0 percent. Normalizing by the ATE, 51.4 percent (s.e. = 13.1) is attributed to technology adoption and 48.6 percent to habits.

Q: How large is the HER effect in absolute terms during the comparison period? A: During the comparison period, the HER reduced average daily electricity consumption by approximately -1.8 to -2.3 percent in the first year and -1.5 to -2.0 percent in the second year, with 95 percent confidence intervals excluding zero. In levels, these correspond to roughly -0.6 to -0.9 kWh per day — equivalent to using 2 to 4 sixty-watt incandescent bulbs for 5 fewer hours per day.

Q: How persistent is the HER effect during the move period? A: In the first year of the move period the HER continues to produce reductions of -1.7 and -1.4 percent; more than a year after the initial resident’s departure the estimated effect is -1.2 percent. All move-period estimates are statistically significant at conventional levels.

Q: How does the paper explain variation in persistence across social-comparison nudge contexts? A: One year after discontinuation, nudges targeting compliance, charitable giving, savings, and voter turnout retain on average only 4 percent of their initial effect, while nudges targeting energy or water conservation retain 65 percent on average. The paper argues the divergence reflects the relative availability of enabling technologies: households can adopt long-lived, input-efficient technologies (appliances, fixtures) to reduce energy and water use, but analogous technologies to facilitate compliance, donations, or voting are largely unavailable or absent.

Q: How does this paper’s finding about technology adoption compare to Allcott and Rogers (2014)? A: Allcott and Rogers (2014) used participation in utility-sponsored energy-efficiency programs as a proxy for technology adoption and found it explained no more than 2 percent of the HER’s long-run effectiveness. The authors reject this conclusion: their decomposition attributes 51.4 percent to technology, which is estimated precisely enough to statistically reject the 2 percent figure from Allcott and Rogers (2014). They attribute the discrepancy to the imperfect proxy used by Allcott and Rogers and low statistical power in analogous analyses.

Q: What are the cost-benefit implications of accounting for HER-induced technology adoption? A: Assuming monthly HERs for one year, a household electricity price of $0.10/kWh, and benefits accruing over two years, the baseline net benefit (ignoring technology costs) is $32.38 per household (electricity savings of $44.38 minus $12 administration cost). Using a technology cost of $0.03/kWh saved (Gillingham et al. 2018), net benefits fall to $27.14. Using $0.12/kWh saved (Billingsley et al. 2014), net benefits drop to $11.43 — a reduction of up to 65 percent from the baseline estimate. The HER still passes cost-benefit analysis but prior evaluations that ignore technology costs overstate net benefits substantially.

Q: How robust are the decomposition results to alternative sample definitions and specifications? A: The qualitative findings are stable across: alternative sets of control variables (Table A1); mover samples defined by receiving as few as 1 or as many as 5 HERs before moving (Table A2, with pre-move effects of -2.08 and post-move effects of -0.93 to -1.04 across cutoffs); balanced panels requiring fixed observation windows in each period (Table A3); and exclusion of homes showing unusually low consumption in the move period (Table A4, post-move effects of -1.19 to -1.48).

Q: What policy implications does the paper draw for nudge design? A: Policymakers seeking persistent nudge effects should target behaviors that can be augmented by readily available technologies, or pair social-comparison nudges with opportunities to adopt new technologies. In voting contexts, combining social-comparison nudges with opt-in mail-in or online ballot defaults could produce more persistent effects. In savings and charitable giving, pairing social comparisons with automatic contribution-rate defaults (as in Madrian and Shea 2001; Thaler and Benartzi 2004) is predicted to produce longer-lived effects than the nudge alone.

Q: What methodological contribution does the paper offer beyond the HER application? A: The mover-based decomposition is a generalizable research design for separating human capital (habits, skills) from physical capital (technology, infrastructure) as channels of policy effectiveness. The authors suggest it can be applied using other natural separation events — such as student graduation or employee departure — to assess the extent to which nudges build human capital in both recipients and the organizations in which they are embedded.

Technology adoption channel (ATK): The component of the HER’s long-run average treatment effect attributable to increases in the stock of energy-efficient technologies in the home — identified empirically as the post-move HER effect that persists after the treated resident departs and the HER is discontinued.

Habit formation channel (ATH): The component of the HER’s long-run treatment effect attributable to changes in the habits or skills of the resident — inferred as the residual after netting the technology component (ATK) from the total long-run effect (ATE).

Post-move effect: The estimated difference in electricity consumption between treatment and control homes after the initial resident has moved out, the HER has been discontinued, and a new resident has taken occupancy; under the paper’s identifying assumptions this equals ATK.

Balanced-habits assumption: The identifying assumption that treatment assignment did not influence the characteristics or habits of residents who subsequently moved into homes in the experimental sample, so that the habits of incoming residents are comparable across treated and control homes.

Stable-technology assumption: The identifying assumption that energy-efficient technologies adopted in response to the HER remain in the home after the initial resident moves; relaxing this assumption implies the post-move effect is a lower bound on ATK.

Home Energy Report (HER): A mailed social-comparison report that contrasts a recipient household’s electricity consumption with that of similar neighboring households; the treatment studied across all 38 experiments in this paper.

Enabling technologies: Long-lived, input-efficient capital goods (appliances, lighting, insulation) that reduce the marginal cost of conservation and thereby lock in behavioral changes induced by a nudge; their relative abundance in energy and water conservation contexts — versus their absence in voting, giving, or compliance contexts — is the paper’s proposed explanation for cross-context variation in nudge persistence.

Ideological Alignment and Evidence-Based Policy Adoption

Mon, 01 Jan 0001 00:00:00 +0000

This paper investigates how the ideological alignment between knowledge-disseminating institutions and policymakers affects the adoption of evidence-based policies. The core research question is whether, and through which mechanisms, the ideology of the messenger — rather than the content of the message — determines whether local policymakers act on rigorous research evidence.

The authors conduct a country-wide randomized controlled trial (RCT) across 5,678 touristic Spanish municipalities. The policy recommendation derives from Hinnosaar et al. (2021), an RCT demonstrating that minor improvements to municipalities’ Wikipedia pages (adding photographs, local festival information, touristic landmark details) increased overnight tourist stays by 9%. This policy was chosen because it is ideologically neutral, low cost, within local policymakers’ remit, and its implementation is directly traceable via Wikipedia edit histories.

Municipalities were randomized into five treatment arms and a control group (approximately 950 municipalities each), stratified by ruling party ideology, population, and touristic accommodation count. Three arms received the same policy brief endorsed by: (1) an ideologically aligned think tank (FAES for right-wing municipalities, Fundación Alternativas for left-wing), (2) the ideologically opposite think tank, or (3) an ideologically nonsalient researcher from the London School of Economics. Two further arms received links to newspaper articles covering the same research from either an ideologically aligned outlet (El Mundo for right, Eldiario.es for left) or an ideologically opposite outlet. The control group received no information. The experiment ran from May to December 2022, with multiple reminder emails sent across the period.

The main outcome is a binary indicator for whether a municipality’s Wikipedia page was changed in line with the recommended guidelines during the study period, coded blind to treatment status by two independent coders.

Key findings: Pooled across all treatment arms, information provision increased the probability of policy adoption by approximately 0.98 percentage points (a 38% relative increase over the control group baseline), but this effect is only marginally above conventional significance thresholds (p-value = 0.13). The aggregate effect masks sharp heterogeneity by ideological alignment. When the informing institution’s ideology aligns with the policymaker’s, policy adoption increases by 1.68 percentage points (think tank) and 1.67 percentage points (newspaper) relative to the control group — equivalent to a 66% and 65% relative increase, respectively, both statistically significant at the 5% level. By contrast, information from an ideologically opposite institution produces a coefficient that is negligible and statistically indistinguishable from zero, indicating that misaligned information is no more effective than receiving no information at all. The ideologically nonsalient LSE researcher arm produced an intermediate effect (0.94 percentage points, 37% relative increase), but the p-value (0.27) exceeds conventional thresholds, and the effect is not statistically distinguishable from either the aligned or the control condition. Policy briefs and newspaper articles are equally effective when ideologically aligned (difference of 0.1 percentage points, p-value = 0.82).

To decompose mechanisms, the authors propose a three-stage framework: (1) selective exposure to information, (2) belief updating, and (3) policy implementation. Email click-through rates (access to the full policy brief or article once the informing institution is revealed) do not differ significantly across treatment arms, ruling out selective exposure as the operative mechanism. A post-intervention online survey experiment with 1,600 policymakers from 1,196 municipalities shows that those receiving information from an aligned or nonsalient institution updated their beliefs about policy effectiveness significantly more than those receiving information from an opposite institution, implicating belief updating as one operative channel. However, comparing the survey experiment (where nonsalient and aligned treatments produce similar belief updating) with the main experiment (where the aligned arm adopts at nearly twice the rate of the nonsalient arm, though not statistically distinguishable) suggests that ideological alignment also affects the third stage — policy implementation — beyond mere belief updating.

The estimated monetary cost of ideological misalignment is 2,192 euros per municipality per year, calculated using the impact of Wikipedia changes on touristic revenues from Hinnosaar et al. (2021).

Scope conditions: The context is Spanish local government, a policy that is explicitly non-ideological, low-cost, and easily implemented. Generalizability to ideologically charged or costly policies is not established. Left-wing municipalities show larger responses to aligned information, though this heterogeneity is not statistically significant at conventional levels.

Q: What is the baseline rate of policy adoption in the control group, and what does the aligned-institution treatment achieve in absolute terms?

A: The paper reports that ideologically aligned institutions increase the share of municipalities implementing recommended Wikipedia changes by 1.68 percentage points (think tank) and 1.67 percentage points (newspaper) relative to the control group. Working backward from the stated 66% and 65% relative increases, this implies a control group baseline of approximately 2.5 percentage points. The aligned effects are statistically significant at the 5% level.

Q: Does information from an ideologically opposite institution have any effect on policy adoption?

A: No. The coefficient for opposite-ideology treatment arms is negligible in magnitude, closely resembling the near-zero coefficients from the placebo analysis conducted for the same months in 2019 (pre-intervention). The authors conclude that receiving information from an ideologically opposite institution is statistically indistinguishable from receiving no information at all. This null result is consistent across heterogeneity analyses by mayor ideology, municipality population, Wikipedia page length, and party type.

Q: How does the ideologically nonsalient (LSE researcher) treatment compare to aligned and opposite arms?

A: The nonsalient arm increases policy adoption by 0.94 percentage points (a 37% relative increase), approximately half the effect of the aligned arm (1.68 percentage points). However, the p-value is 0.27, and the effect is not statistically different from either the aligned arm (p-value = 0.34) or the control group at conventional confidence levels. The result should therefore be interpreted with caution.

Q: Are policy briefs or newspaper articles more effective in promoting policy adoption?

A: Neither format is significantly more effective than the other. Conditional on ideological alignment, the difference between policy brief and newspaper article effects is 0.1 percentage points with a p-value of 0.82. Both are equally effective when ideologically aligned with the receiving policymaker, a finding the authors describe as a novel contribution to the policy communication literature.

Q: Does ideological alignment affect whether policymakers choose to access the full information (selective exposure)?

A: No. Click-through rates on the links to policy briefs or newspaper articles — measured after policymakers have seen the informing institution’s identity — do not differ significantly across treatment arms. The observed average click-through rate is 6.42%. This null result is consistent with the hypothesis that policymakers do not strategically filter information acquisition based on the messenger’s ideology, at least for non-ideological policies.

Q: What does the survey experiment reveal about belief updating?

A: In the post-intervention survey experiment with 1,600 policymakers, participants first reported beliefs about a purportedly beneficial (but actually harmful) policy, then were randomly assigned to receive information about its negative effects from an aligned, opposite, or nonsalient think tank. Those receiving information from an aligned or nonsalient institution updated their beliefs significantly more than those receiving information from an ideologically opposite institution. This implicates belief updating — not just selective exposure — as a channel through which ideological alignment affects policy adoption.

Q: Why do the authors conclude that ideological alignment also affects the third stage (policy implementation) beyond belief updating?

A: In the survey experiment, aligned and nonsalient institutions produce statistically similar belief updating. Yet in the main field experiment, the aligned arm adopts policy at nearly twice the rate of the nonsalient arm (1.68 vs. 0.94 percentage points), although this difference is not statistically significant. The authors interpret this gap as suggestive evidence that ideological alignment affects policy implementation through channels beyond belief updating — such as career concerns, party cues, or the political economy of implementation — though they acknowledge the evidence is indirect and the treatment difference is not statistically distinguishable.

Q: What is the estimated economic cost of ideological misalignment?

A: The authors estimate a cost of 2,192 euros per municipality per year attributable to ideological misalignment between the informing institution and the receiving policymaker. This calculation uses the estimated impact of Wikipedia changes on touristic revenues from Hinnosaar et al. (2021) and reflects not the cost of not implementing the policy, but the marginal cost of using an ideologically opposite rather than aligned institution to disseminate the research evidence.

Q: How did outside researchers’ predictions compare to actual results?

A: Researchers surveyed on the Social Science Prediction Platform correctly anticipated the rank ordering of treatment effectiveness (aligned > nonsalient > opposite > control) but substantially overestimated adoption rates in every arm. They predicted relative increases of 144%, 103%, and 48% for aligned, nonsalient, and opposite conditions respectively, compared to actual relative increases of roughly 65%, 37%, and ~0%. Email opening rates were the most accurately predicted (49% predicted vs. 38% actual). The results highlight the difficulty of translating evidence into policy even for simple, low-cost interventions.

Q: What are the main threats to validity and how are they addressed?

A: Three main threats are considered. First, differential email opening rates across treatment arms: addressed by showing the informing institution was revealed only after email opening, and confirmed by finding no significant differences in opening rates across groups. Second, spillovers between municipalities: the endline survey shows only 5 of 236 control-group respondents reported receiving any information from external sources; spillover distance analyses in Table D.II find no significant effect on control municipalities’ adoption rates. Third, contamination bias in multi-arm RCTs with strata fixed effects: addressed by replicating main results using the Goldsmith-Pinkham et al. (2022) method, yielding nearly identical estimates.

Q: What heterogeneity is observed across left- and right-wing municipalities?

A: The positive effect of receiving information from an ideologically aligned institution appears larger for left-wing municipalities, with coefficients approximately three times larger than for right-wing municipalities, but this difference is not statistically significant at conventional confidence levels. The authors caution that the strength of ideological alignment may differ systematically between the partner think tanks on the left and right, making direct comparisons between left- and right-wing effects difficult to interpret cleanly.

Q: How does the paper relate to prior work on evidence-based policymaking?

A: The closest prior work is Hjort et al. (2021) and Mehmood et al. (2024), which examine the impact of scientific evidence access on actual policy adoption, and DellaVigna and Kim (2022), which identifies ideology as a factor in the diffusion of innovative policies across governments. The present paper’s main contribution is being the first to isolate the causal effect of ideological alignment on policy adoption using a large-scale field experiment with real, authoritative ideological institutions — rather than surveys or hypothetical scenarios — while using a non-ideological policy recommendation to avoid confounding messenger ideology with policy ideology.

Ideological alignment: In this paper’s usage, the congruence between the political ideology of the institution disseminating research evidence (think tank or newspaper) and the political ideology of the local government receiving that information. Alignment is operationalized by matching right-wing municipalities with right-leaning institutions (FAES, El Mundo) and left-wing municipalities with left-leaning institutions (Fundación Alternativas, Eldiario.es).

Evidence-based policy adoption: The actual implementation by local policymakers of a policy recommendation derived from published peer-reviewed research — measured here as whether a municipality’s Wikipedia page was edited in line with specific recommended guidelines during the study period, not merely expressed intention or stated support.

Knowledge brokers: Institutions, such as think tanks, that serve as intermediaries between academic researchers and policymakers, translating and disseminating research findings in accessible formats (policy briefs) to bridge the gap between evidence and policy.

Nonsalient ideology: A condition in which the informing institution carries no salient or recognizable partisan affiliation, operationalized here by a foreign research university professor (LSE) whose institutional identity does not carry a clear left-right signal in the Spanish political context.

Three-stage policy adoption framework: The authors’ conceptual structure positing that ideology can interfere at three sequential stages: (1) selective exposure — whether policymakers choose to access information once the messenger’s ideology is revealed; (2) belief updating — whether policymakers revise their assessment of a policy’s effectiveness upon receiving evidence; and (3) policy implementation — whether policymakers act on updated beliefs to adopt the policy.

Selective exposure: The tendency of individuals to avoid information from sources whose ideology conflicts with their own prior beliefs; in this paper, operationalized as differential click-through rates on links to policy briefs or news articles after the informing institution’s identity is revealed.

Motivated reasoning: A documented tendency, also observed in policymakers, to reject or discount evidence that contradicts ideologically held prior beliefs — the mechanism proposed to explain why opposite-ideology information fails to update beliefs as effectively as aligned-ideology information.

Leveraging Virtual Contact and Social Networks to Foster Interethnic Harmony

Mon, 01 Jan 0001 00:00:00 +0000

This paper investigates whether virtual contact — exposure to an outgroup through a documentary film — can promote interethnic harmony, and whether targeting network-central individuals amplifies effects on untreated community members. The study addresses a context of deep, historically rooted discrimination: the Santal ethnic minority in northwestern Bangladesh have faced colonial-era land dispossession, ongoing violence, labor market discrimination, and structural exclusion by the Bengali ethnic majority. The Santals are the second-largest ethnic-minority group in Bangladesh; in the study villages, their share ranges from 13% to 83% of the population.

The authors conducted a cluster-randomized field experiment across 121 multiethnic villages in the Rajshahi and Naogaon districts of Bangladesh, involving over 3,300 households. Villages were randomly assigned to three arms: a random treatment arm (RR, 40 villages, N=562 Bengalis) in which approximately 14 randomly selected ethnic-majority households per village watched a 45-minute documentary film (“Ami Santal” / “I Am Santal”) portraying Santal culture, economic hardships, and aspirations; a central treatment arm (41 villages) in which approximately 7 randomly selected Bengalis (RC) and 7 network-central Bengalis identified via a diffusion-centrality nomination exercise (CC) watched the same film; and a control arm (40 villages) in which households watched a placebo documentary on flower farming. The documentary, costing approximately $13 per participant, was screened individually at participants’ homes on tablets. Data were collected at baseline (September–October 2022), first end line approximately 3 months post-screening (February–March 2023), and a casual-work field experiment second end line approximately 4.5–5 months post-screening (April–May 2023). Outcomes were measured via lab-in-the-field experiments (dictator game, solidarity game), an experimentally validated interethnic trust survey item (Falk et al. 2018), self-reported behaviors, administrative police complaint data, and facial emotion detection during screening.

The main findings are as follows. First, treated Bengalis in the central arm (RC) gave 14.7% more in the dictator game (p < .01) and exhibited 21.7% greater trust toward Santals (p < .01) compared to controls; RR participants showed a 7.1% increase in solidarity game giving (p < .10) and 11.8% greater trust (p < .01). Effects on reducing negative stereotypes and discriminatory opinions were not statistically significant, suggesting that affective components of prejudice are more responsive to the intervention than cognitive components. About 82% of treated Bengalis reported acquiring new information about Santals, primarily regarding occupational struggles, educational aspirations, and economic potential. Facial expression analysis using emotion-detection software found sadness to be significantly more prevalent among viewers (p < .05), particularly among network-central participants, consistent with an empathetic response.

Second, untreated Bengalis in the central arm — who never watched the documentary — showed 20.9% higher altruism (p < .10), 27.3% higher solidarity (p < .05), and 8.1% higher trust (p < .05) toward Santals relative to controls. No significant effects on untreated Bengalis were found in the random arm. Untreated Santals in both arms exhibited greater trust toward Bengalis (11% increase in random arm, p < .05; 21.7% increase in central arm, p < .01) and higher subjective well-being (p < .01 in both arms). Village-level administrative data show a significant reduction in Bengali police complaints against Santals post-intervention (p < .05), but only in the central arm.

Third, in the casual-work field experiment, multiethnic pairs jointly produced paper bags under piece-rate compensation. Overall productivity increased approximately 5% (p < .05) in the central arm only. Both Bengali and Santal workers increased productivity specifically in the finisher role — the most critical role for determining earnings — in the central arm. The authors interpret Bengali productivity gains as reflecting increased prosociality toward Santal co-workers, and Santal productivity gains as reflecting conformism or peer pressure in response to Bengali effort. The scope of all effects is limited to multiethnic villages in northwestern Bangladesh, a context of historically severe and ongoing majority-minority inequality; the intervention deliberately did not challenge the socioeconomic hierarchy of the villages.

Q: What was the documentary film’s content and design rationale? A: The 45-minute film “Ami Santal” featured three narrative layers: Santal culture (rituals, cuisine, the Baha festival), economic hardships (housing, water access, low incomes, labor market struggles, educational barriers), and aspirational stories of Santals who achieved success. All stories were narrated by non-actor local Santals, filmed outside the study region, and deliberately avoided attributing blame to Bengalis. The film was designed under the supervision of anthropologists at the University of Rajshahi to maintain ethnographic authenticity and a non-moralistic, observational tone (moral judgment language was much lower than in comparison Bangladeshi documentaries and general films, per LIWC-22 analysis).

Q: How were network-central individuals identified and why might targeting them matter? A: In central-arm villages, enumerators surveyed approximately 18–20 randomly selected passers-by at village markets and asked them to nominate the 15 people most effective at disseminating information. The seven most consistently and highly ranked individuals per village were selected as network-central (CC). These individuals were expected to have high diffusion centrality — meaning information they receive spreads widely — so targeting them with the documentary could shift attitudes and behavior among untreated community members through persuasion, visibility, credibility, or diffusion (the paper cannot separately identify which mechanism operates).

Q: What were the primary behavioral effects on treated Bengalis (the ethnic majority who watched the film)? A: Randomly selected participants in the central arm (RC) gave 14.7% more in the dictator game (p < .01) and 8% more in the solidarity game (not statistically significant), and exhibited 21.7% greater trust toward Santals (p < .01), all relative to controls. In the random arm (RR), participants showed a 6.4% increase in dictator game giving (not statistically significant), a 7.1% increase in solidarity game giving (p < .10), and 11.8% greater trust toward Santals (p < .01). Effects on self-reported behaviors — interethnic friendships, social interactions, amount charged to minorities for water — were not statistically significant.

Q: Did the intervention change Bengali stereotypes or discriminatory opinions toward Santals? A: No. Despite treated Bengalis acquiring substantial new information (approximately 82% reported learning new things, primarily about Santal occupational struggles and educational aspirations), the authors find no significant effects on the stereotypes index or the discriminatory-opinions index among treated Bengalis. They propose two explanations: cognitive components of prejudice (stereotypes) are harder to change through indirect contact than affective components (emotions, prosocial behavior), consistent with Tropp and Pettigrew (2005) and Turner, Crisp, and Lambert (2007); and a single documentary may be insufficient to counter deeply ingrained generational biases due to resistance to change.

Q: What emotional responses did the documentary elicit, and how was this measured? A: Field assistants took candid photographs of participants’ faces at a random point during the screening; these were analyzed using Emotimeter software (machine learning-based emotion detection) that assigns scores across seven emotion categories summing to 100%. Sadness was significantly more prevalent among documentary viewers compared to placebo viewers (p < .05), particularly among network-central participants (CC). The authors interpret this as consistent with an empathetic response to the film’s content about Santal hardships, and connect it to increased prosocial behavior via emotion-regulation mechanisms (alleviating sadness through prosocial action).

Q: What were the spillover effects on untreated Bengalis in the central arm? A: Untreated Bengalis in central-arm villages — who never watched the documentary — showed 20.9% higher altruism (p < .10), 27.3% higher solidarity (p < .05), and 8.1% higher trust toward Santals (p < .05) relative to controls. By contrast, untreated Bengalis in random-arm villages showed no statistically significant effects on any of these outcomes. The authors attribute the central-arm spillovers to the presence of network-central individuals being treated in those villages, though whether these patterns reflect persuasion, visibility, credibility, or information diffusion cannot be separately identified.

Q: How did the intervention affect the Santal ethnic minority (who never watched the documentary)? A: Untreated Santals in both arms exhibited greater trust toward Bengalis: an 11% increase in the random arm (p < .05) and a 21.7% increase in the central arm (p < .01) compared to controls. Santals in both arms also reported higher subjective well-being (p < .01). A weakly significant increase in food security was observed among Santals in the central arm (p < .10), possibly reflecting increased material support from Bengalis. No statistically significant effects were found on Santal altruism or solidarity.

Q: What did the village-level administrative complaint data show? A: Using data collected from two police stations covering all 121 villages, the authors find a significant reduction in Bengali complaints against Santals post-intervention in the central arm (p < .05). No significant reduction was found in Santals’ complaints against Bengalis (p > .10) in any arm. Data from village counselors’ offices (shalish arbitration complaints) showed no significant change in any arm. The distinction matters because police complaints involve more serious, violent matters, while village-counselor complaints involve routine arbitration.

Q: How was the casual-work field experiment designed, and what did it find? A: Approximately 4.5 months after the documentary screenings, 720 participants (360 Bengalis, 360 Santals) drawn equally from the three study arms were paired into multiethnic dyads to jointly produce paper bags for a local supplier under piece-rate compensation, with earnings split equally. One worker was randomly assigned the preparer role and the other the finisher role; roles were switched halfway through the three-hour session. The paper finds an approximately 5% overall productivity increase (p < .05) in the central arm only, concentrated in the finisher role (the role most critical for final output). Bengalis and Santals both increased productivity specifically as finishers in the central arm.

Q: What mechanisms explain the productivity effects in the casual-work experiment? A: For Bengali finishers, the productivity gain is interpreted as prosocial behavior: treated Bengalis who showed greater altruism toward Santals worked harder to increase the earnings of their Santal co-workers. For Santal finishers, the productivity gain is interpreted as conformism or peer pressure: Santals increased effort more when they worked as finisher after swapping roles (i.e., after observing Bengalis’ higher effort as finisher first), suggesting responsiveness to the higher productivity of Bengalis rather than an independent prosocial motivation. The authors present a simple theoretical model to formalize these interpretations, citing Rotemberg (1994) on prosocial effort and Kandel and Lazear (1992) and Mas and Moretti (2009) on peer pressure mechanisms.

Q: Why was virtual rather than direct contact used in this intervention? A: The authors argue that encouraging direct contact between Bengalis and Santals in this setting carries specific risks: the unequal status of the groups may generate anxiety during interactions, potentially limiting engagement or provoking backlash. By contrast, the documentary provides an indirect, low-cost ($13 per participant) form of contact that presents Santal lives without disrupting the socioeconomic hierarchy of the villages and without attributing blame to Bengalis. The film’s entertaining veneer and emotional storytelling make it more scalable and logistically feasible in contexts where direct contact is socially difficult or impractical.

Q: What are the primary limitations acknowledged by the authors? A: The authors acknowledge that the study’s sampling protocol relied on a door-to-door skip procedure without systematic records of approached households, raising the possibility of convenience or snowball-type recruitment and potential deviations from random sampling — this is reflected in some imbalances in baseline characteristics across arms. CC-control comparisons are explicitly descriptive (not causal) because network-central individuals were selected on centrality. Differential attrition was found among untreated Santals (both treatment arms had significantly lower attrition than control, p < .05), which could bias estimates for that subgroup. The authors cannot separately identify the mechanisms (persuasion, visibility, credibility, diffusion) underlying spillover effects in central villages.

Q: What are the policy implications of this study? A: The findings suggest that media-based virtual contact interventions are a low-cost, scalable tool for improving interethnic prosociality even in contexts of deep-rooted discrimination where direct contact may be socially impractical. Targeting network-central individuals — identified via a simple nomination exercise requiring no pre-existing network data — amplifies village-wide effects, including among untreated community members and the minority group itself. The productivity gains in multiethnic work teams imply that improved interethnic relations can have tangible economic consequences beyond attitudinal change. However, the null effects on stereotypes and discriminatory opinions suggest that single documentary interventions may not be sufficient to alter deep-seated cognitive biases, and more intensive or repeated interventions may be needed to achieve durable attitude change.

Virtual contact: Indirect exposure to an ethnic outgroup through a documentary film, as distinct from direct intergroup contact; posited to influence majority-group attitudes and behavior by increasing empathy and identification with the outgroup without requiring face-to-face interaction.

Diffusion centrality: A network measure of how effectively an individual can spread information through a community, operationalized via a nomination exercise in which community members identify those best positioned to disseminate information; used to select the seven highest-ranked individuals per village for targeted treatment.

Prosociality (altruism and solidarity): Measured using incentivized lab-in-the-field games — the dictator game (unilateral allocation of an endowment to a passive outgroup recipient) and the solidarity game (precommitted transfers to an outgroup member who may incur a random loss) — capturing willingness to benefit non-coethnic others at personal cost.

Affective versus cognitive components of prejudice: A distinction between emotional aspects of prejudice (feelings, empathy) — which the authors find to be more responsive to the documentary intervention — and cognitive aspects (negative stereotypes, discriminatory opinions) — which show no significant change despite new information acquisition.

Spillover effects (untreated individuals): Changes in behavior or attitudes among community members who did not directly receive the intervention (did not watch the documentary), attributed to the influence of treated individuals in their village, particularly network-central individuals in the central arm.

Piece-rate casual-work field experiment: A second end line in which multiethnic pairs of Bengali and Santal workers jointly produced paper bags for a local supplier, with individual earnings determined by joint piece-rate output; designed to measure whether improved interethnic attitudes translated into higher workplace productivity in ethnically mixed teams.

Source text origin: The provenance classification of the text used to generate a paper summary (full PDF, open-access HTML, or abstract only); the paper’s pipeline rules impose a hard block on abstract-only summarization.

Silence to Solidarity: How Communication About a Minority Affects Discrimination

Mon, 01 Jan 0001 00:00:00 +0000

This paper examines how two types of communication about a minority group affect discriminatory behavior: (i) horizontal communication between majority-group members, and (ii) top-down communication from agents of authority such as the legal system. The setting is urban Chennai, India, where the paper measures discrimination against thirunangai — a community of transgender women who are India’s most visible LGBTQ+ group — in a field experiment with 3,397 participants.

Discrimination is measured using incentivized hiring choices. Participants are offered a free grocery delivery and make 10 binary choices over which worker will carry out the delivery, with worker gender (cisgender male, cisgender female, or transgender) varying across options. The stakes are real: one choice is randomly selected and implemented 2–9 weeks later. Participants in the control condition are highly discriminatory: they are 19 percentage points (32%) less likely to hire a transgender worker than a non-transgender worker (p<0.001), and are willing to sacrifice grocery items worth 1.9 times their median daily per capita food expenditure to avoid a 15-minute interaction with a transgender worker.

The first main treatment involves randomly assigning participants to a 3-person group discussion with two neighbors, in which they discuss and make collective hiring choices over the same options. The key outcome is participants’ subsequent private, individual hiring choices. The discussion eliminates anti-transgender discrimination on average: participants in the discussion arm are 17 percentage points (42%) more likely to select a transgender worker in their private post-discussion choices relative to the control group (p<0.001), so that discrimination is no longer statistically distinguishable from zero (p=0.30). The discussion’s effect is partially persistent: approximately one month later, discussion participants are still 4 percentage points more likely to select transgender workers in hypothetical hiring choices (p=0.03), representing roughly 25% of the short-run effect.

The second main treatment cross-randomizes a video shown before hiring choices. The legal rights video informs participants of a Supreme Court ruling affirming that transgender people hold the same fundamental constitutional rights as other citizens. This reduces discrimination by 10.3 percentage points (p<0.001). A rights messaging video — which argues that transgender people should have equal rights without invoking legal authority — reduces discrimination by a smaller 5.8 percentage points (p=0.001), and there is some evidence the legal-authority version is more effective (p of difference in [0.01, 0.12]). However, the legal rights video’s effect is only 59% as large as the discussion’s effect (p of difference in [0.002, 0.04]), and it does not persist at the one-month follow-up (p in [0.12, 0.51]).

The paper rules out two candidate mechanisms for the discussion’s effects and supports a third. First, the discussion does not work primarily through correcting misperceived norms: while control-group participants do overestimate peer discrimination by 5 percentage points, the discussion reduces predicted discrimination by 24 percentage points — far more than a corrected misperception could explain (at most 21% of the effect under generous assumptions). Second, the discussion does not work through virtue signaling alone: a “No discussion (public)” arm in which participants make individually-visible choices shows no reduction in discrimination on average (p=0.83). Third, the paper provides affirmative evidence for a persuasion channel: participants in a “listener” arm, who silently observe a 2-person discussion without participating, discriminate 13 percentage points less than the control group (p<0.001), an effect that is highly persistent at the 2–9 week follow-up (11 percentage points, p<0.001). The persuasion mechanism is further supported by the finding that pro-trans participants are more vocal: each additional transgender worker chosen in post-discussion private choices is associated with a 32% higher probability of speaking first (p=0.03) and a 27% higher probability of dominating the discussion (p=0.02). Statements about transgender workers during discussions were 5.7 times more likely to be positive than negative. Listeners who heard moral argumentation about equality, rights, and giving opportunities subsequently discriminated less (p<0.001).

Scope conditions: the study is conducted among urban Chennai residents (85% female), where transgender identity is visually recognizable and socially salient, awareness of the 2014 Supreme Court ruling is low (36% could not identify a single legal right transgender people hold), and a wedge exists between descriptive norms (high actual discrimination) and prescriptive norms (93% of the control group rate explicit discrimination as wrong). The model’s “sweet spot” logic implies these effects may not generalize to settings where discrimination is either near-universal (no privately pro-trans individuals to be vocal) or already minimal (no incentive to persuade).

Q: How is anti-transgender discrimination measured in the experiment? A: Participants make 10 incentive-compatible binary hiring choices over grocery delivery workers, with one choice randomly selected and implemented 2–9 weeks later. Discrimination is defined as the reduction in the probability of selecting the alternative worker when that worker is transgender versus non-transgender, conditional on other option characteristics such as items offered and reliability score. Participants are told they will have a 15-minute conversation with the selected worker, ensuring anticipated social contact. The design is framed as market research to obfuscate the study’s purpose; only 8% correctly guessed the true focus.

Q: How large is baseline discrimination in the control group? A: In the No discussion (private) control condition, participants are 19 percentage points (32%) less likely to hire a transgender worker than a non-transgender worker (p<0.001). In willingness-to-pay terms, participants sacrifice grocery items worth 1.9 times their median daily per capita food expenditure (Rs. 127 on a base of Rs. 67) to avoid selecting a transgender worker. Even when a transgender worker dominates on both items and reliability score, participants in the control group still select the non-transgender worker 47% of the time.

Q: What is the main effect of the 3-person group discussion on subsequent discrimination? A: Participants who engage in a group discussion with two neighbors are 17 percentage points more likely to select a transgender worker in their subsequent private individual choices (p<0.001). This eliminates average discrimination entirely: in the discussion arm, the probability of selecting a transgender worker is not statistically distinguishable from the probability of selecting a non-transgender worker (p=0.30). The willingness-to-pay to avoid a transgender worker falls from Rs. 127 to Rs. 13 (p of difference < 0.001), and is no longer significantly different from zero (p=0.265).

Q: How persistent are the effects of the group discussion? A: At the 2–9 week follow-up survey (mean 35 days), discussion participants are approximately 4 percentage points more likely to select transgender workers in hypothetical hiring choices (p=0.03). This represents approximately 25% of the short-run 17 percentage point effect, a decay rate comparable to the persistence of US political advertising effects in the political science literature (Hill et al., 2013, estimate 10–15% remaining after 30 days).

Q: What is the effect of the legal rights video, and how does it compare to the discussion? A: The legal rights video — informing participants of the Supreme Court ruling affirming transgender people’s fundamental constitutional rights — increases the probability of selecting a transgender worker by 10.3 percentage points (p<0.001). The rights messaging video, which argues that transgender people should have equal rights without invoking legal authority, increases it by 5.8 percentage points (p=0.001). The legal rights video’s effect is only 59% as large as the discussion’s 17 percentage point effect (p of difference in [0.002, 0.04]), and unlike the discussion, neither video’s effect is detectable at the one-month follow-up (p in [0.12, 0.51]).

Q: Does the legal rights video work through a different channel than the rights messaging video? A: There is evidence that the legal authority of the Supreme Court matters beyond the content of the rights message. The legal rights video is more effective than the rights messaging video at reducing discrimination (p of difference in [0.01, 0.12]), and the legal rights video (but not the rights messaging) affects participants’ beliefs about the legal status of transgender people (as measured by a summary index). Both videos shift perceived descriptive norms — participants predict others will select transgender workers more, by 2–6 percentage points — but neither significantly affects attitudes as measured by a list experiment or disapproval questions.

Q: Does the discussion work through correcting misperceived norms? A: This channel can account for at most a small fraction of the effect. Control-group participants do overestimate peer discrimination by 5 percentage points in incentivized predictions (p<0.001, as measured by predicted probability of selecting a transgender worker). However, the discussion reduces predicted discrimination by 24 percentage points (p<0.001), far exceeding the initial misperception. Even under generous assumptions in which the misperception is precisely corrected, this mechanism could account for no more than 21% of the discussion’s treatment effect (95% CI: [8.9%, 32.5%]).

Q: Does the discussion work through virtue signaling? A: The evidence rules out virtue signaling as the primary channel. The “No discussion (public)” treatment arm makes participants’ individual hiring choices visible to their group members, exogenously increasing social image concerns in the absence of a discussion. This has no detectable average effect on discrimination (p=0.83), indicating that social image concerns alone — without the persuasive content of an actual discussion — do not explain the reduction in discrimination generated by the group discussion.

Q: What is the evidence for the persuasion mechanism? A: The “listener” treatment arm provides direct evidence. In this arm, one participant silently observes a 2-person discussion without speaking, then makes private individual choices. Listeners discriminate 13 percentage points less than the control group (p<0.001), an effect statistically indistinguishable from full discussion participants. Since listeners changed their behavior based solely on what they heard and saw, this constitutes evidence of persuasion. The listener effect is highly persistent at the 2–9 week follow-up (11 percentage points, p<0.001) and holds on a robustness outcome designed to be completely private. The implied persuasion rate is 29%, described as high relative to values in the literature (DellaVigna & Gentzkow, 2010).

Q: Why do pro-trans participants persuade others — what drives the discussion’s content? A: Pro-trans participants are disproportionately vocal. Each additional transgender worker chosen in post-discussion private choices (a proxy for pro-trans private attitudes) is associated with a 32% higher probability of speaking first (p=0.03) and a 27% higher probability of dominating the discussion (p=0.02), but only when discussing a choice involving a transgender worker. The overall tone of discussions is strongly pro-trans: statements about transgender workers are 5.7 times more likely to be positive than negative. Participants who hear moral argumentation about equality, rights, and giving opportunities subsequently discriminate significantly less (p<0.001).

Q: Does the discussion work by changing statistical (belief-based) discrimination? A: Partially, baseline discrimination in the control group is partly statistical: despite transgender workers having the same average reliability scores as others, participants rate them as less likely to complete a delivery, and revealing the true reliability score makes participants 2.9 percentage points more likely to select a transgender worker (an effect unique to transgender workers). However, the discussion does not significantly affect beliefs about transgender workers’ reliability, and there is no detected reduction in the belief-based component of discrimination in the discussion arm (though the test is underpowered).

Q: Are the effects of the discussion and the legal rights video additive? A: The two interventions appear to combine approximately linearly for the legal rights video: there are no detected interaction effects (p in [0.83, 0.96]). By contrast, there is weak evidence of a negative interaction between the rights messaging video and the discussion, suggesting these two may be substitutes — consistent with the rights messaging video’s content being similar to the pro-trans moral argumentation already present in discussions.

Q: What alternative explanations are ruled out? A: The paper tests and finds no support for: (i) photo characteristics such as perceived caste driving results; (ii) social image concerns affecting even post-discussion private choices (the “extra private” robustness outcome designed to be unobservable by neighbors yields similar results); (iii) increased contemplation or deliberation about choices; (iv) experimenter demand effects or social desirability bias (treatment effects do not differ for the 8% who guessed the study’s purpose); (v) increased salience of the transgender category; and (vi) cheap talk from low stakes (choices were incentive-compatible and implemented).

Q: What is the study’s theoretical model for why pro-trans participants speak out? A: The paper develops a model combining social signaling (people want to fit in with their group; Bénabou & Tirole, 2006) with direct persuasion (participants can change each other’s preferences through messages). Under the right conditions, only pro-trans participants send persuasive pro-trans messages. This occurs in a “sweet spot” range: when average discrimination is not so strong that no one is privately pro-trans, and not so weak that pro-trans participants lack an incentive to persuade (since they are already in the majority). The context in Chennai — high actual discrimination but strong social norms against it — satisfies this sweet spot condition.

Q: What are the policy implications regarding horizontal versus top-down communication? A: In this context, facilitating horizontal communication between neighbors is a more effective tool for reducing discrimination than top-down communication about legal rights: the discussion’s effect is 1.7 times larger than the legal rights video (17 p.p. vs. 10.3 p.p.) and partially persists at one month, whereas the legal rights video’s effect does not persist. However, the legal rights video does reduce discrimination relative to the rights messaging video, suggesting that communicating the legal authority of the Supreme Court carries independent weight beyond rights advocacy messaging. Both interventions are complementary when combined.

Horizontal communication: Communication between members of the majority group about a minority, as distinct from contact between majority and minority groups or top-down communication from authority. In this paper, operationalized as a group discussion among three neighbors who make collective hiring choices.

Top-down communication: Communication from agents of authority — here, the legal system — about a minority group’s rights. Measured via a video informing participants of a Supreme Court ruling affirming transgender people’s constitutional rights.

Anti-transgender discrimination: In the paper’s own measurement, the reduction in the probability that a worker is chosen because they are transgender (relative to being non-transgender), conditional on other delivery option characteristics. Measured in incentivized, privately-elicited binary hiring choices.

Expressive law hypothesis: The theory that changes in the law affect behavior by changing people’s perception of the prevailing social norm, not (only) through deterrence. The paper tests this by comparing a legal rights video (invoking Supreme Court authority) to a rights messaging video with identical content but no legal backing, finding the legal-authority version more effective.

Persuasion channel: The mechanism by which discussion participants change each other’s preferences through persuasive messages, particularly moral arguments about equality and rights. Distinguished in the paper from virtue signaling (publicly visible pro-trans behavior) and norm correction (updating misperceived beliefs about peer behavior).

Pluralistic ignorance: A setting in which people misperceive how common discriminatory attitudes are among their peers, potentially hiding genuine minority support for the discriminated group. The paper tests this as a candidate mechanism and finds it can account for at most 21% of the discussion effect.

Sweet spot condition: The range of average group discrimination levels in which pro-trans participants have both the motivation and opportunity to speak out persuasively — discrimination is not so universal that no one is privately pro-trans, and not so minimal that the pro-trans participants feel no need to persuade others. The paper argues the Chennai context satisfies this condition.