Eliciting Multiple Prior Beliefs
What this paper finds — and why it matters
Multiple prior decision models—in which beliefs are represented by a set of probability measures rather than a single measure, generating a probability interval for each event—have become increasingly important in economics, but choice-based incentive-compatible elicitation of probability intervals remains an open problem: existing scoring rules and matching-probability methods cannot recover probability intervals without assuming probabilistic sophistication that is precisely least warranted in settings where multiple priors are most relevant. This paper develops a preference-based identification of a subject’s probability interval for an event, and a method for eliciting it under weak decision-theoretic assumptions with no need for probabilistic sophistication. Three incentivized experiments on artificial and natural sources of uncertainty demonstrate that the elicited intervals are sensitive to the direction and amount of information, are typically consistent with objective probabilities where available, and exhibit a predominance of non-degenerate probability intervals that are wider when there is less information or predictability. On aggregate, the choice-based intervals are similar to stated probability intervals, providing behavioral foundations for the use of stated interval techniques in the field.
Summary of a forthcoming paper, AI-assisted and human-reviewed. See the linked original for the authoritative claims and full conditions.
Q1. What is the key identification challenge for multiple prior elicitation?
The key challenge is that existing incentive-compatible elicitation methods—scoring rules and matching-probability approaches—confound a subject’s probability interval with their ambiguity attitude, so they cannot separately identify the probability interval without assuming probabilistic sophistication. Under the popular α-maxmin EU model, the matching probability of an event depends on both the subject’s probability interval and their ambiguity attitude parameter α; even eliciting both the event and its complement’s matching probabilities yields two equations in three unknowns. Probabilistic sophistication is least warranted precisely in settings with deep uncertainty where multiple priors are most relevant, making precision-laden methods unsuitable.
Q2. What is the paper’s elicitation solution?
The paper develops a preference-based method that identifies a subject’s probability interval under weak decision-theoretic assumptions—with no need for probabilistic sophistication—using a series of incentivized choices, and demonstrates its feasibility in three laboratory experiments. The approach comprises two components: (i) a preference-based identification theorem establishing the conditions under which the probability interval can be recovered from observable choices; and (ii) a concrete elicitation procedure that is incentive compatible and does not impose the precision-laden assumption of probabilistic sophistication.
Q3. What do the experiments show?
Three incentivized experiments on artificial and natural sources of uncertainty demonstrate that probability intervals elicited by the method are sensitive to the direction and amount of information, are typically consistent with objective probabilities where available, and predominantly non-degenerate—with intervals wider when there is less information or predictability. The sensitivity to information and consistency with objective probabilities provide external validation that the elicited intervals capture real beliefs rather than noise or confusion. The predominance of non-degenerate intervals (rather than point probabilities) indicates that subjects genuinely hold imprecise beliefs in the relevant settings.
Q4. What is the relationship between choice-based and stated probability intervals?
On aggregate, probability intervals elicited with the choice-based method are similar to those stated by subjects, suggesting that the new method can provide behavioral foundations for the use of stated probability-interval techniques that are widely used in field surveys but previously lacked incentive-compatible grounding. This convergence is informative because stated intervals are cognitively simpler and can be collected at large scale in surveys, while the choice-based intervals are theoretically grounded; the consistency between them justifies the use of simpler stated methods in field applications.
Key concepts
multiple priors : a model of beliefs in which a decision maker’s uncertainty is represented by a set of probability measures rather than a single measure; associated with the Gilboa-Schmeidler (1989) maxmin expected utility model and its generalizations; generates a probability interval for each event. probability interval : the interval [p(E), p̄(E)] of probability values a subject’s set of priors assigns to event E; non-degenerate (with width > 0) when the subject’s beliefs are genuinely imprecise. incentive-compatible elicitation : an elicitation procedure in which subjects’ optimal strategy is to report their true beliefs; for Bayesian single-prior beliefs, achieved by scoring rules and matching-probability methods, but these fail for multiple priors. probabilistic sophistication : the assumption that a multiple-prior agent’s set of priors is generated by precise probabilistic beliefs; existing methods require this assumption to disentangle the probability interval from ambiguity attitude, but the paper’s method does not.