Joint Bayesian inference about impulse responses in VAR models
📄 Summarized from the full manuscript · Human-reviewed for faithfulness before publication
In brief
When economists chart how the economy responds to a shock over several years, they usually report the middle estimate at each date with a band around it. This 2022 paper shows that assembling a path this way can produce a shape no version of the underlying model could ever generate, and that conventional bands grossly understate uncertainty about the path as a whole — in places the honest range is three times as wide. The remedy is to report complete candidate paths instead. Why it matters: policy conclusions drawn from one tidy line can be far weaker than they look.
What this paper finds — and why it matters
This 2022 Journal of Econometrics paper by Atsushi Inoue and Lutz Kilian develops a Bayesian decision-theoretic framework for reporting inference about an entire vector of structural VAR impulse responses jointly, rather than horizon by horizon, and shows that the conventional practice of reporting the posterior median or mean impulse response at each horizon together with pointwise credible intervals is not in general the Bayes estimator and can be economically misleading. Formally, letting theta = g(lambda) denote the n_irf-dimensional vector of structural impulse responses implied by the underlying VAR parameters lambda, the Bayes estimator minimizes posterior expected loss over the feasible response space Theta under a chosen loss function – quadratic, absolute, Dirac delta (which yields the posterior mode), or an angular loss invariant to the scaling of the data and structural shocks – and the corresponding joint credible set is constructed as the region of lowest posterior risk (for quadratic or absolute loss) or highest posterior density (for Dirac delta loss), visualized as a “shot-gun” trajectory plot of complete retained impulse-response paths rather than as a separate interval at each horizon. The key theoretical result is that when the number of estimated impulse responses n_irf exceeds the number of underlying structural parameters n_p – the empirically typical case – the space of feasible response vectors Theta is a lower-dimensional manifold embedded in R^{n_irf}, so the vector of pointwise posterior medians or means need not lie in Theta at all; a stylized AR(1) illustration with posterior rho ~ N(0.7, 1/5) yields a mean-response vector across horizons 1-4 of [0.70, 0.69, 0.76, 0.95], a shape that first falls and then rises and is infeasible for any AR(1) coefficient. In two empirical illustrations – a quarterly VAR(4) identifying aggregate demand, aggregate supply, and monetary policy shocks for U.S. real GNP growth, the federal funds rate, and GNP deflator inflation over 1954:IV-2007:IV, exactly identified via short- and long-run exclusion restrictions, and a monthly VAR(24) for the global crude oil market over 1973:2-2018:6 with flow supply, flow demand, and storage demand shocks set-identified via narrative, sign, and impact-elasticity bound restrictions – the paper finds that conventional pointwise 68% error bands “grossly understate” joint estimation uncertainty about the response vector, with the range spanned by the responses in the joint credible set in some cases three times as wide as the conventional bands. Across both examples the absolute, quadratic, and Dirac delta loss functions produce Bayes estimates that are quite similar to one another, and angular loss gives similar answers too, though at greater computational cost, so the paper concludes there is “little to choose” between the loss functions in practice and recommends absolute or quadratic loss as computationally cheap defaults.
Summary of a classic paper, AI-assisted and human-reviewed. See the linked original for the authoritative claims and full conditions.
Questions & answers
Q1. What gap in standard SVAR reporting practice motivates this paper?
Applied work typically reports a structural impulse response function as a sequence of separate, horizon-by-horizon summaries — a posterior median or mean at each horizon, bracketed by pointwise credible intervals built from the marginal posterior distribution at that horizon alone — and the paper argues this practice is not generally valid as either a point estimate or a measure of uncertainty about the impulse response vector. Point estimates and error bands should instead be derived from formal Bayesian decision theory applied to the joint posterior distribution of the full response vector theta, because questions applied researchers actually care about — whether a response is hump-shaped, whether there is delayed overshooting, whether a shock generates comovements consistent with stagflation — are properties of the whole vector and its cross-horizon, cross-variable dependence, not of any single coordinate (Section 1, pp. 457-459; Section 2.2.2, pp. 461-462).
Q2. Why is the conventional posterior median or mean response function generally not the Bayes estimator?
The Bayes estimator theta-hat, defined as the vector minimizing posterior expected loss, is by construction always contained in the feasible response space Theta = g(Lambda); the vector of pointwise posterior medians or means is not, in general, contained in Theta whenever the number of estimated impulse responses n_irf exceeds the number of structural parameters n_p — the typical applied case. In that case Theta is a lower-dimensional smooth manifold inside R^{n_irf} rather than the full Euclidean space, so treating each horizon’s marginal posterior median or mean as if it were unconstrained can produce an impulse-response shape that does not correspond to any possible parameterization of the underlying autoregressive model (Section 2.2, pp. 460-462).
Q3. What does the paper’s AR(1) illustration show concretely?
For y_t = rho*y_{t-1} + u_t with posterior rho ~ N(0.7, 1/5), the vector of pointwise posterior means at horizons 1 through 4 is [0.70, 0.69, 0.76, 0.95] — a response that initially falls and then rises — which is a shape no single value of rho in (0,1) can generate, since the true impulse response rho^h is monotonic in h for any fixed rho. The paper’s Figure 1 shows the same pathology for the pointwise posterior median relative to the (smooth, feasible) Bayes estimator under absolute loss (Section 2.2.1-2.2.2, pp. 460-462).
Q4. How does the paper define the Bayes estimator, and what loss functions does it consider?
The Bayes estimator solves theta-hat = argmin over theta-bar in Theta of the posterior expectation of a loss function L(theta, theta-bar), and the paper derives it under four loss functions: quadratic loss (sum of squared coordinate errors), absolute loss (sum of absolute coordinate errors), Dirac delta loss (which reduces expected-loss minimization to maximizing the joint posterior density, i.e., finding the posterior mode), and an angular loss based on the average cosine-distance between response vectors, which is invariant to the scaling of the data and of the structural shocks. Under quadratic and absolute loss the estimator is approximated by Monte Carlo as the draw-weighted minimizer over the set of M posterior draws (Eqs. 1-5; Section 2.1-2.2, Section 4.1, pp. 460-462, 470).
Q5. What is a “joint credible set” and how does it differ from a pointwise error band?
*The 100(1-alpha)% joint credible set is defined as the smallest-posterior-risk region {theta-bar in Theta : E[L(theta, theta-bar)] <= c_(1-alpha)} containing 100(1-alpha)% posterior probability, approximated by sorting the M posterior draws by their average loss and retaining the lowest-loss (1-alpha)100% of them — each retained draw is a full impulse-response trajectory across all horizons and variables, so plotting all of them together produces a “shot-gun trajectory plot” that preserves the shape of each response path and the comovement across variables, unlike a pointwise band built from separate horizon-by-horizon quantiles. The paper argues shot-gun plots allow direct probability statements about qualitative IRF features (hump shape, sign, delayed overshooting) that pointwise bands cannot support, since pointwise bands discard the across-horizon and across-variable dependence structure of theta (Section 2.4-2.5, pp. 463-465).
Q6. What does the Dirac delta loss function deliver, and how is it computed?
*Under Dirac delta loss the Bayes estimator is the mode of the joint posterior density of theta — the single most likely structural impulse-response vector — and the corresponding 100(1-alpha)% joint credible set is the highest-posterior-density (HPD) set, obtained by evaluating the joint posterior density at each of the M draws (via closed-form expressions the paper derives for sign-identified models, Proposition 1, Eq. 22, and for exactly identified short- and/or long-run exclusion-restriction models, Proposition 2, Eq. 31, each involving a Jacobian correction for the change of variables from reduced-form to structural parameters) and retaining the (1-alpha)100% of draws with the highest density values. These propositions generalize the authors’ earlier Dirac-delta-loss results (Inoue and Kilian 2013, 2019), which were restricted to the special case n_irf = n_p, to allow an arbitrary number of estimated impulse responses (Section 3, pp. 465-469).
Q7. How much do conventional pointwise bands understate joint uncertainty, empirically?
In the quarterly demand/supply/monetary-policy VAR(4) for U.S. output growth, the federal funds rate, and inflation (1954:IV-2007:IV), the paper reports that “in some cases, the range spanned by the responses in the joint credible set is three times as wide” as the conventional 68% pointwise bands, illustrating that pointwise bands can substantially understate the true joint estimation uncertainty about the response vector. This distortion is present regardless of whether n_irf exceeds n_p, since it stems from ignoring cross-horizon/cross-variable dependence rather than from the manifold-feasibility problem specifically (Section 2.5, p. 464; Section 5.1, p. 472).
Q8. How sensitive are the results to the choice of loss function, and is the Bayes estimator always unique?
Across both empirical examples the absolute, quadratic, and Dirac delta loss functions yield Bayes estimates that are “quite similar” to one another, and the angular-loss estimates are likewise close to the others despite being more computationally demanding to compute, leading the authors to conclude there is “little to choose” between the loss functions for typical applications and to recommend absolute or quadratic loss as cheaper defaults. Under Dirac delta and angular loss specifically, the Bayes estimator can fail to be unique even when n_irf <= n_p; the paper’s practical fix is to report the neighborhood of draws within kappa_M = log(M)/sqrt(M) percent of the minimum expected loss, and in the empirical examples this set “consists of a singleton” in most cases and, when not, “typically only two solutions… that are quite similar” (Section 4.1-4.2, pp. 470-471; Section 5.1, p. 472; Section 6, p. 474).
Q9. What are the paper’s stated limitations and its recommended scope of application?
The authors flag that the angular-loss estimator is more computationally costly than absolute or quadratic loss because it requires a larger number of posterior draws M, and that Dirac delta loss under partial identification requires numerical integration, which is why they recommend absolute or quadratic loss as defaults; they also note that two-dimensional “joint error bands” are simpler to plot than shot-gun trajectories but lose the shape- and comovement-information that motivates the joint approach in the first place, so they recommend shot-gun plots over both conventional and joint error bands. The paper explicitly frames its scope as VAR impulse responses under any identification scheme (Cholesky, sign restrictions, exclusion restrictions, or partially identified/set-identified models), while noting the same joint-inference logic could in principle be adapted to forecast error variance decompositions, historical decompositions, and sequences of structural shocks, without carrying out those extensions itself (Section 4.1, p. 470; Section 2.5, p. 465; Section 6, p. 474).
Key terms in this paper
Definitions below follow the paper's own usage.
- Joint (vs. pointwise) inference about impulse responses
- reporting a point estimate and credible region for the entire structural impulse-response vector theta at once -- across all horizons and variables simultaneously -- rather than separately at each horizon; the paper's central argument is that only joint inference respects the dependence structure of theta and supports valid statements about shape properties like hump-shape or delayed overshooting (Sections 1-2).
- Bayes estimator under a loss function L
- the vector theta-hat in the feasible response space Theta that minimizes posterior expected loss E[L(theta, theta-bar)]; the paper derives this estimator under quadratic loss, absolute loss, Dirac delta loss (which picks out the posterior mode), and an angular loss invariant to variable/shock scaling, and shows theta-hat is always contained in Theta by construction, unlike the conventional pointwise median or mean (Section 2.1, Eq. 1).
- Feasible response space Theta as a manifold
- the set Theta = g(Lambda) of impulse-response vectors that some valid structural VAR parameterization lambda in Lambda can actually generate; when the number of estimated responses n_irf exceeds the number of structural parameters n_p, Theta is a lower-dimensional smooth manifold within R^{n_irf}, so an unconstrained pointwise summary (median or mean at each horizon) can fall outside Theta and imply a response shape no VAR could produce (Section 2.2).
- Joint credible set / shot-gun trajectory plot
- the 100(1-alpha)% joint credible set is the lowest-posterior-risk (or, under Dirac delta loss, highest-posterior-density) region of Theta containing (1-alpha) posterior probability, approximated by keeping the lowest-average-loss (1-alpha)*100% of posterior draws; plotting each retained draw as a complete impulse-response trajectory produces the paper's "shot-gun" visualization, which preserves cross-horizon shape and cross-variable comovement that a horizon-by-horizon band discards (Section 2.4).
- Highest posterior density (HPD) credible set under Dirac delta loss
- the specific joint credible set obtained by sorting posterior draws by their joint posterior density value (computed via the paper's Propositions 1 and 2 for sign-identified and exactly identified exclusion-restriction models, respectively) and keeping the highest-density (1-alpha)*100% of them; the corresponding point estimate is the posterior mode, i.e., the single most likely structural impulse-response vector (Section 3).