# Mathematical Sciences Research Institute

Home » Workshop » Schedules » Calibrated Inference: Statistical Inference that Accounts for Both Sampling Uncertainty and Distributional Uncertainty

# Calibrated Inference: Statistical Inference that Accounts for Both Sampling Uncertainty and Distributional Uncertainty

## [Virtual] Hot Topics: Foundations of Stable, Generalizable and Transferable Statistical Learning March 07, 2022 - March 10, 2022

March 09, 2022 (10:00 AM PST - 10:25 AM PST)
Speaker(s): Dominik Rothenhaeusler (Stanford University)
Location: MSRI: Online/Virtual
Tags/Keywords
• stability

• robustness

• replicability

• uncertainty quantification

Primary Mathematics Subject Classification
Secondary Mathematics Subject Classification
Video

#### Calibrated Inference: Statistical Inference That Accounts For Both Sampling Uncertainty And Distributional Uncertainty

Abstract

During data analysis, analysts often have to make seemingly arbitrary decisions. For example during data pre-processing, there are a variety of options for dealing with outliers or inferring missing data. Similarly, many specifications and methods can be reasonable to address a certain domain question. This may be seen as a hindrance to reliable inference since conclusions can change depending on the analyst's choices. In this paper, we argue that this situation is an opportunity to construct confidence intervals that account not only for sampling uncertainty but also some type of distributional uncertainty. Distributional uncertainty is closely related to other issues in data analysis, ranging from dependence between observations to selection bias and confounding. We demonstrate the utility of the approach on simulated and real-world data. This is joint work with Yujin Jeong.

Supplements
 Calibrated Inference: Statistical Inference that Accounts for Both Sampling Uncertainty and Distributional Uncertainty 6.32 MB application/pdf Download
Video/Audio Files

#### Calibrated Inference: Statistical Inference That Accounts For Both Sampling Uncertainty And Distributional Uncertainty

Troubles with video?

Please report video problems to itsupport@msri.org.

See more of our Streaming videos on our main VMath Videos page.