Scinovex
article Open AccessTop 1% cited

Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods

Machine Learning · 2021 · Vol. 110(3) · pp. 457–506
Eyke HüllermeierWillem Waegeman

Abstract

Abstract The notion of uncertainty is of major importance in machine learning and constitutes a key element of machine learning methodology. In line with the statistical tradition, uncertainty has long been perceived as almost synonymous with standard probability and probabilistic predictions. Yet, due to the steadily increasing relevance of machine learning for practical applications and related issues such as safety requirements, new problems and challenges have recently been identified by machine learning scholars, and these problems may call for new methodological developments. In particular, this includes the importance of distinguishing between (at least) two different types of uncertainty, often referred to as aleatoric and epistemic . In this paper, we provide an introduction to the topic of uncertainty in machine learning as well as an overview of attempts so far at handling uncertainty in general and formalizing this distinction in particular.

Adversarial Robustness in Machine LearningExplainable Artificial Intelligence (XAI)Gaussian Processes and Bayesian InferenceProbabilistic logicRelevance (law)Algorithmic learning theoryKey (lock)Computational learning theoryElement (criminal law)

Funding

  • Vlaamse regering
Citations
1,378
FWCI
119.53
field-weighted impact
References
111
Percentile
100%
vs. same field & year
Citations per year
References
Reference Posterior Distributions for Bayesian Inference
Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1979 · 1,088 citations
An Introduction to Variational Methods for Graphical Models
Machine Learning · 1999 · 3,730 citations
Support Vector Data Description
Machine Learning · 2003 · 3,423 citations
An invariant form for the prior probability in estimation problems
Proceedings of the Royal Society of London A Mathematical and Physical Sciences · 1946 · 2,317 citations
The Lack of A Priori Distinctions Between Learning Algorithms
Neural Computation · 1996 · 1,625 citations
A Practical Bayesian Framework for Backpropagation Networks
Neural Computation · 1992 · 2,890 citations
Random Forests
Machine Learning · 2001 · 121,242 citations
Citation Network

How this paper connects to the literature. Drag to explore, click any node to open that paper.