Scinovex
article Open AccessTop 1% cited

Calibrated Probabilistic Forecasting Using Ensemble Model Output Statistics and Minimum CRPS Estimation

Monthly Weather Review · 2005 · Vol. 133(5) · pp. 1098–1118
Tilmann GneitingAdrian E. RafteryAnton H. WestveldTom Goldman

Abstract

Abstract Ensemble prediction systems typically show positive spread-error correlation, but they are subject to forecast bias and dispersion errors, and are therefore uncalibrated. This work proposes the use of ensemble model output statistics (EMOS), an easy-to-implement postprocessing technique that addresses both forecast bias and underdispersion and takes into account the spread-skill relationship. The technique is based on multiple linear regression and is akin to the superensemble approach that has traditionally been used for deterministic-style forecasts. The EMOS technique yields probabilistic forecasts that take the form of Gaussian predictive probability density functions (PDFs) for continuous weather variables and can be applied to gridded model output. The EMOS predictive mean is a bias-corrected weighted average of the ensemble member forecasts, with coefficients that can be interpreted in terms of the relative contributions of the member models to the ensemble, and provides a highly competitive deterministic-style forecast. The EMOS predictive variance is a linear function of the ensemble variance. For fitting the EMOS coefficients, the method of minimum continuous ranked probability score (CRPS) estimation is introduced. This technique finds the coefficient values that optimize the CRPS for the training data. The EMOS technique was applied to 48-h forecasts of sea level pressure and surface temperature over the North American Pacific Northwest in spring 2000, using the University of Washington mesoscale ensemble. When compared to the bias-corrected ensemble, deterministic-style EMOS forecasts of sea level pressure had root-mean-square error 9% less and mean absolute error 7% less. The EMOS predictive PDFs were sharp, and much better calibrated than the raw ensemble or the bias-corrected ensemble.

Meteorological Phenomena and SimulationsClimate variability and modelsWind and Air Flow StudiesStatisticsMean squared errorEnsemble forecastingProbabilistic logicMathematicsLinear regressionComputer scienceEconometricsArtificial intelligence

Funding

  • Multidisciplinary University Research Initiative
  • Office of Naval Research
Citations
1,131
FWCI
11.94
field-weighted impact
References
57
Percentile
99%
vs. same field & year
Citations per year
Cited by
Strictly Proper Scoring Rules, Prediction, and Estimation
Journal of the American Statistical Association · 2007 · 5,266 citations
Probabilistic Forecasts, Calibration and Sharpness
Journal of the Royal Statistical Society Series B (Statistical Methodology) · 2007 · 1,691 citations
References
Strictly Proper Scoring Rules, Prediction, and Estimation
Journal of the American Statistical Association · 2007 · 5,266 citations
Generalized Linear Models (2nd ed.).
Journal of the American Statistical Association · 1993 · 4,940 citations
Interpretation of Rank Histograms for Verifying Ensemble Forecasts
Monthly Weather Review · 2001 · 913 citations
Regression Shrinkage and Selection Via the Lasso
Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1996 · 50,746 citations
The ECMWF Ensemble Prediction System: Methodology and validation
Quarterly Journal of the Royal Meteorological Society · 1996 · 1,617 citations
Statistical Methods in the Atmospheric Sciences
Technometrics · 1996 · 7,691 citations
Using Bayesian Model Averaging to Calibrate Forecast Ensembles
Monthly Weather Review · 2005 · 1,928 citations
Ensemble Forecasting at NCEP and the Breeding Method
Monthly Weather Review · 1997 · 1,083 citations
Citation Network

How this paper connects to the literature. Drag to explore, click any node to open that paper.