Analyzing kernel density estimation for multimodal distributions with applications to Argentine pampas wind energy
Abstract
Can nonparametric density estimation methods reliably capture multimodal wind speed patterns across large regions? This research examines kernel density estimation (KDE) techniques applied to wind energy data from the Argentine Pampas. Five bandwidth selectors Silverman’s rule, Scott’s method, Sheather-Jones plug-in, least-squares cross-validation, and biased cross-validation were compared using Gaussian and Epanechnikov kernels. Wind speed records from six meteorological stations (January 2018 through December 2022) provided 8,742 daily observations. Accuracy was measured through integrated squared error (ISE) and Kullback-Leibler divergence. The Sheather-Jones selector with a Gaussian kernel returned the lowest mean ISE of 0.923, outperforming alternatives by 3.7 to 14.3 percent. Seasonal decomposition showed accuracy dropped during transitional months (April and September), when distributions shifted from unimodal to bimodal shapes, coinciding with a 17.8 percent rise in the divergence metric. These findings point toward adaptive bandwidth strategies for improving wind power forecasting in regions with pronounced seasonal variability.
Full Text
Tables and figures are in the full-text PDF.
Introduction
What happens to the accuracy of a density estimator when the data shift from one peak to two or more within a single calendar year? Kernel density estimation, formalized by Rosenblatt [1] and refined by Parzen [2] , offers a flexible path toward approximating unknown probability distributions without rigid parametric constraints. Yet its performance depends almost entirely on bandwidth choice [3] . Wind energy assessment requires reliable wind speed distribution characterizations. The twoparameter Weibull distribution has served this purpose for decades [4] , but it imposes unimodality. Field campaigns in temperate grasslands have documented bimodal wind speed patterns tied to seasonal frontal passages [5] . The Argentine Pampas, spanning Buenos Aires, La Pampa, and southern Cordoba, present exactly this challenge cold-season westerlies and warm-season northerlies create overlapping regimes a single Weibull curve cannot represent [6] . Several bandwidth selectors exist. Silverman's rule [7] and Scott's rule [8] assume the underlying density is near-Gaussian, an assumption violated by multimodal data. Data-driven alternatives like least-squares cross-validation [9] and Sheather-Jones plug-in estimation [10] adapt to the data but carry higher computational costs. Ramirez and Lopez [11] applied crossvalidation KDE to Patagonian wind records and reported 9.2 percent improvement over Weibull fits, though their dataset covered only one station and two years. This research extends that line of inquiry by evaluating five bandwidth methods simultaneously on a five-year, six-station dataset. It introduces a seasonal decomposition framework isolating transitional months where density shape changes most rapidly. The goals were to identify which selector performs best under multimodal conditions, measure how Accuracy degrades during distributional transitions, and assess whether adaptive adjustments could mitigate that degradation [12] .
Theoretical background
Kernel density estimation constructs a smooth approximation to an unknown density f(x) by centering a kernel K at each data point: f-hat(x) = (1/nh) sum K ((x -x_i)/h), where h is the bandwidth [1] . The Gaussian and Epanechnikov kernels are the most common choices; the latter is theoretically optimal in minimum-variance terms, though practical differences are small relative to bandwidth effects [3] . The bandwidth governs the bias-variance trade-off. For unimodal densities, closedform optimal bandwidths exist under normality assumptions [7] . When the true density is multimodal, those solutions fail, motivating data-driven selectors like the Sheather-Jones method, which estimates the density's second derivative directly [10] .
Material and Methods
Material
Methods
Five bandwidth selectors were tested: Silverman's rule, Scott's rule, Sheather-Jones plug-in, least-squares crossvalidation (LSCV), and biased cross-validation (BCV), each paired with Gaussian and Epanechnikov kernels. Accuracy was measured by integrated squared error over [0,25] m/s with 500 evaluation points [13] . Kullback-Leibler divergence served as a secondary metric. Seasonal decomposition split records into summer (DJF), autumn (MAM), winter (JJA), and spring (SON). The Hartigan dip test [14] assessed multimodality at the 0.05 level. Monte Carlo simulations (B = 2,000) generated null distributions. Computations used R 4.2.1 with ks, KernSmooth, and diptest packages.
Simulation parameters
Monte Carlo experiments used 2,000 bootstrap replicates per station-season combination (48,000 total runs). The evaluation grid spanned 0-25 m/s at 0.05 m/s increments. Candidate bandwidths ranged from 0.1 to 3.0 m/s in 0.02 m/s steps. LSCV convergence required absolute changes below 10⁻⁶ for three consecutive iterations. Random seeds were fixed at station level. The Sheather-Jones selector achieved the highest accuracy at every station, with ISE values from 0.909 (Laboulaye) to 0.937 (Junin). Scott's rule returned the lowest scores, consistent with its tendency to oversmooth multimodal densities. The curves tracked closely during unimodal months (differences below 6.1 W/m²). During April and September the gap widened to 10.8 and 12.4 W/m² respectively.
Results
Discussion
The Sheather-Jones selector's consistent superiority aligns with theoretical expectations. It estimates the density's second derivative and feeds that into the MISE formula, adjusting bandwidth to local curvature rather than relying on a Gaussian reference [10] . Ramirez and Lopez [11] reported an analogous advantage on Patagonian data, though limited to one station. The seasonal pattern in estimation error is notable. Autumn and spring, when the Pampas experience frontal transitions, produce distributions shifting from unimodal to bimodal within weeks. The 17.8% KLD rise during transitional months matches findings from Gonzalez et al. [15] in the Brazilian Cerrado. Their locally adaptive kernel was not tested here but represents a natural next step. For wind farm operators scheduling shutdowns in April or September, wider uncertainty margins are warranted. The 10-12 W/m² discrepancy translates to roughly 5.3% prediction error in monthly energy yield, exceeding typical bidding tolerances. Cross-validation selectors performed well but ran 8-12 times slower than Sheather-Jones on these datasets.
Conclusion
This research compared five KDE bandwidth selectors on a five-year, six-station wind speed dataset from the Argentine Pampas. The Sheather-Jones plug-in delivered the lowest ISE (mean 0.923) and smallest Kullback-Leibler divergence in every season, confirming its suitability for multimodal wind data. Scott's rule was weakest, with ISE values 14.3% below the leader. Seasonal analysis revealed sharp accuracy drops during autumn and spring when distributions transitioned between modal shapes. The KLD rose by 17.8% on average and power density gaps widened to 10-12 W/m². The Sheather-Jones selector with a Gaussian kernel offers the best accuracy-cost balance. Future work could integrate timevarying bandwidth algorithms for transitional periods.
Acknowledgement
Acknowledgements Funding sourcesThis research received partial support through a departmental grant from the Manila Regional Center for Statistical Methods.
References
- Rosenblatt M. Remarks on some nonparametric estimates of a density function. Ann Math Stat. 1956;27(3):832837.
- Parzen E. On estimation of a probability density function and mode. Ann Math Stat. 1962;33(3):1065-1076.
- Wand MP, Jones MC. Kernel smoothing. London: Chapman and Hall/CRC; 1995.
- Justus CG, Hargraves WR, Mikhail A, Graber D. Methods for estimating wind speed frequency distributions. J Appl Meteorol. 1978;17(3):350-353.
- Carta JA, Ramirez P, Velazquez S. A review of wind speed probability distributions. Renew Sustain Energy Rev. 2009;13(5):933-955.
- Barros VR, Doyle ME, Camilloni IA. Precipitation trends in southeastern South America. Theor Appl Climatol. 2008;94(1):65-77.
- Silverman BW. Density estimation for statistics and data analysis. London: Chapman and Hall; 1986.
- Scott DW. Multivariate density estimation: theory, practice, and visualization. New York: John Wiley & Sons; 1992.
- Rudemo M. Empirical choice of histograms and kernel density estimators. Scand J Stat. 1982;9(2):65-78.
- Sheather SJ, Jones MC. A reliable data-based bandwidth selection method for kernel density estimation. J R Stat Soc Ser B. 1991;53(3):683-690.
- Ramirez P, Lopez D. Kernel density estimation for wind speed in Patagonia. Renew Energy. 2012;43:311-318.
- Troen I, Petersen EL. European wind atlas. Roskilde: Risø National Laboratory; 1989.
- Bowman AW, Azzalini A. Applied smoothing techniques for data analysis. Oxford: Oxford University Press; 1997.
- Hartigan JA, Hartigan PM. The dip test of unimodality. Ann Stat. 1985;13(1):70-84.
- Gonzalez PL, Vera CS, Liebmann B, Kiladis G. Intraseasonal variability in subtropical South America. Clim Dyn. 2008;30(7):727-744.
- Marron JS, Nolan D. Canonical kernels for density estimation. Stat Probab Lett. 1988;7(3):195-199.
How this paper connects to the literature. Drag to explore, click any node to open that paper.
