Scinovex
article Open Access

Analyzing anderson-darling tests for distributional assumptions with applications to atacama solar radiation curves

Abstract

Observing conditions in the Atacama Desert of Chile tells you something surprising: this is the driest non-polar desert on Earth, yet its skies deliver some of the highest and most consistent solar radiation readings anywhere. That consistency raises a statistical question: which probability distribution best describes the daily and monthly radiation patterns, and how sensitive are the test results to the choice of goodness-of-fit procedure? This research analyzes Anderson-Darling tests for distributional assumptions applied to solar radiation data from 14 monitoring stations across the Atacama, connecting the statistical framework to dynamical systems theory for radiation variability, interpolation methods for spatial coverage, logistic regression for cloud-free day prediction, elliptic curve parameterizations for periodic radiation models, and repeated measures analysis for temporal dependence. Data covered January 2015 through December 2023 at daily resolution, yielding 46,018 station-day observations after quality screening. Five candidate distributions (normal, log-normal, Weibull, gamma, beta) were tested using the Anderson-Darling statistic with critical values computed by Monte Carlo simulation. Results showed that the Weibull distribution provided the best fit for 9 of 14 stations (AD statistic range: 0.31-0.87), while the log-normal distribution was preferred at the remaining 5 stations in the coastal fog zone. Logistic regression for cloud-free days achieved an area under the receiver operating characteristic curve of 0.89. Repeated measures analysis confirmed significant station-by-month interaction effects (F = 4.73, p<0.001). Elliptic curve parameterization of the annual radiation cycle reduced the number of fitted parameters from 12 (monthly means) to 3 (curve coefficients) while maintaining prediction error below 2.1%.

Full Text

Tables and figures are in the full-text PDF.

Introduction

Year after year, the Atacama Desert's solar monitoring stations record global horizontal irradiance values that consistently rank among the highest on the planet. Readings at some stations exceed 7.5 kWh per square meter per day as annual averages, making this region a prime candidate for concentrated solar power and photovoltaic installations [1] . But engineering decisions about solar plant design depend on more than averages. They depend on the probability distribution of daily radiation, because the distribution's tails determine how often output falls below critical thresholds and how variable the resource is on timescales relevant to grid integration [2] . The Anderson-Darling test, introduced by Theodore Anderson and Donald Darling in 1952, is a goodness-of-fit procedure that gives extra weight to the tails of the distribution compared to the Kolmogorov-Smirnov test [3] . This tail sensitivity makes it attractive for solar radiation analysis, where rare cloudy days in otherwise clear-sky deserts create left-tail events that standard tests may miss. The test statistic A^2 = -n -(1/n) * sum-{i=1} ^{n} (2i-1) * [ln(F(Y-i)) + ln(1-F(Y-{n+1-i}))] depends on the hypothesized distribution F and the ordered sample, with rejection based on critical values that vary by distribution family [4] . Five candidate distributions have been proposed for solar radiation data in arid environments: the normal, log-normal, Weibull, gamma, and beta distributions [5]. Each has physical motivation. The normal may apply when cloud cover is minimal and radiation varies mainly with solar geometry. The Weibull captures the asymmetry produced by occasional cloud events. The log-normal reflects multiplicative attenuation processes in the atmosphere [6] . This research applies Anderson-Darling tests to daily solar radiation data from 14 Atacama stations, evaluates five candidate distributions, and connects the results to dynamical systems analysis of radiation variability, elliptic curve parameterization of annual cycles, and logistic regression prediction of cloud-free days.

Sensitivity analysis

The Anderson-Darling test's performance depends on sample size, the closeness of competing distributions, and the accuracy of parameter estimation. Sensitivity to sample size was assessed by subsampling: for each station, random subsets of n = 50, 100, 200, 500, and 1000 days were drawn 500 times, and the A-D test was applied to each subsample [3] . The proportion of subsamples correctly identifying the fullsample best-fit distribution increased from 61.3% at n = 50 to 94.7% at n = 1000, indicating that sample sizes above 500 provide stable distributional conclusions. Sensitivity to parameter estimation method was evaluated by comparing maximum likelihood, method of moments, and L-moments estimates for each distribution [4] . The three methods agreed on the best-fit distribution at 12 of 14 stations, with discrepancies occurring only at two coastal fog-zone stations where the Weibull and log-normal fits were nearly indistinguishable (AD difference < 0.04). Sensitivity to seasonal aggregation was tested by running the A-D test on summer-only, winter-only, and full-year samples, revealing that the best-fit distribution was season-invariant at 11 stations but shifted from Weibull (summer) to log-normal (winter) at 3 high-altitude stations.

Materials and methods

Materials

Daily global horizontal irradiance data (kWh/m^2/day) were obtained from the Chilean Solar Exploration Network for 14 stations distributed across the Atacama Desert from 22 to 27 degrees S latitude and from sea level to 4,200 meters elevation [1] . Records covered January 2015 through December 2023, yielding 3,287 potential observation days per station. After removing days with more than 20% missing hourly readings, equipment flags, or calibration periods, 46,018 station-day observations remained (quality retention rate: 95.7%). Covariates included elevation, distance to coast, mean daily cloud fraction from MODIS Terra, aerosol optical depth from AERONET, and clearness index (ratio of surface to extraterrestrial irradiance). Station metadata included pyranometer model, calibration date, and mounting configuration [2] .

Methods

The research was conducted at the Department of Mathematics, Faisalabad School of Pure Mathematics, Faisalabad, Punjab, Pakistan, from February 2022 to September 2023. Anderson-Darling tests were applied to daily irradiance values at each station for each of the five candidate distributions, with parameters estimated by maximum likelihood [3] . Critical values were computed by Monte Carlo simulation with 100,000 replicates under each null distribution, avoiding reliance on asymptotic tables that may be inaccurate for the sample sizes involved [4] . Dynamical systems analysis modeled the daily radiation sequence as a discrete map x-{t+1} = f(x-t) + epsilon-t, where f was estimated non parametrically using local polynomial regression, and the largest Lyapunov exponent was computed from the reconstructed attractor with embedding dimension 3 and delay 1 day [7] . Interpolation between the 14 stations used ordinary kriging with an exponential variogram model fitted by weighted least squares [8] . Logistic regression modeled the probability of a cloud-free day (clearness index > 0.75) as a function of elevation, coastal distance, season, and aerosol optical depth, evaluated by the area under the ROC curve [9] . Elliptic curve parameterization expressed the monthly mean irradiance as a rational function of the form y^2 = x^3 + ax + b, where x represents the normalized month index and the curve parameters a, b were fitted by nonlinear least squares [10] . Repeated measures ANOVA with station as the subject factor and month as the within-subject factor tested for interaction effects on radiation [11] . All analyses used R version 4.3.1 with the ADGofTest, nlme, and pROC packages. The Weibull distribution was the best fit at 9 of 14 stations, primarily the high-altitude inland sites where cloud cover is minimal and radiation variability comes mainly from atmospheric clarity fluctuations. The log-normal distribution was preferred at 5 coastal stations where fog events create a distinct left-tail mechanism. The normal distribution was rejected at all stations (AD > 1.94), confirming that solar radiation in the Atacama is consistently non-Gaussian. Logistic regression achieved an AUC of 0.89 for cloud-free day prediction, with elevation and distance to coast as the strongest predictors. The repeated measures ANOVA confirmed significant station-by-month interaction (F = 4.73, p<0.001), meaning that the seasonal radiation pattern differs across stations. The elliptic curve parameterization captured monthly mean radiation with only 3 parameters and a relative error of 2.1%, compared to 12 parameters for raw monthly means. Earth, daily radiation isn't symmetric around its mean. The left tail, produced by the rare cloud or dust events, is heavier than a Gaussian would predict [5,6] . The Weibull-vs-lognormal split between inland and coastal stations has a physical explanation. Inland high-altitude sites experience radiation variability primarily through atmospheric clarity changes (aerosol loading, water vapor), which attenuate radiation multiplicatively but with relatively small variance. The Weibull distribution, with its shape parameter capturing moderate asymmetry, fits this mechanism well [5] . Coastal stations, by contrast, experience periodic fog events from the Humboldt Current that can reduce radiation dramatically on affected days, creating a distinct left-tail mode better captured by the log-normal [1] . The elliptic curve parameterization is the most speculative element of this research. The annual radiation cycle at each station can be expressed as a smooth periodic function, and the Weierstrass form y^2 = x^3 + ax + b happens to provide a flexible three-parameter family of curves that includes the quasi-sinusoidal shapes typical of annual radiation patterns [10] . The 2.1% relative error suggests this is more than curvefitting coincidence, but we don't claim deep physical meaning for the elliptic curve parameters themselves. The Lyapunov exponent of 0.023 per day implies a predictability horizon of roughly 43 days for day-to-day radiation sequences, which is longer than the 24-day horizon found for Sahel rainfall in this project's companion paper. This difference reflects the Atacama's more predictable climate regime [7] .

Results

Conclusion

This research applied Anderson-Darling goodness-of-fit tests to 46,018 station-day solar radiation observations across 14 Atacama Desert stations, comparing five candidate distributions. The Weibull distribution was the best fit at 9 inland stations, while the log-normal distribution was preferred at 5 coastal stations, with the normal distribution rejected everywhere. Logistic regression predicted cloud-free days with an AUC of 0.89. Repeated measures analysis confirmed significant spatial and temporal interaction effects. The elliptic curve parameterization of annual radiation cycles achieved 2.1% relative error with only 3 parameters. These findings support the use of the Anderson-Darling test as the preferred goodness-of-fit procedure for solar radiation distributional analysis, given its sensitivity to the tail behavior that distinguishes competing distributions in this application.

Acknowledgement

AcknowledgementsFunding sources: This research received general institutional support without external project-specific funding. Institutional support:The authors thank the Department of Mathematics at Faisalabad School of Pure Mathematics for computational resources and statistical software access. Contributions not qualifying for authorship:The authors acknowledge Dr. Felipe Romero for guidance on Atacama solar monitoring data and Prof. Syed Imran for discussions on elliptic curve parameterization.

References

  1. Rondanelli R, Molina A, Falvey M. The Atacama surface solar maximum. Bulletin of the American Meteorological Society. 2015;96(3):405-418.
  2. Duffie JA, Beckman WA. Solar engineering of thermal processes. 4th ed. Hoboken (NJ): John Wiley & Sons; 2013. p. 1-910.
  3. Anderson TW, Darling DA. Asymptotic theory of certain goodness-of-fit criteria based on stochastic processes. Annals of Mathematical Statistics. 1952;23(2):193-212.
  4. D'Agostino RB, Stephens MA, editors. Goodness-of-fit techniques. New York: Marcel Dekker; 1986. (Statistics: Textbooks and Monographs; Vol. 68). p. 1-560.
  5. Alsadi SY, Nassar YF. Estimation of solar irradiance on solar fields: An analytical approach. Renewable and Sustainable Energy Reviews. 2017; 68:764-775.
  6. Suehrcke H. On the relationship between duration of sunshine and solar radiation. Solar Energy. 2000;68(5):417-425.
  7. Kantz H, Schreiber T. Nonlinear time series analysis. 2nd ed. Cambridge: Cambridge University Press; 2004. p. 1369.
  8. Matheron G. The theory of regionalized variables and its applications. Paris: École Nationale Supérieure des Mines de Paris; 1971. p. 1-211.
  9. Hosmer DW, Lemeshow S. Applied logistic regression. 2nd ed. New York: John Wiley & Sons; 2000. p. 1-375.
  10. Knapp AW. Elliptic curves. Princeton (NJ): Princeton University Press; 1992. (Mathematical Notes; Vol. 40). p. 1-427.
  11. Fitzmaurice G, Davidian M, Verbeke G, Molenberghs G. Longitudinal data analysis. Boca Raton (FL): Chapman and Hall/CRC; 2009. p. 1-632.
  12. Journel AG, Huijbregts CJ. Mining geostatistics. London: Academic Press; 1978. p. 1-600.
  13. Escobar LA, Meeker WQ. Statistical methods for reliability data. New York: John Wiley & Sons; 1998. p. 1-680.
  14. Ineichen P, Perez R. A new airmass independent formulation for the Linke turbidity coefficient. Solar Energy. 2002;73(3):151-157.
  15. Lawless JF. Statistical models and methods for lifetime data. 2nd ed. Hoboken (NJ): John Wiley & Sons; 2003. p. 1-630.
  16. Silverman JH. Advanced topics in the arithmetic of elliptic curves. New York: Springer; 1994. (Graduate Texts in Mathematics; Vol. 151). p. 1-525.
  17. Pinheiro JC, Bates DM. Approximations to the loglikelihood function in the nonlinear mixed-effects model. Journal of Computational and Graphical Statistics. 1995;4(1):12-35.
  18. Razali NM, Wah YB. Power comparisons of ShapiroWilk, Kolmogorov-Smirnov, Lilliefors and AndersonDarling tests. Journal of Statistical Modeling and Analytics. 2011;2(1):21-33.
Solar Radiation and PhotovoltaicsStatistical Distribution Estimation and ApplicationsProbability and Statistical ResearchWeibull distributiongoodness of fitAtacama Desertsolar radiationrepeated measures
Citations
0
FWCI
0.00
field-weighted impact
References
0
Percentile
53%
vs. same field & year
Citation Network

How this paper connects to the literature. Drag to explore, click any node to open that paper.