Scinovex
article Open Access

Beyond median and mean regression models for count responses: A comparison study

Abstract

Count response variables are commonly encountered in reproductive health studies and require statistical models that accurately capture their distributional characteristics. Traditional count regression models, such as Poisson and Negative Binomial regression, primarily focus on modeling the conditional mean and may overlook heterogeneous effects across different regions of the response distribution. This study compares four regression approaches for count data: Poisson Regression, Negative Binomial Regression, Quantile Regression for Count Data, and Expectile Regression for Count Data. The analysis is based on abortion counts among married women using real reproductive health data. Model performance was evaluated using the Akaike Information Criterion (AIC), Bayesian Information Criterion (BIC), Root Mean Square Error (RMSE), and Mean Absolute Error (MAE). The results indicate that the Negative Binomial model outperformed the Poisson model because it effectively accounted for overdispersion. Quantile and Expectile regression models revealed substantial variation in covariate effects across different regions of the response distribution. Among the competing models, Expectile Regression achieved the best overall performance, producing the lowest values of AIC, BIC, RMSE, and MAE. The findings demonstrate that Expectile Regression provides a flexible and effective framework for modeling count response data and offers a more comprehensive understanding of heterogeneous relationships than conventional mean-based regression models.

Full Text

Tables and figures are in the full-text PDF.

Introduction

Count data are frequently encountered in epidemiology, public health, economics, and the social sciences, where the response variable represents the number of occurrences of an event within a specified period. In reproductive health research, the number of abortions among married women is an important count outcome because it reflects the combined effects of demographic, socioeconomic, and healthcare-related factors. Appropriate statistical modeling of such data provides valuable evidence for understanding risk factors and supporting reproductive health policies (Cameron & Trivedi, 2013; Hilbe, 2011) [2,3] . Poisson regression has long been regarded as the standard approach for modeling count responses because of its simple probabilistic structure and straightforward interpretation. However, the model assumes equality between the conditional mean and conditional variance, an assumption that is frequently violated in real applications. When overdispersion exists, the estimated standard errors become biased, leading to unreliable statistical inference. The Negative Binomial regression model addresses this limitation by introducing a dispersion parameter that accommodates additional variability in count responses (Hilbe, 2011; Agresti, 2015) [3,1] . Although Poisson and Negative Binomial regression models effectively estimate the conditional mean, they provide only a partial description of the response distribution. In many applications, the effects of explanatory variables differ between individuals with low and high event counts. Consequently, models that focus solely on the conditional mean may overlook important heterogeneous relationships within the data (Koenker, 2005; Machado & Santos Silva, 2005) [5,6] .

Distributional regression methods have been developed to overcome this limitation. Quantile Regression for Count Data estimates conditional quantiles and allows covariate effects to vary across different parts of the response distribution. Expectile Regression extends this framework by estimating conditional expectiles through asymmetric least squares, providing a flexible alternative that captures both central and tail behavior of the response variable while maintaining computational efficiency (Newey & Powell, 1987) [7] . Recent methodological developments have further expanded the applicability of Expectile Regression. Raheem and Abid (2025) [8] proposed an adaptive elastic net penalty within the Expectile Regression framework to improve variable selection and prediction in the presence of multicollinearity. (ResearchGate) Later, Raheem and Turki (2026) [9] introduced a Bayesian Reciprocal LASSO Expectile Regression model that combined Bayesian estimation with reciprocal penalization to enhance predictive performance and variable selection in asymmetric data. (ResearchGate) These studies demonstrate the growing importance of Expectile Regression as a flexible alternative to traditional regression models. Despite these developments, empirical comparisons between Expectile Regression, Quantile Regression, and conventional count regression models using real reproductive health data remain limited. Most previous studies have concentrated on methodological development or mean-based regression models, with relatively little attention given to comparing these approaches in the analysis of count responses. This study compares Poisson Regression, Negative Binomial Regression, Quantile Regression for Count Data, and Expectile Regression for Count Data using the number of abortions among married women as an empirical application. The objective is to evaluate the ability of these models to identify significant determinants of abortion counts and to determine the most appropriate modeling framework for count response data characterized by heterogeneous effects across the conditional distribution.

Statistical Methods

Poisson Regression

Poisson regression is one of the most widely used models for analyzing count response variables, where the dependent variable represents the number of occurrences of an event during a fixed period or within a specified observational unit. The model assumes that the response variable follows a Poisson distribution and relates its expected value to a set of explanatory variables through a logarithmic link function (Cameron & Trivedi, 2013) [2] . Let 𝑌 𝑖 denote the count response for the i-th observation. [4,1] .

Negative Binomial Regression

Negative Binomial (NB) regression is an extension of Poisson regression that is designed to analyze count data exhibiting overdispersion, where the conditional variance exceeds the conditional mean. In many real-world applications, such as reproductive health studies, the Poisson assumption of equal mean and variance is often violated, making the Negative Binomial model a more appropriate alternative (Hilbe, 2011) [3] . [2,3] .

Quantile Regression for Count Data

Quantile regression for count data extends the concept of classical quantile regression to discrete response variables. Unlike Poisson and Negative Binomial regression, which model the conditional mean of the response variable, quantile regression estimates conditional quantiles, allowing the effects of explanatory variables to vary across different parts of the outcome distribution (Machado & Santos Silva, 2005) [6] .

Because count outcomes are discrete, the conditional quantile function is not uniquely defined. Machado and Santos Silva (2005) [6] proposed the jittering approach,

where 𝑈 𝑖 ~ 𝑈(0,1), 𝑌 𝑖 is the observed count, and 𝑍 𝑖 is the continuous transformed response.

For a quantile level 𝜏 ∈ (0,1), the conditional quantile model is

The regression coefficients are estimated by minimizing the quantile loss function,

is the check loss function.

Quantile regression for count data is particularly useful when predictor effects differ across the response distribution or when the data exhibit skewness, heterogeneity, or outliers. However, interpretation is more complex because of the discrete nature of count responses (Koenker, 2005; Machado & Santos Silva, 2005) [5,6] .

Expectile Regression for Count Data

Expectile regression for count data extends classical expectile regression to discrete response variables by modeling conditional expectiles rather than conditional means or quantiles. Unlike Poisson and Negative Binomial regression, which focus on the conditional mean, and quantile regression, which estimates conditional quantiles, expectile regression provides a complete description of the conditional distribution through asymmetric least squares estimation (Newey & Powell, 1987) [7] . For count responses, the conditional expectile at level 𝜏 is

where 𝑋 𝑖 denotes the explanatory variables and 𝛽(𝜏) is the vector of regression coefficients. [10,7] . Before model estimation, the dataset is examined using descriptive statistical methods to summarize the distribution of the response variable and the explanatory variables. The presence of overdispersion and other data characteristics is also assessed to determine the suitability of the competing regression models for the subsequent comparative analysis.

Real

Variables

The study considers one dependent variable and several explanatory variables to investigate the factors associated with abortion counts among married women. The response variable is the total number of abortions reported by each respondent, while the explanatory variables represent demographic, socioeconomic, and healthcare characteristics. The dependent variable is the number of abortions experienced by each married woman and is treated as a count variable.

The explanatory variables included in the analysis are summarized in Table 1. These variables were selected because previous reproductive health studies have identified them as important determinants of abortion outcomes. All explanatory variables were incorporated into each competing regression model to ensure a consistent comparison of model performance.

Descriptive Statistics

Descriptive statistics were calculated to summarize the characteristics of the study variables prior to model estimation. For the continuous variables, the mean, standard deviation, minimum, median, and maximum values were computed to describe the central tendency and dispersion of the data. The response variable, representing the number of abortions, exhibited a relatively low average with noticeable variability, indicating that most women experienced no abortions while a smaller proportion reported multiple abortion events. The age distribution showed that the study population mainly consisted of women in their reproductive years. The descriptive statistics of the continuous variables are presented in Table 2. The distribution of the categorical variables is summarized in Table 3. Most respondents had secondary education, more than half resided in urban areas, and approximately two-thirds reported using contraceptive methods and having adequate access to healthcare services. These characteristics indicate that the dataset contains sufficient demographic and socioeconomic variation to evaluate the performance of the competing count regression models.

Poisson Regression Results

The Poisson regression model was first fitted to evaluate the relationship between the explanatory variables and the number of abortions among married women. The results indicate that age, education level, contraceptive use, and access to healthcare were statistically significant predictors of abortion counts. In contrast, residence and employment status did not show statistically significant effects at the 5% significance level. The estimated incidence rate ratios suggest that increasing age was associated with a higher expected number of abortions, while higher educational attainment and contraceptive use were associated with lower abortion counts. Women with adequate access to healthcare also exhibited a lower expected number of abortions than those with limited access to healthcare. The complete estimation results are presented in Table 4. Although the Poisson regression model identified several significant predictors, an examination of the goodness-of-fit statistics revealed evidence of overdispersion, with the residual deviance exceeding the residual degrees of freedom. This finding suggests that the assumption of equidispersion may not hold for the present dataset, indicating that the Negative Binomial regression model is likely to provide a better fit for the abortion count data.

Negative Binomial Regression Results

The Negative Binomial regression model was estimated to account for the overdispersion detected in the Poisson regression model. The estimated dispersion parameter was significantly greater than zero, confirming that the variance of the response variable exceeded its mean. Consequently, the Negative Binomial model provided a more appropriate representation of the abortion count data. The estimated coefficients were generally consistent with those obtained from the Poisson regression model. Age remained positively associated with the expected number of abortions, whereas higher education, contraceptive use, and adequate access to healthcare significantly reduced the expected abortion count. Compared with the Poisson model, the standard errors were slightly larger, resulting in more reliable statistical inference. The estimation results are summarized in Table 5. The estimated dispersion parameter was equal to 0.81 (p< 0.001), indicating substantial overdispersion in the data. This result supports the use of the Negative Binomial regression model over the Poisson regression model. The lower AIC value and improved goodness-of-fit statistics also indicate that the Negative Binomial model provides a better fit for the abortion count data and yields more reliable estimates of the relationships between the explanatory variables and the response variable.

Quantile Regression Results

Quantile regression for count data was estimated to investigate whether the effects of the explanatory variables varied across different parts of the conditional distribution of abortion counts. The analysis was conducted at the 25th, 50th, and 75th conditional quantiles using the jittering approach. This approach provides a more detailed assessment of covariate effects than conventional mean-based models by allowing regression coefficients to change across quantiles.

The estimation results indicate that the influence of several explanatory variables differed considerably across the selected quantiles. Age had a relatively small effect at the lower quantile but became more pronounced at higher quantiles, suggesting that its impact increased among women reporting larger numbers of abortions. Similarly, higher education and contraceptive use exhibited stronger negative effects in the upper quantiles, while access to healthcare remained a significant protective factor throughout the distribution. The estimated regression coefficients are presented in Table 6. The results demonstrate that the effects of the explanatory variables are not constant across the conditional distribution of abortion counts. In particular, age, educational attainment, and contraceptive use exerted substantially stronger effects at the upper quantiles than at the lower quantiles. These findings indicate that quantile regression captures heterogeneous relationships that cannot be identified using Poisson or Negative Binomial regression, both of which summarize only the conditional mean of the response variable.

Expectile Regression Results

The Expectile regression model was estimated to evaluate the effects of the explanatory variables across different regions of the conditional distribution of abortion counts using asymmetric least squares estimation. Similar to the quantile regression model, the analysis was performed at the 25th, 50th, and 75th expectiles. However, expectile regression assigns different weights to positive and negative residuals, allowing greater sensitivity to observations in the tails of the distribution.

The results indicate that the estimated effects varied across the selected expectiles. Age showed a progressively stronger positive association with abortion counts as the expectile level increased. Conversely, higher educational attainment, contraceptive use, and adequate healthcare access exhibited increasingly larger negative effects at higher expectiles, indicating that these factors were particularly important among women with relatively high abortion counts. The estimation results are summarized in Table 7. The results demonstrate that accounting for the entire conditional distribution of abortion counts improves model performance compared with conventional mean-based regression models. The superior performance of the Expectile Regression model indicates that it is well suited for identifying heterogeneous effects of socioeconomic and demographic factors on abortion counts, making it a useful alternative for the analysis of count response data.

Conclusion

This study compared four regression models for count response data using the number of abortions among married women as an empirical application. The comparison included Poisson Regression, Negative Binomial Regression, Quantile Regression for Count Data, and Expectile Regression for Count Data to evaluate their ability to explain the relationship between socioeconomic and demographic characteristics and abortion counts. The descriptive analysis indicated that the response variable exhibited a highly skewed distribution, with most women reporting no abortions and a relatively small proportion reporting multiple abortion events. The presence of overdispersion suggested that conventional Poisson regression might not adequately represent the underlying data structure. The Poisson regression model identified several significant predictors but showed evidence of overdispersion, resulting in a poorer model fit. The Negative Binomial model addressed this limitation by incorporating a dispersion parameter and produced more reliable parameter estimates and improved goodness-of-fit measures. Both Quantile Regression and Expectile Regression demonstrated that the effects of explanatory variables were not constant across the conditional distribution of abortion counts. Age showed a stronger positive association at higher quantiles and expectiles, whereas higher education, contraceptive use, and adequate healthcare access exerted increasingly stronger negative effects among women with higher abortion counts. Among the competing models, Expectile Regression achieved the best overall performance according to the model evaluation criteria. It produced the lowest values of AIC, BIC, RMSE, and MAE, indicating superior predictive accuracy and a better representation of heterogeneous covariate effects across the response distribution. The findings suggest that Expectile Regression provides a flexible and effective framework for analyzing count response data, particularly when the objective is to investigate variations across the entire conditional distribution rather than focusing solely on the conditional mean. Its application offers additional insights that may support more targeted public health and reproductive health policies.

References

  1. Agresti A. Foundations of linear and generalized linear models. John Wiley & Sons; 2015.
  2. Cameron AC, Trivedi PK. Regression analysis of count data. 2nd ed. Cambridge University Press; 2013.
  3. Hilbe JM. Negative binomial regression. 2nd ed. Cambridge University Press; 2011.
  4. Hilbe JM. Modeling count data. Cambridge University Press; 2014.
  5. Koenker R. Quantile regression. Cambridge University Press; 2005.
  6. Machado JAF, Santos Silva JMC. Quantiles for counts. J Am Stat Assoc. 2005;100(472):1226-1237.
  7. Newey WK, Powell JL. Asymmetric least squares estimation and testing. Econometrica. 1987;55(4):819847.
  8. Raheem SH, Abid Alhafidh Mohamed E. Expectile regression with adaptive elastic net penalty. Int J Stat Appl Math. 2025;10(6):101-106.
  9. Raheem SH, Turki ZS, Alsaadi ZS. Bayesian reciprocal LASSO expectile regression. Pak J Stat. 2026;42(2):117128.
  10. Sobotka F, Kneib T. Geoadditive expectile regression. Comput Stat Data Anal. 2012;56(4):755-767.
Statistical Methods and Bayesian InferenceStatistical Distribution Estimation and ApplicationsAdvanced Statistical Methods and Modelsnegative binomial regressionoverdispersionmarried womenPoisson regressionexpectile regressionreproductive health
Citations
0
FWCI
0.00
field-weighted impact
References
0
Percentile
61%
vs. same field & year
Citation Network

How this paper connects to the literature. Drag to explore, click any node to open that paper.