in

Guidelines for selecting variability measure in limited-size ANOVA experiments


Abstract

Graphical representation of variability is essential for accurately communicating scientific results in applied sciences. In ANOVA experiments with a low number of replicates (n), the selection between pooled or individual standard deviations (SDs) poses a methodological challenge. The aim of this study is to offer practical guidelines to help researchers decide whether to use pooled or individual SDs in tables and figures, when the number of replicates is low. This study uses extensive Monte Carlo simulations (over 2,000 scenarios) to investigate the distributional behaviour of SD estimates across different replications and heterogeneity levels. We compare the performance of pooled versus individual SDs using the Mean Absolute Deviation (MAD) from the true population values, and we evaluate the utility of Levene’s and Fmax (Hartley’s) tests in guiding this choice. Results show that pooled SDs offer superior accuracy under homogeneity or low heterogeneity conditions, particularly with n ≤ 4, while individual SDs are preferable when variance heterogeneity is moderate to high and the replication number is higher (n ≥ 5). Levene’s test generally outperforms the Fmax test in supporting the correct selection of the variability measure, especially in multi-group settings. The guidelines proposed can be directly applied to many experimental settings in applied sciences, where the number of replicates and treatments is often limited.

Similar content being viewed by others

Maximizing efficiency in sedimentary ancient DNA analysis: a novel extract pooling approach

Discovery of recessive effect of human polymerase δ proofreading deficiency through mutational analysis of POLD1-mutated normal and cancer cells

Pathogenic variants in SLF2 and SMC5 cause segmented chromosomes and mosaic variegated hyperploidy

Acknowledgments

The authors acknowledge support from the University of Milan through the APC initiative.

Funding

The authors received no specific funding for this work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to
Roberta Calone.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary Material 1 (download XLSX )

Supplementary Material 2

Supplementary Material 3

Supplementary Material 4 (download DOCX )

Supplementary Material 5

Supplementary Material 6 (download XLSX )

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Cite this article

Gabbrielli, M., Valkama, E., Calone, R. et al. Guidelines for selecting variability measure in limited-size ANOVA experiments.
Sci Rep (2026). https://doi.org/10.1038/s41598-026-54181-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1038/s41598-026-54181-0

Keywords

  • Standard deviation reporting
  • Small sample size
  • Pooled standard deviation
  • Variance heterogeneity


Source: Ecology - nature.com

Population thermal regime modulates the response of the agarophyte Gelidium corneum to marine heatwaves

Warm-core eddy intensifies surface mixotrophic bacterivory and fuels mesopelagic heterotrophic grazing

Back to Top