Abstract
Climate change, particularly increasing frequency and intensity of spring frost events, poses a serious threat to viticulture by reducing yield and product quality. This study proposes an image processing and machine learning-based framework for early, rapid, and accurate segmentation of frost damage in vineyards using YOLOv11s enhanced with Atrous Spatial Pyramid Pooling (ASPP). A unique dataset called FGVL dataset from Sultana seedless grape vineyards in Manisa, Türkiye, following a severe frost event in April 2025. FGVL includes 418 frost-damaged grapes, 510 frost-damaged leaves, 395 healthy grapes, and 698 healthy leaves, all manually annotated by experts under natural field conditions. By integrating ASPP into YOLOv11s, proposed model improved multi-scale contextual feature extraction and achieved mAP@50 of 0.7686, demonstrating stronger performance in instance segmentation of small, overlapping, and visually similar grapevine organs. In addition, Dynamic Confidence Thresholding (DCT) strategy was introduced to improve prediction reliability in dense and visually complex vineyard scenes. Despite challenges such as background clutter, object overlap, and small target structures, model maintained stable performance with low computational demand, requiring only 6.45 GB of GPU memory. Proposed framework offers an accurate, efficient, and practically deployable early recognition system for frost damage assessment in viticulture.
Similar content being viewed by others
Multi-annual spectral data of Chardonnay grapevine leaves presenting yellows diseases and confounding symptoms
A technical survey on practical applications and guidelines for IoT sensors in precision agriculture and viticulture
Accurate classification of fresh and charred grape seeds to the varietal level, using machine learning based classification method
Data availability
Source code and dataset are publicly shared in GitHub repository of corresponding author. GitHub repo: https://github.com/kaanarikk/Grape-Instance-Segmentation-For-Viticulture
References
IPCC. Climate change 2023: synthesis report. Contribution of working groups I, II and III to the sixth assessment report of the intergovernmental panel on climate change [core writing team, Lee, H. & Romero, J. (eds.)] 35-115 (IPCC, Geneva, Switzerland, 2023). https://doi.org/10.59327/IPCC/AR6-9789291691647
Ray, D. K. et al. Climate change has likely already affected global food production. PLoS ONE 14, e0217148. https://doi.org/10.1371/journal.pone.0217148 (2019).
Hannah, L. et al. Climate change, wine, and conservation. Proc. Natl. Acad. Sci. USA 110, 6907–6912. https://doi.org/10.1073/pnas.1210127110 (2013).
Vitasse, Y., Schneider, L., Rixen, C., Christen, D. & Rebetez, M. Increase in the risk of exposure of forest and fruit trees to spring frosts at higher elevations in Switzerland over the last four decades. Agric. For. Meteorol. 248, 60–69. https://doi.org/10.1016/j.agrformet.2017.09.005 (2018).
Sgubin, G. et al. The risk of tardive frost damage in French vineyards in a changing climate. Agric. For. Meteorol. 250–251, 226–242. https://doi.org/10.1016/j.agrformet.2017.12.253 (2018).
Masson-Delmotte, V. et al. (eds) Climate change 2021: the physical science basis. Contribution of working group I to the sixth assessment report of the intergovernmental panel on climate change (Cambridge University Press, 2021). https://doi.org/10.1017/9781009157896.
Eyring, V. et al. Overview of the Coupled model intercomparison project phase 6 (CMIP6) experimental design and organization. Geosci. Model Dev. 9, 1937–1958. https://doi.org/10.5194/gmd-9-1937-2016 (2016).
Spinoni, J., Vogt, J. V., Naumann, G., Barbosa, P. & Dosio, A. Will drought events become more frequent and severe in Europe?. Int. J. Climatol. 38, 1718–1736. https://doi.org/10.1002/joc.5291 (2018).
International Organisation of Vine and Wine. State of the world vine and wine sector in 2023. https://www.oiv.int/sites/default/files/2024-04/OIV_STATE_OF_THE_WORLD_VINE_AND_WINE_SECTOR_IN_2023.pdf (2024).
Turkish Statistical Institute (TURKSTAT). Crop production statistics, 2023. https://veriportali.tuik.gov.tr/tr/press/49535 (2023).
Uhlig, B. A. & Clingeleffer, P. R. Ripening characteristics of the fruit from Vitis vinifera L. drying cultivars Sultana and Merbein seedless under furrow irrigation. Am. J. Enol. Vitic. 49, 375–382. https://doi.org/10.5344/ajev.1998.49.4.375 (1998).
Ağaoğlu, Y. S. et al. Genel bahçe bitkileri (Ankara Üniversitesi Ziraat Fakültesi, Ankara, 2010).
Teker, T. Cumulative bioclimatic indices and climate data of recent years in some viticultural regions of Turkey. In Agricultural Studies on Different Subjects 83–114 (IKSAD Publishing House, Ankara, 2021). https://iksadyayinevi.com/wp-content/uploads/2021/12/AGRICULTURAL-STUDIES-ON-DIFFERENT-SUBJECTS.pdf
Keller, M. Managing grapevines to optimise fruit development in a challenging environment: A climate change primer for viticulturists. Aust. J. Grape Wine Res. 16, 56–69. https://doi.org/10.1111/j.1755-0238.2009.00077.x (2010).
Wolkovich, E. M., García de Cortázar-Atauri, I., Morales-Castilla, I., Nicholas, K. A. & Lacombe, T. From Pinot to Xinomavro in the world’s future wine-growing regions. Nat. Clim. Chang. 8, 29–37. https://doi.org/10.1038/s41558-017-0016-6 (2018).
Zhang, C. & Kovacs, J. M. The application of small unmanned aerial systems for precision agriculture: A review. Precision Agric. 13, 693–712. https://doi.org/10.1007/s11119-012-9274-5 (2012).
Xue, J. & Su, B. Significant remote sensing vegetation indices: A review of developments and applications. J Sens 2017, 1353691. https://doi.org/10.1155/2017/1353691 (2017).
Kamilaris, A. & Prenafeta-Boldú, F. X. Deep learning in agriculture: A survey. Comput. Electron. Agric. 147, 70–90. https://doi.org/10.1016/j.compag.2018.02.016 (2018).
Liakos, K. G., Busato, P., Moshou, D., Pearson, S. & Bochtis, D. Machine learning in agriculture: A review. Sensors 18, 2674. https://doi.org/10.3390/s18082674 (2018).
Matese, A. et al. Intercomparison of UAV, aircraft and satellite remote sensing platforms for precision viticulture. Remote Sens. 7, 2971–2990. https://doi.org/10.3390/rs70302971 (2015).
Shammi, S., Sohel, F., Diepeveen, D., Zander, S. & Jones, M. G. K. A survey of image-based computational learning techniques for frost detection in plants. Inform Process Agric 10, 164–191. https://doi.org/10.1016/j.inpa.2022.02.003 (2023).
Cogato, A., Meggio, F., Collins, C. & Marinello, F. Medium-resolution multispectral data from Sentinel-2 to assess the damage and the recovery time of late frost on vineyards. Remote Sens. 12, 1896. https://doi.org/10.3390/rs12111896 (2020).
Fraga, H., Malheiro, A. C., Moutinho-Pereira, J. & Santos, J. A. Future scenarios for viticultural zoning in Europe: Ensemble projections and uncertainties. Int. J. Biometeorol. 57, 909–925. https://doi.org/10.1007/s00484-012-0617-8 (2013).
Li, W. et al. A practical remote sensing monitoring framework for late frost damage in wine grapes using multi-source satellite data. Remote Sens 13, 3231. https://doi.org/10.3390/rs13163231 (2021).
Zhu, X., Cai, F., Tian, J. & Williams, T.K.-A. Spatiotemporal fusion of multisource remote sensing data: literature survey, taxonomy, principles, applications, and future directions. Remote Sens. 10, 527. https://doi.org/10.3390/rs10040527 (2018).
Cogato, A. et al. Assessing the feasibility of using Sentinel-2 imagery to quantify the impact of heatwaves on irrigated vineyards. Remote Sens 11, 2869. https://doi.org/10.3390/rs11232869 (2019).
Towers, P. C., Strever, A. & Poblete-Echeverría, C. Comparison of vegetation indices for leaf area index estimation in vertical shoot positioned vine canopies with and without Grenbiule hail-protection netting. Remote Sens 11, 1073. https://doi.org/10.3390/rs11091073 (2019).
Sozzi, M., Kayad, A., Marinello, F., Taylor, J. & Tisseyre, B. Comparing vineyard imagery acquired from Sentinel-2 and unmanned aerial vehicle (UAV) platform. OENO One 54, 189–197. https://doi.org/10.20870/oeno-one.2020.54.2.2557 (2020).
Poblete, T., Ortega-Farías, S., Moreno, M. A. & Bardeen, M. Artificial neural network to predict vine water status spatial variability using multispectral information obtained from an unmanned aerial vehicle (UAV). Sensors 17, 2488. https://doi.org/10.3390/s17112488 (2017).
Santesteban, L. G. et al. High-resolution UAV-based thermal imaging to estimate the instantaneous and seasonal variability of plant water status within a vineyard. Agric. Water Manag. 183, 49–59. https://doi.org/10.1016/j.agwat.2016.08.026 (2017).
Baluja, J. et al. Assessment of vineyard water status variability by thermal and multispectral imagery using an unmanned aerial vehicle (UAV). Irrig. Sci. 30, 511–522. https://doi.org/10.1007/s00271-012-0382-9 (2012).
Bellvert, J., Zarco-Tejada, P. J., Girona, J. & Fereres, E. Mapping crop water stress index in a ‘Pinot-noir’ vineyard: comparing ground measurements with thermal remote sensing imagery from an unmanned aerial vehicle. Precision Agric. 15, 361–376. https://doi.org/10.1007/s11119-013-9334-5 (2014).
Primicerio, J. et al. A flexible unmanned aerial vehicle for precision agriculture. Precision Agric. 13, 517–523. https://doi.org/10.1007/s11119-012-9257-6 (2012).
Kurtulmuş, F., Lee, W. S. & Vardar, A. Green citrus detection using ‘eigenfruit’, color and circular Gabor texture features under natural outdoor conditions. Comput. Electron. Agric. 78, 140–149. https://doi.org/10.1016/j.compag.2011.07.001 (2011).
Mohimont, L., Alin, F., Rondeau, M., Gaveau, N. & Steffenel, L. A. Computer vision and deep learning for precision viticulture. Agronomy 12, 2463. https://doi.org/10.3390/agronomy12102463 (2022).
Geetharamani, G. & Pandian, J. A. Identification of plant leaf diseases using a nine-layer deep convolutional neural network. Comput. Electr. Eng. 76, 323–338. https://doi.org/10.1016/j.compeleceng.2019.04.011 (2019).
Kerkech, M., Hafiane, A. & Canals, R. Vine disease detection in UAV multispectral images using optimized image registration and deep learning segmentation approach. Comput. Electron. Agric. 174, 105446. https://doi.org/10.1016/j.compag.2020.105446 (2020).
Murphy, M. E., Boruff, B., Callow, J. N. & Flower, K. C. Detecting frost stress in wheat: A controlled environment hyperspectral study on wheat plant components and implications for multispectral field sensing. Remote Sens 12, 477. https://doi.org/10.3390/rs12030477 (2020).
Ruan, S. et al. Hyperspectral classification of frost damage stress in tomato plants based on few-shot learning. Agronomy 13, 2348. https://doi.org/10.3390/agronomy13092348 (2023).
LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436–444. https://doi.org/10.1038/nature14539 (2015).
Krizhevsky, A., Sutskever, I. & Hinton, G. E. ImageNet classification with deep convolutional neural networks. Commun. ACM 60, 84–90. https://doi.org/10.1145/3065386 (2017).
Redmon, J. & Farhadi, A. YOLOv3: An incremental improvement. Preprint at https://arxiv.org/abs/1804.02767 (2018).
Badgujar, C. M., Poulose, A. & Gan, H. Agricultural object detection with You Only Look Once (YOLO) algorithm: A bibliometric and systematic literature review. Comput. Electron. Agric. 223, 109090. https://doi.org/10.1016/j.compag.2024.109090 (2024).
Hochreiter, S. & Schmidhuber, J. Long short-term memory. Neural Comput. 9, 1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735 (1997).
Abbatantuono, F. et al. Recent progress on grapevine water status assessment through remote and proximal sensing: A review. Sci. Hortic. 338, 113658. https://doi.org/10.1016/j.scienta.2024.113658 (2024).
Amjoud, A. B. & Amrouch, M. Transfer learning for automatic image orientation detection using deep learning and logistic regression. IEEE Access 10, 128543–128553. https://doi.org/10.1109/ACCESS.2022.3225455 (2022).
Ouyang, W. et al. DeepID-Net: object detection with deformable part based convolutional neural networks. IEEE Trans. Pattern Anal. Mach. Intell. 39, 1320–1334. https://doi.org/10.1109/TPAMI.2016.2587642 (2017).
Shorten, C. & Khoshgoftaar, T. M. A survey on image data augmentation for deep learning. J. Big Data 6, 60. https://doi.org/10.1186/s40537-019-0197-0 (2019).
Tran, D., Bourdev, L., Fergus, R., Torresani, L. & Paluri, M. Learning spatiotemporal features with 3D convolutional networks. In Proc. IEEE Int. Conf. Comput. Vis. 4489–4497. https://doi.org/10.1109/ICCV.2015.510 (2015).
Singh, B. & Davis, L. S. An analysis of scale invariance in object detection: SNIP. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit. 3578–3587. https://doi.org/10.1109/CVPR.2018.00377 (2018).
Buslaev, A. et al. Albumentations: Fast and flexible image augmentations. Information 11, 125. https://doi.org/10.3390/info11020125 (2020).
Perez, L. & Wang, J. The effectiveness of data augmentation in image classification using deep learning. Preprint at https://arxiv.org/abs/1712.04621 (2017).
Taylor, L. & Nitschke, G. Improving deep learning using generic data augmentation. Preprint at https://arxiv.org/abs/1708.06020 (2017).
Mikołajczyk, A. & Grochowski, M. Data augmentation for improving deep learning in image classification problem. In 2018 International Interdisciplinary PhD Workshop (IIPhDW) 117–122. https://doi.org/10.1109/IIPHDW.2018.8388338 (2018).
Chen, Y. et al. Application of YOLOv4 algorithm for foreign object detection on a belt conveyor in a low-illumination environment. Sensors 22, 6851. https://doi.org/10.3390/s22186851 (2022).
Rana, S., Hensel, O. & Nasirahmadi, A. From vineyard to vision: Multi-domain analysis and mitigation of grape cluster detection failures in complex viticultural environments. Results. Eng. 29, 108833. https://doi.org/10.1016/j.rineng.2025.108833 (2026).
Everingham, M., van Gool, L., Williams, C. K. I., Winn, J. & Zisserman, A. The Pascal visual object classes (VOC) challenge. Int. J. Comput. Vis. 88, 303–338. https://doi.org/10.1007/s11263-009-0275-4 (2010).
Lin, T.-Y. et al. Microsoft COCO: common objects in context. In Comput. Vis. – ECCV 2014 740–755; https://doi.org/10.1007/978-3-319-10602-1_48 (2014).
Rezatofighi, H. et al. Generalized intersection over union: a metric and a loss for bounding box regression. In Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. 658–666. https://doi.org/10.1109/CVPR.2019.00075 (2019).
Tharwat, A. Classification assessment methods. Appl Comput Inform 17, 168–192. https://doi.org/10.1016/j.aci.2018.08.003 (2021).
Ultralytics. YOLO11. https://docs.ultralytics.com/models/yolo11/ (2024).
Dosovitskiy, A. et al. An image is worth 16×16 words: transformers for image recognition at scale. Preprint at https://arxiv.org/abs/2010.11929. https://doi.org/10.48550/arXiv.2010.11929 (2020).
Liu, S., Qi, L., Qin, H., Shi, J. & Jia, J. Path aggregation network for instance segmentation. In Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. 8759–8768. https://doi.org/10.1109/CVPR.2018.00913 (2018).
Li, X. et al. Generalized focal loss: Learning qualified and distributed bounding boxes for dense object detection. In Adv. Neural Inf. Process. Syst. 33, 21002–21012 (2020).
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K. & Yuille, A. L. DeepLab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 40, 834–848. https://doi.org/10.1109/TPAMI.2017.2699184 (2018).
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F. & Adam, H. Encoder-decoder with atrous separable convolution for semantic image segmentation. In Comput. Vis. – ECCV 2018 833–851. https://doi.org/10.1007/978-3-030-01234-2_49 (2018).
Fuentes, A., Yoon, S., Kim, S. C. & Park, D. S. A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors 17, 2022. https://doi.org/10.3390/s17092022 (2017).
Milioto, A., Lottes, P. & Stachniss, C. Real-time semantic segmentation of crop and weed for precision agriculture robots leveraging background knowledge in CNNs. In Proc. IEEE Int. Conf. Robot. Autom. 2229–2235. https://doi.org/10.1109/ICRA.2018.8460962 (2018).
Hütten, N. et al. Deep learning for automated visual inspection in manufacturing and maintenance: A survey of open-access papers. Appl Syst Innov 7, 11. https://doi.org/10.3390/asi7010011 (2024).
Luo, Z., Yang, W., Yuan, Y., Gou, R. & Li, X. Semantic segmentation of agricultural images: A survey. Inform Process Agric 11, 172–186. https://doi.org/10.1016/j.inpa.2023.02.001 (2024).
Ozan, Ş. Training data generation for U-Net based MRI image segmentation using level-set methods. J Math Sci Modell 6, 17–23. https://doi.org/10.33187/jmsm.1106012 (2023).
Manakitsa, N., Maraslidis, G. S., Moysis, L. & Fragulis, G. F. A review of machine learning and deep learning for object detection, semantic segmentation, and human action recognition in machine and robotic vision. Technologies 12, 15. https://doi.org/10.3390/technologies12020015 (2024).
Ho, S. Y., Phua, K., Wong, L. & Goh, W. W. B. Extensions of the external validation for checking learned model interpretability and generalizability. Patterns 1, 100129. https://doi.org/10.1016/j.patter.2020.100129 (2020).
Kamann, C. & Rother, C. Benchmarking the robustness of semantic segmentation models with respect to common corruptions. Int. J. Comput. Vis. 129, 462–483. https://doi.org/10.1007/s11263-020-01383-2 (2021).
Rashidisabet, H. et al. Validating the generalizability of ophthalmic artificial intelligence models on real-world clinical data. Transl. Vis. Sci. Technol. 12, 8. https://doi.org/10.1167/tvst.12.11.8 (2023).
Rafi, T. H. et al. Domain generalization for semantic segmentation: A survey. Artif. Intell. Rev. 57, 247. https://doi.org/10.1007/s10462-024-10817-z (2024).
Gao, Z., Luo, Z., Zhang, W., Lv, Z. & Xu, Y. Deep learning application in plant stress imaging: A review. AgriEngineering 2, 430–446. https://doi.org/10.3390/agriengineering2030029 (2020).
Birdal, R. G. Ensemble learning-based approach for Parkinson’s disease detection using random forest and gradient boosting on spiral drawing biomarkers. J. Math. Sci. Model. 8, 144–152. https://doi.org/10.33187/jmsm.1705745 (2025).
Rasmussen, C. B., Kirk, K. & Moeslund, T. B. The challenge of data annotation in deep learning: A case study on whole plant corn silage. Sensors 22, 1596. https://doi.org/10.3390/s22041596 (2022).
Tschirschwitz, D. E. & Rodehorst, V. Label convergence: defining an upper performance bound in object recognition through contradictory annotations. In Proc. IEEE/CVF Winter Conf. Appl. Comput. Vis. 6848–6857. https://doi.org/10.1109/WACV61041.2025.00666 (2025).
Redmon, J., Divvala, S., Girshick, R. & Farhadi, A. You only look once: unified, real-time object detection. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit. 779–788. https://doi.org/10.1109/CVPR.2016.91 (2016).
Tan, M. & Le, Q. EfficientNet: Rethinking model scaling for convolutional neural networks. Proc. Mach. Learn. Res. 97, 6105–6114 (2019).
Lu, Y. & Young, S. A survey of public datasets for computer vision tasks in precision agriculture. Comput. Electron. Agric. 178, 105760. https://doi.org/10.1016/j.compag.2020.105760 (2020).
Yang, M., Yu, K., Zhang, C., Li, Z. & Yang, K. DenseASPP for semantic segmentation in street scenes. In Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. 3684–3692. https://doi.org/10.1109/CVPR.2018.00388 (2018).
Huang, J. et al. Speed/accuracy trade-offs for modern convolutional object detectors. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit. 7310–7311. https://doi.org/10.1109/CVPR.2017.351 (2017).
Low, G., Meuwissen, M. P. M., Finger, R. & Dalhaus, T. Frost shocks negatively impact the supply of high-stem juicing apples in Switzerland. Agric. Syst. 228, 104363. https://doi.org/10.1016/j.agsy.2025.104363 (2025).
Shammi, S., Diepeveen, D., Zander, S., Jones, M. G. K. & Sohel, F. Early frost detection in wheat using machine learning from vertical temperature distributions. Comput. Electron. Agric. 221, 108950. https://doi.org/10.1016/j.compag.2024.108950 (2024).
Gökgöz, N. & Çifdalöz, O. For a depensatory fishery system hybrid modeling and optimal control of harvest policies. J Math Sci Modell 8(1), 1–6. https://doi.org/10.33187/jmsm.1595004 (2025).
Funding
This research received no external funding.
Author information
Authors and Affiliations
Contributions
K.A; Methodology, Software, Validation, Formal analysis, Investigation, Data curation, Visualization, Writing—original draft. E.B.; Conceptualization, Formal analysis, Writing—review & editing, Project administration.
Corresponding author
Ethics declarations
Competing interests
The authors declare no conflict of interest.
Ethics approval
This study involved visual analysis of agricultural plant material and did not include human or animal subjects. Therefore, formal ethical committee approval was not required.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.
Reprints and permissions
About this article
Cite this article
Arık, K., Büyükbıçakcı, E. Frost damage segmentation in grapevine organs using YOLOv11s with ASPP and dynamic confidence thresholding.
Sci Rep (2026). https://doi.org/10.1038/s41598-026-45694-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-026-45694-9
Keywords
- Frost damage recognition
- Grapevine organ segmentation
- Viticulture
- YOLOv11
- Atrous spatial pyramid pooling
- Dynamic confidence thresholding
Source: Ecology - nature.com

