in

Image dataset for benchmarking automated fish detection and classification algorithms

  • Cheung, W. W. L. et al. Shrinking of fishes exacerbates impacts of global ocean changes on marine ecosystems. Nat. Clim. Chang. 3, 254–258, https://doi.org/10.1038/nclimate1691 (2013).

    Article 
    ADS 

    Google Scholar 

  • Cheung, W. W. L., Watson, R. & Pauly, D. Signature of ocean warming in global fisheries catch. Nature 497, 365–368, https://doi.org/10.1038/nature12156 (2013).

    Article 
    ADS 
    CAS 

    Google Scholar 

  • Hilborn, R. et al. Global status of groundfish stocks. Fish Fish. 00, 1–18, https://doi.org/10.1111/faf.12560 (2021).

    Article 

    Google Scholar 

  • Aguzzi, J. et al. Challenges to the assessment of benthic populations and biodiversity as a result of rhythmic behaviour: video solutions from cabled observatories. Oceanography and Marine Biology: An Annual Review 50, 233–284 (2012).

    Google Scholar 

  • Aguzzi, J. et al. Coastal observatories for monitoring of fish behaviour and their responses to environmental changes. Reviews in fish biology and fisheries 25, 463–483, https://doi.org/10.1007/s11160-015-9387-9 (2015).

    Article 

    Google Scholar 

  • Doya, C. et al. Diel behavioral rhythms in sablefish (Anoplopoma fimbria) and other benthic species, as recorded by the Deep-sea cabled observatories in Barkley canyon (NEPTUNE-Canada). Journal of Marine Systems 130, 69–78, https://doi.org/10.1016/j.jmarsys.2013.04.003 (2014).

    Article 
    ADS 

    Google Scholar 

  • Aguzzi, J. et al. Ecological video monitoring of Marine Protected Areas by underwater cabled surveillance cameras. Marine Policy 119, 104052, https://doi.org/10.1016/j.marpol.2020.104052 (2020).

    Article 

    Google Scholar 

  • Milligan, R. J. et al. Evidence for seasonal cycles in deep‐sea fish abundances: A great migration in the deep SE Atlantic? Journal of Animal Ecology 89, 1593–1603, https://doi.org/10.1111/1365-2656.13215 (2020).

    Article 

    Google Scholar 

  • Hutchingson, G. E. Concluding remarks. Cold Spring Harbor Symp. 22, 415–427, https://doi.org/10.1101/SQB.1957.022.01.039 (1957).

    Article 

    Google Scholar 

  • Hut, R. A., Kronfeld-Schor, N., Van Der Vinne, V. & De la Iglesia, H. In search of a temporal niche: environmental factors. Progress in brain research 199, 281–304, https://doi.org/10.1016/B978-0-444-59427-3.00017-4 (2012).

    Article 

    Google Scholar 

  • Aguzzi, J. et al. The hierarchic treatment of marine ecological information from spatial networks of benthic platforms. Sensors 20, 1751, https://doi.org/10.3390/s20061751 (2020).

    Article 
    ADS 

    Google Scholar 

  • Danovaro, R. et al. A new international ecosystem-based strategy for the global deep ocean. Science 355, 452–454, https://doi.org/10.1126/science.aah7178 (2017).

    Article 
    ADS 
    CAS 

    Google Scholar 

  • Aguzzi, J. et al. The potential of video imagery from worldwide cabled observatory networks to provide information supporting fish-stock and biodiversity assessment. ICES Journal of Marine Science 77, 2396–2410, https://doi.org/10.1093/icesjms/fsaa169 (2020).

    Article 

    Google Scholar 

  • Aguzzi, J. et al. New high-tech flexible networks for the monitoring of deep-sea ecosystems. Environmental science and technology 53, 6616–6631, https://doi.org/10.1021/acs.est.9b00409 (2019).

    Article 
    ADS 
    CAS 

    Google Scholar 

  • Rountree, R. A. et al. Towards an optimal design for ecosystem-level ocean observatories. In Oceanography and Marine Biology. Taylor and Francis, pp. 79–106 (2020).

  • Aguzzi, J. et al. Developing technological synergies between deep-sea and space research. Elementa: Science of the Anthropocene 10, 00064, https://doi.org/10.1525/elementa.2021.00064 (2022).

    Article 

    Google Scholar 

  • Aguzzi, J. et al. Multiparametric monitoring of fish activity rhythms in an Atlantic coastal cabled observatory. Journal of Marine Systems 212, 103424, https://doi.org/10.1016/j.jmarsys.2020.103424 (2020).

    Article 

    Google Scholar 

  • Matabos et al. Expert, Crowd, Students or Algorithm: who holds the key to deep-sea imagery ‘big data’ processing? Methods in Ecology and Evolution 8, 996–1004, https://doi.org/10.1111/2041-210X.12746 (2017).

    Article 

    Google Scholar 

  • Zuazo, A. et al. An automated pipeline for image processing and data treatment to track activity rhythms of Paragorgia arborea in relation to hydrographic conditions. Sensors 20, 6281, https://doi.org/10.3390/s20216281 (2020).

    Article 
    ADS 

    Google Scholar 

  • Dibattista, J. D. et al. Community-based citizen science projects can support the distributional monitoring of fishes. Aquatic Conservation: Marine and Freshwater Ecosystems 31, 3580–3593, https://doi.org/10.1002/aqc.3726 (2021).

    Article 

    Google Scholar 

  • Malde, K., Handegard, N. O., Eikvil, L. & Salberg, A. B. Machine intelligence and the data-driven future of marine science. ICES Journal of Marine Science 77, 1274–1285, https://doi.org/10.1093/icesjms/fsz057 (2020).

    Article 

    Google Scholar 

  • European Marine Board. Big Data in Marine Science. European Marine Broad Advencing Seas & Ocean Science. https://www.marineboard.eu/publications/big-data-marine-science (2020).

  • Aguzzi, J. et al. The new SEAfloor OBservatory (OBSEA) for remote and long-term coastal ecosystem monitoring. Sensors-Basel 11, 5850–5872, https://doi.org/10.3390/s110605850 (2011).

    Article 
    ADS 

    Google Scholar 

  • Del Rio, J. et al. Obsea: a decadal balance for a cabled observatory deployment. IEEE Access 8, 33163–33177, https://doi.org/10.1109/ACCESS.2020.2973771 (2020).

    Article 

    Google Scholar 

  • Condal, F. et al. Seasonal rhythm in a Mediterranean coastal fish community as monitored by a cabled observatory. Marine Biology 159, 2809–2817, https://doi.org/10.1007/s00227-012-2041-3 (2012).

    Article 

    Google Scholar 

  • Naylor, E. Chronobiology of marine organisms (Cambridge University Press, 2010).

  • Weis, J. S., Smith, G., Zhou, T., Santiago-Bass, C. & Weis, P. Effects of contaminants on behavior: biochemical mechanisms and ecological consequences: killifish from a contaminated site are slow to capture prey and escape predators; altered neurotransmitters and thyroid may be responsible for this behavior, which may produce population changes in the fish and their major prey, the grass shrimp. Bioscience 51, 209–217 https://doi.org/10.1641/0006-3568(2001)051[0209:EOCOBB]2.0.CO;2 (2001).

  • Bellido, J. M. et al. Identifying essential fish habitat for small pelagic species in Spanish Mediterranean waters. In Essential Fish Habitat Mapping in the Mediterranean. Springer Netherlands, 171–184 https://doi.org/10.1007/978-1-4020-9141-4_13 (2008).

  • Brander, K. Impacts of climate change on fisheries. Journal of Marine Systems 79, 389–402, https://doi.org/10.1016/j.jmarsys.2008.12.015 (2010).

    Article 
    ADS 

    Google Scholar 

  • Viehman, H. A. & Zydlewski, G. B. Multi-scale temporal patterns in fish presence in a high-velocity tidal channel. PLoS One 12, e0176405, https://doi.org/10.1371/journal.pone.0176405 (2017).

    Article 
    CAS 

    Google Scholar 

  • Van Der Walt, K. A., Porri, F., Potts, W. M., Duncan, M. I. & James, N. C. Thermal tolerance, safety margins and vulnerability of coastal species: Projected impact of climate change induced cold water variability in a temperate African region. Marine Environmental Research 169, 105346, https://doi.org/10.1016/j.marenvres.2021.105346 (2021).

    Article 
    CAS 

    Google Scholar 

  • Marini, S. et al. Tracking fish abundance by underwater image recognition. Scientific reports 8, 1–12, https://doi.org/10.1038/s41598-018-32089-8 (2018).

    Article 
    ADS 
    CAS 

    Google Scholar 

  • Sbragaglia, V. et al. Annual rhythms of temporal niche partitioning in the Sparidae family are correlated to different environmental variables. Scientific reports 9, 1–11, https://doi.org/10.1038/s41598-018-37954-0 (2019).

    Article 
    ADS 
    CAS 

    Google Scholar 

  • Francescangeli, M. et al. Long-Term Monitoring of Diel and Seasonal Rhythm of Dentex dentex at an Artificial Reef. Frontier in Marine Science 9, 1–17, https://doi.org/10.3389/fmars.2022.801033 (2022).

    Article 

    Google Scholar 

  • Knausgård, K. M. et al. Temperate fish detection and classification: a deep learning based approach. Applied Intelligence 52, 6988–7001, https://doi.org/10.1007/s10489-020-02154-9 (2022).

    Article 

    Google Scholar 

  • Wu, J. et al. Multi-Label Active Learning Algorithms for Image Classification: Overview and Future Promise. ACM Computing Surveys (CSUR) 53, 1–35, https://doi.org/10.1145/3379504 (2020).

    Article 

    Google Scholar 

  • He J., Mao R., Shao Z. & Zhu F. Incremental Learning in Online Scenario. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 13923–13932 https://doi.org/10.1109/CVPR42600.2020.01394 (2020).

  • Zhou, D. W., Yang, Y., & Zhan, D. C. Learning to Classify with Incremental New Class. In IEEE Transactions on Neural Networks and Learning Systems https://doi.org/10.1109/TNNLS.2021.3104882 (2021).

  • Hashmani, M. A., Jameel, S. M., Alhussain, H., Rehman, M. & Budiman, A. Accuracy performance degradation in image classification models due to concept drift. International Journal of Advanced Computer Science and Applications 10, 422–425, https://doi.org/10.14569/ijacsa.2019.0100552 (2019).

    Article 

    Google Scholar 

  • Langenkämper, D., van Kevelaer, R., Purser, A. & Nattkemper, T. W. Gear-Induced Concept Drift in Marine Images and Its Effect on Deep Learning Classification. Front. Mar. Sci. 7, 506, https://doi.org/10.3389/fmars.2020.00506 (2020).

    Article 

    Google Scholar 

  • Kloster, M., Langenkämper, D., Zurowietz, M., Beszteri, B. & Nattkemper, T. W. Deep learning-based diatom taxonomy on virtual slides. Scientific Reports 10, 1–13, https://doi.org/10.1038/s41598-020-71165-w (2020).

    Article 
    CAS 

    Google Scholar 

  • Ottaviani, E. et al. Assessing the image concept drift at the OBSEA coastal underwater cabled observatory. Frontiers in Marine Science 9, 1–13, https://doi.org/10.3389/fmars.2022.840088 (2022).

    Article 

    Google Scholar 

  • Katija, K. et al. FathomNet: A global image database for enabling artificial intelligence in the ocean. Scientific reports 12, 1–14, https://doi.org/10.1038/s41598-022-19939-2 (2022).

    Article 
    ADS 
    CAS 

    Google Scholar 

  • Kohavi, R. A study of cross-validation and bootstrap for accuracy estimation and model selection. International Joint Conference on Artificial Intelligence 14, 1137–1145 (1995).

    Google Scholar 

  • Tharwat, A. Classification assessment methods. Applied Computing and Informatics 17, 168–192, https://doi.org/10.1016/j.aci.2018.08.003 (2018).

    Article 

    Google Scholar 

  • Qi, C., Diao, J. & Qiu, L. On estimating model in feature selection with cross-validation. IEEE Access 7, 33454–33463, https://doi.org/10.1109/ACCESS.2019.2892062 (2019).

    Article 

    Google Scholar 

  • Lopez-Vazquez, V. et al. Video image enhancement and machine learning pipeline for underwater animal detection and classification at cabled observatories. Sensors 20, 726, https://doi.org/10.3390/s20030726 (2020).

    Article 
    ADS 

    Google Scholar 

  • Francescangeli, M. et al. Underwater camera photos with manual tagging of fish species at OBSEA seafloor observatory from 2013 to 2014. PANGAEA https://doi.pangaea.de/10.1594/PANGAEA.946149 (2022).

  • Marini, S. Source code for: simoneMarinIsmar/Image-Tagging-tool: Image Tagging (v1.0). Zenodo https://doi.org/10.5281/zenodo.6566282 (2022).

  • Froese, R. & Pauly, D. FishBase. www.fishbase.org (2019).

  • Martinez Padro, E. et al. CTD data acquired at the OBSEA seafloor observatory from 2013 to 2014. PANGAEA https://doi.org/10.1594/PANGAEA.946015 (2022).

  • Martinez Padro, E. et al. Meteorological data from a weather station at Vilanova i la Geltrú (Catalonia, Spain) from 2013 to 2014. PANGAEA https://doi.org/10.1594/PANGAEA.945911 (2022).

  • Martinez Padro, E. et al. Meteorological data from a weather station at Sant Pere de Ribes (Catalonia, Spain) from 2013 to 2014. PANGAEA https://doi.org/10.1594/PANGAEA.945906 (2022).

  • Redmon, J., Divvala, S., Girshick, R. & Farhadi, A. You Only Look Once: Unified, Real-Time Object Detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 779–788 https://doi.org/10.1109/CVPR.2016.91 (2016).

  • Marrable, D. et al. Accelerating species recognition and labelling of fish from underwater video with machine-assisted deep learning. Frontiers in Marine Science 9, 944582, https://doi.org/10.3389/fmars.2022.944582 (2022).

    Article 

    Google Scholar 

  • Zabala, M., García-Rubies, A., & Corbera, J. Els peixos de les illes Medes i del litoral català: guia per observar-los al seu ambient (Centre d’Estudis Marins de Badalona, 1992).

  • Corbera, J., Sabatés, A., & García-Rubies, A. Peces de mar de la península ibérica (Ed. Planeta, 1996).

  • Mercader, L., Lloris, D., & Rucabado, J. Tots els peixos del mar Català: Diagnosis i claus d’identificació (Institut d’Estudis Catalans, 2001).

  • Aguzzi, J. et al. Daily activity rhythms in temperate coastal fishes: insights from cabled observatory video monitoring. Marine Ecology Progress Series 486, 223–236, https://doi.org/10.3354/meps10399 (2013).

    Article 
    ADS 

    Google Scholar 

  • Campos‐Candela, A. et al. A camera‐based method for estimating absolute density in animals displaying home range behaviour. Journal of Animal Ecology 87, 825–837, https://doi.org/10.1111/1365-2656.12787 (2018).

    Article 

    Google Scholar 

  • Jang, J. & Yoon, S. Feature concentration for supervised and semisupervised learning with unbalanced datasets in visual inspection. IEEE Transactions on Industrial Electronics 68, 7620–7630, https://doi.org/10.1109/TIE.2020.3003622 (2020).

    Article 

    Google Scholar 

  • Zhang, J. et al. Adaptive Vertical Federated Learning on Unbalanced Features. IEEE Transactions on Parallel and Distributed Systems 33, 4006–4018, https://doi.org/10.1109/TPDS.2022.3178443 (2022).

    Article 

    Google Scholar 

  • Lin, C. H., Lin, C. S., Chou, P. Y. & Hsu, C. C. An Efficient Data Augmentation Network for Out-of-Distribution Image Detection. IEEE Access 9, 35313–35323, https://doi.org/10.1109/ACCESS.2021.3062187 (2021).

    Article 

    Google Scholar 

  • Lu, Y., Chen, D., Olaniyi, E. & Huang, Y. Generative adversarial networks (GANs) for image augmentation in agriculture: A systematic review. Computers and Electronics in Agriculture 200, 107208, https://doi.org/10.1016/j.compag.2022.107208 (2022).

    Article 

    Google Scholar 

  • Waqas, N., Safie, S. I., Kadir, K. A., Khan, S. & Khel, M. H. K. DEEPFAKE Image Synthesis for Data Augmentation. IEEE Access 10, 80847–80857, https://doi.org/10.1109/ACCESS.2022.3193668 (2022).

    Article 

    Google Scholar 


  • Source: Ecology - nature.com

    Bee species perform distinct foraging behaviors that are best described by different movement models

    Alfred Russel Wallace’s first expedition ended in flames