Neural networks as a support element of phytosanitary monitoring of fruit crops on the example of apple trees

The paper presents the results of developing a convolutional neural network model for detecting and classifying diseases based on images of apple tree leaves and fruits. The study involves transfer learning for the YOLOv10-X model (You Only Look Once, version 10, Extra-large), pre-trained on the public COCO dataset (Common Objects in Context), which includes over 200,000 images and millions of annotated objects. The training dataset was compiled in the Research and Production Department of the Federal Horticultural Center for Breeding, Agrotechnology and Nursery (Russia). Artificial augmentation of the training dataset by rotating images, adding noise, and changing tints and shades increased the dataset to 2200 images. The Precision and Recall metrics, as well as the mean Average Precision (mAP) metric, were used to evaluate the performance of the model. The study demonstrated that the model effectively recognizes leaf lesions caused by scab, powdery mildew, rust, and various types of spots, achieving a mean Average Precision (mAP) of 0.6. The “spot” class appeared to be the most difficult to recognize (mAP50=0.411; Recall=0.324), while the “rust” class revealed the least difficulty (mAP=0.868; Recall=0.803). The study contributed to optimizing the model parameters, including the confidence threshold (0.48), the learning rate (0.01), the number of epochs (313) and the batchsize (8). Testing of a robotic platform equipped with RGB cameras indicated that automatic data collection at high frequency enables effective real-time monitoring of lesion dynamics.

1. Pantia G. G., Mikhailova E. V. Eff ect of the growth regulator Zerebra Agro on the intensity of Venturia inaequalis (Cooke) Wint development and apple yield, Transactions of Taurida agricultural science. 2023;35(198):62-68. (in Russ.).

2. Kozlovskaya Z. A., Gashenko T. A., Kondratenok Yu. G., Martsinkevich T. N. Population polymorphism of the apple scab pathogen Venturia inaequalis (Cooke) Wint in Belarus, Molecular and Applied Genetics. 2021;30:68-76. (in Russ.).

3. Golovin S. E., Pryakhina M. S. Plum rust – a new disease in the Moscow region. Plodovodstvo i yagodovodstvo Rossii. 2024;78:84- 92. DOI: 10.31676/2073-4948-2024-78-84-92. (in Russ.).

4. Ryabchinskaya T. A. Ecologized strategy for protecting fruit and berry crops, Zashchita i karantin rastenij. 2008;7:10-12. (in Russ.).

5. Zhang Z., Yang Y., Xu X., Liu L., Yue J., Ding R., Lu Y., Liu J., QiaoH. GVC-YOLO: A Lightweight Real-Time Detection Method for Cotton Aphid-Damaged Leaves Based on Edge Computing, Remote Sensing. 2024;16(16):3046. DOI: 10.3390/rs16163046.

6. Shurygin B., Smirnov I. G., Chilikin A., Khort D. O., Kutyrev A. I., Zhukovskaya S., Solovchenko A. Mutual augmentation of spectral sensing and machine learning for non-invasive detection of apple fruit damages, Horticulturae. 2022;8(12):1111. DOI: 10.3390/horticulturae8121111.

7. Kutyrev A. I. Recognition and classifi cation of apple leaf diseases based on image analysis by convolutional neural network (CNN) models, Vestnik Ul’yanovskoj gosudarstvennoj sel’skohozyajstvennoj akademii. 2023;3(63):215-223. (in Russ.).

8. Li Y., Sun S., Zhang C., Yang G., Ye Q. One-stage disease detection method for maize leaf based on multi-scale feature fusion, Appl. Sci. 2022;12(16):7960. DOI: 10.3390/app12167960.

9. Bolikulov F., Abdusalomov A., Nasimov R., Akhmedov F., Cho Y-I. Early Poplar (Populus) Leaf-Based Disease Detection through Computer Vision, YOLOv8, and Contrast Stretching Technique, Sensors. 2024;24(16):5200. DOI: 10.3390/s24165200.

10. Smirnov I., Kutyrev A., Kiktev N. Neural network for identifying apple fruits on the crown of a tree, E3S Web of Conferences, WFCES. 2021;01021. DOI: 10.1051/e3sconf/202127001021.

11. Li R., Li Y., Qin W., Abbas A., Li S., Ji R., Wu Y., He Y., Yang J. Lightweight Network for Corn Leaf Disease Identifi cation Based on Improved YOLO v8s, Agriculture. 2024;14(2):220.

12. Terven J., Córdova-Esparza D-M., Romero-González J-A. A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS, Machine Learning and Knowledge Extraction. 2023;5(4):1680-1716. DOI: 10.3390/make5040083.

13. Dyakov Yu. T. Phytopathology: a textbook for secondary vocational education. Moscow: Yurait Publishing House, 2024, 238 p. (in Russ.).

14. Treivas L. Yu., Kashtanova O. A. Diseases and pests of fruit plants: Atlas-identifi er. Moscow: Fiton XXI, 2024, 352 p. (in Russ.).

15. Maxwell A., Warner T., Guillén L. Accuracy Assessment in Convolutional Neural Network-Based Deep Learning Remote Sensing Studies. Part 1: Literature Review, Remote Sens. 2021;13(13):2450. DOI: 10.3390/rs13132450.

16. Kutyrev A., Kiktev N., Jewiarz M., Khort D., Smirnov I., Zubina V., Hutsol T. Tomasik M., Biliuk M. Robotic Platform for Horticulture: Assessment Methodology and Increasing the Level of Autonomy, Sensors. 2022;22(22):8901. DOI: 10.3390/s22228901.