Tomato Growth Stage Monitoring for Smart Farm Using Deep Transfer Learning with Machine Learning-based Maturity Grading

Robert G. de Luna, Elmer P. Dadios, Argel A. Bandala, Ryan Rhay P. Vicerra

Abstract

khk
The tomato farming industry needs to adopt new ideas in applying the technology for its growth monitoring and main. Machine vision and image processing techniques have become useful in the increasing need for quality inspection of fruits, particularly, tomatoes. This paper deals with the design and development of a computer-vision monitoring system to assess the growth of tomato plants in a chamber by detecting the presence of flowers and fruits. The system also provides maturity grading for the tomato fruit. Two pre-trained deep transfer learning models were used in the study for the detection of flowers and fruits, namely, the Regional-based Convolutional Neural Network (R-CNN) and the Single Shot Detector (SDD). Maturity classification of tomato fruits are implemented using the Artificial Neural Network (ANN), K-Nearest Neighbors (KNN), and the Support Vector Machine (SVM). Evaluation results show that for the detection of flowers and fruits, the over-all accuracy of the R-CNN is 1.67% for flower detection and 19.48% for the fruit detection while SSD registered 100% and 95.99% for flower and fruit detection respectively. In the machine learning for maturity grading, SVM produced the training-testing accuracy rate of 97.78%-99.81%, KNN with 93.78%-99.32%, and ANN with 91.33%-99.32%.

Keywords


Deep learning; Flower and fruit detection; Maturity classification; Regional-based convolutional neural network; Single shot detector

Full Text:

PDF

References


Burpee. (n.d.) Top 10 tomato solutions. Retrieved from https://www.burpee.com/gardenadvicecenter/vegetables/tomatoes/top-10-tomato-solutions/article10369.html

de Luna, R. G., Baldovino, R. G., Cotoco, E. A., de Ocampo, A. L. P., Valenzuela, I. C., Culaba, A. B., & Gokongwei, E. P. D. (2017). Identification of Philippine herbal medicine plant leaf using artificial neural network. In 2017 IEEE 9th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM) (pp. 1–8). https://doi.org/10.1109/HNICEM.2017.8269470

de Luna, R. G., Dadios, E. P., Bandala, A. A., & Vicerra, R. R. (2019). Size classification of tomato fruit using thresholding, machine learning and deep learning technique. AGRIVITA Journal of Agricultural Science, 586–596. doi:http://doi.org/10.17503/agrivita.v41i3.2435

Dimatira, J. B. U., Dadios, E. P., Culibrina, F., Magsumbol, J., Cruz, J. D., Sumage, K., … Gomez, M. (2016). Application of fuzzy logic in recognition of tomato fruit maturity in smart farming. In 2016 IEEE Region 10 Conference (TENCON) (pp. 2031–2035). https://doi.org/10.1109/TENCON.2016.7848382

El-Bendary, N., El Hariri, E., Hassanien, A. E., & Badr, A. (2015). Using machine learning techniques for evaluating tomato ripeness. Expert Systems with Applications, 42(4), 1892–1905. https://doi.org/10.1016/j.eswa.2014.09.057

Islam, M. Z., Mele, M. A., & Kang, H.-M. (2018). Gaseous, physicochemical and microbial performances of silicon foliar spraying techniques on cherry tomatoes. AGRIVITA Journal of Agricultural Science, 40(2), 185–192. https://doi.org/10.17503/agrivita.v40i2.1792

Kandi, S. G. (2010). Automatic defect detection and grading of single-color fruits using HSV (Hue, Saturation, Value) color space. Journal of Life Sciences, 4(7), 39–45. Retrieved from https://pdfs.semanticscholar.org/9aee/866e2cba939b58c8a7ff7e43d5dcfcbffc9b.pdf

Lesaca, P. R. A. (2019, February 15). There is gold in tomatoes. Business Diary Philippines. Retrieved from https://businessdiary.com.ph/6293/goldtomatoes/

Liberato, M. O. (2018). Off-season production of tomato (Lycopersicon esculentum L.) under different shading and mulching materials. KnE Social Sciences, 3(6), 947–953. https://doi.org/10.18502/kss.v3i6.2432

Malik, M. H., Zhang, T., Li, H., Zhang, M., Shabbir, S., & Saeed, A. (2018). Mature tomato fruit detection algorithm based on improved HSV and watershed algorithm. IFAC-PapersOnLine, 51(17), 431–436. https://doi.org/10.1016/j.ifacol.2018.08.183

Mohammed, F. G., & Amer, W. A. (2017). Color-based for tree yield fruits image counting. International Journal of Science and Research (IJSR), 6(12), 69–73. https://doi.org/10.21275/art20176031

Ninawe, P., & Pandey, S. (2014). A completion on fruit recognition system using K-Nearest Neighbors algorithm. International Journal of Advanced Research in Computer Engineering and Technology, 3(7), 2352–2356. Retrieved from http://ijarcet.org/wp-content/uploads/IJARCETVOL-3-ISSUE-7-2352-2356.pdf

Oppenheim, D., Edan, Y., & Shani, G. (2017). Detecting tomato flowers in greenhouses using computer vision. International Journal of Computer and Information Engineering, 11(1), 104–109. Retrieved from https://publications.waset.org/10006411/detecting-tomato-flowers-ingreenhouses-using-computer-vision

Prihatiningsih, N., Djatmiko, H. A., & Rochminarsi, E. (2011). Applications of potassium fertilizer and Bacillus sp. biopesticide for increasing tomato resistance to bacterial wilt disease. AGRIVITA Journal of Agricultural Science, 33(1), 8–14. Retrieved from https://agrivita.ub.ac.id/index.php/agrivita/article/view/33

PSA. (2019). Major vegetables and root crops quarterly bulletin, July-September 2019. Philippine Statistics Authority. Retrieved from https://psa.gov.ph/vegetable-root-crops-main/tomato

Rahnemoonfar, M., & Sheppard, C. (2017). Deep count: Fruit counting based on deep simulated learning. Sensors, 17(4), 905. https://doi.org/10.3390/s17040905

Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., & McCool, C. (2016). Deepfruits: A fruit detection system using deep neural networks. Sensors, 16(8), 1222. https://doi.org/10.3390/s16081222

Semary, N. A., Tharwat, A., Elhariri, E., & Hassanien, A. E. (2015). Fruit-based tomato grading system using features fusion and support vector machine. In D. Filev, J. Jabłkowski, J. Kacprzyk, M. Krawczak, I. Popchev, L. Rutkowski, … S. Zadrozny (Eds.), Advances in Intelligent Systems and Computing (vol. 323) (pp. 401–410). Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-319-11310-4_35

Siriborvornratanakul, T. (2018). Enhancing user experiences of mobile-based augmented reality via spatial augmented reality: Designs and architectures of projector-camera devices. Advances in Multimedia, 2018(8194726), 1–17. https://doi.org/10.1155/2018/8194726

Sun, J., He, X., Ge, X., Wu, X., Shen, J., & Song, Y. (2018). Detection of key organs in tomato based on deep migration learning in a complex background. Agriculture, 8(12), 196. https://doi.org/10.3390/agriculture8120196

Valenzuela, I. C., Puno, J. C. V, Bandala, A. A., Baldovino, R. G., de Luna, R. G., De Ocampo, A. L., … Dadios, E. P. (2017). Quality assessment of lettuce using artificial neural network. in 2017 IEEE 9th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM) (pp. 1–5). https://doi.org/10.1109/HNICEM.2017.8269506

Ware, M. (2017). Everything you need to know about tomatoes. Medical News Today. Retrieved from https://www.medicalnewstoday.com/articles/273031.php

Yamamoto, K., Guo, W., Yoshioka, Y., & Ninomiya, S. (2014). On plant detection of intact tomato fruits using image analysis and machine learning methods. Sensors, 14(7), 12191–12206. https://doi.org/10.3390/s140712191

Yossy, E. H., Pranata, J., Wijaya, T., Hermawan, H., & Budiharto, W. (2017). Mango fruit sortation system using neural network and computer vision. Procedia Computer Science, 116, 596–603. https://doi.org/10.1016/j.procs.2017.10.013




DOI: http://doi.org/10.17503/agrivita.v42i1.2499

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.