A Comprehensive Survey on Methods and Techniques for Automated Fruit Plucking
Keywords:
Fruit Harvesting Techniques, Cost, Efficiency, Manual Harvesting, Computer Vision, Robotic Systems, Mechanical Harvesting.Abstract
In comparison of various product types in the farming, fruit farming has been more challenging than grain farming due to the challenges in its cultivation, harvesting in unstructured environment, high cost of safety during storage and timely distribution due to their short life. Fruit plucking becomes an important part due to its direct relation with the safety of potential return on farmer's investment. After humans started farming, there is step by step changes in fruit plucking techniques. Regardless, this process still remains labor intensive and manual in nature. The population on world is growing at rapid pace and so is the world-wide demand of agricultural products. However, labor shortages have remained a limiting factor in agriculture production. To cope up with the upcoming growth as well as to reduce the wastage of perishable items like fruits, it's important that the agriculture sector brings further automation. Sector needs to tackle the common fruit picking challenges through novel system solutions and improve the current systems. This paper shows the changes and growth in plucking techniques from ancient times to modern day plucking. Paper reviews the manual plucking techniques that involves the intensive risk and crude equipment with manual labors, to modern fruit plucking techniques based on computer vision and robotic systems. From this review, this paper intends to identify major research opportunities that are drafted under future research directions section.
Downloads
References
Na Luo, Tava Olsen, Yanping Liu, Abraham Zhang,"Reducing food loss and waste in supply chain operations", Transportation Research Part E: Logistics and Transportation Review, Volume 162, 2022.
Cletus E. Schertz and G. K. Brown, "Basic Considerations in Mechanizing Citrus Harvest",Transactions of the ASABE,1968, volume 11, pages 343-0346.
Blanco, German, and Fritz M. Roka., "Cost/Benefit of Abscission Registration for Citrus Mechanical Harvesting", No. 1369-2016-108670. 2009.
J.M. Monaghan, A.M. Beacham,"Salad Vegetable Crops", Editor(s): Brian Thomas, Brian G Murray, Denis J Murphy, Encyclopedia of Applied Plant Sciences (Second Edition), Academic Press, Pages 262-267,2017.
N. Benkeblia, D.P.F. Tennant, S.K. Jawandha, P.S. Gill,"4 - Preharvest and harvest factors influencing the postharvest quality of tropical and subtropical fruits",Editor(s): Elhadi M. Yahia, In Woodhead Publishing Series in Food Science, Technology and Nutrition, Postharvest Biology and Technology of Tropical and Subtropical Fruits, Woodhead Publishing,Pages 112-142e,2011.
Singerman, Ariel, and Marina Burani-Arouca. "Harvesting Charges for Florida Citrus",2018).
Rosana Moreno, Antonio Torregrosa, Enrique Moltó and Patricia Chueca,"Effect of harvesting with a trunk shaker and an abscission chemical on fruit detachment and defoliation of citrus grown under Mediterranean conditions",panish Journal of Agricultural Research13(1), e02-006, 12 pages (2015)
Costa SEA, Camarotto JA, "An ergonomics approach to citrus harvest mechanization", Work, 41(1):5027-5032, 2012.
Reza Ehsani, Sajith Udumala," Mechanical harvesting of citrus: an overview", Resource: Engineering & Technology for a Sustainable World ,American Society of Agricultural Engineers, Volume: 17 Issue: 3 Page: 4(3),May 1, 2010.
Yike Chen, Tyler J. Barzee, Ruihong Zhang, Zhongli Pan, "Chapter 9 - Citrus", Editor(s): Zhongli Pan, Ruihong Zhang, Steven Zicari, Integrated Processing Technologies for Food and Agricultural By-Products, Academic Press,Pages 217-242, 2019.
Malinovski, R.A., Malinovski, J.R., Nutto, L., Sanches, N.S., "Safety and Training in Harvesting", In: Pancel, L., Köhl, M. (eds) Tropical Forestry Handbook. Springer, Berlin, Heidelberg,2016.
Wani, S.N., Mohan, S., Kamal, M. "Engineering and Ergonomics—An Important Aspect in Fruit Harvesting Systems", In: Govindan, K., Kumar, H., Yadav, S. (eds) Advances in Mechanical and Materials Technology . Lecture Notes in Mechanical Engineering. Springer, Singapore ,2022.
Mustafa Erkan, Adem Dogan,"Harvesting of Horticultural Commodities", Postharvest Technology of Perishable Horticultural Commodities, Woodhead Publishing,2019, Pages 129-159.
Smith, Erick David. Abscission, storability, "fruit quality of mechanically harvested fresh market stem-free sweet cherry", Washington State University, 2009.
Refik, Polat & Güner, Metin & Ergin, Dursun & Dogan, Erdogan & Gezer, Ibrahim & Bilim, Cem., "Mechanical Harvesting of Almond with an Inertia Type Limb Shaker", Asian Journal of Plant Sciences,2007.
Sola-Guirado, Rafael & Jiménez-Jiménez, Francisco & Blanco-Roldan, Gregorio & Castro-Garcia, Sergio & Castillo, Francisco & Gil-Ribes, Jesus, "Vibration parameters assessment to develop a continuous lateral canopy shaker for mechanical harvesting of traditional olive trees", Spanish Journal of Agricultural Research. 14.2016.
Mustafa Erkan, Adem Dogan, "Chapter 5 - Harvesting of Horticultural Commodities", Postharvest Technology of Perishable Horticultural Commodities,Woodhead Publishing,Pages 129-159, 2019.
Whitney J D ; Patterson J M, Development of citrus removal device using oscillating forced air, Transaction of the ASAE, vol.15, no.5, pp.849-860, 1972.
Jutras P J; Coppock G E; Patterson J M, Harvesting citrus fruit with an oscillating air blast, in American Society of Agricultural Engineers, no.62-155, 1962
Whitney J D, Design and performance of an air shaker for citrus fruit removal, Transaction of the ASAE, vol.20, no.1, pp.52-56,1977.
C.H. Crisosto and L. Ferguson and G. Nanos,"5 - Olive (Olea europaea L.)",Postharvest Biology and Technology of Tropical and Subtropical Fruits,Woodhead Publishing,Pages 63-87e,2011.
S. Bachche and K. Oka, “Design, modeling and performance testing of end-effector for sweet pepper harvesting robot hand,” J. of Robotics and Mechatronics, vol. 25, no. 4, pp. 705–717, 2013.
S. Bachche and K. Oka, “Distinction of green sweet peppers by using various color space models and computation of 3 dimensional location coordinates of recognized green sweet peppers based on parallel stereovision system,” Journal of System Design and Dynamics, vol. 7, no. 2, pp. 178–196, 2013.
S. BACHCHE and K. OKA, “Performance testing of thermal cutting systems for sweet pepper harvesting robot in greenhouse horticulture,” Journal of System Design and Dynamics, vol. 7, no. 1, pp. 36–51, 2013.
H. Yaguchi, K. Nagahama, T. Hasegawa and M. Inaba, "Development of an autonomous tomato harvesting robot with rotational plucking gripper," 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016, pp. 652-657,
X. Wang, G. Fang, K. Wang, X. Xie, K.-H. Lee, J. D. L. Ho, W. L. Tang, J. Lam, and K.-W. Kwok, “Eyein-hand visual servoing enhanced with sparse strain measurement for soft continuum robots,” IEEE Robotics and Automation Letters, vol. 5, no. 2, pp. 2161–2168, 2020.
Jordi Gené-Mola, Ricardo Sanz-Cortiella, Joan R. Rosell-Polo, Josep-Ramon Morros, Javier Ruiz-Hidalgo, Verónica Vilaplana, Eduard Gregorio,
Whittaker A Dale; Miles G E; Mitchell O R; Gaultney L D , "Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry", Fruit Location in a Partially Occluded Image, American Society , Computers and Electronics in Agriculture, Volume 169, 2020.
Benady Meny ; Miles Gaines E, Locating melons for robotic harvesting using structured light, in American Society of Agricultural Engineers.; Society for Engineering in Agricultural, Food, and Biolo, no.92-7021, 1992
Ostovar, A.; Ringdahl, O.; Hellström, T. Adaptive Image Thresholding of Yellow Peppers for a Harvesting Robot. Robotics 2018, 7, 11.
R. Barth, J. Ijsselmuiden, J. Hemming, E. Van Henten, Data synthesis methods for semantic segmentation in agriculture: A Capsicum annuum dataset, Computers and Electronics in Agriculture 144 (2018) 284–296
Papandreou, G., Chen, L.C., Murphy, K., Yuille, A.L., 2015. Weakly-and semi-supervised learning of a dcnn for semantic image segmentation. In: ICCV.
Arad, B., Kurtser, P., Ehud, B., Harel, B., Edan, Y., & Ben‐Shahar, O. (2019). Controlled lighting and illumination‐independent target detection for real‐time cost‐efficient applications. The case study of sweet pepper harvesting robots. Sensors, 19(6), 1390.
Barth, R.; Hemming, J.; van Henten, E.J. Design of an eye-in-hand sensing and servo control framework for harvesting robotics in dense vegetation. Biosyst. Eng. 2016, 146, 71–84. doi: 10.1016/j.biosystemseng.2015.12.001.
T. S. Perry, "John Deere's quest to solve agricultures deep-learning problems - [Spectral Lines]," in IEEE Spectrum, vol. 57, no. 2, pp. 4-4, Feb. 2020, doi: 10.1109/MSPEC.2020.8976885.
Borse, J.; Patil, D (2021). Tracking Keypoints from Consecutive Video Frames Using CNN Features for Space Applications. Tehnički glasnik, 15 (1), 11-17
Lokhande, Meghana P. and Dipti Durgesh Patil(2021),Trust Computation Model for IoT Devices Using Machine Learning Techniques, Proceeding of First Doctoral Symposium on Natural Computing Research. Lecture Notes in Networks and Systems, vol 169. Springer
Lokhande, Meghana P. and Dipti Durgesh Patil(2022),Object Identification in Remotely-Assisted Robotic Surgery Using Fuzzy Inference System, Demystifying Federated Learning for Blockchain and Industrial Internet of Things, , pp. 58-73.
Sandro Augusto Magalhaes,Antonio Paulo Moreira,Filipe Neves dos Santos, Jorge Dias, "Active Perception Fruit Harvesting Robots — A Systematic Review", Journal of Intelligent & Robotic Systems, 2022
Eleni Vrochidou, Viktoria Nikoleta Tsakalidou, Ioannis Kalathas, Theodoros Gkrimpizis, Theodore Pachidis and Vassilis G. Kaburlasos
Delia SepúLveda, Roemi F, Eduardo N, Manuel, Pablo González-De-Santos, Robotic Aubergine Harvesting Using Dual-Arm Manipulation, IEEE Access Vol 8, Pg 121889 – 121904, July 2020
Berry Picking at Its Best with Sensor Technology (Agrobot), May 14, 2021
NVIDIA - A Bountiful Harvest - Agrobot | Season 1 Episode 9| I AM AI Docuseries, Oct, 10, 2018, Accessed Sep 4, 2020
Rashmi Pandey, “non-destructive quality grading of mango (mangifera indica l.) Using image processing”, A dissertation submitted to Uka Tarsadia University, May 2014.
Liu, G.; Nouaze, J.C.; Touko Mbouembe, P.L.; Kim, J.H. YOLO-Tomato: A Robust Algorithm for Tomato Detection Based on YOLOv3. Sensors 2020, 20, 2145.
Shihan Mao, Yuhua Li, You Ma, Baohua Zhang, Jun Zhou, Kai Wang,
Automatic cucumber recognition algorithm for harvesting robots in the natural environment using deep learning and multi-feature fusion, Computers and Electronics in Agriculture, Volume 170, 2020, 105254,
Sane, Tanmay & Sane, Tanuj. (2021). Artificial Intelligence and Deep Learning Applications in Crop Harvesting Robots -A Survey.Conference: 3 rd International Conference on Electrical, Communication and Computer Engineering (ICECCE 2021)At: Kuala Lumpur
Kurena Motokura , Masaki Takahashi , Marco Ewerton , and Jan Peters, Plucking Motions for Tea Harvesting Robots Using Probabilistic Movement Primitives, IEEE Robotics and Automation Letters, Vol 5. No 2. April 2020
A. Paraschos, C. Daniel, J. Peters, and G. Neumann, “Probabilistic movement primitives,” in Proc. Adv. Neural Inf. Process. Syst., 2013, pp.2616–2624
Juan Fernando Villacrés and Fernando Auat Cheein , Detection and Characterization of Cherries: A Deep Learning Usability Case Study in Chile, Agronomy 2020, 10 (6), 835
Fue, K.G.; Porter, W.M.; Barnes, E.M.; Rains, G.C. An Extensive Review of Mobile Agricultural Robotics for Field Operations: Focus on Cotton Harvesting. AgriEngineering 2020, 2, 150-174.
Kamilaris, A.; Prenafeta-Boldú, F.X. Deep learning in agriculture: A survey. Comput. Electron. Agric. 2018, 147, 70–90.
Sa, I.; Ge, Z.; Dayoub, F.; Upcroft, B.; Perez, T.; McCool, C. DeepFruits: A Fruit Detection System Using Deep Neural Networks. Sensors 2016, 16, 1222.
Bargoti, S.; Underwood, J. Deep fruit detection in orchards. In Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore, 3 June 2017; pp. 3626–3633.
Fue, K.; Porter, W.; Barnes, E.; Li, C.; Rains, G. Center-Articulated Hydrostatic Cotton Harvesting Rover Using Visual-Servoing Control and a Finite State Machine. Electronics 2020, 9, 1226.
Xie, T.; Li, J.; Yang, C.; Jiang, Z.; Chen, Y.; Guo, L.; Zhang, J. Crop height estimation based on UAV images: Methods, errors, and strategies. Comput. Electron. Agric. 2021, 185, 106155. [CrossRef]
Mazzia, V.; Comba, L.; Khaliq, A.; Chiaberge, M.; Gay, P. UAV and Machine Learning Based Refinement of a Satellite-Driven Vegetation Index for Precision Agriculture. Sensors 2020, 20, 2530.
Das, S.; Christopher, J.; Apan, A.; Choudhury, M.R.; Chapman, S.; Menzies, N.W.; Dang, Y.P. Evaluation of water status of wheat genotypes to aid prediction of yield on sodic soils using UAV-thermal imaging and machine learning. Agric. For. Meteorol. 2021,
Kelly, J.; Kljun, N.; Olsson, P.-O.; Mihai, L.; Liljeblad, B.; Weslien, P.; Klemedtsson, L.; Eklundh, L. Challenges and Best Practices for Deriving Temperature Data from an Uncalibrated UAV Thermal Infrared Camera. Remote Sens. 2019, 11, 567.
Qiu, Z.; Ma, F.; Li, Z.; Xu, X.; Ge, H.; Du, C. Estimation of nitrogen nutrition index in rice from UAV RGB images coupled with machine learning algorithms. Comput. Electron. Agric. 2021, 189, 106421.
Tetila, E.C.; Machado, B.B.; Menezes, G.K.; Da Silva Oliveira, A.; Alvarez, M.; Amorim, W.P.; De Souza Belete, N.A.; Da Silva, G.G.; Pistori, H. Automatic Recognition of Soybean Leaf Diseases Using UAV Images and Deep Convolutional Neural Networks. IEEE Geosci. Remote Sens. Lett. 2020, 17, 903–907.
Apolo-Apolo, O.E.; Martínez-Guanter, J.; Egea, G.; Raja, P.; Pérez-Ruiz, M. Deep learning techniques for estimation of the yield and size of citrus fruits using a UAV. Eur. J. Agron. 2020, 115, 126030.
Meng, Y.; Su, J.; Song, J.; Chen, W.-H.; Lan, Y. Experimental evaluation of UAV spraying for peach trees of different shapes: Effects of operational parameters on droplet distribution. Comput. Electron. Agric. 2020, 170, 105282.
TEVEL Flying Autonomous Robots (FAV) (accessed on 18 April 2022)
Vrochidou, E.; Tsakalidou, V.N.; Kalathas, I.; Gkrimpizis, T.; Pachidis, T.; Kaburlasos, V.G. “An Overview of End Effectors in Agricultural Robotic Harvesting Systems”, Agriculture 2022.
![Pepper (left), strawberry (middle), and fig (right) are harvested by hand.[13]](https://ijisae.org/public/journals/1/article_2454_cover_en_US.png)
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
