Research Status and Trend of Vision and Laser in Agricultural Machinery Navigation

Jing Tang; Sihan He; Jie He

doi:10.6911/WSRJ.202604_12(4).0007

Authors

Jing Tang
Sihan He
Jie He

DOI:

https://doi.org/10.6911/WSRJ.202604_12(4).0007

Keywords:

Vision, Lidar, Data fusion, Agricultural machinery navigation.

Abstract

With the aging of the population and the development of urban and rural integration, the shortage of agricultural productivity restricts the development of agricultural economy. The automatic navigation technology of agricultural machinery can effectively reduce the input of manpower in agricultural production, which is the key direction of agricultural machinery automation research. In the agricultural environment with lush vegetation, the signal interference is more serious, and the visual and laser sensors are less affected in this case, which is widely used in the research of agricultural machinery navigation. This paper mainly summarizes the methods of vision and laser navigation information acquisition in agricultural machinery navigation, analyzes the advantages and disadvantages of different types of sensors, and points out the research status of multi-source data fusion methods. Finally, the problems and development trends of vision and laser technology in agricultural machinery navigation are proposed.

Downloads

Download data is not yet available.

References

[1] Zhou Jun, He Yongqiang. Advances in Research on Navigation Path Planning of Agricultural Machinery [ J ]. Journal of Agricultural Machinery, 2021, 52 ( 09 ) : 1-14

[2] Wang Baoliang, Shen Wenlong, Zhang Baoyu. Development status and trend analysis of environmental perception technology for agricultural unmanned vehicles [ J ].Chinese Journal of Agricultural Machinery Chemistry, 2021,42 ( 11 ) : 214-221

[3] Hu Jingtao, Gao Lei, Bai Xiaoping, etc. Advances in Automatic Navigation Technology of Agricultural Machinery [ J ]. ACTA AGRICULTURAL ENGINEERING, 2015,31 ( 10 ) : 1-10

[4] Zhang Man, Ji Yuhan, Li Shichao, etc. Advances in Navigation Technology of Agricultural Machinery [ J ]. Journal of Agricultural Machinery, 2020,51 ( 04 ) : 1-18

[5] Yang Tao, Li Xiaoxiao. Research progress of machine vision technology in modern agricultural production [ J ]. Chinese Journal of Agricultural Machinery Chemistry, 2021, 42 ( 03 ) : 171-181

[6] Otsu N. A Threshold Selection Method from Gray-Level Histograms[J]. IEEE Transactions on Systems, Man, and Cybernetics,1979,9(1)

[7] Woebbecke D M, Meyer G E, Bargen K V, et al. Color Indices for Weed Identification Under Various Soil, Residue, and Lighting Conditions[J]. Transactions of the Asae,1995,38(1):259-269

[8] Soggaard H, Olsen H J. Determination of crop rows by image analysis without segmentation[J]. Computers & Electronics in Agriculture,2003,38(2):141-158

[9] M. Montalvo, G. Pajares, J.M. Guerrero, et al. Automatic detection of crop rows in maize fields with high weeds pressure[J]. Expert Systems with Applications,2012,39(15)2012:11889-11897

[10] Zhang Wei, Du Shangfeng. Recognition of positioning datum line in farmland by machine vision [ J ]. Journal of China Agricultural University, 2006 ( 04 ) : 75-77 + 88

[11] Chen Jiao, Jiang Guoquan, Du Shangfeng, etc. Visual navigation multi-ridge line recognition based on ridge line parallel feature [ J ]. ACTA AGRICULTURAL ENGINEERING, 2009,25 ( 12 ) : 107-113

[12] Diao Zhihua, Zhao Mingzhen, Song Yinmao, etc. Crop row recognition algorithm and system implementation of corn precision application system based on machine vision [ J ].ACTA AGRICULTURAL ENGINEERING SCIENCE, 2015,31 ( 07 ) : 47-52

[13] Zhang Tiemin, Zhuang Xiaolin. Field path recognition and navigation system of high clearance car based on DM642 [ J ].ACTA AGRICULTURAL ENGINEERING SINICA, 2015,31 ( 04 ) : 160-167

[14] Guan Zhuohuai, Chen Keyin, Ding Youchun, etc. Visual navigation path extraction method for rice harvesting [ J ].Journal of Agricultural Machinery, 2020,51 ( 01 ) : 19-28

[15] Jiang Guoquan, Ke Xing, Du Shangfeng, et al. Crop row detection based on machine vision [ J ]. Journal of Optics, 2009,29 ( 04 ) : 1015-1020

[16] Meng Qingkuan, He Jie, Qiu Ruicheng, etc. Crop row recognition and navigation line extraction in natural environment based on machine vision [ J ].Journal of Optics, 2014,34 ( 07 ) : 180-186

[17] Gao Guoqin, Li Ming. Greenhouse mobile robot navigation path recognition based on K-means algorithm [ J ]. ACTA AGRICULTURAL ENGINEERING, 2014,30 ( 07 ) : 25-33

[18] Li Yunwu, Xu Junjie, Wang Mingfeng, et al. Development of self-driving transfer vehicle and its visual navigation system for field roads in hilly and mountainous areas [ J ].ACTA AGRICULTURAL ENGINEERING SINICA, 2019, 35 ( 01 ) : 52-61

[19] Kim W, Lee D, Kim Y, et al. Path detection for autonomous traveling in orchards using patch-based CNN[J]. Computers and Electronics in Agriculture, 2020, 175:105620

[20] Yang Yang, Zhang Yalan, Miao Wei, et al. Research on accurate identification and location of maize rhizomes based on convolutional neural network [ J ]. Journal of Agricultural Machinery, 2018,49 ( 10 ) : 46-53

[21] Wang Yi, Liu Bo, Xiong Longye, et al. Research on orchard road navigation line generation algorithm based on deep learning [ J ].Journal of Hunan Agricultural University ( Natural Science Edition ), 2019,45 ( 06 ) : 674-678

[22] Han Zhenhao, Li Jia, Yuan Yanwei, et al. Orchard visual navigation path recognition method based on U-Net network [ J ].Journal of Agricultural Machinery, 2021,52 ( 01 ) : 30-39

[23] Bison, Wang Yuhao. Orchard robot vision navigation inter-row pose estimation and fruit tree target positioning method [ J ]. Journal of Agricultural Machinery, 2021,52 ( 08 ) : 16-26 + 39

[24] Rao Honghui, Ji Changying. Detection of early crop row centerline using Hough transform based on label information [ J ].ACTA AGRICULTURAL ENGINEERING SCIENCE, 2007 ( 03 ) : 146-150

[25] Zhang Zhibin, Luo Xiwen, Li Qing, etc. Visual navigation parameter extraction algorithm for agricultural machinery based on well-ordered set and ridge structure [ J ].ACTA AGRICULTURAL ENGINEERING SCIENCE, 2007 ( 07 ) : 122-126

[26] Feng Juan, Liu Gang, Si Yongsheng, et al. Orchard visual navigation baseline generation algorithm [ J ].Journal of Agricultural Machinery, 2012,43 ( 07 ) : 185-189 + 184

[27] Diao Zhihua, Wang Huidan, Song Yinmao. Research on farmland mechanical navigation line extraction algorithm based on machine vision [ J ].Research on agricultural mechanization, 2015,37 ( 02 ) : 35-39 + 45

[28] Zhang Q, Chen M.S, Li B. A visual navigation algorithm for paddy field weeding robot based on image understanding[J]. Computers and Electronics in Agriculture, 2017,143:66-78

[29] Peng Shunzheng, Kan Za, Li Jingbin. Visual navigation path extraction for harvesting operation in dwarf and close planting jujube orchard [ J ].According to Journal of Agricultural Engineering, 2017,33 ( 09 ) : 45-52

[30] Guo Xiangyu, Xue Xinyu. Navigation line extraction method for rice seed production field based on machine vision [ J ]. Chinese Journal of Agricultural Machinery Chemistry, 2021, 42 ( 05 ) : 197-201

[31] B Astrand, Baerveldt A J. A vision based row-following system for agricultural field machinery[J]. Mechatronics, 2006, 15(2):251-269

[32] Zhang Zhibin, Luo Xiwen, Zhou Xuecheng, et al. Ridge recognition algorithm based on Hough transform and Fisher criterion [ J ].Chinese Journal of Image and Graphics, 2007 ( 12 ) : 2164-2168

[33] Wu Gang, Tan Yu, Zheng Yongjun, et al. Linear detection of walking target for harvesting robot based on improved Hough transform [ J ].Journal of Agricultural Machinery, 2010,41 ( 02 ) : 176-179

[34] Si Yongsheng, Jiang Guoquan, Liu Gang, et al. Early crop row centerline detection method based on least square method [ J ].Journal of Agricultural Machinery, 2010,41 ( 07 ) : 163-167 + 185

[35] Song Yu, Liu Yongbo, Liu Lu, et al. Extraction method of maize rhizome navigation baseline based on machine vision [ J ].ACTA AGRICULTURAL MACHINERY, 2017,48 ( 02 ) : 38-44

[36] Ma Chi, Dong Ziyang, Chen Zhijun, etc. Study on the generation method of inter-row navigation lines in kiwifruit orchards based on root point substitution [ J ].Agriculture research in arid areas, 2021,39 ( 05 ) : 222-230

[37] Jiang G Q, Wang Z H, Liu H M. Automatic detection of crop rows based on multi-ROIs [ J ]. Expert Systems With Applications, 2015,42 ( 5 ) : 2429-2441

[38] Kneip J, Fleischmann P, Berns K. Crop edge detection based on stereo vision[J]. Robotics and Autonomous Systems, 2020,123:103323

[39] Zhang Zhengan, Li Shichao, Li Chenyang, et al. Navigation path extraction method of banana garden inspection robot based on binocular vision [ J ].ACTA AGRICULTURAL ENGINEERING SCIENCE, 2021, 37 ( 21 ) : 9-15

[40] Gai J Y, Xiang L R, Tang Lie. Using a depth camera for crop row detection and mapping for under-canopy navigation of agricultural robotic vehicle[J]. Computers and Electronics in Agriculture,2021,188:106301

[41] Xue Jinlin, Zhang Shunshun. Research on navigation control of agricultural robot based on laser radar [ J ].Journal of Agricultural Machinery, 2014,45 ( 09 ) : 55-60

[42] Oscar C, Mizushima A, Ishii K, et al. Development of an autonomous navigation system using a two-dimensional laser scanner in an orchard application[J]. Biosystems Engineering,2007,96(2):139-149

[43] Santosh A. Hiremath et al. Laser range finder model for autonomous navigation of a robot in a maize field using a particle filter[J]. Computers and Electronics in Agriculture,2014,100:41-50

[44] Bayar G, Bergerman M, Koku A B, et al. Localization and control of an autonomous orchard vehicle[J]. Computers and Electronics in Agriculture,2015,115:118-128

[45] Pieter M. Blok, Koen van Boheemen, Frits K. van Evert, et al. Robot navigation in orchards with localization based on Particle filter and Kalman filter[J]. Computers and Electronics in Agriculture,2019,157:261-269

[46] Chen Jun, Jiang Haoran, Liu Pei, et al. Curved path navigation control of orchard mobile robot [J].Journal of Agricultural Machinery, 2012,43 ( 04 ) : 179-182 + 187

[47] Jia Shiwei, Li Junmin, Qiu Quan, etc. Road edge detection and path navigation of greenhouse robot based on laser range finder [ J ]. ACTA AGRICULTURAL ENGINEERING, 2015,31 ( 13 ) : 39-45

[48] Ai Changsheng, Lin Hongchuan, Wu Delin, et al. Path planning algorithm for vineyard plant protection robot [ J ]. Journal of Agricultural Engineering, 2018,34 ( 13 ) : 77-85

[49] Li Qiujie, Ding Xudong, Deng Xian. Laser radar-based inter-row path extraction and navigation in orchards [ J ].Journal of Agricultural Machinery, 2020,51 ( S2 ) : 344-350

[50] Liu Xingxing, Zhang Chao, Zhang Hao, etc. Autonomous navigation method between fruit rows based on least square method and SVM [ J ].ACTA AGRICULTURAL ENGINEERING SCIENCE, 2021, 37 ( 09 ) : 157-164

[51] Tuan Le, Jon Glenn Omholt Gjevestad, Pål Johan From. Online 3D Mapping and Localization System for Agricultural Robots[J]. IFAC PapersOnLine,2019,52(30)

[52] Liu Lu, Pan Yanjuan, Chen Zhijian, etc. Research on inter-row navigation of maize plant protection robot in high occlusion environment [ J ]. Agricultural Machinery Journal, 2020,51 ( 10 ) : 11-17

[53] Liu Weihong, He Xiongkui, Liu Yajia, et al. Orchard inter-row 3D LiDAR navigation method [ J ].Journal of Agricultural Engineering, 2021, 37 ( 09 ) : 165-174

[54] Zhang J, Chambers A, Maeta S, et al. 3D perception for accurate row following: Methodology and results[C]. IEEE International Conference on Intelligent Robots and Systems,2013

[55] F. Auat Cheein, G. Steiner, G. Perez Paina, R. Carelli. Optimized EIF-SLAM algorithm for precision agriculture mapping based on stems detection[J]. Computers and Electronics in Agriculture, 2011, 78(2): 195-207

[56] Nagham S, Tobias L, Cheryl M, et al. Orchard mapping and mobile robot localisation using on-board camera and laser scanner data fusion – Part A: Tree detection[J]. Computers and Electronics in Agriculture,2015,119:254-266

[57] Xue Jinlin, Dong Shuxian, et al. Obstacle detection method for agricultural autonomous vehicles based on information fusion [ J ]. Agricultural Machinery Journal, 2018,49 ( S1 ) : 29-34

[58] Abdelkrim A, Lhoussaine M, Mohamed E A. A calibration method of 2D LIDAR-Visual sensors embedded on an agricultural robot[J]. Optik, 2022, 249:168254