A lawn mower control system and control method thereof
The lawnmower control system, composed of camera modules, radar modules, and other components, combined with hierarchical processing and correlation function optimization for path planning, solves the problems of requiring manual supervision and high hardware costs for lawnmowers, and achieves automated path planning and improved safety for lawnmowers.
Patent Information
- Application Number
- CN201910308768.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-04-17
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2039-04-17
AI Technical Summary
Existing lawn mowers require manual supervision throughout the operation, which is time-consuming and labor-intensive. Furthermore, existing automatic path planning methods result in high hardware costs, hindering the widespread use of lawn mowers.
By combining a camera module, radar module, contact pressure sensor, and infrared sensor with a control module and a remote control terminal, the system optimizes path planning through hierarchical processing of information data, reduces hardware processing speed requirements, and utilizes correlation functions to further optimize path planning.
This technology enables lawnmowers to accurately plan paths and avoid obstacles without significantly increasing hardware costs, thus improving the safety and accuracy of path planning.
Smart Images

Figure CN109947115B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of agricultural machinery, and in particular to a lawn mower control system and a control method thereof. Background Art
[0002] Lawn mowers are mainly used for mowing and clearing weeds on large flat lawns, golf courses, park lawns, green belts, etc. Existing lawn mowers require manual on-site supervision throughout the operation, which is time-consuming and labor-intensive and does not meet the requirements of modern development. The existing automatic path planning method has high requirements for hardware computing speed. Directly applying it to lawn mowers will lead to a significant increase in the cost of lawn mowers, affecting the widespread use of lawn mowers. Summary of the invention
[0003] The technical problem to be solved by the present invention is to provide a lawn mower control system and a control method thereof, which can solve the deficiencies of the prior art and enable the lawn mower to accurately plan its path and avoid obstacles without significantly increasing the hardware cost.
[0004] In order to solve the above technical problems, the technical solutions adopted by the present invention are as follows.
[0005] A lawn mower control system, comprising:
[0006] a camera module for capturing an image of a path in front of the lawn mower;
[0007] a radar module to detect obstacles in the path ahead of the mower;
[0008] A plurality of contact pressure sensors are distributed around the lawn mower to detect objects in contact with the lawn mower;
[0009] Several infrared sensors are distributed around the lawn mower to detect life forms approaching the lawn mower;
[0010] A control module is respectively connected to the camera module, the radar module, the contact pressure sensor and the infrared sensor for planning and controlling the travel path of the lawn mower;
[0011] The remote control terminal is connected to the control module for processing non-real-time large-volume data tasks;
[0012] The communication module is used for the communication connection between the control module and the remote control terminal.
[0013] A control method of the above lawn mower control system comprises the following steps:
[0014] A. The camera module captures the path image in front of the lawn mower. The obtained path image is segmented and pre-processed by the control module and then sent to the remote control terminal;
[0015] B. The remote control terminal analyzes the sent path image, obtains the planned path, and transmits the planned path back to the control module;
[0016] C. The control module controls the lawn mower to move according to the received planned path;
[0017] D. The radar module sends the detected obstacle information to the control module, which corrects the planned path according to the obstacle information and sends the correction result to the remote control terminal;
[0018] E. The remote control terminal corrects the future path image analysis process according to the correction result;
[0019] F. When the contact pressure sensor or the contact pressure sensor detects a valid signal, the control module controls the lawn mower to stop urgently;
[0020] Preferably, in step A, the control module performs graphic segmentation according to the distance between the image position and the lawn mower, and divides the image into three parts: a close-range image, a medium-range image, and a long-range image; the obstacles in the medium-range image and the long-range image are fuzzy processed, the areas between different obstacles are marked, the marked areas are divided into obstacle-related areas and obstacle-independent areas, and a correlation function between the obstacle-independent areas and the adjacent obstacle-related areas is established.
[0021] Preferably, in step B, when the planned path can be formed using only obstacle-independent areas, the planned path is established in the obstacle-independent areas, and the correlation function is used to calculate the correlation between different positions of the obstacle-independent areas and the obstacle-independent areas with the smallest average distance from the calculated positions, and the correlation calculated at any position in the planned path is less than the set threshold; when the planned path cannot be formed using only obstacle-independent areas, the correlation function is used to calculate the correlation between the obstacle-independent areas and the adjacent obstacle-independent areas, and the different positions of the obstacle-independent areas are arranged in descending order according to the correlation, and the corresponding obstacle-independent areas and obstacle-independent areas are used in descending order according to the correlation from high to low to form the planned path.
[0022] Preferably, in step D, the obstacle information is compared with the planned path. If the obstacle is located within the planned path, the planned path is corrected according to the position of the obstacle. During the correction process, the obstacle non-related area used in the planned path in step B is preferentially used; then, based on the positive result, the inverse operation of establishing the planned path described in step B is performed to calculate the updated correlation function, and the updated correlation function is sent to the remote control terminal.
[0023] Preferably, in step E, the remote control terminal establishes a mapping relationship set between the original correlation function and the updated correlation function, and uses the established mapping relationship set to correct the correlation function sent to the remote control terminal in the future. As the lawn mower runs, the mapping relationship set between the original correlation function and the updated correlation function is kept updated in real time.
[0024] The beneficial effects of adopting the above technical solution are: the present invention establishes a two-level control system to perform hierarchical synchronous processing on the collected information data, thereby reducing the requirements for hardware computing speed, and realizing the accurate path planning and obstacle avoidance of the lawn mower without significantly increasing the hardware cost. And by setting a contact pressure sensor and a contact pressure sensor, the safety of the lawn mower is further increased.
[0025] The present invention optimizes the processing method of image information, uses fuzzy processing to reduce the amount of calculation, and uses the correlation function to optimize the path planning method, thereby reducing the information loss rate of the edge area of the image block caused by the fuzzy processing. In addition, through the secondary comparison and correction of radar data and image data, not only the accuracy of path planning is further improved, but also the accuracy of setting the future correlation function is improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] Figure 1 It is a structural diagram of a specific implementation mode of the present invention.
[0027] In the figure: 1. Camera module; 2. Radar module; 3. Contact pressure sensor; 4. Infrared sensor; 5. Control module; 6. Remote control terminal; 7. Communication module. DETAILED DESCRIPTION
[0028] The standard parts used in the present invention can all be purchased from the market, and special-shaped parts can be customized according to the description in the specification and the drawings. The specific connection methods of each part adopt conventional means such as mature bolts, rivets, welding, and bonding in the prior art, which will not be described in detail here.
[0029] Reference Figure 1 , a specific embodiment of the present invention includes a camera module 1 for capturing a path image in front of a lawn mower;
[0030] Radar module 2, used to detect obstacles in the path ahead of the mower;
[0031] A plurality of contact pressure sensors 3 are distributed around the lawn mower and are used to detect objects in contact with the lawn mower;
[0032] A plurality of infrared sensors 4 are distributed around the lawn mower to detect life forms approaching the lawn mower;
[0033] The control module 5 is respectively connected to the camera module 1, the radar module 2, the contact pressure sensor 3 and the infrared sensor 4 for planning and controlling the travel path of the lawn mower;
[0034] The remote control terminal 6 is connected to the control module 5 for processing non-real-time large-volume data tasks;
[0035] The communication module 7 is used for communication connection between the control module 5 and the remote control terminal 6 .
[0036] A control method of the above lawn mower control system comprises the following steps:
[0037] A. The camera module 1 captures the path image in front of the lawn mower. The obtained path image is segmented and pre-processed by the control module 5 and then sent to the remote control terminal 6;
[0038] B. The remote control terminal 6 analyzes the sent path image to obtain a planned path, and transmits the planned path back to the control module 5;
[0039] C. The control module 5 controls the lawn mower to move according to the received planned path;
[0040] D. The radar module 2 sends the detected obstacle information to the control module 5. The control module 5 corrects the planned path according to the obstacle information and sends the correction result to the remote control terminal 6;
[0041] E. The remote control terminal 6 corrects the future path image analysis process according to the correction result;
[0042] F. When the contact pressure sensor 3 or the contact pressure sensor 3 detects a valid signal, the control module 5 controls the lawn mower to stop urgently.
[0043] In step A, the control module 5 performs graphic segmentation according to the distance between the image position and the lawn mower, and divides the image into three parts: a close-range image, a medium-range image, and a long-range image; the obstacles in the medium-range image and the long-range image are fuzzy processed, the areas between different obstacles are marked, the marked areas are divided into obstacle-related areas and obstacle-independent areas, and a correlation function between the obstacle-independent areas and the adjacent obstacle-related areas is established.
[0044] In step B, when the planned path can be formed using only the obstacle non-relevant area, the planned path is established in the obstacle non-relevant area, and the correlation function is used to calculate the correlation between different positions of the obstacle non-relevant area and the obstacle-relevant area with the smallest average distance from the calculated position, and the correlation calculated at any position in the planned path is less than the set threshold; when the planned path cannot be formed using only the obstacle non-relevant area, the correlation function is used to calculate the correlation between the obstacle-relevant area and the adjacent obstacle non-relevant area, and the different positions of the obstacle-relevant area are arranged in descending order according to the correlation, and the corresponding obstacle-relevant area and the obstacle non-relevant area are used in order from high to low according to the correlation to form the planned path.
[0045] In step D, the obstacle information is compared with the planned path. If the obstacle is located within the planned path, the planned path is corrected according to the obstacle position. During the correction process, the obstacle non-related area used in the planned path in step B is preferentially used; then the inverse operation of establishing the planned path described in step B is performed based on the positive result, and the updated correlation function is calculated and sent to the remote control terminal 6.
[0046] In step E, the remote control terminal 6 establishes a mapping relationship set between the original correlation function and the updated correlation function, and uses the established mapping relationship set to correct the correlation function sent to the remote control terminal 6 in the future. As the lawn mower runs, the mapping relationship set between the original correlation function and the updated correlation function is kept updated in real time.
[0047] In addition, the control module 5 compares the close-range image with the obstacle information detected by the radar module 2, and uses the obstacle deviation information after comparison to correct the fuzzy threshold in the fuzzy processing process in real time to improve the accuracy of the fuzzy processing.
[0048] The camera module 1 adopts the SK08 vehicle-mounted camera produced by Shenzhen Mitel Technology Co., Ltd., the radar module 2 adopts the CHQ1050 vehicle-mounted radar produced by Shenzhen Chengqiang Optoelectronics Digital Co., Ltd., the contact pressure sensor 3 adopts the Keyence AP-C30 pressure sensor, the infrared sensor 4 adopts the Keyence FS-V31 infrared sensor, the control module 5 adopts the Mitsubishi FX3U PLC, the remote control terminal 6 adopts the Lenovo Tianyi 510Pro desktop computer, and the communication module 7 adopts the GH-NB DTU communication module produced by Weihai Jinghe Information Technology Co., Ltd.
[0049] In the description of the present invention, it should be understood that the terms "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside" and "outside" etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present invention.
[0050] The above shows and describes the basic principles and main features of the present invention and the advantages of the present invention. It should be understood by those skilled in the art that the present invention is not limited to the above embodiments. The above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention to be protected. The scope of protection of the present invention is defined by the attached claims and their equivalents.
Claims
1. A lawn mower control method, Features: The control method is implemented by a lawn mower control system, and the control system includes: A camera module (1) for capturing an image of a path in front of the lawn mower; A radar module (2) for detecting obstacles in the path ahead of the lawn mower; A plurality of contact pressure sensors (3) are distributed around the lawn mower and are used to detect objects in contact with the lawn mower; A plurality of infrared sensors (4) are distributed around the lawn mower to detect life forms approaching the lawn mower; A control module (5) is respectively connected to the camera module (1), the radar module (2), the contact pressure sensor (3) and the infrared sensor (4) for planning and controlling the travel path of the lawn mower; A remote control terminal (6) is connected to the control module (5) for processing non-real-time large-volume data tasks; A communication module (7) for communication connection between the control module (5) and the remote control terminal (6); The control method comprises the following steps: A. The camera module (1) captures a path image in front of the lawn mower. The obtained path image is segmented and pre-processed by the control module (5) and then sent to the remote control terminal (6); B. The remote control terminal (6) analyzes the sent path image, obtains the planned path, and transmits the planned path back to the control module (5); C. The control module (5) controls the lawn mower to move according to the received planned path; D. The radar module (2) sends the detected obstacle information to the control module (5), and the control module (5) corrects the planned path according to the obstacle information and sends the correction result to the remote control terminal (6); E. The remote control terminal (6) corrects the future path image analysis process according to the correction result; F. When the contact pressure sensor (3) or the contact pressure sensor (3) detects a valid signal, the control module (5) controls the lawn mower to stop urgently; In the step A, the control module (5) performs graphic segmentation according to the distance between the image position and the lawn mower, and divides the image into three parts: a close-range image, a medium-range image, and a long-range image; performs fuzzy processing on obstacles in the medium-range image and the long-range image, marks the areas between different obstacles, divides the marked areas into obstacle-related areas and obstacle-irrelevant areas, and establishes a correlation function between the obstacle-irrelevant area and the obstacle-related area adjacent thereto.
2. The lawn mower control method according to claim 1, Features: In step B, when the planned path can be formed using only the obstacle non-relevant area, the planned path is established in the obstacle non-relevant area, and the correlation function is used to calculate the correlation between different positions of the obstacle non-relevant area and the obstacle-relevant area with the smallest average distance from the calculated position, and the correlation calculated at any position in the planned path is less than the set threshold; when the planned path cannot be formed using only the obstacle non-relevant area, the correlation function is used to calculate the correlation between the obstacle-relevant area and the adjacent obstacle non-relevant area, and the different positions of the obstacle-relevant area are arranged in descending order according to the correlation, and the corresponding obstacle-relevant area and the obstacle non-relevant area are used in order from high to low according to the correlation to form the planned path.
3. The lawn mower control method according to claim 2, Features: In step D, the obstacle information is compared with the planned path. If the obstacle is located within the planned path, the planned path is corrected according to the obstacle position. During the correction process, the obstacle-free area used in the planned path in step B is preferentially used; Then, the positive result is used to perform the inverse operation of establishing the planned path in step B, and an updated correlation function is calculated and sent to the remote control terminal (6).
4. The lawn mower control method according to claim 3, Features: In step E, the remote control terminal (6) establishes a mapping relationship set between the original correlation function and the updated correlation function, and uses the established mapping relationship set to correct the correlation function sent to the remote control terminal (6) in the future. As the lawn mower runs, the mapping relationship set between the original correlation function and the updated correlation function is kept updated in real time.
Citation Information
Patent Citations
Lawn mower control system
CN209447038U
