Smart autonomous agricultural spraying and load carrier vehicle
The smart autonomous vehicle addresses the limitations of two-dimensional mapping by using RTK-GPS, lidar sensors, and stereo cameras for precise three-dimensional mapping and precision spraying, enabling cost-effective and efficient crop management, reducing waste and environmental impact, and improving safety and efficiency in agriculture.
Patent Information
- Application Number
- PCT/TR2023/051752
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-27
- Publication Date
- 2024-12-05
AI Technical Summary
Conventional two-dimensional mapping techniques in agriculture are inadequate for precise crop management, leading to erroneous data and high costs, limiting the adoption of precision agriculture practices, especially for small-scale farmers who lack access to specialized equipment or expertise.
A smart autonomous vehicle equipped with RTK-GPS, lidar sensors, stereo cameras, and a carrier board for three-dimensional mapping and precision spraying, enabling precise position detection, collision avoidance, and heavy load carrying, which reduces labor costs and increases productivity.
The vehicle provides accurate and reliable three-dimensional maps for informed crop management decisions, optimizing irrigation, fertilization, and pest control, while reducing waste and environmental impact, and enhancing safety and efficiency in agricultural operations.
Smart Images

Figure 000001 
Figure 000002 
Figure 000003
Abstract
Description
[0001] SMART AUTONOMOUS AGRICULTURAL SPRAYING AND LOAD CARRIER VEHICLE
[0002] Technical Field
[0003] The invention relates to a smart autonomous vehicle developed specifically for use in agriculture and defense industry, capable of three-dimensional mapping and agricultural precision spraying in agricultural areas and carrying heavy loads for farmers.
[0004] Prior Art
[0005] In the agricultural mapping and surveying applications used in the present art, conventional mapping and surveying methods such as manual measurements or satellite imagery are used. The results obtained as a result of these methods may be erroneous. Said erroneous data lead to uncertainty in crop yield estimations and other important agricultural decisions in agricultural areas.
[0006] In the state of the art, two-dimensional mapping techniques are generally used. Said techniques do not provide enough detail to identify subtle changes in land or crop health. It makes it difficult to identify potential problem areas or optimize crop management practices. Further, the conventional mapping and surveying methods used can be expensive, especially for small-scale farmers who do not have access to specialized equipment or expertise. The methods used in the present art lead to high costs, limiting the adoption of precision agriculture practices based on accurate mapping and surveying data.
[0007] Satellite imagery and other remote sensing methods used in other known methods of the art cannot obtain data at a fine and precise enough scale for agriculture practices. Thus, problems arise in identifying variability within areas and optimizing management practices.
[0008] The invention numbered TR 2021 007172 which is a part of the state of the art relates to an agricultural unmanned aerial vehicle that performs spraying on the pest detected on agricultural lands or in general, returns to the designated point when the pesticide it contains runs out, performs autonomous filling and agricultural liquid fertilization and indoor-outdoor disinfection, and contains an autonomous and wireless charging battery for its operation. Said document does not include SLAM mapping, RTK-GNSS position isolation and IMU-Direction Localization.
[0009] The invention numbered TR 2022 018293 which is a part of another state of the art relates to an autonomous agricultural frost fogging vehicle, which can be used to prevent rime / frost formation on fruits / vegetables in cold weather in indoor / outdoor areas where fruits / vegetables are grown, including gardens, fields and greenhouses. Said document does not include a carrier board, lidar sensor and stereo camera to ensure mapping.
[0010] New technologies and developments are needed in order to eliminate the mentioned disadvantages of the techniques that are a part of the state of the art.
[0011] Summary of the Invention
[0012] The invention relates to a smart autonomous vehicle developed for use in agriculture and defense industry, capable of three-dimensional mapping in agricultural areas and precision spraying in agriculture field and carrying heavy loads for farmers.
[0013] With the invention, it is ensured that farmers make more informed decisions about crop management practices, especially in the agricultural sector, thereby increasing yields and reducing costs.
[0014] With the precise position detection and real-time kinematic positioning (RTK-GPS) modules included in the autonomous vehicle of the invention, collision avoidance and "follow me" mode are developed in order to prevent possible accidents for safe and efficient operation.
[0015] With the useful load carrying capacity of the autonomous vehicle of the invention, it can easily perform various challenging tasks for farmers such as precision spraying and carrying heavy loads. The vehicle of the invention helps in mapping crops and lands, monitoring fields and crops, optimizing crop yields, determining where irrigation and fertilization are required, identifying areas prone to harmful pests and diseases, and monitoring crops.
[0016] Detailed Description of the Invention
[0017] Exemplary embodiments are described in more detail with reference to the accompanying descriptions below. However, embodiments may be created in different forms and should not be construed as being limited to the embodiments presented herein. Rather, these exemplary embodiments are provided so that this description will be thorough, and will fully convey the scope to those skilled in the art.
[0018] The terminology used in this description is intended to describe a particular exemplary embodiment only and is not intended to be limiting. As used herein, the forms "one", "at least", and "preferably" are intended to include plural forms as well, unless the context clearly states otherwise. When the terms "comprises" and / or "includes" are used in this specification, the indicated features, integers, steps, operations, elements and / or components, however, do not preclude the presence or addition of one or more other features, integers, steps, operations, elements and / or components.
[0019] The invention relates to an autonomous vehicle developed specifically for use in the defense industry and agricultural sector, capable of creating three-dimensional maps of fields, performing precision spraying and carrying heavy loads for farmers, comprising:
[0020] - at least one skeletal structure forming the skeletal system,
[0021] - at least one drive unit,
[0022] - at least one carrier board positioned in at least one main carrier panel, ensuring the determination of communication accuracy,
[0023] - at least one driver circuit unit positioned on a carrier board, enabling precise positional verification,
[0024] - at least one vibration absorbing part positioned inside the carrier board, allowing the carrier board to reduce the effect of vibrations on the autopilot system and the peripherals connected to it,
[0025] - at least one battery which is a power supply,
[0026] - at least one fastener enabling the transfer of power and / or data flow to a carrier board, - at least one inertial sensor (IMU) enabling obtaining of magnetic field and acceleration data,
[0027] - at least one internal computer,
[0028] - at least one stereo camera measuring the depth of objects and creating three- dimensional images,
[0029] - at least one anti-collision sensor,
[0030] - at least one lidar sensor measuring the positions of surrounding objects using high-intensity laser beams and enabling the creation of three-dimensional maps using its data,
[0031] - at least one RTK-GPS module enabling the vehicle to navigate with precision in agricultural areas,
[0032] - at least one GNSS module.
[0033] The carrier board included in the invention is at least one electronic carrier board in a preferred embodiment of the invention. The carrier board is designed to carry autopilot systems such as Pixhawk. The carrier board is fused with the power distribution system, which distributes power to the autopilot system and the peripherals connected to it.
[0034] Positional verification process in the driver circuit unit is provided by the data obtained by at least one acceleration (accelerometer) sensor positioned on the carrier board.
[0035] In an exemplary embodiment of the invention, the vehicle contains at least one cargo bed and / or at least one sprayer positioned within a skeletal structure. The at least one cargo bed included in the vehicle together with the useful load carrying capabilities thereof can be used to carry heavy equipment or crop loads, thereby reducing labor costs and increasing productivity. By using the sprayer contained in the autonomous vehicle of the invention in pesticide or herbicide or pest control applications, reducing waste and minimizing the environmental impact, benefits are provided in precision agriculture.
[0036] In one embodiment of the invention, lidar is the ToF (time of flight) laser distance sensor, but the embodiment is not limited thereto. In one embodiment of the invention, three-dimensional cameras are used. The vehicle of the invention comprises at least two wheels in one embodiment.
[0037] The fastener can be used as at least one cable macaron, providing electrical insulation of at least one cable.
[0038] Said anti-collision sensor detects obstacles in the vehicle's path and allows the vehicle to automatically turn around them. The sensors included in the invention provide communication between the vehicle and the driver in areas where there may be large rocks or other obstacles that may damage the vehicle or its equipment, preventing possible hazards.
[0039] The RTK-GPS module is a real-time kinematic position system. With the RTK-GPS module included in the invention, the vehicle provides accurate and reliable position information even in harsh environments such as fields with high vegetation. Thus, it provides precise navigation / position and mapping even in areas where GPS (location) systems used in conventional methods may struggle.
[0040] By providing three-dimensional mapping, precise navigation and localization vital for tasks such as precise spraying or useful load carrying are allowed. By having a three- dimensional map of the environment, the vehicle of the invention can plan its route more effectively and avoid obstacles or other hazards.
[0041] The resulting three-dimensional mapping can provide valuable information about the land and vegetation of the area examined. Said information can be used to make more informed decisions about crop management, such as determining the optimal placement of irrigation systems or identifying areas that may require additional fertilizer or pest control.
[0042] In the most general sense, three-dimensional mapping increases the efficiency and effectiveness of agricultural operations and thus achieving lower costs with increased yields.
[0043] With the sensors included in the invention, the risk of damage to the vehicle and its load is reduced and it helps to increase safety for operators and bystanders. The invention has a follow-me mode, which allows it to autonomously follow at least one operator or at least one vehicle. Said mode is that the vehicle processes the visuals from the camera data to the operator and transfers the outputs of the YOLO algorithm back to the motion mechanism with a ROS node. The user can adjust the vehicle modes with the switches on the remote control. It is used in situations where the operator needs to move around the field, but still wants to keep an eye on the vehicle and its operations. The follow me mode is another important feature of the vehicle that allows farmers to control the vehicle easily. With at least one smartphone, farmers can set a specific path for the vehicle to be tracked, and the vehicle can automatically move along that path while avoiding any obstacles in its path.
[0044] In an exemplary embodiment of the invention which is an autonomous vehicle, it is used in the fields of crop mapping, field monitoring, soil analysis, crop spraying, and precision agriculture.
[0045] With the invention, field maps including elevation data, crop health and soil moisture can be created. Said maps can be used in the future processes to determine where irrigation and fertilization are necessary, areas prone to pests and diseases, and to monitor crop growth.
[0046] In another exemplary embodiment of the invention, the vehicle provides soil analysis, in which it collects soil samples from various parts of the fields and analyzes them for nutrient content and pH levels. The obtained analyzes can be used to determine optimum fertilizer and soil improvement application rates, improve soil health and crop yields.
[0047] The autonomous vehicle can be used for land mapping and exploration, disaster response, and surveillance. For example, it can be used in search and rescue missions to search for survivors in dangerous environments, such as collapsed buildings or areas affected by natural disasters.
[0048] The operation method obtained with the skeletal structure of the autonomous vehicle and the internal computer of the vehicle are given in detail below; - In the first step, measuring the depth of the objects and creating three- dimensional images by at least one stereo camera, and measuring the positions of the surrounding objects using high-intensity laser beams by at least one lidar sensor and creating three-dimensional maps using the measured data,
[0049] - In the second step, combining stereo camera data and lidar sensor data using point cloud registration and / or feature matching and / or occupancy grid mapping and / or iterative closest point registration methods and transferring them to at least one vehicle internal computer,
[0050] - In the third step, creating the environment map and localizing the vehicle within that environment at the same time using grid mapping (g-mapping) and SLAM (simultaneous localization and mapping) algorithms,
[0051] - In the fourth step, combining the IMU data with the global map and using the extended kalman filter (EKF) to estimate the current position and speed of the vehicle,
[0052] - In the fifth step, creating the PID controller (proportional-integral-differential controller) using the Ziegler-Nichols tuning algorithm,
[0053] - In the seventh step, controlling the vehicle movements with the ROS (Robot Operating System) based system and transmitting the vehicle mission commands to the autopilot with Mavlink commands.
[0054] The methods used to combine stereo camera data and lidar sensor data in the second step are explained in detail below;
[0055] Point cloud registration method enables lidar data to be aligned with stereo camera images. Said method connects the overlapping portions of the lidar point clouds to the stereo camera images by matching and aligning them.
[0056] Feature matching method combines similar features in stereo camera images and lidar point clouds by matching them. For example, objects with similar color and brightness features in a stereo camera image and a lidar point cloud can be combined.
[0057] Occupancy grid mapping method first creates a three-dimensional map using lidar data and then further develops the map using stereo camera data. The Iterative Closest Point registration (ICP) method first matches similar points between two data sets and then performs the registration process.
[0058] The operation principle of said methods in the second step includes different approaches to combining stereo camera and lidar data. Said approaches perform the process of aligning or combining two datasets by using different features of stereo camera and lidar data. By combining stereo camera and lidar data using said methods, a more accurate three-dimensional map is created and the map is used in navigation, map making, land identification and other applications. The integration of the resulting mapping data into the vehicle provides farmers with accurate and up-to-date information on the status of their crops, enabling them to make informed decisions about when and where to apply fertilizers and pesticides.
[0059] The third step of the invention is to dynamically integrate a three-dimensionally generated map with a ROS-based mapping and localization program. It enables the vehicle of the invention to better localize itself and navigate around.
[0060] In the fourth step, the deviations are prevented with the sensors containing the IMU data by matching the speed measurement data with the kalman filter in case of the location data deviation.
[0061] In the fifth step, the PID controller filters the movement commands of the motors (drive unit) in the vehicle and prevents movement deviations. Deviations may occur in the resulting localization data through the movement commands going to the motors, said problem is eliminated with the PID controller. The Ziegler-Nichols algorithm causes the PID controller to be integrated into the vehicle and allows the input values of the algorithm to be adjusted.
[0062] In the seventh step, the ROS System is the software module responsible for establishing the communication infrastructure between the control computer and the carrier board as a message carrier system and transmits the commands with the help of nodes via the mavlink protocol.
[0063] The advantages of the electronic carrier board included in the invention are given in detail below; - One of the most important advantages of the carrier board is that it provides power distribution system integration. The power distribution system distributes power to the autopilot system and the peripherals connected to it. The integration of the power distribution system reduces the number of cables and connectors required, making the system more reliable and efficient. The reduced number of cables and connectors also simplifies the installation process, reducing installation time and cost. The simplified cabling and connection system also reduces the possibility of failures due to loose connections or broken cables.
[0064] - The carrier board contains vibration absorbing parts that reduce the impact of vibrations on the autopilot system and its connected peripherals. Vibration can damage components of the autopilot system, resulting in reduced accuracy and reliability. Vibration absorbing parts reduce the effect of vibrations, increasing the accuracy and reliability of the autopilot system. For example; vibrations can cause errors in the data collected by sensors in UAVs, which is one of the application areas. Vibration is suppressed with vibration absorbing parts, helping to reduce these errors and ensuring the obtaining of accurate data. Further, vibrations can cause mechanical stress on components, leading to premature failure. With the invention, the vibration level is reduced and the service life of the components is extended.
[0065] - Since the main carrier panel, in which the carrier board is placed, is designed to be smaller and lighter than other carrier panels, it is made more suitable for land vehicles and / or drones and / or UAVs. The reduced size and weight of the carrier board also reduces power consumption, which is important for vehicles where battery life is a critical factor.
[0066] - The integration of the power distribution system and vibration damping parts increases the reliability of the carrier board. The reduced number of cables and connectors reduces the possibility of failures due to loose connections or broken cables and increases the reliability of the system. Vibration absorbing parts reduce the impact of vibrations on components, reducing the possibility of damage and failure.
[0067] - Due to the close proximity of critical components included in the carrier board, communication between them can be optimized for faster data transfer and improved overall performance. The autonomous vehicle of the invention is preferably in a hybrid structure. The advantages of said vehicle are listed below;
[0068] The hybrid autonomous vehicle of the invention consumes less charging time compared to a battery-powered vehicle used in the state of the art. Reduced charging time increases the efficiency of material handling and transportation operations, reducing downtime and increasing productivity.
[0069] The hybrid autonomous vehicle of the invention has a higher range than a battery- powered vehicle. The drive unit included in the invention procures battery life and increases the range of the vehicle by charging the batteries while the vehicle is in operation. The increased range allows the vehicle to operate uninterrupted over longer distances, increasing the efficiency of material handling and transportation operations. Thus, reduced operating costs, profitability of material handling and transportation operations are achieved with the invention.
[0070] The hybrid autonomous vehicle of the invention has better environmental performance than a battery-powered vehicle. The drive unit included in the invention is more fuelefficient than the battery-powered system, reduces greenhouse gas emissions and improves the environmental performance of the vehicle.
[0071] The hybrid autonomous vehicle provides more flexibility than a battery-powered vehicle. The diesel engine included in the invention provides an alternative power source, allowing the vehicle to operate in areas where there are no charging stations. It enables the vehicle to carry out material handling and transportation operations in wider environments, increasing the efficiency and productivity of operations.
[0072] In one embodiment of the invention, the drive unit is at least one diesel engine, but in practice it is not limited thereto. The drive unit, which is a diesel engine, powers at least one generator, which charges the batteries, extends battery life and reduces the need for frequent charging.
[0073] With said drive unit which is a diesel engine, the batteries are charged while the vehicle is running, extending the battery life and reducing the need for frequent charging. Increased battery life allows the vehicle to operate uninterrupted for longer periods of time, increasing the efficiency of material handling and transportation operations.
[0074] In another embodiment of the invention, the drive unit is at least one gasoline engine or at least one fossil fuel engine, but in practice it is not limited thereto. These drive units extend the operating time interval of the vehicle and increase its efficiency.
[0075] In said embodiment of the invention, hybrid conversion system operation method of the of the gasoline engine or fossil fuel engine, i.e. the drive units included in the vehicle is given below;
[0076] - Determination of the power requirements of the vehicle
[0077] - Installation of the drive unit and generator or the charging system in the vehicle
[0078] - Connecting mechanical and electrical components to ensure that the drive units can charge the batteries included in the vehicle
[0079] - Installation of at least one ROS node to monitor the battery level of the vehicle and to control the drive unit and charging system according to the battery level
[0080] - Testing the drive units by observing the vehicle operation and the battery charging process
[0081] - By taking into account factors such as fuel consumption, charging time and battery capacity, the battery charging system is optimized for maximum efficiency.
[0082] The mechanical and electrical components connected to ensure that the drive units can charge the batteries included in the vehicle are the ready-made converter circuit allowing the power obtained from the drive unit to be converted into a voltage output compatible with the battery voltage.
[0083] The battery level measured using the ROS infrastructure is transferred to the in-vehicle computer. For ROS, each node represents a data link, so the overall algorithm uses the data exchange provision of said nodes as a source.
[0084] Application of the Invention to Industry The invention relates to a smart autonomous vehicle developed specifically for use in agriculture and defense industry, capable of three-dimensional mapping and agricultural precision spraying in agricultural areas and carrying heavy loads for farmers, and is applicable to industry.
[0085] The invention is not limited to the above descriptions and the person skilled in the art can readily present other different embodiments of the invention. These should be considered within the protection scope of the invention claimed by the claims.
Claims
CLAIMS1 . A vehicle developed specifically for use in the defense industry and agricultural sector, capable of creating three-dimensional maps of fields, performing spraying and developed for carrying heavy loads for farmers; comprising at least one skeletal structure forming the skeletal system, at least one drive unit;- characterized in that it comprises at least one carrier board positioned in at least one main carrier panel, ensuring the determination of communication accuracy, at least one driver circuit unit positioned on a carrier board enabling positional verification, at least one vibration absorbing part positioned inside the carrier board, allowing the carrier board to reduce the effect of vibrations on the autopilot system and the peripherals connected to it, at least one battery which is a power supply, at least one fastener enabling the transfer of power and / or data flow to a carrier board, at least one inertial sensor (IMU) enabling obtaining of magnetic field and acceleration data, at least one internal computer, at least one stereo camera measuring the depth of objects and creating three-dimensional images, at least one anti-collision sensor, at least one lidar sensor, measuring the positions of surrounding objects using laser beams and enabling the creation of three-dimensional maps using its data, at least one RTK-GPS module enabling the vehicle to navigate in agricultural areas and at least one GNSS module.
2. A vehicle of Claim 1 , characterized in that it comprises at least one acceleration (accelerometer) sensor positioned on the carrier board, enabling positional verification process in the driver circuit unit.
3. A vehicle of Claim 1 , characterized in that it comprises at least one cargo bed and / or at least one sprayer for carrying heavy equipment or crop loads and for use in pesticide or herbicide or pest control applications so as to reduce waste and minimize environmental impact.
4. A vehicle of Claim 1 , characterized in that it comprises at least one lidar which is a ToF (time of flight) laser distance sensor.
5. A method developed to work with the skeletal structure of the autonomous vehicle and the vehicle internal computer, characterized by the steps of:In the first step, measuring the depth of the objects and creating three- dimensional images by at least one stereo camera, and measuring the positions of the surrounding objects using laser beams by at least one lidar sensor and creating three-dimensional maps using the measured data,In the second step, combining stereo camera data and lidar sensor data using point cloud registration and / or feature matching and / or occupancy grid mapping and / or iterative closest point registration methods and transferring them to at least one vehicle internal computer,In the third step, creating the environment map and localizing the vehicle within that environment at the same time using grid mapping and the SLAM algorithm,In the fourth step, combining the IMU data with the global map and using the extended kalman filter to estimate the current position and speed of the vehicle,In the fifth step, creating the PID controller using the Ziegler-Nichols tuning algorithm,In the seventh step, controlling the vehicle movements with the ROS based system and transmitting the vehicle mission commands to the autopilot with Mavlink commands.
6. A method of Claim 5, characterized in that in the fourth step, with the sensors containing the IMU data, the speed measurement data is matched with the kalman filter in case of the location data deviation.
7. A method of Claim 6, characterized in that in the seventh step, the ROS system enables the establishment of the communication infrastructure between the control computer and the carrier board as a message carrier system, and transmits the commands with the nodes via the mavlink protocol.
8. A method for operating the hybrid conversion system of the drive unit included in the vehicle, characterized byDetermination of the power requirements of the vehicleInstallation of the drive unit and generator or the charging system in the vehicle- Connecting mechanical and electrical components to ensure that the drive units can charge the batteries included in the vehicle - Installation of at least one ROS node to monitor the battery level of the vehicle and to control the drive unit and charging system according to the battery level- Testing the drive units by observing the vehicle operation and the battery charging process - Optimizing the battery charging system by taking into account factors such as fuel consumption, charging time and battery capacity.
9. A method of Claim 8, characterized in that it comprises a ready-made converter circuit allowing the power obtained from the drive unit to be converted into a voltage output compatible with the battery voltage.
Citation Information
Patent Citations
Agricultural Drone for Use in Controlling the Direction of Tillage and Applying Matter to a Field
US20170127606A1
Vehicle Controllers For Agricultural And Industrial Applications
US20200029488A1
Agricultural Lane Following
US20210000006A1
Apparatus and method for agricultural data collection and agricultural operations
WO2019040866A2
