Path planning and dynamic obstacle avoidance method and device in pasture, medium and product
By obtaining the ranch environment map and target work order tasks, combining sensor data to detect obstacles and avoid obstacles, and generating obstacle avoidance control instructions, it solves the problem of insufficient obstacle avoidance capabilities in autonomous driving of ranch vehicles, and improves safety and obstacle avoidance Accuracy.
Patent Information
- Application Number
- CN202411264901.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-10
- Publication Date
- 2024-12-03
AI Technical Summary
Ranch vehicles lack intelligent obstacle avoidance capabilities during autonomous driving, which has affected the safety of autonomous driving.
By obtaining the ranch environment map and target work ticket tasks, extracting key points and marking path planning and marking maps, obstruction detection and obstacle avoidance analysis are performed based on sensor data, and obstacle avoidance control instructions are generated to guide the vehicle's obstacle avoidance operation.
It improves the accuracy of obstacle avoidance and the safety of autonomous driving in ranch vehicles, ensures that vehicles can take accurate obstacle avoidance operations in a timely manner when facing sudden obstacles, and ensures the safety of vehicles and personnel.
Smart Images

Figure CN119065379A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of vehicle control, and in particular to path planning and dynamic obstacle avoidance methods, devices, media and products within a pasture. Background Art
[0002] As ranch scale continues to expand and management becomes increasingly complex, traditional manual scheduling and path planning methods can no longer meet the needs of efficient and accurate management. In order to improve ranch operation efficiency, reduce labor costs and ensure animal welfare, ranch management is gradually transforming towards intelligence and automation to achieve optimal allocation and efficient use of ranch resources.
[0003] In modern ranch management, with the continuous integration of intelligent and automated technologies, path planning methods have made significant progress, so that the planned driving paths can be used to guide ranch vehicles to operate efficiently, greatly improving the efficiency and accuracy of ranch operations. However, in the actual process of automatic driving of ranch vehicles, when faced with sudden obstacles, ranch vehicles often lack sufficient intelligent obstacle avoidance capabilities, which seriously affects the safety of automatic driving.
[0004] Therefore, how to improve the accuracy of ranch vehicle obstacle avoidance to improve the safety of autonomous driving is a technical problem that needs to be urgently solved by technicians in this field. Summary of the invention
[0005] The purpose of this application is to provide a path planning and dynamic obstacle avoidance method, equipment, medium and product within a ranch to solve at least one of the above technical problems.
[0006] The above invention objectives of the present application are achieved through the following technical solutions: In the first aspect, the present application provides a path planning and dynamic obstacle avoidance method in a pasture, which adopts the following technical solution: A path planning and dynamic obstacle avoidance method in a pasture, comprising: Obtain a ranch environment map and a target work order task in the ranch, extract key points based on the target work order task, determine the starting point, destination, and multiple travel points corresponding to the ranch vehicle, and mark the starting point, destination, and multiple travel points in the ranch environment map to determine a path planning and marking map; Performing path planning based on the path planning annotated map, determining an autonomous driving path, and sending the autonomous driving path to a ranch vehicle terminal so that the ranch vehicle terminal drives the vehicle according to the autonomous driving path; When it is detected that the ranch vehicle terminal starts to drive automatically according to the automatic driving path, multi-dimensional sensor data collected by sensors installed in the ranch vehicle are acquired in real time, obstacle detection is performed based on the multi-dimensional sensor data, and obstacle information is determined; Obstacle avoidance analysis is performed based on the obstacle information and the automatic driving path, an obstacle avoidance control instruction is determined, and the obstacle avoidance control instruction is sent to the ranch vehicle terminal so that the ranch vehicle terminal completes the vehicle obstacle avoidance operation according to the obstacle avoidance control instruction.
[0007] By adopting the above technical solution, the ranch environment map and the target work order task in the ranch are obtained, and the key points are extracted based on the target work order task, and the starting point, destination and multiple driving points corresponding to the ranch vehicle are determined, and the starting point, destination and multiple driving points are marked in the ranch environment map to determine the path planning and marking map. Then, the path planning is performed based on the path planning and marking map, and the automatic driving path is determined, and the automatic driving path is sent to the ranch vehicle terminal so that the ranch vehicle terminal drives the vehicle according to the automatic driving path. Furthermore, when it is detected that the ranch vehicle terminal starts to drive automatically according to the automatic driving path, the multi-dimensional sensor data collected by the sensors installed in the ranch vehicle is obtained in real time. The multi-dimensional sensor data provides more comprehensive and accurate obstacle information, which helps to improve the accuracy of the ranch vehicle obstacle avoidance and improve the safety of automatic driving. In order to enable the ranch vehicle to better adapt to the complex ranch conditions and improve the safety of the ranch vehicle automatic driving, obstacle detection is performed based on the multi-dimensional sensor data, obstacle information is determined, and obstacle avoidance analysis is performed based on the obstacle information and the automatic driving path to determine the obstacle avoidance control instruction. Finally, the obstacle avoidance control instruction is sent to the ranch vehicle terminal so that the ranch vehicle terminal completes the vehicle obstacle avoidance operation according to the obstacle avoidance control instruction. Through real-time obstacle avoidance analysis and command control, ranch vehicles can take timely and highly accurate obstacle avoidance operations when facing sudden obstacles, ensuring the safety of ranch vehicles and personnel.
[0008] In a preferred example, the present application may be further configured as follows: performing obstacle detection based on the multi-dimensional sensor data to determine obstacle information includes: Performing a fusion operation based on the multi-dimensional sensor data to obtain fused sensor data; Obstacle detection is performed based on the fused sensor data to determine obstacle information, wherein the obstacle information includes: obstacle type, obstacle position, and obstacle size.
[0009] In a preferred example, the present application can be further configured as follows: the obstacle categories include: mobile obstacles and fixed obstacles, The performing obstacle avoidance analysis based on the obstacle information and the automatic driving path to determine the obstacle avoidance control instruction includes: When the obstacle category is the fixed obstacle, performing a position relationship evaluation based on the obstacle information and the autonomous driving path, and determining a position relationship evaluation result; When the position relationship evaluation result is that the vehicle is hindering driving, an obstacle avoidance analysis is performed based on the automatic driving path, the obstacle position in the obstacle information, and the obstacle size, to determine an obstacle avoidance control instruction; When the obstacle category is the mobile obstacle, a movement analysis is performed based on the obstacle information to determine dynamic obstacle information, wherein the dynamic obstacle information is used to characterize the movement of the mobile obstacle within a preset time period; Performing a position relationship evaluation based on the dynamic obstacle information and the autonomous driving path, and determining a position relationship evaluation result; When the position relationship evaluation result is that it hinders driving, an obstacle avoidance analysis is performed based on the dynamic obstacle information and the automatic driving path to determine an obstacle avoidance control instruction.
[0010] In a preferred example, the present application may be further configured as follows: after performing obstacle avoidance analysis based on the obstacle information and the autonomous driving path and determining the obstacle avoidance control instruction, the method further includes: Acquire animal breeding data and facility deployment data, and build a virtual environment based on the animal breeding data, the facility deployment data and the ranch environment map to obtain a three-dimensional model of the ranch; Based on the automatic driving path and the obstacle avoidance control instruction, a vehicle obstacle avoidance simulation is performed in the three-dimensional model of the ranch to obtain a simulation result; When the simulation result is that the obstacle avoidance fails, the obstacle avoidance control instruction is updated to a braking instruction to reduce the probability of the ranch vehicle colliding with the obstacle; Accordingly, sending the obstacle avoidance control instruction to the ranch vehicle terminal includes: When the simulation result shows that the obstacle avoidance is successful, the obstacle avoidance control instruction is sent to the ranch vehicle terminal.
[0011] In a preferred example, the present application may be further configured as follows: after sending the obstacle avoidance control instruction to the ranch vehicle terminal, the present application may further include: Acquiring actual obstacle avoidance information, and performing obstacle avoidance effect evaluation and analysis on the obstacle avoidance control instruction based on the actual obstacle avoidance information to determine an obstacle avoidance effect evaluation result; When the obstacle avoidance effect evaluation result does not meet the requirements, an obstacle avoidance analysis optimization instruction is generated, wherein the obstacle avoidance analysis optimization instruction is used to prompt the technician to adjust the obstacle avoidance analysis method.
[0012] In a preferred example, the present application may be further configured as follows: before obtaining the ranch environment map and the target work order task in the ranch, the application may further include: Obtain each work order task created by the ranch staff, wherein the work order task includes: urgency and impact scope; Perform a preliminary sorting based on the urgency and impact scope corresponding to each of the work order tasks to determine an initial sequence; Acquire task dependencies, perform task verification and adjustment based on the initial sequence and the task dependencies, and obtain a work order task sequence, wherein each of the work order tasks in the work order task sequence is arranged from high to low according to priority; The work order task with the highest priority in the work order task sequence is determined as the target work order task.
[0013] In a second aspect, the present application provides an electronic device, which adopts the following technical solution: at least one processor; Memory; At least one application, wherein the at least one application is stored in a memory and configured to be executed by at least one processor, and the at least one application is configured to: execute the above-mentioned path planning and dynamic obstacle avoidance method within the ranch.
[0014] In a third aspect, the present application provides a computer-readable storage medium, which adopts the following technical solution: A computer-readable storage medium stores a computer program, which, when executed in a computer, causes the computer to execute the above-mentioned path planning and dynamic obstacle avoidance method in a pasture.
[0015] In a fourth aspect, the present application provides a computer program product, which adopts the following technical solution: A computer program product includes a computer program, and when the computer program is executed by a processor, the path planning and dynamic obstacle avoidance method in the pasture is implemented.
[0016] In summary, the present application includes at least one of the following beneficial technical effects: The ranch environment map and the target work order task in the ranch are obtained, and the key points are extracted based on the target work order task, and the starting point, destination and multiple driving points corresponding to the ranch vehicle are determined, and the starting point, destination and multiple driving points are marked in the ranch environment map to determine the path planning and marking map. Then, the path planning is performed based on the path planning and marking map, and the automatic driving path is determined, and the automatic driving path is sent to the ranch vehicle terminal so that the ranch vehicle terminal drives the vehicle according to the automatic driving path. Furthermore, when it is detected that the ranch vehicle terminal starts to drive automatically according to the automatic driving path, the multi-dimensional sensor data collected by the sensors installed in the ranch vehicle is obtained in real time. The multi-dimensional sensor data provides more comprehensive and accurate obstacle information, which helps to improve the accuracy of the ranch vehicle obstacle avoidance and improve the safety of automatic driving. In order to enable the ranch vehicle to better adapt to the complex ranch conditions and improve the safety of the ranch vehicle automatic driving, obstacle detection is performed based on the multi-dimensional sensor data, obstacle information is determined, and obstacle avoidance analysis is performed based on the obstacle information and the automatic driving path to determine the obstacle avoidance control instruction. Finally, the obstacle avoidance control instruction is sent to the ranch vehicle terminal so that the ranch vehicle terminal completes the vehicle obstacle avoidance operation according to the obstacle avoidance control instruction. Through real-time obstacle avoidance analysis and command control, ranch vehicles can take timely and highly accurate obstacle avoidance operations when facing sudden obstacles, ensuring the safety of ranch vehicles and personnel.
[0017] In order to make full use of the complementarity of sensor data, make up for their respective deficiencies, and improve the accuracy and reliability of data, a fusion operation is performed based on multi-dimensional sensor data to obtain fused sensor data, which can achieve all-round and multi-angle perception of the environment. Then, obstacle detection is performed based on the fused sensor data to determine obstacle information, thereby improving the accuracy of obstacle information. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 This is a flow chart of a path planning and dynamic obstacle avoidance method in a pasture according to one embodiment of the present application; Figure 2 This is a schematic diagram of the structure of a path planning and dynamic obstacle avoidance device in a pasture in one embodiment of the present application; Figure 3 It is a structural schematic diagram of an electronic device according to one embodiment of the present application. DETAILED DESCRIPTION
[0019] The following combination Figures 1 to 3 This application is described in further detail.
[0020] This specific embodiment is merely an explanation of the present application and is not a limitation of the present application. After reading this specification, a person skilled in the art may make non-creative modifications to the present embodiment as needed, but such modifications are protected by the patent law as long as they are within the scope of the present application.
[0021] In order to make the purpose, technical scheme and advantages of the embodiment of the present application clearer, the technical scheme in the embodiment of the present application will be clearly and completely described in conjunction with the drawings in the embodiment of the present application. Obviously, the described embodiment is a part of the embodiment of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application. It should be noted that in the optional embodiments of the present application, the object information and other related data involved, when the embodiments in the present application are applied to specific products or technologies, need to obtain the permission or consent of the object, and the collection, use and processing of the relevant data need to comply with the relevant laws, regulations and standards of the relevant countries and regions. In other words, if the data related to the object is involved in the embodiment of the present application, it needs to be obtained through the authorization and consent of the object, the authorization and consent of the relevant departments, and in accordance with the relevant laws, regulations and standards of the country and region. If personal information is involved in the embodiment, the acquisition of all personal information needs to obtain the consent of the individual. If sensitive information is involved, the separate consent of the information subject needs to be obtained, and the embodiment also needs to be implemented with the authorization and consent of the object.
[0022] In addition, the term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article, unless otherwise specified, generally means that the associated objects before and after are in an "or" relationship.
[0023] The embodiments of the present application are further described in detail below in conjunction with the drawings in the specification.
[0024] The embodiment of the present application provides a path planning and dynamic obstacle avoidance method in a ranch, which is executed by an electronic device, which can be a server or a terminal device, wherein the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The terminal device can be a smart phone, a tablet computer, a laptop computer, a desktop computer, etc., but is not limited thereto. The terminal device and the server can be directly or indirectly connected via wired or wireless communication, which is not limited in the embodiment of the present application. Figure 1 As shown, the method includes step S101, step S102, step S103 and step S104, wherein: Step S101: Obtain the ranch environment map and the target work order task in the ranch, extract key points based on the target work order task, determine the starting point, destination and multiple driving points corresponding to the ranch vehicle, and mark the starting point, destination and multiple driving points in the ranch environment map to determine the path planning annotation map.
[0025] For the embodiment of the present application, the pasture environment map is used to display the terrain data and road network of the pasture. A map generation module is pre-set in the electronic device. The map generation module can be integrated with Beidou map data and actual terrain features to generate a pasture environment map that can comprehensively and accurately display the current terrain and road network of the pasture. That is, the map generation module uses the Beidou map API to obtain the road network information and terrain data inside the pasture to ensure the accuracy of the data. At the same time, the laser radar and depth camera carried by the terrain detection vehicle are used to collect the actual terrain features corresponding to the pasture, so as to accurately construct elements such as roads, obstacles, and boundaries. Finally, the pasture environment map is constructed by combining Beidou map data and actual terrain features. At the same time, the pasture staff can create work order tasks according to the actual situation of the pasture, such as feeding and spreading tasks, calf feeding tasks, inspection tasks, etc., so that the electronic device can automatically plan the driving path of the pasture vehicle according to the work order task, so that the pasture vehicle can intelligently complete the work order task, and the intelligent operation improves the accuracy and reliability of the completion of the work order task.
[0026] Then, the target work order task is parsed to determine the specific requirements of the work order task, such as feed delivery, milking operation, automatic grazing, etc. The key points necessary for this type of work order task are set in each specific requirement. For example, the key points of the work order task of feed delivery include the feed warehouse; the key points of the work order task of milking operation include the milking station. Then, based on the target work order task, the key points are extracted to determine the starting point, destination and multiple driving points corresponding to the ranch vehicle, wherein the driving points can be specific area points, key intersections, etc. The starting point, destination and driving points are all key points corresponding to the target work order task. Preferably, the key points preliminarily selected are matched with the specific requirements corresponding to the work order task to determine that the extracted key points can meet the requirements of the work order task. Then, the starting point, destination and multiple driving points are marked in the ranch environment map to determine the path planning annotation map.
[0027] Step S102: Perform path planning based on the path planning annotated map, determine the autonomous driving path, and send the autonomous driving path to the ranch vehicle terminal so that the ranch vehicle terminal drives the vehicle according to the autonomous driving path.
[0028] For the embodiment of the present application, path planning is performed based on the path planning annotation map, and an automatic driving path with the starting point and the destination as endpoints and connecting each necessary driving point is determined, and the automatic driving path is marked in the path planning annotation map. The path annotation is usually displayed as a line of travel, and the marked line should clearly and accurately connect the starting point, the destination and each necessary driving point. In the operation process of executing path planning, a variety of path planning algorithms can be selected, including but not limited to: A* algorithm, Dijkstra algorithm, genetic algorithm, etc. In the embodiment of the present application, the A* algorithm is selected for path planning, and reasonable algorithm parameters are set according to the target work order task and the ranch environment characteristics, such as heuristic functions, weight coefficients, etc., and the A* algorithm that completes the algorithm parameter setting is used for path planning, and the optimal driving path is selected as the automatic driving path. Then, the automatic driving path is sent to the ranch vehicle terminal so that the ranch vehicle terminal drives the vehicle according to the automatic driving path.
[0029] Step S103: When it is detected that the ranch vehicle terminal starts to drive automatically according to the automatic driving path, multi-dimensional sensor data collected by sensors installed in the ranch vehicle is acquired in real time, obstacle detection is performed based on the multi-dimensional sensor data, and obstacle information is determined.
[0030] For the embodiments of the present application, the ranch vehicle terminal may face a sudden obstacle blocking the driving road while driving along the autonomous driving path. In order to ensure the safe driving of the ranch vehicle, a variety of sensors are installed in the ranch vehicle, which can instantly sense changes in the surrounding environment and provide more comprehensive and accurate obstacle information, which helps to improve the accuracy of the ranch vehicle's obstacle avoidance and improve the safety of autonomous driving.
[0031] Specifically, a variety of sensors are installed in the ranch vehicle, including but not limited to: laser radar, depth camera, ultrasonic sensor, among which, laser radar measures the distance of objects by emitting light pulses and receiving reflected signals, and can generate high-precision three-dimensional point cloud maps; depth camera is used to capture visual information around the ranch vehicle, which can assist the laser radar in collecting environmental data; ultrasonic sensor is used for close-range obstacle detection. Therefore, when it is detected that the ranch vehicle terminal starts to drive automatically according to the automatic driving path, the multi-dimensional sensor data collected by the sensors installed in the ranch vehicle is obtained in real time, and obstacle detection is performed based on the multi-dimensional sensor data to determine the obstacle information, wherein the obstacle information includes but is not limited to: obstacle category, obstacle location, and obstacle size.
[0032] There are many ways to detect obstacles, which are not limited in the embodiments of the present application. In one feasible way, the raw data of the surrounding environment of the ranch vehicle is collected in real time by sensors, that is, the multi-dimensional sensor data includes but is not limited to: point cloud data, image data, radar reflection data, etc. The collected raw data is pre-processed by denoising, filtering, calibration and other pre-processing operations to improve the accuracy and reliability of the data. At the same time, the multi-source sensor data is time-synchronized and spatially registered to ensure the consistency of different sensor data. Then, the obstacle feature is extracted from the pre-processed data to obtain obstacle features, such as shape, size, speed, reflection intensity, etc. For obstacle feature extraction, for image data, edge detection, corner detection and other algorithms can be used to extract the outline and feature points of the obstacle; for point cloud data, point cloud segmentation, clustering and other algorithms can be used to identify the obstacle area. Then, obstacle analysis is performed using obstacle features to determine obstacle information, which includes but is not limited to: obstacle category, obstacle location, obstacle size, and obstacle category is mainly divided based on the mobility of the obstacle, including: mobile obstacles and fixed obstacles. In another feasible way, since different types of sensors have their own advantages and limitations in data collection, a fusion operation is performed based on multi-dimensional sensor data to obtain fused sensor data, and obstacle detection is performed based on the fused sensor data to determine obstacle information, wherein the obstacle information includes: obstacle category, obstacle location, and obstacle size. Fusion sensor data can achieve all-round and multi-angle perception of the environment, thereby ensuring the accuracy and reliability of obstacle detection.
[0033] Step S104: Perform obstacle avoidance analysis based on obstacle information and the automatic driving path, determine obstacle avoidance control instructions, and send the obstacle avoidance control instructions to the ranch vehicle terminal so that the ranch vehicle terminal completes the vehicle obstacle avoidance operation according to the obstacle avoidance control instructions.
[0034] For the embodiments of the present application, due to the complex and changeable ranch environment, including undulating terrain, dense vegetation, animal presence and other factors, ranch vehicles often encounter sudden obstacles blocking normal driving during the automatic driving process according to the automatic driving path. In order to enable ranch vehicles to better adapt to complex ranch conditions and improve the safety of automatic driving of ranch vehicles, real-time obstacle avoidance analysis and command control are used to enable ranch vehicles to take high-precision obstacle avoidance operations in a timely manner when facing sudden obstacles, thereby ensuring the safety of ranch vehicles and personnel.
[0035] Therefore, obstacle avoidance analysis is performed based on obstacle information and the automatic driving path to determine obstacle avoidance control instructions, wherein the obstacle avoidance control instructions include but are not limited to: steering instructions, speed instructions, and braking instructions. There are many ways to implement obstacle avoidance analysis to determine obstacle avoidance control instructions, and the embodiments of the present application are no longer limited. In one achievable method, the obstacle categories include: mobile obstacles and fixed obstacles. When the obstacle category is a fixed obstacle, a position relationship assessment is performed based on the obstacle information and the automatic driving path to determine the position relationship assessment result; when the position relationship assessment result is an obstruction to driving, an obstacle avoidance analysis is performed based on the automatic driving path, the obstacle position in the obstacle information, and the obstacle size to determine the obstacle avoidance control instruction; when the obstacle category is a mobile obstacle, a movement analysis is performed based on the obstacle information to determine the dynamic obstacle information, wherein the dynamic obstacle information is used to characterize the movement of the mobile obstacle within a preset time period; a position relationship assessment is performed based on the dynamic obstacle information and the automatic driving path to determine the position relationship assessment result; when the position relationship assessment result is an obstruction to driving, an obstacle avoidance analysis is performed based on the dynamic obstacle information and the automatic driving path to determine the obstacle avoidance control instruction. For different types of obstacles, obstacle avoidance strategies that meet their characteristics are selected to improve the accuracy and execution efficiency of obstacle avoidance. Finally, the obstacle avoidance control command is sent to the ranch vehicle terminal so that the ranch vehicle terminal completes the vehicle obstacle avoidance operation according to the obstacle avoidance control command.
[0036] It can be seen that in the embodiment of the present application, the ranch environment map and the target work order task in the ranch are obtained, and the key point extraction is performed based on the target work order task, and the starting point, destination and multiple driving points corresponding to the ranch vehicle are determined, and the starting point, destination and multiple driving points are marked in the ranch environment map to determine the path planning and marking map. Then, the path planning is performed based on the path planning and marking map, and the automatic driving path is determined, and the automatic driving path is sent to the ranch vehicle terminal so that the ranch vehicle terminal drives the vehicle according to the automatic driving path. Furthermore, when it is detected that the ranch vehicle terminal starts to drive automatically according to the automatic driving path, the multi-dimensional sensor data collected by the sensor installed in the ranch vehicle is obtained in real time. The multi-dimensional sensor data provides more comprehensive and accurate obstacle information, which helps to improve the accuracy of the ranch vehicle obstacle avoidance and improve the safety of automatic driving. In order to enable the ranch vehicle to better adapt to the complex ranch situation and improve the safety of the ranch vehicle automatic driving, obstacle detection is performed based on the multi-dimensional sensor data, obstacle information is determined, and obstacle avoidance analysis is performed based on the obstacle information and the automatic driving path to determine the obstacle avoidance control instruction. Finally, the obstacle avoidance control instruction is sent to the ranch vehicle terminal so that the ranch vehicle terminal completes the vehicle obstacle avoidance operation according to the obstacle avoidance control instruction. Through real-time obstacle avoidance analysis and command control, ranch vehicles can take timely and highly accurate obstacle avoidance operations when facing sudden obstacles, ensuring the safety of ranch vehicles and personnel.
[0037] Furthermore, in order to improve the accuracy and reliability of sensor data, in an embodiment of the present application, obstacle detection is performed based on multi-dimensional sensor data to determine obstacle information, including: Perform fusion operation based on multi-dimensional sensor data to obtain fused sensor data; Obstacle detection is performed based on the fused sensor data to determine obstacle information, wherein the obstacle information includes: obstacle type, obstacle location, and obstacle size.
[0038] For the embodiments of the present application, the data collected by different types of sensors have their own advantages and limitations. For example, point cloud data can provide accurate spatial location information, but may be affected by factors such as lighting and occlusion; image data can provide rich color and texture information, but the depth information is relatively weak; radar reflection data has strong penetration and anti-interference capabilities. In order to fully utilize the complementarity of sensor data, make up for their respective deficiencies, and improve the accuracy and reliability of data, a fusion operation is performed based on multi-dimensional sensor data to obtain fused sensor data, wherein the fused sensor data can achieve all-round and multi-angle perception of the environment.
[0039] Specifically, a fusion operation is performed based on multi-dimensional sensor data to obtain fused sensor data. The levels of fusion operations include but are not limited to: data-level fusion and feature-level fusion. Data-level fusion is fusion performed directly at the raw data level, which is suitable for scenarios where sensor data types are similar and original details need to be retained, for example, aligning and fusing the data of visual sensors and lidar in three-dimensional space to form a more complete environmental model; feature-level fusion is used to extract features from multi-dimensional sensor data for fusion, which is suitable for scenarios where sensor data types are different but features can complement each other, for example, extracting edge features in point clouds and texture features in images for feature fusion. Therefore, when performing a fusion operation, a fusion algorithm is selected based on the fusion operation level and multi-dimensional sensor data to determine the target fusion algorithm. The target fusion algorithm includes but is not limited to: Kalman filtering, Bayesian network, neural network, fuzzy logic, etc., so as to use the target fusion algorithm to perform fusion operations on multi-dimensional sensor data and obtain fused sensor data.
[0040] Then, obstacle detection is performed based on the fused sensor data to determine obstacle information, which includes obstacle category, obstacle location, and obstacle size. In the obstacle detection process, the fused sensor data is classified using a trained classifier to determine the category of the obstacle; the specific location of the obstacle in three-dimensional space is determined based on the fused sensor data, combined with the sensor's location information and coordinate transformation relationship, that is, the obstacle location is determined; by measuring the size of the area occupied by the obstacle in the image or point cloud, combined with the sensor's calibration parameters and imaging principle, the actual size of the obstacle is calculated, that is, the obstacle size is determined.
[0041] It can be seen that in the embodiment of the present application, in order to make full use of the complementarity of sensor data, make up for their respective deficiencies, and improve the accuracy and reliability of data, a fusion operation is performed based on multi-dimensional sensor data to obtain fused sensor data, which can achieve all-round and multi-angle perception of the environment. Then, obstacle detection is performed based on the fused sensor data to determine obstacle information, thereby improving the accuracy of obstacle information.
[0042] Furthermore, in order to improve the accuracy and execution efficiency of obstacle avoidance, in the embodiment of the present application, the obstacle categories include: mobile obstacles and fixed obstacles. Obstacle avoidance analysis is performed based on obstacle information and the autonomous driving path, and obstacle avoidance control instructions are determined, including: When the obstacle category is a fixed obstacle, a position relationship evaluation is performed based on the obstacle information and the autonomous driving path to determine the position relationship evaluation result; When the position relationship evaluation result is that it hinders driving, obstacle avoidance analysis is performed based on the automatic driving path, obstacle position and obstacle size in the obstacle information, and obstacle avoidance control instructions are determined; For the embodiments of the present application, the autonomous driving vehicle needs to accurately identify and evaluate obstacles in the surrounding environment, especially fixed obstacles, during driving to prevent collision accidents. By evaluating the position relationship, it is determined whether the obstacle will hinder the autonomous driving path, and emergency obstacle avoidance operations are performed in the case of obstruction to driving, thereby ensuring driving safety.
[0043] Therefore, when the obstacle category is a fixed obstacle, a position relationship assessment is performed based on the obstacle information and the autonomous driving path to determine the position relationship assessment result, wherein the position relationship assessment result includes: obstructed driving and normal driving. The specific implementation process for the position relationship assessment is as follows: using coordinate transformation and geometric calculation methods, the position information of the obstacle is unified with the coordinate system of the autonomous driving path, and the spatial position relationship between the obstacle and the path is calculated. The position relationship assessment standard is obtained. The position relationship assessment standard is an assessment standard set by technicians based on factors such as the performance indicators, safety standards, and traffic rules of the autonomous driving vehicle. Users can adjust it according to actual conditions, and the embodiments of this application are no longer limited. Furthermore, the calculated spatial position relationship is compared with the position relationship assessment standard to determine the position relationship assessment result between the obstacle and the autonomous driving path.
[0044] When the position relationship evaluation result is normal driving, no other operations are performed, and the ranch vehicle is controlled to drive normally according to the automatic driving path. When the position relationship evaluation result is obstructed driving, obstacle avoidance analysis is performed based on the automatic driving path, the obstacle position and obstacle size in the obstacle information, and the obstacle avoidance control command is determined, wherein the obstacle avoidance control command includes but is not limited to: steering command, speed command, braking command. For the obstacle avoidance analysis of fixed obstacles, the minimum safe distance between the ranch vehicle and the obstacle is calculated based on the ranch vehicle size and the obstacle size, as well as the traffic safety standard, and an obstacle avoidance area is delineated with the obstacle position as the center according to the minimum safe distance and the obstacle size. The area should completely cover the obstacle and expand outward with a certain safety margin. Then, the obstacle avoidance starting point is selected according to the automatic driving path and the obstacle avoidance area. The obstacle avoidance starting point should be as close to the obstacle as possible but will not immediately enter the obstacle avoidance area, and the obstacle avoidance path is planned according to the obstacle avoidance starting point and the obstacle avoidance area to determine the curvature of the obstacle path. Preferably, when approaching the obstacle avoidance area, it is necessary to decelerate appropriately to ensure that the vehicle can smoothly enter the obstacle avoidance path and pass safely. The magnitude of deceleration should be determined based on the vehicle's braking performance, current speed, and the length and curvature of the obstacle avoidance path. Finally, based on the obstacle avoidance area, obstacle avoidance starting point, obstacle avoidance path curvature, and obstacle avoidance speed, instructions are generated to determine the obstacle avoidance control instructions to guide the target vehicle to perform obstacle avoidance operations.
[0045] When the obstacle category is a mobile obstacle, a movement analysis is performed based on the obstacle information to determine the dynamic obstacle information, wherein the dynamic obstacle information is used to characterize the movement of the mobile obstacle within a preset time period; Perform position relationship evaluation based on dynamic obstacle information and autonomous driving path, and determine the position relationship evaluation result; When the position relationship evaluation result is an obstacle to driving, an obstacle avoidance analysis is performed based on the dynamic obstacle information and the autonomous driving path to determine the obstacle avoidance control instructions.
[0046] For the embodiments of the present application, real-time analysis of the dynamic information of moving obstacles helps to quickly perceive potential dangers and take obstacle avoidance measures when necessary, thereby avoiding collisions with moving obstacles, significantly improving the safety of ranch vehicle driving.
[0047] Specifically, when the obstacle category is a mobile obstacle, the mobile obstacle is continuously tracked based on the obstacle information, and the key motion parameters of the mobile obstacle are extracted, such as position, speed, acceleration, and direction of movement. These parameters will be used to characterize the movement of the mobile obstacle over a period of time, and motion prediction is performed based on the key motion parameters to determine the estimated operating state of the mobile obstacle in the future preset period of time. Finally, the current motion state and the estimated operating state corresponding to the mobile obstacle are integrated to obtain dynamic obstacle information. Then, the position relationship is evaluated based on the dynamic obstacle information and the automatic driving path, and the position relationship evaluation result is determined, that is, the movement planning is performed based on the dynamic obstacle information to obtain the obstacle movement trajectory, in which the size of the area affected by the obstacle can be characterized, and the obstacle movement trajectory and the automatic driving path are compared and analyzed in space and time to evaluate whether the obstacle will intersect or conflict with the planned automatic driving path in a certain period of time in the future. When there is an intersection or conflict, the position relationship evaluation result is determined to be an obstruction to driving; otherwise, the position relationship evaluation result is determined to be normal driving.
[0048] When the position relationship evaluation result is normal driving, no other operations are performed, and the ranch vehicle is controlled to drive normally along the automatic driving path. When the position relationship evaluation result is obstructed driving, the obstacle movement trajectory and the automatic driving path are compared and analyzed in space and time to determine the conflict time and conflict area. Obstacle avoidance path planning is performed based on the conflict time, conflict area and automatic driving path, and the driving path around the conflict area is determined. The driving path is converted into instructions to obtain obstacle avoidance control instructions to guide the target vehicle to perform obstacle avoidance operations. Obstacle avoidance strategies that meet the characteristics of different types of obstacles are selected to improve the accuracy and execution efficiency of obstacle avoidance.
[0049] It can be seen that in the embodiment of the present application, the autonomous driving vehicle needs to accurately identify and evaluate obstacles in the surrounding environment during driving. For fixed obstacles, the position relationship evaluation is performed based on the obstacle information and the autonomous driving path to determine the position relationship evaluation result. Furthermore, when the position relationship evaluation result is an obstruction to driving, an obstacle avoidance analysis is performed based on the obstacle position and obstacle size in the autonomous driving path and obstacle information to determine the obstacle avoidance control instruction. For mobile obstacles, a mobile analysis is performed based on the obstacle information to determine the dynamic obstacle information, and a position relationship evaluation is performed based on the dynamic obstacle information and the autonomous driving path to determine the position relationship evaluation result. Furthermore, when the position relationship evaluation result is an obstruction to driving, an obstacle avoidance analysis is performed based on the dynamic obstacle information and the autonomous driving path to determine the obstacle avoidance control instruction. By analyzing the dynamic information of the mobile obstacle in real time, it is helpful to quickly perceive potential dangers and take obstacle avoidance measures when necessary, thereby avoiding collisions with mobile obstacles, significantly improving the safety of ranch vehicle driving. For different types of obstacles, obstacle avoidance strategies that meet the characteristics of the obstacles are selected to improve the accuracy and execution efficiency of obstacle avoidance.
[0050] Furthermore, in order to effectively prevent the occurrence of actual collisions and improve the success rate of obstacle avoidance, in the embodiment of the present application, after performing obstacle avoidance analysis based on obstacle information and the autonomous driving path and determining the obstacle avoidance control instruction, the following steps are also included: Obtain animal breeding data and facility deployment data, build a virtual environment based on the animal breeding data, facility deployment data and ranch environment map, and obtain a three-dimensional model of the ranch; Based on the autonomous driving path and obstacle avoidance control instructions, the vehicle obstacle avoidance simulation is carried out in the three-dimensional model of the ranch to obtain the simulation results; When the simulation result shows that obstacle avoidance fails, the obstacle avoidance control command is updated to a braking command to reduce the probability of the ranch vehicle colliding with obstacles; Accordingly, the obstacle avoidance control command is sent to the ranch vehicle terminal, including: When the simulation result shows that the obstacle avoidance is successful, the obstacle avoidance control command is sent to the ranch vehicle terminal.
[0051] For the embodiment of the present application, after the obstacle avoidance control instruction is determined, a vehicle obstacle avoidance simulation is performed in the three-dimensional model of the pasture to pre-evaluate the effectiveness of the obstacle avoidance control instruction. When the simulation result is an obstacle avoidance failure, the obstacle avoidance control instruction is automatically updated to a braking instruction, which can effectively prevent the occurrence of actual collisions, thereby improving the obstacle avoidance success rate.
[0052] Specifically, animal breeding data and facility deployment data are obtained. Animal breeding data is used to characterize the types, growth cycles, feeding requirements, behavioral habits and other information of animals raised in the ranch; facility deployment data is used to characterize the layout and specifications of buildings, equipment, facilities and the like in the ranch. Then, a virtual environment is built based on animal breeding data, facility deployment data and ranch environment map using 3D modeling software to obtain a 3D model of the ranch, which can simulate the operating status of the equipment, the growth process and behavioral habits of the animals raised. Furthermore, based on the automatic driving path and obstacle avoidance control instructions, a vehicle obstacle avoidance simulation is performed in the ranch 3D model to obtain a simulation result, wherein the simulation result is used to show the driving result presented by the ranch vehicle when the obstacle avoidance operation is performed according to the obstacle avoidance control instruction. When the simulation result is that the obstacle avoidance is successful, the obstacle avoidance control instruction is sent to the ranch vehicle terminal. When the simulation result is that the obstacle avoidance fails, the control instruction abnormal information is generated, and the obstacle avoidance control instruction is updated to a braking instruction to reduce the probability of the ranch vehicle colliding with an obstacle.
[0053] It can be seen that in the embodiment of the present application, a virtual environment is constructed based on animal breeding data, facility deployment data and pasture environment map to obtain a three-dimensional pasture model. Then, based on the automatic driving path and obstacle avoidance control instructions, a vehicle obstacle avoidance simulation is performed in the three-dimensional pasture model to obtain a simulation result. When the simulation result is that the obstacle avoidance fails, the obstacle avoidance control instruction is updated to a braking instruction, which can effectively prevent the occurrence of actual collisions, thereby improving the success rate of obstacle avoidance.
[0054] Further, in order to improve the accuracy and reliability of the obstacle avoidance method, in the embodiment of the present application, after the obstacle avoidance control instruction is sent to the ranch vehicle terminal, it also includes: Obtain actual obstacle avoidance information, and based on the actual obstacle avoidance information, perform obstacle avoidance effect evaluation and analysis on the obstacle avoidance control instructions to determine the obstacle avoidance effect evaluation result; When the obstacle avoidance effect evaluation result does not meet the requirements, an obstacle avoidance analysis optimization instruction is generated, wherein the obstacle avoidance analysis optimization instruction is used to prompt the technician to adjust the obstacle avoidance analysis method.
[0055] For the embodiment of the present application, the obstacle avoidance effect is evaluated based on the actual obstacle avoidance information, which can accurately determine the performance and method of the obstacle avoidance method, and timely discover and solve potential problems in the obstacle avoidance method. When the obstacle avoidance effect evaluation result does not meet the requirements, an obstacle avoidance analysis optimization instruction is generated to achieve dynamic adjustment of the obstacle avoidance analysis method. The dynamic adjustment mechanism can improve the accuracy and reliability of the obstacle avoidance method.
[0056] Specifically, the actual obstacle avoidance information is obtained, and the actual obstacle avoidance information includes but is not limited to: vehicle speed, steering angle, acceleration, obstacle avoidance time, obstacle avoidance path information, and the distance between the obstacle and the obstacle. Then, based on the actual obstacle avoidance information, the obstacle avoidance control instruction is evaluated and analyzed for the obstacle avoidance effect, that is, effective feature extraction is performed based on the actual obstacle avoidance information to determine the features to be evaluated, including but not limited to: vehicle speed change, steering angle change, obstacle avoidance path smoothness, obstacle avoidance time, etc.; the electronic device pre-sets the obstacle avoidance effect evaluation index, that is, a reasonable evaluation index is set for each feature to be evaluated, so the obstacle avoidance effect evaluation result is determined based on the obstacle avoidance effect evaluation index and the feature to be evaluated. When any feature to be evaluated does not meet the obstacle avoidance effect evaluation index, the obstacle avoidance effect evaluation result is determined to be unsatisfactory; otherwise, the obstacle avoidance effect evaluation result is determined to be satisfactory. Furthermore, when the obstacle avoidance effect evaluation result does not meet the requirements, an obstacle avoidance analysis optimization instruction is generated, wherein the obstacle avoidance analysis optimization instruction is used to prompt the technician to adjust the obstacle avoidance analysis method, and the dynamic adjustment mechanism can ensure that the obstacle avoidance analysis method can maintain good performance in different environments.
[0057] It can be seen that in the embodiment of the present application, based on the actual obstacle avoidance information, the obstacle avoidance control instruction is evaluated and analyzed to determine the obstacle avoidance effect evaluation result. Furthermore, when the obstacle avoidance effect evaluation result does not meet the requirements, an obstacle avoidance analysis optimization instruction is generated to achieve dynamic adjustment of the obstacle avoidance analysis method. The dynamic adjustment mechanism can improve the accuracy and reliability of the obstacle avoidance method.
[0058] Furthermore, in order to ensure that important and urgent tasks are responded to and processed in a timely manner and to avoid problems such as waste of resources, time delays or task conflicts caused by improper task execution order, in the embodiment of the present application, before obtaining the pasture environment map and the target work order task in the pasture, it also includes: Get each work order task created by the ranch staff, where the work order task includes: urgency and impact scope; Perform a preliminary sorting based on the urgency and impact scope of each work order task and determine the initial sequence; Obtaining task dependencies, performing task verification and adjustment based on the initial sequence and the task dependencies, and obtaining a work order task sequence, wherein each work order task in the work order task sequence is arranged from high to low according to priority; The work order task with the highest priority in the work order task sequence is determined as the target work order task.
[0059] For the embodiment of the present application, the ranch staff can create corresponding work order tasks according to actual needs. By preliminarily sorting the work order tasks by urgency and scope of impact, it helps to reasonably allocate resources and ensure that important and urgent tasks are responded to and processed in a timely manner, thereby improving the efficiency of overall work order processing. Furthermore, on the basis of the preliminary sorting, the dependencies between tasks are further considered. Through task verification and adjustment, problems such as resource waste, time delays or task conflicts caused by improper task execution order are avoided, making the entire work order processing process smoother and more efficient.
[0060] Specifically, the ranch staff can submit the work order task through the work order system. When submitting the work order task, the ranch staff needs to enter the specific content of the work order task and clearly mark its urgency and impact range. The urgency can be divided into different levels (such as high, medium, and low) according to the actual situation, and the impact range can be described as the affected area, equipment, or business process. Of course, the work order task can also include: work order number, submission time, submitter, task content and other information. Then, based on the urgency and impact range corresponding to each work order task, a preliminary sorting is performed to determine the initial sequence. The specific execution process of the preliminary sorting method is as follows: According to the urgency and impact range corresponding to each work order task, the work order tasks are preliminarily classified. The work order types include: urgent tasks with a large impact range, urgent tasks with a small impact range, non-urgent tasks with a large impact range, and non-urgent tasks with a small impact range. Then, based on the preliminary classification, the work order tasks are preliminarily sorted in the order of urgency from high to low and impact range from large to small to obtain the initial sequence. In the actual operation of the ranch, there are dependencies between some work order tasks. The dependency dimensions include but are not limited to: order, resource sharing, skill requirements and other dependencies. Therefore, the task dependency is obtained, and the task verification and adjustment are performed based on the initial sequence and task dependency. The task dependency clearly records the predecessor task, and the predecessor task clearly defines the work order task that must be executed before the current work order task. The specific implementation process of the task verification and adjustment operation is as follows: traverse each work order task in the initial sequence, check whether it has a predecessor task, and when there is a predecessor task, determine whether there is a corresponding predecessor task after the current work order task, and adjust the corresponding predecessor task to the position before the current task to ensure that the predecessor task is executed first. After the initial sequence is traversed, the execution order of the work order tasks obtained is finally determined as the work order task sequence. Then, the work order task with the highest priority in the work order task sequence is determined as the target work order task.
[0061] It can be seen that in the embodiment of the present application, each work order task created by the ranch staff is obtained, and a preliminary sorting is performed based on the urgency and impact scope corresponding to each work order task to determine the initial sequence, which helps to reasonably allocate resources and ensure that important and urgent tasks are responded to and processed in a timely manner, thereby improving the efficiency of the overall work order processing. Furthermore, based on the initial sequence and task dependencies, task verification and adjustment are performed to obtain a work order task sequence, avoiding problems such as resource waste, time delays or task conflicts caused by improper task execution order, making the entire work order processing process smoother and more efficient. Finally, the work order task with the highest priority in the work order task sequence is determined as the target work order task.
[0062] The above embodiment introduces a path planning and dynamic obstacle avoidance method in a ranch from the perspective of a method flow, and the following embodiment introduces a path planning and dynamic obstacle avoidance device in a ranch from the perspective of a virtual module or a virtual unit. For details, please refer to the following embodiment.
[0063] The present application embodiment provides a path planning and dynamic obstacle avoidance device in a pasture, such as Figure 2 As shown, the path planning and dynamic obstacle avoidance device in the ranch may specifically include: The environmental map marking module 210 is used to obtain the ranch environmental map and the target work order task in the ranch, extract key points based on the target work order task, determine the starting point, destination and multiple driving points corresponding to the ranch vehicle, and mark the starting point, destination and multiple driving points in the ranch environmental map to determine the path planning marking map; A driving path planning module 220 is used to perform path planning based on the path planning annotation map, determine the automatic driving path, and send the automatic driving path to the ranch vehicle terminal so that the ranch vehicle terminal drives the vehicle according to the automatic driving path; The obstacle detection module 230 is used to obtain multi-dimensional sensor data collected by sensors installed in the ranch vehicle in real time when it is detected that the ranch vehicle terminal starts to drive automatically according to the automatic driving path, perform obstacle detection based on the multi-dimensional sensor data, and determine obstacle information; The obstacle avoidance analysis module 240 is used to perform obstacle avoidance analysis based on obstacle information and the automatic driving path, determine obstacle avoidance control instructions, and send the obstacle avoidance control instructions to the ranch vehicle terminal so that the ranch vehicle terminal completes the vehicle obstacle avoidance operation according to the obstacle avoidance control instructions.
[0064] For the embodiment of the present application, a ranch environment map and a target work order task in the ranch are obtained, key points are extracted based on the target work order task, the starting point, destination and multiple driving points corresponding to the ranch vehicle are determined, and the starting point, destination and multiple driving points are marked in the ranch environment map to determine the path planning and marking map. Then, path planning is performed based on the path planning and marking map to determine the automatic driving path, and the automatic driving path is sent to the ranch vehicle terminal so that the ranch vehicle terminal drives the vehicle according to the automatic driving path. Furthermore, when it is detected that the ranch vehicle terminal starts to drive automatically according to the automatic driving path, multi-dimensional sensor data collected by the sensors installed in the ranch vehicle is obtained in real time. The multi-dimensional sensor data provides more comprehensive and accurate obstacle information, which helps to improve the accuracy of the ranch vehicle's obstacle avoidance and improve the safety of automatic driving. In order to enable the ranch vehicle to better adapt to the complex ranch conditions and improve the safety of the ranch vehicle's automatic driving, obstacle detection is performed based on the multi-dimensional sensor data, obstacle information is determined, and obstacle avoidance analysis is performed based on the obstacle information and the automatic driving path to determine the obstacle avoidance control instruction. Finally, the obstacle avoidance control instruction is sent to the ranch vehicle terminal so that the ranch vehicle terminal completes the vehicle obstacle avoidance operation according to the obstacle avoidance control instruction. Through real-time obstacle avoidance analysis and command control, ranch vehicles can take timely and highly accurate obstacle avoidance operations when facing sudden obstacles, ensuring the safety of ranch vehicles and personnel.
[0065] In a possible implementation of the embodiment of the present application, when the obstacle detection module 230 performs obstacle detection based on multi-dimensional sensor data and determines obstacle information, it is used to: Perform fusion operation based on multi-dimensional sensor data to obtain fused sensor data; Obstacle detection is performed based on the fused sensor data to determine obstacle information, wherein the obstacle information includes: obstacle type, obstacle location, and obstacle size.
[0066] In a possible implementation of the embodiment of the present application, the obstacle categories include: mobile obstacles and fixed obstacles. When the obstacle avoidance analysis module 240 performs obstacle avoidance analysis based on obstacle information and the autonomous driving path and determines the obstacle avoidance control instruction, it is used to: When the obstacle category is a fixed obstacle, a position relationship evaluation is performed based on the obstacle information and the autonomous driving path to determine the position relationship evaluation result; When the position relationship evaluation result is that it hinders driving, obstacle avoidance analysis is performed based on the automatic driving path, obstacle position and obstacle size in the obstacle information, and obstacle avoidance control instructions are determined; When the obstacle category is a mobile obstacle, a movement analysis is performed based on the obstacle information to determine the dynamic obstacle information, wherein the dynamic obstacle information is used to characterize the movement of the mobile obstacle within a preset time period; Perform position relationship evaluation based on dynamic obstacle information and autonomous driving path, and determine the position relationship evaluation result; When the position relationship evaluation result is an obstacle to driving, an obstacle avoidance analysis is performed based on the dynamic obstacle information and the autonomous driving path to determine the obstacle avoidance control instructions.
[0067] A possible implementation of the embodiment of the present application, the path planning and dynamic obstacle avoidance device in the pasture also includes: The simulation module is used to obtain animal breeding data, facility deployment data, and build a virtual environment based on the animal breeding data, facility deployment data, and pasture environment map to obtain a three-dimensional pasture model; Based on the autonomous driving path and obstacle avoidance control instructions, the vehicle obstacle avoidance simulation is carried out in the three-dimensional model of the ranch to obtain the simulation results; When the simulation result shows that obstacle avoidance fails, the obstacle avoidance control command is updated to a braking command to reduce the probability of the ranch vehicle colliding with obstacles; Accordingly, when executing the obstacle avoidance control instruction to be sent to the ranch vehicle terminal, the obstacle avoidance analysis module 240 is used to: When the simulation result shows that the obstacle avoidance is successful, the obstacle avoidance control command is sent to the ranch vehicle terminal.
[0068] A possible implementation of the embodiment of the present application, the path planning and dynamic obstacle avoidance device in the pasture also includes: The obstacle avoidance effect evaluation module is used to obtain actual obstacle avoidance information, and based on the actual obstacle avoidance information, to evaluate and analyze the obstacle avoidance effect of the obstacle avoidance control command to determine the obstacle avoidance effect evaluation result; When the obstacle avoidance effect evaluation result does not meet the requirements, an obstacle avoidance analysis optimization instruction is generated, wherein the obstacle avoidance analysis optimization instruction is used to prompt the technician to adjust the obstacle avoidance analysis method.
[0069] A possible implementation of the embodiment of the present application, the path planning and dynamic obstacle avoidance device in the pasture also includes: The work order task sorting module is used to obtain each work order task created by the ranch staff, where the work order task includes: urgency and impact scope; Perform a preliminary sorting based on the urgency and impact scope of each work order task and determine the initial sequence; Obtaining task dependencies, performing task verification and adjustment based on the initial sequence and the task dependencies, and obtaining a work order task sequence, wherein each work order task in the work order task sequence is arranged from high to low according to priority; The work order task with the highest priority in the work order task sequence is determined as the target work order task.
[0070] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the path planning and dynamic obstacle avoidance device in the pasture described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.
[0071] An electronic device is provided in an embodiment of the present application, such as Figure 3 As shown, Figure 3 The electronic device 300 shown includes: a processor 301 and a memory 303. The processor 301 and the memory 303 are connected, such as through a bus 302. Optionally, the electronic device 300 may also include a transceiver 304. It should be noted that in actual applications, the transceiver 304 is not limited to one, and the structure of the electronic device 300 does not constitute a limitation on the embodiments of the present application.
[0072] The processor 301 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It may implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. The processor 301 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.
[0073] The bus 302 may include a path to transmit information between the above components. The bus 302 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus 302 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 Only one thick line is used in the diagram, but it does not mean that there is only one bus or only one type of bus.
[0074] The memory 303 may be a ROM (Read Only Memory) or other types of static storage devices that can store static information and instructions, a RAM (Random Access Memory) or other types of dynamic storage devices that can store information and instructions, or an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory) or other optical disk storage, optical disk storage (including compressed optical disk, laser disk, optical disk, digital versatile disk, Blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.
[0075] The memory 303 is used to store the application code for executing the solution of the present application, and the execution is controlled by the processor 301. The processor 301 is used to execute the application code stored in the memory 303 to implement the contents shown in the above method embodiment.
[0076] The electronic devices include, but are not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), and fixed terminals such as digital TVs, desktop computers, etc. It can also be a server, etc. Figure 3 The electronic device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0077] An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer can execute the corresponding content in the aforementioned method embodiment.
[0078] The embodiment of the present application provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the method in any of the above embodiments is implemented. Compared with the related art, the embodiment of the present application obtains a ranch environment map and a target work order task in the ranch, extracts key points based on the target work order task, determines the starting point, destination and multiple driving points corresponding to the ranch vehicle, and marks the starting point, destination and multiple driving points in the ranch environment map to determine the path planning annotation map. Then, path planning is performed based on the path planning annotation map to determine the automatic driving path, and the automatic driving path is sent to the ranch vehicle terminal so that the ranch vehicle terminal drives the vehicle according to the automatic driving path. Furthermore, when it is detected that the ranch vehicle terminal starts to drive automatically according to the automatic driving path, multi-dimensional sensor data collected by the sensors installed in the ranch vehicle is obtained in real time. The multi-dimensional sensor data provides more comprehensive and accurate obstacle information, which helps to improve the accuracy of the ranch vehicle's obstacle avoidance and improve the safety of automatic driving. In order to enable the ranch vehicle to better adapt to the complex ranch conditions and improve the safety of the ranch vehicle's automatic driving, obstacle detection is performed based on the multi-dimensional sensor data, obstacle information is determined, and obstacle avoidance analysis is performed based on the obstacle information and the automatic driving path to determine the obstacle avoidance control instructions. Finally, the obstacle avoidance control command is sent to the ranch vehicle terminal, so that the ranch vehicle terminal completes the vehicle obstacle avoidance operation according to the obstacle avoidance control command. Through real-time obstacle avoidance analysis and command control, the ranch vehicle can take timely and accurate obstacle avoidance operations when facing sudden obstacles, ensuring the safety of ranch vehicles and personnel.
[0079] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.
[0080] The above are only some implementation methods of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.
Claims
1. A path planning and dynamic obstacle avoidance method in a pasture, characterized in that: include: Obtain a ranch environment map and a target work order task in the ranch, extract key points based on the target work order task, determine the starting point, destination, and multiple travel points corresponding to the ranch vehicle, and mark the starting point, destination, and multiple travel points in the ranch environment map to determine a path planning and marking map; Performing path planning based on the path planning annotated map, determining an autonomous driving path, and sending the autonomous driving path to a ranch vehicle terminal so that the ranch vehicle terminal drives the vehicle according to the autonomous driving path; When it is detected that the ranch vehicle terminal starts to drive automatically according to the automatic driving path, multi-dimensional sensor data collected by sensors installed in the ranch vehicle are acquired in real time, obstacle detection is performed based on the multi-dimensional sensor data, and obstacle information is determined; Obstacle avoidance analysis is performed based on the obstacle information and the automatic driving path, an obstacle avoidance control instruction is determined, and the obstacle avoidance control instruction is sent to the ranch vehicle terminal so that the ranch vehicle terminal completes the vehicle obstacle avoidance operation according to the obstacle avoidance control instruction.
2. The path planning and dynamic obstacle avoidance method in a pasture according to claim 1, characterized in that: The performing obstacle detection based on the multi-dimensional sensor data and determining obstacle information includes: Performing a fusion operation based on the multi-dimensional sensor data to obtain fused sensor data; Obstacle detection is performed based on the fused sensor data to determine obstacle information, wherein the obstacle information includes: obstacle type, obstacle position, and obstacle size.
3. The path planning and dynamic obstacle avoidance method in a pasture according to claim 2, characterized in that: The obstacle categories include: mobile obstacles and fixed obstacles. The performing obstacle avoidance analysis based on the obstacle information and the automatic driving path to determine the obstacle avoidance control instruction includes: When the obstacle category is the fixed obstacle, performing a position relationship evaluation based on the obstacle information and the autonomous driving path, and determining a position relationship evaluation result; When the position relationship evaluation result is that the vehicle is hindering driving, an obstacle avoidance analysis is performed based on the automatic driving path, the obstacle position in the obstacle information, and the obstacle size, to determine an obstacle avoidance control instruction; When the obstacle category is the mobile obstacle, a movement analysis is performed based on the obstacle information to determine dynamic obstacle information, wherein the dynamic obstacle information is used to characterize the movement of the mobile obstacle within a preset time period; Performing a position relationship evaluation based on the dynamic obstacle information and the autonomous driving path, and determining a position relationship evaluation result; When the position relationship evaluation result is that it hinders driving, an obstacle avoidance analysis is performed based on the dynamic obstacle information and the automatic driving path to determine an obstacle avoidance control instruction.
4. The path planning and dynamic obstacle avoidance method in a pasture according to claim 1, characterized in that: After performing obstacle avoidance analysis based on the obstacle information and the automatic driving path and determining an obstacle avoidance control instruction, the method further includes: Acquire animal breeding data and facility deployment data, and build a virtual environment based on the animal breeding data, the facility deployment data and the ranch environment map to obtain a three-dimensional model of the ranch; Based on the automatic driving path and the obstacle avoidance control instruction, a vehicle obstacle avoidance simulation is performed in the three-dimensional model of the ranch to obtain a simulation result; When the simulation result is that the obstacle avoidance fails, the obstacle avoidance control instruction is updated to a braking instruction to reduce the probability of the ranch vehicle colliding with the obstacle; Accordingly, sending the obstacle avoidance control instruction to the ranch vehicle terminal includes: When the simulation result shows that the obstacle avoidance is successful, the obstacle avoidance control instruction is sent to the ranch vehicle terminal.
5. The path planning and dynamic obstacle avoidance method in a pasture according to claim 1, characterized in that: After sending the obstacle avoidance control instruction to the ranch vehicle terminal, the method further includes: Acquiring actual obstacle avoidance information, and performing obstacle avoidance effect evaluation and analysis on the obstacle avoidance control instruction based on the actual obstacle avoidance information to determine an obstacle avoidance effect evaluation result; When the obstacle avoidance effect evaluation result does not meet the requirements, an obstacle avoidance analysis optimization instruction is generated, wherein the obstacle avoidance analysis optimization instruction is used to prompt the technician to adjust the obstacle avoidance analysis method.
6. The path planning and dynamic obstacle avoidance method in a pasture according to claim 1, characterized in that: Before obtaining the ranch environment map and the target work order task in the ranch, the following steps are also included: Obtain each work order task created by the ranch staff, wherein the work order task includes: urgency and impact scope; Perform a preliminary sorting based on the urgency and impact scope corresponding to each of the work order tasks to determine an initial sequence; Acquire task dependencies, perform task verification and adjustment based on the initial sequence and the task dependencies, and obtain a work order task sequence, wherein each of the work order tasks in the work order task sequence is arranged from high to low according to priority; The work order task with the highest priority in the work order task sequence is determined as the target work order task.
7. An electronic device, characterized in that: include: at least one processor; Memory; At least one application, wherein the at least one application is stored in a memory and configured to be executed by at least one processor, and the at least one application is configured to: execute the path planning and dynamic obstacle avoidance method within a ranch as described in any one of claims 1 to 6.
8. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed in a computer, the computer is caused to execute the path planning and dynamic obstacle avoidance method in a pasture as described in any one of claims 1 to 6.
9. A computer program product, characterized in that The method comprises a computer program, wherein the computer program is executed by a processor to implement the path planning and dynamic obstacle avoidance method in a pasture as described in any one of claims 1 to 6.
Citation Information
Cited By
Forage baler control method and control system based on visual navigation
CN119937435A
