Operation path planning method, electronic equipment and storage medium

By combining the boundary maps of multiple job sub-regions and determining the connection path in the job map, the problem of inefficient path planning when multiple job areas overlap in the prior art is solved, and global optimal path planning and efficient path adjustment are realized .

CN119022946APending Publication Date: 2024-11-26SHENZHEN MAMMOTION INNOVATION CO LTD
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202411112224.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-14
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The existing job path planning method has poor results when multiple job areas overlap, resulting in inefficient path planning and inability to obtain global shortest paths.

Method used

By obtaining the boundary map of multiple job sub-regions from the mobile device, the job map is generated after merging and processing. Based on the preset job sequence and the path of each job sub-region, determine any two adjacent areas in the job map in the job map. and adjust the path if necessary to avoid obstacles.

Benefits of technology

Improve the efficiency and accuracy of job path planning, ensure that the connection path is globally optimized, and avoid unnecessary path planning times and map switching operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119022946A_ABST
    Figure CN119022946A_ABST
Patent Text Reader

Abstract

The invention provides a working path planning method, electronic equipment and a storage medium. The method comprises the following steps: acquiring boundary maps corresponding to a plurality of working sub-regions of self-mobile equipment; carrying out merging processing on the boundary maps to obtain an operation map; determining a communication path between any two adjacent operation sub-regions in the operation map based on a preset operation sequence and the operation sub-path corresponding to each operation sub-region; and combining the operation sub-path of each operation sub-region and the communication path between the adjacent operation sub-regions according to the operation sequence to obtain an operation path. By using the method and the device, the path planning effect of the self-moving equipment in a scene that a plurality of operation areas are overlapped can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of self-moving equipment, and in particular to an operation path planning method, electronic equipment and storage medium. Background Art

[0002] With the continuous advancement of science and technology and the rapid development of artificial intelligence, the use of self-moving equipment (such as lawn mowers, cleaning machines, cruise machines, etc.) to perform operations can greatly improve work efficiency.

[0003] In the related art, since different work areas may require different degrees of work, it is necessary to divide different work areas, and this process often involves the overlap of multiple work areas. Most existing path planning methods work well in scenarios with a single work area, but work poorly in scenarios with multiple work areas and overlapping work areas. Summary of the invention

[0004] In view of the above, it is necessary to provide an operation path planning method, an electronic device and a storage medium that can solve the technical problem of poor path planning effect in scenarios where multiple operation areas overlap.

[0005] In a first aspect, an embodiment of the present application provides a method for planning a work path, the method comprising: obtaining boundary maps corresponding to multiple work sub-areas from a mobile device; merging the boundary maps to obtain a work map; based on a preset work sequence and a work sub-path corresponding to each work sub-area, determining a connection path between any two adjacent work sub-areas in the work map; and combining the work sub-path of each work sub-area with the connection path between adjacent work sub-areas according to the work sequence to obtain a work path.

[0006] Furthermore, in the above-mentioned operation path planning method provided in an embodiment of the present application, the boundary map corresponding to multiple operation sub-areas obtained from the mobile device includes: determining multiple boundary contours in response to the operation instruction; based on the multiple boundary contours, determining the boundary map of multiple operation sub-areas corresponding to the self-mobile device, and there are at least two operation sub-areas overlapping among the multiple operation sub-areas.

[0007] Furthermore, in the above-mentioned operation path planning method provided in an embodiment of the present application, the merging processing of the boundary maps to obtain the operation map includes: determining the boundary contour corresponding to the boundary map; determining the map area overlapping the boundary map based on the boundary contour; and merging the map areas to obtain the operation map.

[0008] Furthermore, in the above-mentioned work path planning method provided in the embodiment of the present application, before determining the connecting path between any two adjacent work sub-areas in the work map based on the preset work sequence and the work sub-path corresponding to each work sub-area, the method also includes: determining the work parameters and boundary contours corresponding to each work sub-area; and determining the work sub-path of each work sub-area based on the work parameters and the boundary contour.

[0009] Furthermore, in the above-mentioned operation path planning method provided in the embodiment of the present application, the connection path between any two adjacent operation sub-areas in the operation map is determined based on the preset operation sequence and the operation sub-path corresponding to each operation sub-area, including: selecting any two adjacent operation sub-areas according to the preset operation sequence; determining the first operation starting point and the first operation end point according to the operation sub-path of the previous operation sub-area, and determining the second operation starting point and the second operation end point according to the operation sub-path of the subsequent operation sub-area; taking the first operation end point as the first position, and taking the second operation starting point as the second position, and determining the connection path based on the first position and the second position.

[0010] Furthermore, in the above-mentioned operation path planning method provided in an embodiment of the present application, determining the connecting path based on the first position and the second position includes: based on the operation map, determining the shortest path from the first position to the second position as the connecting path.

[0011] Furthermore, in the above-mentioned operation path planning method provided in the embodiment of the present application, the method also includes: if there is an obstacle in the connecting path, determining an obstacle avoidance path corresponding to the obstacle based on the operation map; and adjusting the connecting path according to the obstacle avoidance path.

[0012] Furthermore, in the above-mentioned work path planning method provided in an embodiment of the present application, after determining the obstacle avoidance path corresponding to the obstacle based on the work map, the method also includes: determining an obstacle avoidance end point corresponding to the obstacle avoidance path; if the obstacle avoidance end point is not in the connecting path, then based on the work map, determining the shortest path from the obstacle avoidance end point to the second position as the adjusted connecting path.

[0013] In a second aspect, an embodiment of the present application provides a work path planning device, the device comprising: a map determination module, used to determine the boundary maps corresponding to multiple work sub-areas of a self-moving device; a merging processing module, used to merge the boundary maps to obtain a work map; a path planning module, used to determine the connecting path between any two adjacent work sub-areas in the work map based on a preset work sequence and the work sub-path corresponding to each work sub-area; a path combination module, used to combine the work sub-path of each work sub-area with the connecting path between adjacent work sub-areas according to the work sequence to obtain a work path.

[0014] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a storage device, a processing device, and a computer program stored on the storage device and executable on the processing device, wherein the processing device implements the operation path planning method as described in any one of the above items when executing the computer program.

[0015] Furthermore, in the above-mentioned electronic device provided in the embodiment of the present application, the electronic device is a self-moving device.

[0016] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor in an electronic device, the operation path planning method as described in any one of the above items is implemented.

[0017] In the operation path planning method of this embodiment, the boundary maps of multiple operation sub-areas are merged to obtain an operation map; then, based on the preset operation sequence and the operation sub-path corresponding to each operation sub-area, the connection path between any two adjacent operation sub-areas is determined in the operation map. By merging multiple operation sub-areas into an operation map, the problem of treating each operation sub-area as an independent map and planning the path in the independent map corresponding to each operation sub-area, which leads to a large number of path planning times, is avoided, thereby improving the efficiency of operation path planning; and by determining the connection path between any two adjacent operation sub-areas in the operation map, the connection path can be globally optimized, thereby improving the accuracy of operation path planning. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a schematic diagram of the operation path planning of the prior art provided in the embodiment of the present application.

[0019] Figure 2 It is a flow chart of the operation path planning method provided in an embodiment of the present application.

[0020] Figure 3 It is a schematic diagram of the operation map provided in the embodiment of the present application.

[0021] Figure 4 It is a flowchart of the boundary map merging method provided in an embodiment of the present application.

[0022] Figure 5 It is a flowchart of the method for determining a job sub-path provided in an embodiment of the present application.

[0023] Figure 6 It is a schematic diagram of the connection path provided in the embodiment of the present application.

[0024] Figure 7 It is a flow chart of the obstacle avoidance path determination method provided in an embodiment of the present application.

[0025] Figure 8 It is a structural schematic diagram of the operation path planning device provided in an embodiment of the present application.

[0026] Fig. 9 It is a schematic diagram of the structure of a self-moving device provided in an embodiment of the present application.

[0027] Fig.10 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0028] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application is described in detail below with reference to the accompanying drawings and specific embodiments.

[0029] It should be noted that in this application, "at least one" means one or more, and "more than one" means two or more than two. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The terms "first", "second", "third", "fourth", etc. (if any) in the specification, claims and drawings of this application are used to distinguish similar objects, rather than to describe a specific order or sequence.

[0030] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0031] With the continuous advancement of science and technology and the rapid development of artificial intelligence, the use of self-moving devices (such as mowers, cleaning machines, cruisers, etc.) to perform operations can greatly improve the work efficiency. In the related art, since different areas may need to perform different degrees of operations, it is necessary to divide different areas. Taking the self-moving device as a mowing robot as an example, the mowing robot will perform different degrees of operations according to the growth of grass in different areas. For example, the grass in the front house is exposed to more sunlight, and the grass grows tall and lush; while the backyard is in the shade, the grass in the backyard is exposed to less sunlight, and the grass grows short and sparse. The mowing robot needs to perform different degrees of operations (for example, mowing height, mowing spacing, mowing machine power, etc.) on the grass in the front house and the backyard. Since the path of the mowing robot is difficult to cover the edge of the area, or the mowing robot may encounter complex terrain such as irregular edges and many obstacles when operating in different areas, the integrity and uniformity of the lawn can be ensured by setting overlapping areas. Therefore, in the process of dividing different operating areas, there is often a situation where the operating areas overlap partially.

[0032] Most existing path planning methods work well in scenarios with a single work area. However, in scenarios with multiple work areas and partial overlap, there are problems such as low efficiency of work path planning and inability to obtain the global shortest path, resulting in poor work path planning results. Figure 1 The figure shows a schematic diagram of the operation path planning of the prior art provided in an embodiment of the present application. Figure 1 There are two areas to be worked in the working area A shown (referred to as "working sub-areas" in the embodiment of the present application), namely working sub-area A1 and working sub-area A2. There is an overlapping area between working sub-area A1 and working sub-area A2. After the mowing robot finishes mowing at position P1 in working sub-area A1, it will enter position P2 in working sub-area A2 to start mowing. In the related art, in order to plan a connecting path across working sub-area A1 and working sub-area A2, two working path plannings are required to obtain a combined connecting path. The planning efficiency of the working path is low, and the connecting path is a local shortest path, not a global shortest path.

[0033] In view of this, it is necessary to provide an operation path planning method, an electronic device and a storage medium, which can improve the path planning effect of a mobile device in a scenario where multiple operation areas partially overlap.

[0034] The operation path planning method provided in the embodiment of the present application can be applied to one or more electronic devices, and the electronic device can be used to control the movement of the self-moving device, for example, the electronic device can be a computer, a tablet, a mobile phone, a server, a cloud server, a personal digital assistant (PDA), a game console, an interactive network television (IPTV), a smart wearable device, etc.; the electronic device can also be a self-moving device, for example, the electronic device can be a lawn mowing robot, a cleaning robot, a deicing robot, a cruise robot, etc. This application does not limit the types of the self-moving device and the electronic device.

[0035] In order to more clearly illustrate the operation path planning method provided by the embodiment of the present application, the present application will describe the technical solution of the present application in detail through specific embodiments below. It should be noted that the following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0036] like Figure 2 , which is a flow chart of a method for operating path planning provided by an embodiment of the present application. According to different requirements, the order of each step in the flow chart can be adjusted according to actual requirements, and some steps can be omitted. The method is applied to electronic equipment.

[0037] S11, obtaining boundary maps corresponding to multiple operation sub-areas from a mobile device.

[0038] In at least one embodiment of the present application, the electronic device can provide a human-computer interaction mode, and the user can input the operation instruction in the electronic device through a keyboard, a mouse, a remote controller, a touch pad, or a voice control device. In other embodiments, the electronic device can also be connected to a user terminal for communication, and the user terminal includes but is not limited to any electronic product that can perform human-computer interaction with the user through a keyboard, a mouse, a remote controller, a touch pad, or a voice control device, such as a personal computer, a tablet computer, a smart phone, a digital camera, etc. The user terminal can also be a control device, such as a remote controller. The user can send the operation instruction to the electronic device through the user terminal.

[0039] In some embodiments, the operation instruction is used to instruct the electronic device to plan the operation path. When the electronic device is used to control the movement of the self-moving device, the electronic device is connected to the self-moving device in communication, and the electronic device sends the planned operation path to the self-moving device, and the self-moving device performs the operation of the corresponding operation type according to the operation path; when the electronic device is a self-moving device, the self-moving device performs the operation of the corresponding operation type according to the planned operation path. The operation type can be determined according to the device type of the self-moving device. For example, when the self-moving device is a lawn mowing robot, the operation type is a lawn mowing operation; when the self-moving device is a cleaning robot, the operation type is a cleaning operation; when the self-moving device is a deicing robot, the operation type is a deicing operation, and there is no limitation here.

[0040] In some embodiments, the operation instruction may include multiple operation sub-areas of the self-moving device and corresponding operation parameters. Among them, the operation sub-area may represent the area where the self-moving device is to be operated, and the shape of the operation sub-area may be a regular shape (e.g., a rectangle, a circle) or an irregular shape, which is not limited here. In some embodiments, the operation parameters of at least two of the multiple operation sub-areas are different, and the operation degrees corresponding to different operation parameters are different. The operation parameters may include, but are not limited to, operation parameters such as operation height, operation spacing, operation angle, and operation power. Taking the self-moving device as a lawn mowing robot as an example, the operation parameters may include operation parameters such as mowing height, mowing spacing, route mode (e.g., single bow and double bow), moving angle, and lawn mower power. In response to the operation instruction, the self-moving device may determine the operation sub-area and perform work in each operation sub-area according to the operation parameters.

[0041] S12, merging the boundary maps to obtain an operation map.

[0042] In at least one embodiment of the present application, at least two of the multiple operation sub-areas overlap, and the overlapping map areas of the multiple operation sub-areas are merged to obtain an operation map.

[0043] For example, Figure 3 The figure is a schematic diagram of the operation map provided by the embodiment of the present application. Following the above embodiment, there are operation sub-area A1 and operation sub-area A2, and there is an overlapping area between operation sub-area A1 and operation sub-area A2. The overlapping map areas in operation sub-area A1 and operation sub-area A2 are merged to obtain an operation map.

[0044] S13, based on the preset operation sequence and the operation sub-path corresponding to each operation sub-area, determining a connection path between any two adjacent operation sub-areas in the operation map.

[0045] In at least one embodiment of the present application, each working sub-area has a corresponding working sub-path, and the working sub-path can be determined based on the working parameters and boundary contours of the working sub-area. For example, the working height, working distance, working angle, working power and other working parameters of the working sub-area can be determined based on the working parameters. In this way, the self-mobile equipment can plan the working sub-path of each working sub-area based on the working parameters such as working height, working distance, working angle, working power and the boundary contours of the working sub-area.

[0046] In some embodiments, there is a pre-set operation sequence between multiple operation sub-areas. Any two adjacent operation sub-areas can be determined based on the operation sequence. In order to realize cross-area operation, the self-moving device needs to plan the connection path between any two operation sub-areas based on the operation sub-paths of the adjacent operation sub-areas. Continuing from the above embodiment, there are operation sub-area A1 and operation sub-area A2, wherein the operation sequence of operation sub-area A1 comes first, and the operation sequence of operation sub-area A2 comes later, that is, after the mowing robot finishes mowing in operation sub-area A1, it needs to reach operation sub-area A2 to mow the grass. In this way, it is necessary to plan the connection path from operation sub-area A1 to operation sub-area A2.

[0047] S14, combining the operation sub-path of each operation sub-area with the connection paths between adjacent operation sub-areas according to the operation sequence to obtain an operation path.

[0048] In at least one embodiment of the present application, a work sub-path of a work sub-area with an earlier work sequence is determined, recorded as work sub-path R1, a work sub-path of a work sub-area with a later work sequence is determined, recorded as work sub-path R2, and a connection path between the above two work sub-paths is determined, recorded as connection path R3. The above paths are combined in the order of work sub-path R1, connection path R3, and work sub-path R2 to obtain a work path. According to the work path, the self-mobile device can first perform work on the work sub-area with an earlier work sequence, and reach the work sub-area with a later work sequence through the connection path, and perform work on the work sub-area with a later work sequence.

[0049] In the operation path planning method of the present embodiment, the boundary maps of multiple operation sub-areas are merged to obtain an operation map; then, based on the preset operation sequence and the operation sub-path corresponding to each operation sub-area, the connection path between any two adjacent operation sub-areas is determined in the operation map. By merging multiple operation sub-areas into an operation map, the problem of treating each operation sub-area as an independent map and planning the path in the independent map corresponding to each operation sub-area, which leads to a large number of path planning times, is avoided, thereby improving the efficiency of operation path planning; and by determining the connection path between any two adjacent operation sub-areas in the operation map, the connection path can be globally optimized, thereby improving the accuracy of operation path planning. In addition, the embodiment of the present application merges multiple operation sub-areas into an operation map, realizes operation path planning through one map switching and map generation, avoids redundant map switching and map generation operations, and improves the efficiency of operation path planning.

[0050] In at least one embodiment of the present application, the multiple operating sub-areas and corresponding boundary maps obtained from the mobile device include: determining multiple boundary contours in response to the operating instruction; determining the boundary maps of the multiple operating sub-areas corresponding to the mobile device based on the multiple boundary contours, and at least two of the multiple operating sub-areas overlap. In some embodiments, the operating sub-areas can be drawn by the user according to actual needs. For example, the user obtains the overall boundary map of the operating area in a preset application, and then draws multiple boundary contours in the overall boundary map, and each boundary contour is used as an operating sub-area, so that multiple operating sub-areas and their corresponding boundary maps can be obtained. Among them, the overall boundary map of the operating area can be a global positioning system (GPS) map, which can include a two-dimensional or three-dimensional scene map. In actual applications, there is no restriction on the form of the overall boundary map of the operating area. In addition, considering that the travel path of the self-mobile device is difficult to cover the edge of the operating area, or when the self-mobile device operates in different areas, it may encounter complex terrain such as irregular area edges and many obstacles. In order to ensure the operating effect, at least two of the multiple operating sub-areas overlap. Please continue to refer to Figure 1In the overall boundary map of the operation area A, two operation sub-areas are drawn, namely the operation sub-area A1 and the operation sub-area A2, and there is an overlap between the operation sub-area A1 and the operation sub-area A2. In some embodiments, the shape of the operation sub-area can be set according to actual needs. The embodiment of the present application takes the shape of the operation sub-area A1 as an ellipse and the shape of the operation sub-area A2 as an irregular shape as an example for explanation. The positional relationship between the operation sub-area A1 and the operation sub-area A2 can be determined according to actual operation needs, and is not limited here. The embodiment of the present application determines the boundary maps of multiple operation sub-areas in response to the operation instruction, so that the operation of the self-equipped device can meet the user's needs.

[0051] like Figure 4 As shown, it is a flow chart of the boundary map merging method provided by the embodiment of the present application, and the boundary map merging method is applied to a mobile device. Figure 4 As shown, the following steps are included:

[0052] S21, determining a boundary contour corresponding to the boundary map.

[0053] In at least one embodiment of the present application, the area information contained in the boundary map includes, but is not limited to, the boundary contour of the operating sub-area, the terrain of the operating sub-area, obstacles, vegetation density and other information. By parsing the boundary map, the boundary contour corresponding to the boundary map can be determined. The boundary contour refers to the outer limit of the operating sub-area, and the boundary contour can be a collection of multiple coordinate points. By parsing the boundary contour, information such as the perimeter and shape of the operating sub-area can be determined.

[0054] S22: Determine a map area where the boundary map overlaps based on the boundary contour.

[0055] In at least one embodiment of the present application, at least two of the multiple working sub-areas partially overlap. If the boundary contour of one working sub-area intersects with the boundary contour of another working sub-area, it is determined that the two working sub-areas partially overlap, and the area formed by the intersecting boundary contours is used as the map area of ​​the boundary map overlap.

[0056] S23, merging the map areas to obtain the operation map.

[0057] In at least one embodiment of the present application, merging the map areas to obtain the work map may include: deleting the contour lines of the overlapping parts of the two work sub-areas through a visual processing algorithm (such as OpenCV, etc.) to obtain a merged boundary contour, and using the boundary map corresponding to the merged boundary contour as the work map.

[0058] In the above-mentioned operation path planning method provided in the embodiment of the present application, the efficiency of operation map construction can be improved by determining the boundary contour corresponding to the boundary map, determining the overlapping map area of ​​the boundary map based on the boundary contour, and merging the overlapping map areas.

[0059] In at least one embodiment of the present application, a minimum blank map including multiple operating sub-areas can be constructed based on the location information of multiple operating sub-areas, and the merging process of multiple operating sub-areas can be implemented on the blank map.

[0060] In some embodiments, taking the coordinates of the operation sub-area in the world coordinate system as an example, the horizontal coordinate in the location information of each operation sub-area is determined to obtain multiple horizontal coordinates, and the maximum and minimum values ​​of the horizontal coordinates are determined from the multiple horizontal coordinates, and the difference between the maximum and minimum values ​​of the horizontal coordinates is used as the map length. Taking the coordinates of the operation sub-area in the world coordinate system as an example, the vertical coordinate in the location information of each operation sub-area is determined to obtain multiple vertical coordinates, and the maximum and minimum values ​​of the vertical coordinates are determined from the multiple vertical coordinates, and the difference between the maximum and minimum values ​​of the vertical coordinates is used as the map width. According to the map length and the map width, a blank map with a regular shape and an area greater than or equal to the map length * map width can be constructed. Among them, the location information can be obtained by global positioning system (Global Positioning System, GPS) positioning, Beidou system positioning, real-time kinematic (Real-time kinematic, RTK) positioning, or multi-sensor fusion positioning, which is not limited in this application.

[0061] In some embodiments, boundary maps corresponding to multiple operating sub-areas from a mobile device are mapped onto the blank map, and merging processing is implemented on the blank map.

[0062] In the above-mentioned work path planning method provided in the embodiment of the present application, a blank map is constructed according to the horizontal coordinate in the location information of each work sub-area and according to the vertical coordinate in the location information of each work sub-area, which can ensure that the boundary contours of multiple work sub-areas can be mapped to the blank map, thereby ensuring the accuracy and completeness of map construction, thereby improving the accuracy of work path planning.

[0063] In at least one embodiment of the present application, before the electronic device determines the connection path between any two adjacent operation sub-areas in the operation map, it needs to determine the operation sub-path of each operation sub-area. Figure 5 As shown, it is a flow chart of the method for determining the operation sub-path provided by the embodiment of the present application, and the method for determining the operation sub-path is applied to the self-moving device. Figure 5 As shown, the following steps are included:

[0064] S31, determining the operation parameters and boundary contours corresponding to each operation sub-area.

[0065] In at least one embodiment of the present application, the operating parameters may include, but are not limited to, operating parameters such as operating height, operating spacing, operating angle, operating power, etc. Taking the self-moving device as a mowing robot as an example, the operating parameters may include operating parameters such as mowing height, mowing spacing, route mode (e.g., single bow and double bow), moving angle, and mowing machine power.

[0066] S32: Determine the operation sub-path of each operation sub-area according to the operation parameters and the boundary contour.

[0067] In at least one embodiment of the present application, a path planning algorithm is provided in the electronic device, and the path planning algorithm may include machine learning algorithms such as convolutional neural networks, positioning algorithms, and navigation algorithms, etc., which are not limited here. In one embodiment, based on the path planning algorithm, according to operating parameters such as operating height, operating spacing, operating power, and the boundary contour corresponding to the operating sub-area, the operating sub-path of each operating sub-area can be obtained. Among them, the operating sub-path can have a corresponding direction and shape. For example, the operating sub-path can be a bow-shaped path, a U-shaped path, etc., which are not limited here.

[0068] Taking the self-moving device as a mowing robot as an example, when the mowing robot performs path planning for the working sub-area to obtain the working sub-path, it mainly considers working parameters such as mowing height, mowing spacing, route mode (for example, single bow and double bow), moving angle and mower power, so as to ensure efficient and comprehensive lawn coverage, or obtain a lawn with a specified shape, for example, a bow-shaped or U-shaped lawn. In some embodiments, the mowing robot is provided with a path planning algorithm, and the path planning algorithm may include but is not limited to machine learning algorithms such as convolutional neural networks, positioning algorithms and navigation algorithms. Based on the path planning algorithm, the mowing robot plans the working sub-path of each working sub-area according to the working parameters such as mowing height, mowing spacing, route mode (for example, single bow and double bow), moving angle and mower power, and the boundary contour corresponding to the working sub-area.

[0069] In the above-mentioned work path planning method provided in the embodiment of the present application, the work sub-path corresponding to the work parameters and boundary contour planning corresponding to each work sub-area can improve the accuracy of work sub-path planning, and then improve the accuracy of determining the connecting path between adjacent work sub-areas, thereby improving the accuracy of the work path corresponding to the work area.

[0070] In at least one embodiment of the present application, the determination of the connection path between any two adjacent operation sub-areas in the operation map based on the preset operation sequence and the operation sub-path corresponding to each operation sub-area includes: selecting any two adjacent operation sub-areas according to the preset operation sequence; determining the first operation starting point and the first operation end point according to the operation sub-path of the previous operation sub-area, and determining the second operation starting point and the second operation end point according to the operation sub-path of the subsequent operation sub-area; taking the first operation end point as the first position, and taking the second operation starting point as the second position, and determining the connection path based on the first position and the second position. Wherein, the preset operation sequence can be the sequence of each operation sub-area set in advance. The first operation starting point refers to the operation start position of the self-mobile device in the previous operation sub-area, and the first operation end point refers to the operation end position of the self-mobile device in the previous operation sub-area. The second operation starting point refers to the operation start position of the self-mobile device in the subsequent operation sub-area, and the second operation end point refers to the operation end position of the self-mobile device in the subsequent operation sub-area. If the self-moving device is to be moved from the previous operation sub-area to the next operation sub-area, it needs to be moved from the operation end position of the previous operation sub-area (i.e., the first operation end point) to the operation start position of the next operation sub-area (i.e., the second operation start point). Based on this, the first operation end point is used as the first position of the connection path, and the second operation start point is used as the second position of the connection path.

[0071] In some embodiments, generating a connection path connecting the operation end point and the operation start point according to the operation map includes: determining the shortest path from the first position to the second position as the connection path based on the operation map. Since a straight line path is the shortest path between two points, the self-mobile device can determine the straight line path from the first position to the second position in the operation map as the connection path.

[0072] For example, Figure 6 , which is a schematic diagram of a connection path provided by an embodiment of the present application. The operation map includes the boundary contours of the operation sub-area A1 and the boundary contours of the operation sub-area A2 after merging, wherein the operation sequence of the operation sub-area A1 is first, and the operation sequence of the operation sub-area A2 is later, the first operation end point (i.e., the first position) of the operation sub-area A1 is recorded as P1, and the second operation starting point (i.e., the second position) of the operation sub-area A2 is recorded as P2, and the straight line path from P1 to P2 is determined as the connection path between the operation sub-area A1 and the operation sub-area A2.

[0073] In the above-mentioned operation path planning method provided in the embodiment of the present application, the first position and the second position are determined according to the operation sub-paths of adjacent operation sub-areas, and the straight line path from the first position to the second position is determined as a connected path, so that the connected path achieves the shortest global distance. In addition, the embodiment of the present application obtains the connected path through one-time path planning, avoids multiple planning of the operation path, and improves the planning efficiency of the operation path.

[0074] In at least one embodiment of the present application, a self-moving device may encounter obstacles (e.g., birds, animals, people, cars, stones, wood, etc.) when performing cross-region operations based on a connected path. If there are obstacles in the connected path, an obstacle avoidance path can be generated for obstacle avoidance. Figure 7 1 is a flow chart of the obstacle avoidance path determination method provided in the embodiment of the present application, and the obstacle avoidance path determination method is applied to a self-moving device. Figure 7 As shown, the following steps are included:

[0075] S41: If there is an obstacle in the communication path, determine an obstacle avoidance path corresponding to the obstacle based on the operation map.

[0076] In at least one embodiment of the present application, a preset sensor is provided on the self-mobile device for detecting whether there are obstacles in the current operation path. The preset sensor can be set according to actual needs. For example, the preset sensor can include but is not limited to a collision sensor, a depth sensor, an ultrasonic sensor, and an infrared sensor. Exemplarily, the preset sensor can collect detection data in the current operation path once in real time or according to a preset time interval. By analyzing the detection data, it can be determined whether there are obstacles in the connected path. Among them, the data type of the detection data can be determined by the type of the preset sensor. For example, the detection data collected by the collision sensor is impact data, the detection data collected by the depth sensor is depth data, the detection data collected by the ultrasonic sensor is ultrasonic data, and the detection data collected by the infrared sensor is infrared data.

[0077] In some embodiments, if there is no obstacle in the communication path, the communication path is not adjusted, and the self-moving device implements cross-zone operation according to the communication path; if there is an obstacle in the communication path, an obstacle avoidance path is generated. In some embodiments, the determination of the obstacle avoidance path corresponding to the obstacle may include: determining the characteristic information corresponding to the obstacle; based on the operation map, generating the obstacle avoidance path according to the characteristic information. Among them, the characteristic information corresponding to the obstacle may include the shape, contour, position and other information of the obstacle. By determining the characteristic information of the obstacle and generating the obstacle avoidance path according to the characteristic information, the self-moving device can completely bypass the obstacle, improve the accuracy of the obstacle avoidance path determination, and ensure the operation safety of the self-moving device. In one embodiment, the obstacle avoidance path can be a broken line composed of three line segments, so that the self-moving device can operate according to the broken line to bypass the obstacle; in other embodiments, the obstacle avoidance path can also be an arc, so that the self-moving device can operate according to the arc to bypass the obstacle. The shape of the obstacle avoidance path can be set according to actual needs and is not limited here.

[0078] S42: Adjust the connection path according to the obstacle avoidance path.

[0079] In at least one embodiment of the present application, the obstacle avoidance path includes an obstacle avoidance start point and an obstacle avoidance end point. Since the self-moving device encounters an obstacle during the movement of the connected path, the obstacle avoidance start point is generally on the connected path, and the obstacle avoidance end point can be set according to actual operation requirements. In one embodiment, the obstacle avoidance start point and the obstacle avoidance end point of the obstacle avoidance path can both be located in the connected path, so that the self-moving device can continue to operate along the connected path after avoiding the obstacle. In other embodiments, the obstacle avoidance end point of the obstacle avoidance path is not in the connected path. After the self-moving device bypasses the obstacle according to the obstacle avoidance path, the connected path needs to be replanned according to the obstacle avoidance end point of the obstacle avoidance path and the second position. Based on this, the method also includes: if the obstacle avoidance end point is not in the connected path, then based on the operation map, the shortest path from the obstacle avoidance end point to the second position is determined as the adjusted connected path. Exemplarily, a straight line from the obstacle avoidance end point of the obstacle avoidance path to the second position is replanned in the operation map as the adjusted connected path.

[0080] In the above-mentioned operation path planning method provided in the embodiment of the present application, when there is an obstacle in the connected path, an obstacle avoidance path is generated in the operation map based on the characteristic information of the obstacle, which can improve the planning efficiency and accuracy of the obstacle avoidance path; in addition, the embodiment of the present application performs obstacle avoidance path planning based on the operation map obtained by merging multiple operation sub-areas, which can avoid the problem of clearing historically detected obstacles each time the map is switched or the map is generated when each operation sub-area is used as an independent map for obstacle avoidance path planning, thereby improving the operation safety of the self-moving equipment.

[0081] See also Figure 8 , Figure 8 2 is a schematic diagram of the structure of the operation path planning device provided in an embodiment of the present application. In some embodiments, the operation path planning device 20 may include a plurality of functional modules composed of computer program segments. The computer program of each program segment in the operation path planning device 20 may be stored in a storage device of an electronic device and executed by at least one processing device to execute (see Figure 2 Description) Function of operation path planning.

[0082] In this embodiment, the operation path planning device 20 can be divided into multiple functional modules according to the functions it performs. The functional modules may include: a map determination module 201, a merging processing module 202, a path planning module 203, and a path combination module 204. The module referred to in this application refers to a series of computer program segments that can be executed by at least one processing device and can complete fixed functions, which are stored in a storage device. In this embodiment, the functions of each module will be described in detail in subsequent embodiments.

[0083] The map determination module 201 may be used to determine boundary maps corresponding to a plurality of operation sub-areas of the mobile device.

[0084] The merging processing module 202 can be used to merge the boundary maps to obtain a work map.

[0085] The path planning module 203 may be used to determine a connection path between any two adjacent operation sub-areas in the operation map based on a preset operation sequence and an operation sub-path corresponding to each operation sub-area.

[0086] The path combination module 204 may be used to combine the operation sub-path of each operation sub-area with the connection paths between adjacent operation sub-areas according to the operation sequence to obtain an operation path.

[0087] It can be understood that the operation path planning device 20 and the operation path planning method of the above-mentioned embodiment belong to the same inventive concept, and the specific implementation method of each module in the operation path planning device 20 corresponds to the various steps of the operation path planning method in the above-mentioned embodiment, which will not be repeated in this application.

[0088] The module division described above is a logical function division, and there may be other division methods in actual implementation. In addition, the functional modules in each embodiment of the present application may be integrated in the same processing unit, or each module may exist physically separately, or two or more modules may be integrated in the same unit. The above-mentioned integrated modules may be implemented in the form of hardware or in the form of hardware plus software functional modules.

[0089] like Fig. 9 , which is a schematic diagram of the structure of a self-moving device provided in an embodiment of the present application. Fig. 9 In the embodiment, when the electronic device is a self-moving device, the self-moving device 1 includes a body, and a memory 11, a processor 12, a power supply 13, a sensor 14, an operating mechanism 15, a communication module 16, a positioning module 17, a driving wheel 18 and a bus 19 arranged on the body. The processor 12 is coupled to the memory 11, the power supply 13, the sensor 14, the operating mechanism 15, the communication module 16, the positioning module 17, and the driving wheel 18 through the bus 19.

[0090] The memory 11 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM). The random access memory can be directly read and written by the processor 12, and can be used to store executable programs (such as machine instructions) of the operating system or other running programs, and can also be used to store user and application data. The random access memory may include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), etc.

[0091] The non-volatile memory may also store executable programs and user and application data, etc., and may be loaded into the random access memory in advance for direct reading and writing by the processor 12. The non-volatile memory may include a disk storage device and a flash memory.

[0092] The memory 11 is used to store one or more computer programs. The one or more computer programs are configured to be executed by the processor 12. The one or more computer programs include a plurality of instructions, and when the plurality of instructions are executed by the processor 103, the operation path planning method executed on the mobile device 1 can be implemented.

[0093] In other embodiments, the self-mobile device 1 further includes an external memory interface for connecting to an external memory to expand the storage capacity of the self-mobile device 1 .

[0094] The processor 12 may include one or more processing units, for example, the processor 12 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0095] The processor 12 provides computing and control capabilities. For example, the processor 12 is used to execute a computer program stored in the memory 11 to implement the above-mentioned operation path planning method.

[0096] The power source 13 is used to power the self-moving device. In one embodiment of the present application, the power source 13 may include any one or more power supply devices such as a battery, a fuel generator, a solar power generation module, a wind power generation module, etc.

[0097] The sensor 14 is used to obtain information for the mobile device 1, such as obtaining environmental information and movement information of the mobile device 1. In an embodiment of the present application, the sensor 14 may include one or more sensors such as a laser radar, a camera, an infrared sensor, and an encoder.

[0098] The operating mechanism 15 is used to perform corresponding operating tasks, such as mowing, deicing, cruising, cleaning, and spraying pesticides. In some embodiments of the present application, the operating mechanism 15 may include a motor, a transmission mechanism, a cutter disc, and other mechanisms. When the self-moving device is a lawn mower, the motor can drive the cutter disc to rotate through the transmission mechanism to achieve the mowing function. The motor can also control the movement of the blade to adjust the mowing height and mowing area.

[0099] The communication module 16 is used to realize communication between the mobile device and other devices. In one embodiment of the present application, the communication module 16 can exchange data with other devices based on wired communication and / or wireless communication. The above-mentioned wireless communication can include one or more combinations of communication modes such as Bluetooth communication, Wi-Fi communication, and Near Field Communication (NFC).

[0100] The positioning module 17 is used to determine the position of the mobile device. In some embodiments of the present application, the positioning module 17 may include one or more positioning modules of the type of global positioning system (GPS), inertial navigation system, real-time kinematic (RTK) carrier phase differential system, etc.

[0101] The driving wheel 18 is used to realize the movement of the self-moving device. In some embodiments of the present application, the driving wheel 18 can realize the movement function of the self-moving device according to the control of the processor 12. In some embodiments of the present application, the driving wheel 18 may include a left driving wheel and a right driving wheel.

[0102] The bus 19 is at least used to provide a channel for mutual communication among the memory 11 , the processor 12 , the power supply 13 , the sensor 14 , the operating mechanism 15 , the communication module 16 , the positioning module 17 , and the driving wheel 18 in the mobile device 1 .

[0103] In other embodiments of the present application, the self-moving device 1 may further include an anti-collision part and a steering assembly, etc. The anti-collision part may be used to prevent the driving wheel 18 from colliding with an obstacle in front of the self-moving device. The steering assembly may be used to enable the driving wheel 18 to adjust the driving direction.

[0104] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the self-moving device 1. In other embodiments of the present application, the self-moving device 1 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0105] like Fig.10 , which is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Fig.10 In the embodiment, when the electronic device is a device for controlling movement of a mobile device, the electronic device 2 may include a communication module 21, a storage device 22, a processing device 23, an input / output (I / O) interface 24, and a bus 25. The processing device 23 is coupled to the communication module 21, the storage device 22, and the input / output interface 24 through the bus 25.

[0106] The communication module 21 may include a wired communication module and / or a wireless communication module. The wired communication module may provide one or more wired communication solutions such as universal serial bus (USB), controller area network bus (CAN, Controller Area Network). The wireless communication module may provide one or more wireless communication solutions such as wireless fidelity (wireless fidelity, Wi-Fi), Bluetooth (Bluetooth, BT), mobile communication network, frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR), etc.

[0107] The storage device 22 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM). The random access memory can be directly read and written by the processing device 23, and can be used to store executable programs (such as machine instructions) of other running programs, and can also be used to store user and application data. The random access memory may include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), etc.

[0108] The non-volatile memory may also store executable programs and user and application data, etc., and may be pre-loaded into the random access memory for direct reading and writing by the processing device 23. The non-volatile memory may include a disk storage device and a flash memory.

[0109] The storage device 22 is used to store one or more computer programs. The one or more computer programs are configured to be executed by the processing device 23. The one or more computer programs include multiple instructions, and when the multiple instructions are executed by the processing device 23, the operation path planning method executed on the electronic device 2 can be implemented.

[0110] In other embodiments, Fig.10 The electronic device 2 shown also includes an external memory interface for connecting to an external memory to expand the storage capacity of the electronic device 2 .

[0111] The processing device 23 may include one or more processing units, for example, the processing device 23 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0112] The processing device 23 provides computing and control capabilities. For example, the processing device 23 is used to execute a computer program stored in the storage device 22 to implement the above-mentioned operation path planning method.

[0113] The input / output interface 24 is used to provide a channel for user input or output. For example, the input / output interface 24 can be used to connect various input and output devices, such as a mouse, keyboard, touch device, display screen, etc., so that the user can enter information or visualize information.

[0114] The bus 25 is at least used to provide a channel for mutual communication among the communication module 21 , the storage device 22 , the processing device 23 , and the input / output interface 24 in the electronic device 2 .

[0115] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 2. In other embodiments of the present application, the electronic device 2 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0116] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. The computer program includes program instructions. The method implemented when the program instructions are executed can refer to the methods in the above-mentioned embodiments of the present application.

[0117] The computer-readable storage medium may be an internal memory of the mobile device or electronic device described in the above embodiments, for example, a hard disk or memory of the mobile device or electronic device. The computer-readable storage medium may also be an external storage device of the mobile device or electronic device, for example, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (FlashCard), etc., equipped on the mobile device or electronic device.

[0118] In some embodiments, the computer-readable storage medium may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function, etc.; the data storage area may store data created based on the use of the mobile device or electronic device, etc.

[0119] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0120] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0121] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for planning an operation path, characterized in that: The method comprises: Obtain boundary maps corresponding to a plurality of operation sub-areas from a mobile device; Merging the boundary maps to obtain an operation map; Based on a preset operation sequence and an operation sub-path corresponding to each operation sub-area, determining a connection path between any two adjacent operation sub-areas in the operation map; The operation sub-path of each operation sub-area is combined with the connecting path between adjacent operation sub-areas according to the operation sequence to obtain an operation path.

2. The operation path planning method according to claim 1, characterized in that: The boundary maps corresponding to the multiple operation sub-areas obtained from the mobile device include: In response to the operation instruction, a plurality of boundary contours are acquired; Based on the multiple boundary contours, the boundary map of the multiple operating sub-areas corresponding to the self-moving device is determined, and at least two of the multiple operating sub-areas overlap.

3. The operation path planning method according to claim 1, characterized in that: The merging process of the boundary maps to obtain the operation map includes: Determining a boundary contour corresponding to the boundary map; Determining a map area where the border map overlaps based on the border contour; The map areas are merged to obtain the operation map.

4. The operation path planning method according to claim 1, characterized in that: Before determining a connection path between any two adjacent operation sub-areas in the operation map based on the preset operation sequence and the operation sub-path corresponding to each operation sub-area, the method further includes: Determine the operation parameters and boundary contours corresponding to each operation sub-area; An operation sub-path of each operation sub-area is determined according to the operation parameters and the boundary contour.

5. The operation path planning method according to claim 1, characterized in that: The determining of a connection path between any two adjacent operation sub-areas in the operation map based on a preset operation sequence and an operation sub-path corresponding to each operation sub-area includes: According to the preset operation sequence, any two adjacent operation sub-areas are selected; Determine a first operation starting point and a first operation end point according to the operation sub-path of the previous operation sub-area, and determine a second operation starting point and a second operation end point according to the operation sub-path of the subsequent operation sub-area; The first operation end point is taken as a first position, and the second operation start point is taken as a second position, and the communication path is determined based on the first position and the second position.

6. The operation path planning method according to claim 5, characterized in that: The determining the communication path based on the first position and the second position includes: Based on the work map, the shortest path from the first position to the second position is determined as the connection path.

7. The operation path planning method according to claim 6, characterized in that: The method further comprises: If there is an obstacle in the connected path, determining an obstacle avoidance path corresponding to the obstacle based on the operation map; The communication path is adjusted according to the obstacle avoidance path.

8. The operation path planning method according to claim 7, characterized in that: After determining the obstacle avoidance path corresponding to the obstacle based on the operation map, the method further includes: Determining an obstacle avoidance endpoint corresponding to the obstacle avoidance path; If the obstacle avoidance endpoint is not in the connected path, the shortest path from the obstacle avoidance endpoint to the second position is determined as the adjusted connected path based on the operation map.

9. An electronic device, characterized in that: The electronic device comprises: a storage device, a processing device and a computer program stored on the storage device and executable on the processing device, and the processing device implements the operation path planning method as described in any one of claims 1 to 8 when executing the computer program.

10. The electronic device according to claim 9, characterized in that: The electronic device is a self-moving device.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor in an electronic device, the computer program implements the operation path planning method as described in any one of claims 1 to 8.

Citation Information

Cited By

  • Path planning method and apparatus, and electronic device and storage medium

    WO2026113503A1

  • Map construction method and apparatus for multiple areas

    WO2026124116A1