Obstacle representation method, device, electronic device and readable storage medium

By projecting the point cloud of obstacles vertically onto the ground and building columnar objects, the problem of incomplete obstacle information is solved to ensure the operational effect of automation equipment.

CN112597946BActive Publication Date: 2024-12-03GUANGZHOU XAIRCRAFT TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202011599302.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-12-29
Publication Date
2024-12-03
Estimated Expiration
2040-12-29

AI Technical Summary

Technical Problem

During the automated operation of automation equipment, the lack of the bottom part of the point cloud of the obstacle causes incomplete information of the obstacle, affecting the effect of obstacle avoidance operations.

Method used

By projecting the point cloud of target obstacles vertically to the ground, columnar objects are constructed based on projected point clouds and target heights to ensure the integrity of the bottom information of the obstacle.

Benefits of technology

Even if some bottom information is missing in the point cloud, a complete bottom of the obstacle is constructed by projecting the point cloud and target height, providing accurate obstacle information to ensure the normal operation of the automation equipment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112597946B_ABST
    Figure CN112597946B_ABST
Patent Text Reader

Abstract

The embodiments of the present application provide an obstacle representation method, device, electronic device and readable storage medium, which relate to the field of computer technology. The method includes: calculating the distance from each point cloud to the ground based on the position information of each point cloud in the obtained point cloud set of the target obstacle, the preset projection equation corresponding to the target obstacle and the ground equation of the ground, and determining the target height based on the distance; vertically projecting the point cloud set to the ground to obtain the projection point cloud set of the target obstacle; constructing a columnar object for representing the target obstacle based on the projection point cloud set and the target height. In this way, even if the point cloud at the bottom of the target obstacle is missing in the obtained point cloud set of the target obstacle, the bottom of the columnar object constructed to represent the target obstacle can still be complete and not missing, so that the bottom information of the target obstacle can be accurately obtained through the columnar object, so that the automation equipment can perform automated operations.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an obstacle representation method, device, electronic device and readable storage medium. Background Art

[0002] With the advancement of intelligent life, industry, and agriculture, more and more automated equipment (such as unmanned vehicles) are operating in daily life, factory warehouses, agricultural scenes, etc. In the process of automated operation of automated equipment, obstacle information needs to be obtained in order to perform operations such as obstacle avoidance. At present, the point cloud of the obstacle is generally obtained through detection, and then the obtained point cloud is directly constructed into an obstacle. In other words, the constructed obstacle only includes the obtained point cloud, and then the obstacle information is obtained. However, if the bottom of the obstacle is blocked or affected by other factors, causing part of the point cloud at the bottom of the obstacle to be missing in the obtained point cloud, the bottom of the constructed obstacle will be missing and incomplete, which will cause the bottom information in the obtained obstacle information to be missing, which is not conducive to operations such as obstacle avoidance. Summary of the invention

[0003] The purpose of the present application is to provide an obstacle representation method, device, electronic device and readable storage medium, which can construct an obstacle with a complete bottom based on a point cloud set of the obstacle, thereby avoiding affecting the automated operation of the automated equipment due to the missing bottom of the constructed obstacle.

[0004] In order to achieve the above purpose, the technical solution adopted in the embodiment of the present application is as follows:

[0005] In a first aspect, an embodiment of the present application provides an obstacle representation method, the method comprising:

[0006] According to the position information of each point cloud in the point cloud set of the target obstacle, the preset projection equation corresponding to the target obstacle and the ground equation of the ground, the distance from each point cloud to the ground is calculated, and the target height is determined according to the distance;

[0007] Vertically projecting the point cloud set onto the ground to obtain a projected point cloud set of the target obstacle;

[0008] A columnar object for representing the target obstacle is constructed according to the projection point cloud set and the target height.

[0009] In an optional implementation, constructing a columnar object for representing the target obstacle according to the projection point cloud set and the target height includes:

[0010] Performing polygon boundary search on the projection point cloud set to obtain polygon boundary;

[0011] A polygonal columnar object is constructed according to the polygonal boundary and the target height.

[0012] In an optional implementation, performing a polygon boundary search on the projected point cloud set to obtain a polygon boundary includes:

[0013] Performing thinning processing on the projection point cloud set to obtain a thinned projection point cloud set;

[0014] A polygon boundary search is performed on the thinned projection point cloud set to obtain the polygon boundary.

[0015] In an optional implementation, determining the target height according to the distance includes:

[0016] By comparing the distances from each point cloud to the ground, a maximum distance among the distances from each point cloud to the ground is obtained, and the maximum distance is used as the target height.

[0017] In an optional implementation, the vertically projecting the point cloud set onto the ground to obtain the projected point cloud set of the target obstacle includes:

[0018] According to the position information of each point cloud of the target obstacle, the preset projection equation corresponding to the target obstacle and the ground equation of the ground, the position information of the projection point cloud corresponding to each point cloud of the target obstacle is calculated to obtain the projection point cloud set.

[0019] In an optional embodiment, the ground equation is:

[0020] Ax+By+Cz+D=0

[0021] Among them, A, B, C and D are all pre-set parameters;

[0022] The preset projection equation is:

[0023] Among them, (x i ,y i ,z i ) represents the position information of the point cloud in the point cloud set, (x, y, z) represents the position information of the point cloud in the point cloud set after projection, and t represents the distance from the point cloud in the point cloud set to the ground;

[0024] According to the ground equation and the preset projection equation, we can obtain:

[0025] In an optional implementation, after constructing a columnar object for representing the target obstacle according to the projection point cloud set and the target height, the method further includes:

[0026] According to the columnar object, the automated equipment is controlled to move.

[0027] In a second aspect, an embodiment of the present application provides an obstacle display device, the device comprising:

[0028] A height determination module, configured to calculate the distance from each point cloud to the ground based on the position information of each point cloud in the point cloud set of the target obstacle, the preset projection equation corresponding to the target obstacle and the ground equation of the ground, and determine the target height based on the distance;

[0029] A projection module, used for vertically projecting the point cloud set onto the ground to obtain a projection point cloud set of the target obstacle;

[0030] A processing module is used to construct a columnar object representing the target obstacle according to the projection point cloud set and the target height.

[0031] In a third aspect, an embodiment of the present application provides an electronic device, including a processor and a memory, wherein the memory stores machine executable instructions that can be executed by the processor, and the processor can execute the machine executable instructions to implement the obstacle representation method described in any one of the aforementioned embodiments.

[0032] In a fourth aspect, an embodiment of the present application provides a readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the obstacle representation method as described in any one of the aforementioned embodiments is implemented.

[0033] The obstacle representation method, device, electronic device and readable storage medium provided in the embodiments of the present application project the point cloud set of the target obstacle vertically onto the ground to obtain a projected point cloud set; then, based on the projected point cloud set and the determined target height, a columnar object for representing the target obstacle is constructed. Among them, the distance from each point cloud to the ground is calculated based on the position information of each point cloud in the point cloud set of the target obstacle, the preset projection equation corresponding to the target obstacle and the ground equation of the ground, and the above-mentioned target height is determined based on the distance. Therefore, even if part of the point cloud at the bottom of the target obstacle is missing from the point cloud set, a complete columnar object for representing the bottom of the target obstacle can still be constructed through the projected point cloud set located on the ground and the target height, so that the bottom information of the target obstacle can be accurately obtained through the columnar object, so that the automated equipment can perform automated operations. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0035] Figure 1 A block diagram of an electronic device provided in an embodiment of the present application;

[0036] Figure 2 One of the flowcharts of the obstacle representation method provided in the embodiment of the present application;

[0037] Figure 3 A schematic diagram of the effect provided by the embodiment of the present application;

[0038] Figure 4 A schematic diagram of a projection provided for an embodiment of the present application;

[0039] Figure 5 for Figure 2 A schematic flow chart of the sub-steps included in step S130;

[0040] Figure 6 for Figure 5 A schematic flow chart of the sub-steps included in sub-step S131;

[0041] Figure 7 The second flowchart of the obstacle representation method provided in the embodiment of the present application;

[0042] Figure 8 A block diagram of an obstacle representation device provided in an embodiment of the present application.

[0043] Icon: 100 - electronic device; 110 - memory; 120 - processor; 130 - communication unit; 200 - obstacle indication device; 210 - height determination module; 220 - projection module; 230 - processing module. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.

[0045] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0046] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0047] In the description of the present application, it should be noted that if the terms "upper", "lower", "inside", "outside", etc. appear to indicate an orientation or position relationship, it is based on the orientation or position relationship shown in the drawings, or is the orientation or position relationship in which the product of the invention is usually placed when used. It is only for the convenience of describing the present application and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present application.

[0048] In addition, the terms “first”, “second”, etc., if used, are merely used to distinguish between the descriptions and should not be understood as indicating or implying relative importance.

[0049] It should be noted that, in the absence of conflict, the features in the embodiments of the present application may be combined with each other.

[0050] Before the inventor of the present application proposed the technical solution in the embodiment of the present application, obstacle information was generally obtained through two-dimensional recognition or laser radar, SLAM (Simultaneous Localization and Mapping). The above solutions all have some shortcomings, which makes it inconvenient for automated operations of automated equipment.

[0051] Two-dimensional recognition refers to detecting the two-dimensional position of obstacles on an image. However, in automated operations, what is needed is the real position information of obstacles in the world, so two-dimensional recognition cannot obtain the obstacle information required for automated operations.

[0052] The laser radar method refers to the use of laser radar to generate a point cloud of a three-dimensional scene and then detect the position of obstacles. Among them, the point cloud of the three-dimensional scene includes obstacle point clouds and non-obstacle point clouds. The SLAM method refers to the use of three-dimensional mapping and automatic navigation based on the point cloud of the obstacle to bypass obstacles in real time. However, when affected by some factors, for example, when the point cloud is sparse or the bottom of the actual obstacle is blocked, part of the point cloud at the bottom of the obstacle will be missing in the obtained obstacle point cloud, which will result in the bottom of the obstacle directly determined based on the obtained obstacle point cloud being missing. If automated operations are performed based on obstacles with missing bottoms, the automated operation effect will be poor.

[0053] In order to solve the above problems, the embodiments of the present application propose an obstacle representation method, device, electronic device and readable storage medium, which can construct an obstacle with a complete bottom based on a point cloud set of the obstacle, thereby avoiding the impact on the automated operation of the automated equipment due to the missing bottom of the obstacle.

[0054] The embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0055] Please refer to Figure 1 , Figure 1 The block diagram of the electronic device 100 provided in the embodiment of the present application. The electronic device 100 may be, but is not limited to, a terminal, a server, a ground workstation, an unmanned aerial vehicle, an unmanned vehicle, etc., wherein the terminal may be a smart phone, a tablet computer, etc. Figure 1 As shown, the electronic device 100 may include: a memory 110, a processor 120 and a communication unit 130. The memory 110, the processor 120 and the communication unit 130 are electrically connected directly or indirectly to achieve data transmission or interaction. For example, these components can be electrically connected to each other through one or more communication buses or signal lines.

[0056] The memory 110 is used to store programs or data. The memory 110 may be, but is not limited to, a random access memory (RAM), a read only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), etc.

[0057] The processor 120 is used to read / write data or programs stored in the memory 110 and execute corresponding functions. For example, the memory 110 stores an obstacle representation device 200, and the obstacle representation device 200 includes at least one software function module that can be stored in the memory 110 in the form of software or firmware. The processor 120 executes various functional applications and data processing by running software programs and modules stored in the memory 110, such as the obstacle representation device 200 in the embodiment of the present application, that is, realizing the obstacle representation method in the embodiment of the present application.

[0058] The communication unit 130 is used to establish a communication connection between the electronic device 100 and other communication terminals through a network, and to send and receive data through the network. For example, the electronic device 100 is connected to a detection device (such as a laser radar) for communication, and the detection device is used to obtain point cloud position information of a target obstacle through detection, and send the point cloud position information to the electronic device 100.

[0059] Understandably, Figure 1 The structure shown is for illustration only. The electronic device 100 may also include Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown. Figure 1 Each component shown in the figure can be implemented by hardware, software or a combination thereof.

[0060] Please refer to Figure 2 , Figure 2 This is one of the flowcharts of the obstacle representation method provided in the embodiment of the present application. The method can be applied to the above electronic device 100. The specific process of the obstacle representation method is described in detail below.

[0061] Step S110, based on the position information of each point cloud in the point cloud set of the target obstacle, the preset projection equation corresponding to the target obstacle and the ground equation of the ground, calculate the distance from each point cloud to the ground, and determine the target height based on the distance.

[0062] In this embodiment, the target height is related to the height of the constructed columnar object relative to the ground, and the height of the columnar object relative to the ground can be greater than or equal to the target height, or less than the target height. Optionally, the target height can be a preset fixed value, a value set according to a certain strategy, or a value set by other means, such as using a value input by a user as the target height.

[0063] In this embodiment, the point cloud set of the target obstacle can be obtained first, so as to determine the target height in combination with the point cloud set. Among them, the point cloud set of the target obstacle can be obtained from the detection device through a communication connection with the detection device. The detection device can be a device for obtaining an obstacle point cloud by detection, such as a laser radar device. The point cloud set of the target obstacle can also be obtained from a device (such as a server) that stores the point cloud sets of each obstacle. Of course, it can be understood that the point cloud set of the target obstacle can also be obtained by other means. Among them, the point cloud set of the target obstacle includes each point cloud of the target obstacle, and the position information of each point cloud can be represented by a three-dimensional coordinate.

[0064] The target obstacle is the obstacle represented by the columnar object to be constructed, which can be determined according to the actual situation. For example, if there are multiple obstacles in an actual scene, the multiple obstacles can be used as the target obstacles in sequence, so as to construct multiple columnar objects for representing each obstacle.

[0065] When the point cloud set of the target obstacle is obtained, each point cloud of the target obstacle can be vertically projected onto the ground corresponding to the target obstacle to obtain the projection point cloud corresponding to each point cloud of the target obstacle. Then the distance between the corresponding point cloud and the projection point cloud is calculated, and the distance is used as the distance from each point cloud to the ground, and then the target height is set in combination with the distance. Among them, the distance between a point cloud and the ground represents the distance between the point cloud and the projection point cloud corresponding to the point cloud, and the projection point cloud corresponding to the point cloud is the vertical projection of the point cloud on the ground. The projection point cloud is a point located on the ground.

[0066] The electronic device 100 may pre-store a preset projection equation corresponding to the target obstacle and a ground equation of the ground where the target obstacle is located. The ground equation may be an equation pre-constructed based on the point cloud of the ground, or an equation determined by other means. During calculation, the distance from each point cloud to the ground may be calculated based on the position information of each point cloud of the target obstacle, the preset projection equation corresponding to the target obstacle, and the ground equation of the ground.

[0067] Step S120: vertically project the point cloud set onto the ground to obtain a projected point cloud set of the target obstacle.

[0068] When the point cloud set of the target obstacle is obtained, each point cloud of the target obstacle may be vertically projected onto the ground, thereby obtaining a projection point cloud corresponding to each point cloud of the target obstacle. The projection point clouds corresponding to each point cloud of the target obstacle constitute the projection point cloud set of the target obstacle.

[0069] The execution order of step S110 and step S120 is not specifically limited. Step S110 may be executed before or after step S120, or may be executed simultaneously with step S120.

[0070] Step S130: constructing a columnar object representing the target obstacle according to the projection point cloud set and the target height.

[0071] In this embodiment, when the target height and the projection point cloud set are obtained, the projection point cloud set can be used as the bottom surface, and the height of the columnar object is determined according to the target height, and then a columnar object is constructed to represent the target obstacle.

[0072] Please refer to Figure 3 , Figure 3 This is a schematic diagram of the effect provided by the embodiment of the present application. When the point cloud of the target obstacle is as follows Figure 3 As shown in FIG. 1 , after obtaining the projection point cloud set of the target obstacle and the target height H, the Figure 3 A cylindrical object with a height of H is shown, and the cylindrical object is used to represent the target obstacle.

[0073] Therefore, even if part of the point cloud at the bottom of the target obstacle is missing in the point cloud set of the target obstacle, a complete columnar object representing the bottom of the target obstacle can still be constructed through the projected point cloud set on the ground and the target height, so that the bottom information of the obstacle can be accurately obtained through the columnar object, so that the automated equipment can perform automated operations.

[0074] In this embodiment, when determining the target height, it can be set in combination with the distance between each point cloud in the point cloud set and the ground and the application scenario. Optionally, in one implementation of this embodiment, when the automated equipment is a device that travels on the ground and performs automated operations only within its own height range (for example, an unmanned vehicle), the target height can be set in combination with the height of the automated equipment and the distance between each point cloud in the point cloud set and the ground, thereby constructing a columnar object that meets actual needs. For example, if the height of the automated equipment is 1.4 meters, and the maximum distance between each point cloud and the ground is greater than 1.4 meters, then the target height can be set to be greater than or equal to 1.4 meters.

[0075] Optionally, in another implementation of this embodiment, when the automated equipment is an equipment that performs automated operations on obstacles in the air (e.g., a drone that sprays pesticides), the target height can be set according to the normal height of the obstacle and the distance between each point cloud in the point cloud set and the ground. For example, when spraying pesticides on rice, the general height of rice is 1.1 meters, and the distance between each point cloud in the point cloud set and the ground is about 1 meter, then the target height can be set to be greater than or equal to 1 meter to ensure that the pesticide can be sprayed on the rice.

[0076] Optionally, in order to improve the similarity between the constructed columnar object and the actual target obstacle so as to accurately characterize the target obstacle, after obtaining the distance from each point cloud to the ground, the obtained distances can be compared to determine the maximum distance among the above distances, and the maximum distance can be used as the target height for subsequent construction of the columnar object.

[0077] Please refer to Figure 4 , Figure 4 This is a schematic diagram of the projection provided by the embodiment of the present application. Figure 4 The process of calculating the distance from each point cloud to the ground is illustrated by an example. i (x i ,y i ,z i ) represents the point cloud V i The location information is (x i ,y i ,z i ), V i '(x,y,z) represents the projected point cloud V i 'The location information is (x, y, z), point cloud V i After being vertically projected onto the ground, it becomes the projected point cloud V i '. Assume that the ground equation of the ground is Ax+By+Cz+D=0, where A, B, C and D are all pre-set parameters. The preset projection equation is:

[0078]

[0079] Wherein, t represents the distance from the point cloud to the ground, that is, the distance between each point cloud and the projection point cloud corresponding to each point cloud.

[0080] After substituting the ground equation and the position information of the point cloud into the above preset projection equation, we can obtain: Thus, according to the position information of each point cloud of the target obstacle, the preset projection equation corresponding to the target obstacle and the ground equation of the ground, the distance between each point cloud of the target obstacle and the ground is obtained.

[0081] In this embodiment, as an optional implementation method, the projection point cloud set can be obtained in the following manner: based on the position information of each point cloud of the target obstacle, the preset projection equation corresponding to the target obstacle and the ground equation of the ground, the position information of the projection point cloud corresponding to each point cloud of the target obstacle is calculated to obtain the projection point cloud set.

[0082] During projection, each point cloud can be projected onto the ground represented by the ground equation according to the preset projection equation, thereby obtaining the projected point cloud set.

[0083] Continue with Figure 4 For example, after calculating the distance t between the point cloud and the projected point cloud according to the position information of the point cloud, the preset projection equation and the ground equation, the distance t can be substituted into the preset projection equation to obtain the position information of each projected point cloud. In this way, the projected point cloud set can be obtained.

[0084] After determining the target height and the projection point cloud set, as an optional implementation, the columnar object can be constructed by directly extending each projection point cloud in a direction away from the ground according to the target height.

[0085] As another optional implementation, the boundary of the projection point cloud set may be obtained first, and then the columnar object may be constructed based on the boundary, thereby speeding up the construction of the columnar object. Figure 5 , Figure 5 for Figure 2 Schematic diagram of the flow of sub-steps included in step S130. Step S130 may include sub-step S131 and sub-step S132.

[0086] Sub-step S131 , performing polygon boundary search on the projection point cloud set to obtain polygon boundaries.

[0087] Usually, the boundaries of the projected point cloud set of the target obstacle are polygons. Therefore, after obtaining the projected point cloud set, the alpha shape algorithm or other methods can be used to perform a polygonal boundary search on the projected point cloud in the projected point cloud set to obtain the polygonal boundary.

[0088] Optionally, when performing polygon boundary search, the projected point cloud set may be processed first to reduce the number of projected point clouds, thereby alleviating the pressure of dense point clouds on boundary calculation and further speeding up the construction of the columnar object. Figure 6 , Figure 6 for Figure 5 The flowchart of the sub-steps included in sub-step S131 is shown in FIG.

[0089] Sub-step S1311, performing thinning processing on the projection point cloud set to obtain a thinned projection point cloud set.

[0090] Sub-step S1312, performing polygon boundary search on the thinned projection point cloud set to obtain the polygon boundary.

[0091] After obtaining the projection point cloud set, the projection point clouds included in the projection point cloud set can be thinned to reduce the number of projection point clouds. Optionally, the projection point clouds in the projection point cloud set can be voxelized using a preset spatial resolution, and then the projection point cloud closest to the center of each voxel is used as the representative of the voxel, and the final number of voxels is the number of projection point clouds after thinning. The projection point clouds after thinning constitute the thinned projection point cloud set. Then, a polygon search is performed on the thinned projection point cloud, and the polygon boundary is determined based on the search results.

[0092] Sub-step S132, constructing a polygonal columnar object according to the polygonal boundary and the target height.

[0093] The target height can be used as the height of the columnar object, or a value greater than the target height can be used as the height of the columnar object. Then, a polygonal columnar object representing the target obstacle is constructed based on the polygonal boundary and the height of the columnar object. In this way, a columnar object that can accurately represent the target obstacle can be obtained.

[0094] The obstacle representation method provided by the embodiment of the present application is such that even if part of the bottom point cloud is missing from the point cloud of the target obstacle, by constructing a columnar object using the ground projection of the target obstacle, it is helpful to include the missing part, thereby generating a columnar object with a complete bottom. Furthermore, by constructing a columnar object based on the height of the highest point of the target obstacle above the ground, it is convenient to construct a columnar object that accurately represents the target obstacle, which is beneficial to the refined operation of automated equipment (for example, obstacle avoidance and detour of drones or drones).

[0095] Please refer to Figure 7 , Figure 7 The second flowchart of the obstacle representation method provided in the embodiment of the present application. After step S130, the method may further include step S140.

[0096] Step S140: controlling the movement of the automated equipment according to the columnar object.

[0097] After the columnar object is constructed, the shape, position and other information of the target obstacle can be obtained according to the columnar object, and then the movement of the automation equipment can be controlled to complete the automation operation.

[0098] In order to execute the corresponding steps in the above embodiments and various possible methods, a method for implementing the obstacle display device 200 is given below. Optionally, the obstacle display device 200 can adopt the above Figure 1 The components and structure of the electronic device 100 shown in FIG. Figure 8 , Figure 8 A block diagram of an obstacle display device 200 provided in an embodiment of the present application. It should be noted that the basic principle and technical effects of the obstacle display device 200 provided in this embodiment are the same as those of the above-mentioned embodiments. For the sake of brief description, for parts not mentioned in this embodiment, reference can be made to the corresponding contents in the above-mentioned embodiments. The obstacle display device 200 may include: a height determination module 210, a projection module 220 and a processing module 230.

[0099] The height determination module 210 is used to calculate the distance from each point cloud to the ground based on the position information of each point cloud in the point cloud set of the target obstacle, the preset projection equation corresponding to the target obstacle and the ground equation of the ground, and determine the target height based on the distance.

[0100] The projection module 220 is used to vertically project the point cloud set onto the ground to obtain a projection point cloud set of the target obstacle.

[0101] The processing module 230 is used to construct a columnar object representing the target obstacle according to the projection point cloud set and the target height.

[0102] Optionally, in this embodiment, the processing module 230 is further configured to control the movement of automated equipment according to the columnar object.

[0103] Optionally, the above modules can be stored in the form of software or firmware. Figure 1 The memory 110 shown in the figure may be fixed in the operating system (OS) of the electronic device 100 and may be Figure 1 Meanwhile, the data and program codes required for executing the above modules may be stored in the memory 110.

[0104] Optionally, an embodiment of the present application further provides a readable storage medium having a computer program stored thereon, wherein the computer program implements the obstacle representation method when executed by a processor.

[0105] In summary, the embodiments of the present application provide an obstacle representation method, device, electronic device, and readable storage medium, which projects the point cloud set of the target obstacle vertically onto the ground to obtain a projected point cloud set; then, based on the projected point cloud set and the determined target height, a columnar object for representing the target obstacle is constructed. Among them, according to the position information of each point cloud in the point cloud set of the target obstacle, the preset projection equation corresponding to the target obstacle, and the ground equation of the ground, the distance from each point cloud to the ground is calculated, and the above-mentioned target height is determined based on the distance. Therefore, even if part of the point cloud at the bottom of the target obstacle is missing from the point cloud set, a complete columnar object for representing the bottom of the target obstacle can still be constructed through the projected point cloud set located on the ground and the target height, so that the bottom information of the target obstacle can be accurately obtained through the columnar object, so that the automated equipment can perform automated operations.

[0106] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0107] In addition, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0108] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0109] The above description is only the preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A method for representing an obstacle, characterized in that: The method comprises: According to the position information of each point cloud in the point cloud set of the target obstacle, the preset projection equation corresponding to the target obstacle and the ground equation of the ground, the distance from each point cloud to the ground is calculated, and the target height is determined according to the distance; Vertically projecting the point cloud set onto the ground to obtain a projected point cloud set of the target obstacle; Constructing a columnar object representing the target obstacle according to the projection point cloud set and the target height; Wherein, the ground equation is: Ax+By+Cz+D=0 Among them, A, B, C and D are all pre-set parameters; The preset projection equation is: Among them, (x i ,y i ,z i ) represents the position information of the point cloud in the point cloud set, (x, y, z) represents the position information of the point cloud in the point cloud set after projection, and t represents the distance from the point cloud in the point cloud set to the ground; According to the ground equation and the preset projection equation, we can obtain:

2. The method according to claim 1, characterized in that The step of constructing a columnar object for representing the target obstacle according to the projection point cloud set and the target height includes: Performing polygon boundary search on the projection point cloud set to obtain polygon boundary; A polygonal columnar object is constructed according to the polygonal boundary and the target height.

3. The method according to claim 2, characterized in that The step of performing a polygon boundary search on the projected point cloud set to obtain a polygon boundary comprises: Performing thinning processing on the projection point cloud set to obtain a thinned projection point cloud set; A polygon boundary search is performed on the thinned projection point cloud set to obtain the polygon boundary.

4. The method according to any one of claims 1 to 3, characterized in that: Determining the target height according to the distance includes: By comparing the distances from each point cloud to the ground, a maximum distance among the distances from each point cloud to the ground is obtained, and the maximum distance is used as the target height.

5. The method according to any one of claims 1 to 3, characterized in that: The step of vertically projecting the point cloud set onto the ground to obtain a projected point cloud set of the target obstacle includes: According to the position information of each point cloud of the target obstacle, the preset projection equation corresponding to the target obstacle and the ground equation of the ground, the position information of the projection point cloud corresponding to each point cloud of the target obstacle is calculated to obtain the projection point cloud set.

6. The method according to claim 1, characterized in that After constructing a columnar object for representing the target obstacle according to the projection point cloud set and the target height, the method further includes: According to the columnar object, the automated equipment is controlled to move.

7. An obstacle display device, characterized in that: The device comprises: A height determination module, configured to calculate the distance from each point cloud to the ground based on the position information of each point cloud in the point cloud set of the target obstacle, the preset projection equation corresponding to the target obstacle and the ground equation of the ground, and determine the target height based on the distance; A projection module, used for vertically projecting the point cloud set onto the ground to obtain a projection point cloud set of the target obstacle; A processing module, configured to construct a columnar object representing the target obstacle according to the projection point cloud set and the target height; Wherein, the ground equation is: Ax+By+Cz+D=0 Among them, A, B, C and D are all pre-set parameters; The preset projection equation is: Among them, (x i ,y i ,z i ) represents the position information of the point cloud in the point cloud set, (x, y, z) represents the position information of the point cloud in the point cloud set after projection, and t represents the distance from the point cloud in the point cloud set to the ground; According to the ground equation and the preset projection equation, we can obtain:

8. An electronic device, characterized in that: The invention comprises a processor and a memory, wherein the memory stores machine executable instructions that can be executed by the processor, and the processor can execute the machine executable instructions to implement the obstacle representation method according to any one of claims 1 to 6.

9. A readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the obstacle representation method according to any one of claims 1 to 6 is implemented.