Method, device and computer readable storage medium for determining altitude trajectory
By acquiring and processing the 3D point cloud data of the vehicle's surrounding environment and determining its height trajectory, it solves the problem that the vehicle is difficult to obtain the pavement height during driving, and ensures safe travel on sunken or protruding road surfaces.
Patent Information
- Application Number
- CN202110057609.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-01-15
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2041-01-15
AI Technical Summary
In the prior art, it is difficult for vehicles to obtain height information on the road surface during driving, resulting in difficulty in ensuring safe travel in the case of sunken or protruding road surfaces.
By obtaining the 3D point cloud data of the surrounding environment of the target mobile carrier within a predetermined time period, including the color and position height of the point, determining its height trajectory, using lidar or infrared ranging technology to remove noise, calculate the sub-region height, and then determining Movement trajectory and road surface conditions.
It can accurately obtain the height information of the road surface when the road surface is sunken or protruding, and ensure the safety of vehicle driving.
Smart Images

Figure CN112750207B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of point cloud data, and in particular, to a method, device, computer-readable storage medium and processor for determining a height trajectory. Background Art
[0002] In the prior art, GPS can locate the specific three-dimensional coordinates of the vehicle, but in the case of a sunken or protruding road surface, the coordinate values obtained by positioning will not change. When a vehicle is driving on a sunken or protruding road surface, it may cause a safety accident. In the prior art, it is difficult for a vehicle to obtain the specific conditions of the road surface height during driving, which is not conducive to subsequent safe travel.
[0003] The above information disclosed in the background technology section is only used to enhance the understanding of the background technology of the technology described in this article. Therefore, the background technology may contain certain information that does not form the prior art known in this country for those skilled in the art. Summary of the invention
[0004] The main purpose of the present application is to provide a method, device, computer-readable storage medium and processor for determining a height trajectory, so as to solve the problem in the prior art that it is difficult for a vehicle to obtain the height of the road surface during driving, which is not conducive to subsequent safe travel.
[0005] According to one aspect of an embodiment of the present application, a method for determining a height trajectory is provided, comprising: obtaining a 3D point cloud corresponding to the surrounding environment of each frame of a target mobile carrier within a predetermined time period, and the color of the points included in the 3D point cloud is related to the height of the corresponding position, and the surrounding environment includes the surrounding ground; based on the 3D point cloud, determining the height trajectory of the target mobile carrier within the predetermined time period.
[0006] Optionally, determining the altitude trajectory of the target mobile carrier within the predetermined time period includes: obtaining motion trajectory information of the target mobile carrier within the predetermined time period, the motion trajectory information including the position coordinates of each point on the motion trajectory of the target mobile carrier within the predetermined time period, and the 3D point cloud including the points corresponding to the motion trajectory; determining the altitude trajectory based on the 3D point cloud and the motion trajectory information.
[0007] Optionally, determining the height trajectory according to the 3D point cloud and the motion trajectory information includes: dividing the area including the motion trajectory into multiple sub-areas; calculating the height of each sub-area according to the 3D point cloud; and determining the height trajectory at least according to the height of each sub-area.
[0008] Optionally, any two of the sub-regions are the same sub-regions.
[0009] Optionally, calculating the height of each sub-region based on the 3D point cloud includes: projecting the 3D point cloud onto the sub-region; and calculating the height of each sub-region based on the height of corresponding positions of the points located within each sub-region and / or outside the sub-region.
[0010] Optionally, the height of each sub-region is determined according to the height of the corresponding position of the point located within each sub-region and / or outside the sub-region, including: when the point is projected within the sub-region, the height of the sub-region is determined according to the height of the corresponding position of the point within each sub-region; when the point is not projected within the sub-region, the height of the sub-region is determined according to the height of the adjacent sub-region.
[0011] Optionally, in the case where the points are projected within the sub-area, the height of the sub-area is determined according to the heights corresponding to the points within the sub-areas, including: obtaining the heights of the corresponding positions of each of the points within the sub-area; removing noise points within the sub-area according to the heights of the corresponding positions of each of the points, the heights of the noise points being greater than the heights corresponding to a first number of the points in the sub-area and / or less than the heights corresponding to a second number of the points in the sub-area, the first number and / or the second number being less than the total number of the points in the sub-area; and determining the height of the sub-area according to the heights of the corresponding positions of each of the points in the sub-area after removing the noise points.
[0012] Optionally, the height of the sub-region is determined according to the heights of the corresponding positions of each point in the sub-region after the noise points are removed, including: determining that a partial area of the sub-region after the noise points are removed is a predetermined area, an area in which the density of the points in the predetermined area is greater than a predetermined density; and determining the height of the sub-region according to the heights of the corresponding positions of the points in the predetermined area.
[0013] Optionally, determining the height of the sub-region according to the heights corresponding to the points in the predetermined region includes: averaging the heights corresponding to all the points in the predetermined region to obtain the height of the sub-region.
[0014] Optionally, the height trajectory is determined at least based on the height of each sub-area, including: obtaining ground height information corresponding to each sub-area; determining the height of each point of the target mobile carrier on the motion trajectory based on the height of each sub-area, the ground height information corresponding to each sub-area and the angle of the 3D point cloud projection.
[0015] Optionally, a laser radar is used to obtain a 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period.
[0016] Optionally, before obtaining the 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period, the method also includes: acquiring an image that simultaneously displays multiple frames of continuous 3D point clouds; and determining the motion trajectory of the target mobile carrier based on the image.
[0017] Optionally, determining the motion trajectory of the target mobile carrier according to the image includes: determining the position of the target mobile carrier corresponding to each frame on the image according to the size of the target mobile carrier; determining the motion trajectory of the target mobile carrier according to the position of the target mobile carrier corresponding to each frame on the image.
[0018] Optionally, determining the position of each frame corresponding to the target mobile carrier on the image according to the size of the target mobile carrier includes: determining a first boundary position and a second boundary position of each frame corresponding to the target mobile carrier on the image according to the size of the target mobile carrier, the direction in which the second boundary position points to the first boundary position being the same as the moving direction of the target mobile carrier; determining the position of each frame corresponding to the target mobile carrier on the image according to the first boundary position and the second boundary position of each frame corresponding to the target mobile carrier on the image.
[0019] Optionally, after determining the height trajectory, the method further includes: determining a road surface condition in an area corresponding to the motion trajectory according to the height trajectory; and planning a driving strategy according to the road surface condition.
[0020] According to another aspect of an embodiment of the present application, a device for determining motion information is also provided, including: an acquisition unit, used to acquire a 3D point cloud corresponding to the surrounding environment of each frame of a target mobile carrier within a predetermined time period, and the color of the points included in the 3D point cloud is related to the height of the position of the corresponding point, and the surrounding environment includes the surrounding ground; a first determination unit, used to determine the height trajectory of the target mobile carrier within the predetermined time period based on the 3D point cloud.
[0021] According to another aspect of an embodiment of the present application, a storage medium is further provided, wherein the storage medium includes a stored program, wherein when the program is executed, the device where the storage medium is located is controlled to execute any one of the determination methods.
[0022] According to another aspect of an embodiment of the present application, a processor is further provided, wherein the processor is used to run a program, wherein the program executes any one of the determination methods when running.
[0023] In an embodiment of the present invention, a method for determining a height trajectory is adopted. By obtaining a 3D point cloud corresponding to the surrounding environment of each frame of a target mobile carrier within a predetermined time period, and the color of the points included in the 3D point cloud is related to the height of the corresponding position, the surrounding environment includes the surrounding ground, and the height trajectory of the target mobile carrier within the predetermined time period is determined according to the 3D point cloud, so that when the road surface is concave or protruding, the coordinate value obtained by positioning can change, thereby achieving the purpose of obtaining the specific situation of the height of the road surface when the vehicle is traveling on a concave or protruding road surface, and ensuring the technical effect of subsequent safe travel, thereby solving the technical problem in the prior art that it is difficult for the vehicle to obtain the specific situation of the height of the road surface during driving, which is not conducive to subsequent safe travel. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] The drawings constituting part of the present application are used to provide a further understanding of the present application. The exemplary embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:
[0025] Figure 1 A schematic flow chart showing a method for determining a height trajectory according to an embodiment of the present application; and
[0026] Figure 2 A schematic structural diagram of a device for determining motion information according to an embodiment of the present application is shown. DETAILED DESCRIPTION
[0027] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.
[0028] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.
[0029] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present application described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0030] It should be understood that when an element (such as a layer, film, region, or substrate) is described as being "on" another element, the element may be directly on the other element, or there may be intermediate elements. Moreover, in the specification and claims, when an element is described as being "connected" to another element, the element may be "directly connected" to the other element, or "connected" to the other element through a third element.
[0031] As mentioned in the background technology, it is difficult for vehicles in the prior art to obtain the specific conditions of the height of the road surface during driving, which is not conducive to subsequent safe travel. In order to solve the above problem, the present application provides a method, device, computer-readable storage medium and processor for determining a height trajectory.
[0032] According to an embodiment of the present application, a method for determining a height trajectory is provided. Figure 1 is a flow chart of a method for determining a height trajectory according to an embodiment of the present application. Figure 1 As shown, the method comprises the following steps:
[0033] Step S101, obtaining a 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period, wherein the color of the points included in the 3D point cloud is related to the height of the corresponding position, and the surrounding environment includes the surrounding ground;
[0034] Step S102: determining the height trajectory of the target mobile carrier within the predetermined time period based on the 3D point cloud.
[0035] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.
[0036] In the above scheme, first, the 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within the predetermined time period is obtained, and the color of the points included in the above 3D point cloud is related to the height of the corresponding position, and the above surrounding environment includes the surrounding ground; secondly, the height trajectory of the above target mobile carrier within the above predetermined time period is determined based on the above 3D point cloud. This method can determine the height trajectory of the target mobile carrier during driving, that is, the height corresponding to each point on its motion trajectory, so that the driving path of the mobile carrier can be planned according to the height of the predetermined area (the predetermined area formed by the motion trajectory) to ensure subsequent safe travel.
[0037] It should be noted that the predetermined time period can be 10 minutes, 15 minutes, 30 minutes, 1 hour or other predetermined time periods. Of course, in the present application, the 3D point cloud corresponding to the surrounding environment can also be obtained in real time, so that the predetermined time period is an infinite time period. Those skilled in the art can select a suitable predetermined time period according to actual conditions.
[0038] It should also be noted that in the 3D point cloud, points with different heights can be marked with different colors. For example, when the height changes from low to high, the color of the corresponding point gradually changes from light green to dark green, and then from dark green to blue. The color change trend of the point can be analyzed later to determine the change trend of the height.
[0039] In addition, the above-mentioned surrounding environment is not limited to the surrounding ground, but may also include buildings, flower beds, and lane lines.
[0040] In one embodiment of the present application, the height trajectory of the target mobile carrier within the predetermined time period is determined based on the 3D point cloud, including: obtaining the motion trajectory information of the target mobile carrier within the predetermined time period, the motion trajectory information including the position coordinates of each point on the motion trajectory of the target mobile carrier within the predetermined time period, the 3D point cloud including the points corresponding to the motion trajectory; determining the height trajectory based on the 3D point cloud and the motion trajectory information. In this solution, since the 3D point cloud includes the points corresponding to the motion trajectory, the height of each point corresponding to the motion trajectory can be determined based on the height of each point in the 3D point cloud, thereby accurately determining the height trajectory.
[0041] In a specific embodiment of the present application, the height trajectory is determined based on the 3D point cloud and the motion trajectory information, including: dividing the area including the motion trajectory into multiple sub-areas; calculating the height of each of the sub-areas based on the 3D point cloud; and determining the height trajectory based on at least the height of each of the sub-areas. In this solution, the height of the sub-areas is subsequently stored, which can reduce the amount of data storage compared to storing the height of each point.
[0042] It should be noted that the multiple sub-regions in the present application may be different sub-regions, and those skilled in the art may select sub-regions of appropriate sizes according to actual conditions.
[0043] In order to further simplify data processing and improve processing efficiency, in an embodiment of the present application, any two of the above sub-regions are the same sub-regions, that is, the sizes and shapes of any two sub-regions are the same.
[0044] In another embodiment of the present application, calculating the height of each of the above sub-regions based on the above 3D point cloud includes: projecting the above 3D point cloud onto the above sub-region; and determining the height of each of the above sub-regions based on the height of the corresponding position of the above point located in each of the above sub-regions and / or outside each of the above sub-regions. This solution further ensures the accuracy of the determined height of the sub-region.
[0045] In another embodiment of the present application, the height of each of the above sub-regions is determined according to the height of the corresponding position of the above point located in each of the above sub-regions and / or outside each of the above sub-regions, including: when the above point is projected in the above sub-region, the height of the above sub-region is determined according to the height of the corresponding position of the above point in the above sub-region; when the above point is not projected in the above sub-region, the height of the above sub-region is determined according to the height of the adjacent above sub-region. In this way, the corresponding heights of different sub-regions can be calculated.
[0046] In one embodiment of the present application, in the case where the above-mentioned points are projected in the above-mentioned sub-area, the height of the above-mentioned sub-area is determined according to the heights corresponding to the above-mentioned points in the above-mentioned sub-areas, including: obtaining the heights of the corresponding positions of each of the above-mentioned points in the above-mentioned sub-area; removing noise points in the above-mentioned sub-area according to the heights of the corresponding positions of each of the above-mentioned points, the heights of the above-mentioned noise points being greater than the heights corresponding to the first number of the above-mentioned points in the above-mentioned sub-area and / or less than the heights corresponding to the second number of the above-mentioned points in the above-mentioned sub-area, that is, removing points with larger corresponding heights and / or removing points with smaller corresponding heights, the above-mentioned first number and / or the above-mentioned second number being less than the total number of the above-mentioned points in the above-mentioned sub-area; determining the height of the above-mentioned sub-area according to the heights of the corresponding positions of each of the above-mentioned points in the above-mentioned sub-area after removing the above-mentioned noise points. In this method, the height of each of the above-mentioned corresponding positions in the sub-area can be obtained by means of a laser radar, or by means of an infrared ranging method. The height of each of the above-mentioned corresponding positions in the sub-area is first clustered according to the height value to remove noise points. Specifically, the points corresponding to larger values and the points corresponding to smaller values can be removed. For example, 100 points, with coordinates from left to right, are found to correspond to the points corresponding to the minimum value and the points corresponding to the maximum value, and then removed to obtain the sub-area after noise removal, and then the height of the sub-area is calculated, thereby further improving the accuracy of the calculated height of the sub-area.
[0047] In order to accurately obtain the height of the point projected in the sub-area, in one embodiment of the present application, a laser radar is used to obtain the corresponding 3D point cloud.
[0048] In a specific embodiment, the height trajectory is determined at least according to the height of each of the sub-areas, including: acquiring ground height information corresponding to each sub-area; determining the height of each point on the motion trajectory of the target mobile carrier according to the height of each of the sub-areas, the ground height information corresponding to each of the sub-areas and the angle of the 3D point cloud projection, and the height of the target mobile carrier refers to its altitude.
[0049] In another embodiment of the present application, the height of the sub-region is determined according to the height of the corresponding position of each of the points in the sub-region after the noise points are removed, including: determining a part of the sub-region after the noise points are removed as a predetermined region, an area where the density of the points in the predetermined region is greater than the predetermined density; and determining the height of the sub-region according to the height of the corresponding position of the points in the predetermined region. After the noise points are removed, the part with a larger density is used as the predetermined region, so that the height of the sub-region can be determined more accurately.
[0050] In practical applications, in order to simply and efficiently determine the height of the sub-area, in an embodiment of the present application, the height of the sub-area is determined based on the height corresponding to the above-mentioned points in the above-mentioned predetermined area, including: averaging the heights corresponding to all the above-mentioned points in the above-mentioned predetermined area to obtain the height of the above-mentioned sub-area.
[0051] Of course, in the present application, determining the height of a sub-area according to the height corresponding to a point in a predetermined area is not limited to the above-mentioned averaging algorithm, but may also be other algorithms. Those skilled in the art may determine the specific algorithm according to actual conditions.
[0052] In one embodiment of the present application, a laser radar is used to obtain a 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period. The laser radar has high resolution, good concealment, strong anti-active interference ability, good low-altitude detection performance, small size and light weight.
[0053] In order to ensure that the determined motion trajectory is more accurate and the height trajectory can be determined more accurately based on the motion trajectory, in an embodiment of the present application, before obtaining the 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period, the above method also includes: acquiring an image that simultaneously displays multiple frames of continuous 3D point clouds; determining the motion trajectory of the above target mobile carrier based on the above image.
[0054] In a specific embodiment of the present application, determining the motion trajectory of the target mobile carrier according to the image includes: determining the position of the target mobile carrier corresponding to each frame on the image according to the size of the target mobile carrier; determining the motion trajectory of the target mobile carrier according to the position of the target mobile carrier corresponding to each frame on the image. The position of the object in each frame is different, and determining the position of the frame where the target mobile carrier is located according to the size can ensure that the motion trajectory of the target mobile carrier can be accurately obtained. In an embodiment of the present application, determining the position of the target mobile carrier corresponding to each frame on the image according to the size of the target mobile carrier includes: determining the first boundary position and the second boundary position of the target mobile carrier corresponding to each frame on the image according to the size of the target mobile carrier, the direction of the second boundary position pointing to the first boundary position is the same as the moving direction of the target mobile carrier; determining the position of the target mobile carrier corresponding to each frame on the image according to the first boundary position and the second boundary position of the target mobile carrier corresponding to each frame on the image. In this way, the accurate position of the target mobile carrier corresponding to each frame on the image can be obtained, ensuring the validity of the data of the position of the target mobile carrier in each frame on the image. For example, when the target moving carrier is a vehicle and the vehicle is traveling forward, the first boundary position is the front position of the vehicle, and the second boundary position is the rear position of the vehicle.
[0055] In actual applications, the height information of the height trajectory or the height information in the sub-area can be further utilized for machine training or simulation.
[0056] In another embodiment of the present application, after determining the height trajectory, the method further includes: determining the road conditions of the area corresponding to the motion trajectory according to the height trajectory; and planning a driving strategy according to the road conditions, so as to further ensure the safe driving of the mobile carrier.
[0057] The present application also provides a motion information determination device. It should be noted that the motion information determination device of the present application can be used to execute the method for determining the height trajectory provided by the present application. The motion information determination device provided by the present application is introduced below.
[0058] Figure 2 is a schematic diagram of the structure of a device for determining motion information according to an embodiment of the present application. Figure 2 As shown, the device comprises:
[0059] The acquisition unit 10 is used to acquire a 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period, wherein the color of the points included in the 3D point cloud is related to the height of the position of the corresponding point, and the surrounding environment includes the surrounding ground;
[0060] The first determination unit 20 is used to determine the height trajectory of the target mobile carrier within the predetermined time period according to the 3D point cloud.
[0061] In the above-mentioned device, the acquisition unit acquires the 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period, and the color of the points included in the above-mentioned 3D point cloud is related to the height of the corresponding position, and the above-mentioned surrounding environment includes the surrounding ground; the first determination unit determines the height trajectory of the above-mentioned target mobile carrier within the above-mentioned predetermined time period based on the above-mentioned 3D point cloud. The device can determine the height trajectory of the target mobile carrier during driving, that is, the height corresponding to each point on its motion trajectory, so that the driving path of the mobile carrier can be planned according to the height of the predetermined area (the predetermined area formed by the motion trajectory) to ensure subsequent safe travel.
[0062] It should be noted that the predetermined time period can be 10 minutes, 15 minutes, 30 minutes, 1 hour or other predetermined time periods. Of course, in the present application, the 3D point cloud corresponding to the surrounding environment can also be obtained in real time, so that the predetermined time period is an infinite time period. Those skilled in the art can select a suitable predetermined time period according to actual conditions.
[0063] It should also be noted that in the 3D point cloud, points with different corresponding heights can be marked with different colors. For example, when the height changes from low to high, the color of the corresponding point gradually changes from light green to dark green, and then from dark green to blue. The color change trend of the point can be analyzed later to determine the change trend of the height.
[0064] In addition, the above-mentioned surrounding environment is not limited to the surrounding ground, but may also include buildings, flower beds, and lane lines.
[0065] In one embodiment of the present application, the first determination unit includes an acquisition module and a first determination module, the acquisition module is used to acquire the motion trajectory information of the target mobile carrier within the predetermined time period, the motion trajectory information includes the position coordinates of each point on the motion trajectory of the target mobile carrier within the predetermined time period, the 3D point cloud includes the points corresponding to the motion trajectory, and the first determination module is used to determine the height trajectory according to the 3D point cloud and the motion trajectory information. In this solution, since the 3D point cloud includes the points corresponding to the motion trajectory, the height of each point corresponding to the motion trajectory can be determined according to the height of each point in the 3D point cloud, so that the height trajectory can be accurately determined.
[0066] In a specific embodiment of the present application, the first determination module includes a division submodule, a first determination submodule and a second determination submodule, the division submodule is used to divide the area including the above-mentioned motion trajectory into multiple sub-areas, the first determination submodule is used to calculate the height of each of the above-mentioned sub-areas based on the above-mentioned 3D point cloud computing, and the second determination submodule is used to determine the above-mentioned height trajectory at least based on the height of each of the above-mentioned sub-areas. In this solution, the height of the sub-area is subsequently stored, which can reduce the storage amount of data compared to storing the height of each point.
[0067] It should be noted that the multiple sub-regions in the present application can be different sub-regions, and those skilled in the art can select sub-regions of appropriate sizes according to actual conditions. In order to further simplify data processing and improve processing efficiency, in one embodiment of the present application, any two of the above sub-regions are the same sub-regions, that is, any two sub-regions have the same size and shape.
[0068] In another embodiment of the present application, the second determination submodule includes a projection submodule and a third determination submodule, the projection submodule is used to project the 3D point cloud onto the subregion, and the determination submodule is used to determine the height of each of the subregions according to the height of the corresponding position of the point located within each of the subregions and / or outside each of the subregions. This solution further ensures the accuracy of the height of the determined subregion.
[0069] In another embodiment of the present application, the third determination submodule includes a fourth determination submodule and a fifth determination submodule, the fourth determination submodule is used to determine the height of the subregion according to the height of the corresponding position of the above-mentioned point in each of the above-mentioned subregions when the above-mentioned point is projected in the above-mentioned subregion, and the fifth determination submodule is used to determine the height of the above-mentioned subregion according to the height of the adjacent above-mentioned subregion when the above-mentioned point is not projected in the above-mentioned subregion. In this way, the corresponding heights of different subregions can be calculated.
[0070] In one embodiment of the present application, the fifth determination submodule includes an acquisition submodule, a removal submodule and a sixth determination submodule. The acquisition submodule is used to acquire the height of each of the above-mentioned corresponding positions in the sub-area by means of a laser radar, and can also acquire the height of each of the above-mentioned corresponding positions in the sub-area by means of infrared ranging. The removal submodule is used to remove noise points in the above-mentioned sub-area according to the height of the corresponding position of each of the above-mentioned points. The height of the above-mentioned noise point is greater than the height corresponding to the first number of the above-mentioned points in the above-mentioned sub-area and / or is less than the height corresponding to the second number of the above-mentioned points in the above-mentioned sub-area, that is, remove points with larger corresponding heights and / or remove points with smaller corresponding heights, and the above-mentioned first number and / or the above-mentioned second number are less than the total number of the above-mentioned points in the above-mentioned sub-area. The sixth determination submodule is used to determine the height of the above-mentioned sub-area according to the height of the corresponding position of each of the above-mentioned points in the above-mentioned sub-area after removing the above-mentioned noise points. In the device, clustering is first performed according to the height values to remove noise points. Specifically, points corresponding to larger values and points corresponding to smaller values can be removed. For example, for 100 points, the coordinates are from left to right, and the points corresponding to the minimum value and the points corresponding to the maximum value are found and then removed to obtain the sub-area after noise removal. The height of the sub-area is then calculated, thereby further improving the accuracy of the calculated height of the sub-area.
[0071] In another embodiment of the present application, the sixth determination submodule includes a seventh determination submodule and an eighth determination submodule, the seventh determination submodule is used to determine that a portion of the subregion after removing the noise points is a predetermined region, and the density of the points in the predetermined region is greater than the predetermined density, and the eighth determination submodule is used to determine the height of the subregion according to the height of the corresponding position of the points in the predetermined region. After removing the noise points, the portion with a larger density is used as the predetermined region, so that the height of the subregion can be determined more accurately.
[0072] In practical applications, in order to simply and efficiently determine the height of the sub-area, in one embodiment of the present application, the eighth determination submodule includes an averaging submodule, which is used to average the heights corresponding to all the above points in the above predetermined area to obtain the height of the above sub-area.
[0073] Of course, in the present application, determining the height of a sub-area according to the height corresponding to a point in a predetermined area is not limited to the above-mentioned averaging algorithm, but may also be other algorithms. Those skilled in the art may determine the specific algorithm according to actual conditions.
[0074] In order to accurately obtain the height of the point projected in the sub-area, in one embodiment of the present application, a laser radar is used to obtain the corresponding 3D point cloud, and the height of the corresponding point is determined according to the color of the point, the height of the laser radar, and the position of the corresponding laser radar on the target mobile carrier. The laser radar has a high resolution, good concealment, strong anti-active interference ability, good low-altitude detection performance, and a small size and light weight.
[0075] In a specific embodiment, the second determination submodule is used to determine the above-mentioned height trajectory based on at least the height of each of the above-mentioned sub-areas, including: obtaining ground height information corresponding to each sub-area; determining the height of each point on the above-mentioned motion trajectory of the above-mentioned target mobile carrier according to the height of each of the above-mentioned sub-areas, the ground height information corresponding to each of the above-mentioned sub-areas and the angle of the above-mentioned 3D point cloud projection, and the height of the target mobile carrier refers to its altitude.
[0076] In order to ensure that the determined motion trajectory is more accurate and the height trajectory can be determined more accurately based on the motion trajectory, in one embodiment of the present application, the above-mentioned device also includes an acquisition unit and a second determination unit. The acquisition unit is used to acquire images that simultaneously display multiple frames of continuous 3D point clouds before acquiring 3D point clouds corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period. The second determination unit is used to determine the motion trajectory of the above-mentioned target mobile carrier based on the above-mentioned image.
[0077] In a specific embodiment of the present application, the second determination unit includes a second determination module and a third determination module, the second determination module is used to determine the position of the target mobile carrier corresponding to each frame on the image according to the size of the target mobile carrier, and the third determination module is used to determine the motion trajectory of the target mobile carrier according to the position of the target mobile carrier corresponding to each frame on the image. The position of the object in each frame is different, and determining the position of the frame where the target mobile carrier is located according to the size can ensure that the motion trajectory of the target mobile carrier can be accurately obtained.
[0078] In one embodiment of the present application, the third determination module includes a ninth determination submodule and a tenth determination submodule, the ninth determination submodule is used to determine the first boundary position and the second boundary position of the target mobile carrier corresponding to each frame on the image according to the size of the target mobile carrier, the direction in which the second boundary position points to the first boundary position is the same as the moving direction of the target mobile carrier, and the tenth determination submodule is used to determine the position of the target mobile carrier corresponding to each frame on the image according to the first boundary position and the second boundary position of the target mobile carrier corresponding to each frame on the image. In this way, the accurate position of the target mobile carrier corresponding to each frame on the image can be obtained, ensuring the validity of the data of the position of the target mobile carrier in each frame on the image. For example, in the case where the target moving carrier is a vehicle and the vehicle is traveling forward, the first boundary position is the front position of the vehicle, and the second boundary position is the rear position of the vehicle.
[0079] In actual applications, the height information of the height trajectory or the height information in the sub-area can be further utilized for machine training or simulation.
[0080] In one embodiment of the present application, the above-mentioned device also includes a third determination unit and a planning unit. The third determination unit is used to determine the road condition of the area corresponding to the motion trajectory according to the height trajectory after determining the above-mentioned height trajectory, and the planning unit is used to plan the driving strategy according to the road condition.
[0081] The above-mentioned motion information determination device includes a processor and a memory. The above-mentioned acquisition unit and the first determination unit, etc. are all stored in the memory as program units, and the processor executes the above-mentioned program units stored in the memory to realize corresponding functions.
[0082] The processor includes a kernel, which retrieves the corresponding program unit from the memory. One or more kernels can be set, and the specific conditions of the height of the road surface during the vehicle's driving process can be obtained by adjusting the kernel parameters, which is conducive to subsequent safe travel.
[0083] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.
[0084] An embodiment of the present invention provides a storage medium on which a program is stored. When the program is executed by a processor, the method for determining the height trajectory is implemented.
[0085] An embodiment of the present invention provides a processor, and the processor is used to run a program, wherein the method for determining the height trajectory is executed when the program is run.
[0086] An embodiment of the present invention provides a device, the device including a processor, a memory, and a program stored in the memory and executable on the processor, and when the processor executes the program, at least the following steps are implemented:
[0087] Step S101, obtaining a 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period, wherein the color of the points included in the 3D point cloud is related to the height of the corresponding position, and the surrounding environment includes the surrounding ground;
[0088] Step S102: determining the height trajectory of the target mobile carrier within the predetermined time period based on the 3D point cloud.
[0089] The devices in this article can be servers, PCs, PADs, mobile phones, etc.
[0090] The present application also provides a computer program product, which, when executed on a data processing device, is suitable for executing a program for initializing at least the following method steps:
[0091] Step S101, obtaining a 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period, wherein the color of the points included in the 3D point cloud is related to the height of the corresponding position, and the surrounding environment includes the surrounding ground;
[0092] Step S102: determining the height trajectory of the target mobile carrier within the predetermined time period based on the 3D point cloud.
[0093] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0094] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the above-mentioned units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.
[0095] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0096] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0097] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the above-mentioned methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.
[0098] From the above description, it can be seen that the above embodiments of the present application achieve the following technical effects:
[0099] 1) The method for determining the height trajectory of the present application first obtains the 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period, and the color of the points included in the above 3D point cloud is related to the height of the corresponding position, and the above surrounding environment includes the surrounding ground; secondly, based on the above 3D point cloud, the height trajectory of the above target mobile carrier within the above predetermined time period is determined. This method can determine the height trajectory of the target mobile carrier during driving, that is, the height corresponding to each point on its motion trajectory, so that the driving path of the mobile carrier can be planned according to the height of the predetermined area (the predetermined area formed by the motion trajectory) to ensure subsequent safe travel.
[0100] 2) The motion information determination device of the present application, the acquisition unit acquires the 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period, and the color of the points included in the above 3D point cloud is related to the height of the corresponding position, and the above surrounding environment includes the surrounding ground; the first determination unit determines the height trajectory of the above target mobile carrier within the above predetermined time period based on the above 3D point cloud. The device can determine the height trajectory of the target mobile carrier during driving, that is, the height corresponding to each point on its motion trajectory, so that the driving path of the mobile carrier can be planned according to the height of the predetermined area (the predetermined area formed by the motion trajectory) to ensure subsequent safe travel.
[0101] The above description is only the preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. A method for determining a height trajectory, characterized in that: include: Acquire a 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period, wherein the color of the points included in the 3D point cloud is related to the height of the corresponding position, and the surrounding environment includes the surrounding ground; Determining the height trajectory of the target mobile carrier within the predetermined time period according to the 3D point cloud, and determining the height trajectory of the target mobile carrier within the predetermined time period according to the 3D point cloud, including: Acquire motion trajectory information of the target mobile carrier within the predetermined time period, the motion trajectory information including position coordinates of each point on the motion trajectory of the target mobile carrier within the predetermined time period, and the 3D point cloud including points corresponding to the motion trajectory; Determine the height trajectory according to the 3D point cloud and the motion trajectory information, Determining the height trajectory according to the 3D point cloud and the motion trajectory information includes: dividing the area including the motion trajectory into a plurality of sub-areas; Computing the height of each sub-area according to the 3D point cloud; The height trajectory is determined at least according to the height of each of the sub-areas, and any two of the sub-areas are the same sub-areas, Computing the height of each sub-area according to the 3D point cloud includes: Projecting the 3D point cloud onto the sub-region; Determine the height of each sub-region according to the height of the corresponding position of the point located in each sub-region and / or outside each sub-region, Determining the height trajectory at least according to the height of each of the sub-areas includes: Obtaining ground height information corresponding to each sub-area; The height of each point of the target mobile carrier on the motion trajectory is determined according to the height of each sub-area, the ground height information corresponding to each sub-area and the angle of the 3D point cloud projection.
2. The method according to claim 1, characterized in that Determining the height of each sub-region according to the height of the corresponding position of the point located in each sub-region and / or outside each sub-region includes: When the point is projected into the sub-region, determining the height of the sub-region according to the height of the corresponding position of the point in each sub-region; When the point is not projected into the sub-region, the height of the sub-region is determined according to the height of the adjacent sub-region.
3. The method according to claim 2, characterized in that In a case where the point is projected into the sub-region, determining the height of the sub-region according to the height corresponding to the point in each sub-region includes: Obtaining the height of the corresponding position of each point in the sub-area; removing noise points in the sub-region according to the height of the corresponding position of each of the points, the height of the noise point being greater than the height corresponding to a first number of the points in the sub-region and / or less than the height corresponding to a second number of the points in the sub-region, the first number and / or the second number being less than the total number of the points in the sub-region; The height of the sub-region is determined according to the heights of corresponding positions of each of the points in the sub-region after the noise points are removed.
4. The method according to claim 3, characterized in that: Determining the height of the sub-region according to the height of the corresponding position of each point in the sub-region after removing the noise point includes: Determine a partial area of the sub-area after the noise points are removed as a predetermined area, and a density of the points in the predetermined area is greater than a predetermined density; The height of the sub-area is determined according to the height of the position corresponding to the point in the predetermined area.
5. The method according to claim 4, characterized in that Determining the height of the sub-area according to the height corresponding to the point in the predetermined area includes: The heights corresponding to all the points in the predetermined area are averaged to obtain the height of the sub-area.
6. The method according to any one of claims 1 to 5, characterized in that The laser radar is used to obtain the 3D point cloud corresponding to the surrounding environment of the target mobile carrier in each frame within a predetermined time period.
7. The method according to any one of claims 1 to 5, characterized in that Before obtaining the 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period, the method further includes: Collect and display images with multiple frames of 3D point clouds; The motion trajectory of the target mobile carrier is determined according to the image.
8. The method according to claim 7, characterized in that Determining the motion trajectory of the target mobile carrier according to the image includes: Determine the position of the target mobile carrier corresponding to each frame on the image according to the size of the target mobile carrier; The motion trajectory of the target mobile carrier is determined according to the position of the target mobile carrier on the image corresponding to each frame.
9. The method according to claim 8, characterized in that Determining the position of the target mobile carrier corresponding to each frame on the image according to the size of the target mobile carrier includes: Determine, according to the size of the target mobile carrier, a first boundary position and a second boundary position of the target mobile carrier corresponding to each frame on the image, wherein the direction in which the second boundary position points to the first boundary position is the same as the moving direction of the target mobile carrier; The position of the target mobile carrier corresponding to each frame on the image is determined according to the first boundary position and the second boundary position of each frame corresponding to the target mobile carrier on the image.
10. The method according to any one of claims 1 to 5, characterized in that After determining the altitude trajectory, the method further comprises: Determine the road surface condition of the area corresponding to the motion trajectory according to the height trajectory; Plan driving strategies based on road conditions.
11. A device for determining motion information, characterized in that: include: An acquisition unit, configured to acquire a 3D point cloud corresponding to the surrounding environment of each frame of the target mobile carrier within a predetermined time period, wherein the color of the points included in the 3D point cloud is related to the height of the position of the corresponding point, and the surrounding environment includes the surrounding ground; A first determining unit is configured to determine a height trajectory of the target mobile carrier within the predetermined time period according to the 3D point cloud, The first determination unit includes an acquisition module and a first determination module, the acquisition module is used to acquire the motion trajectory information of the target mobile carrier within the predetermined time period, the motion trajectory information includes the position coordinates of each point on the motion trajectory of the target mobile carrier within the predetermined time period, the 3D point cloud includes the points corresponding to the motion trajectory, and the first determination module is used to determine the height trajectory according to the 3D point cloud and the motion trajectory information. The first determination module includes a division submodule, a first determination submodule and a second determination submodule, the division submodule is used to divide the area including the motion trajectory into a plurality of sub-areas, the first determination submodule is used to calculate the height of each sub-area according to the 3D point cloud computing, the second determination submodule is used to determine the height trajectory according to at least the height of each sub-area, any two sub-areas are the same sub-areas, The second determination submodule includes a projection submodule and a third determination submodule, the projection submodule is used to project the 3D point cloud onto the subregion, the determination submodule is used to determine the height of each subregion according to the height of the corresponding position of the point located in each subregion and / or outside each subregion, The second determination submodule is used to determine the height trajectory based on at least the height of each sub-area, including: obtaining ground height information corresponding to each sub-area; determining the height of each point of the target mobile carrier on the motion trajectory based on the height of each sub-area, the ground height information corresponding to each sub-area and the angle of the 3D point cloud projection.
12. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein the program executes the determination method according to any one of claims 1 to 10.
13. A processor, characterized in that: The processor is used to run a program, wherein the program executes the determination method according to any one of claims 1 to 10 when running.
