Intelligent sensing laser radar system and intelligent sensing laser radar control method

Through intelligent controllers, adjusting the performance of lidar and camera, and integrating the advantages of lidar and camera, solving the problems of insufficient intelligence and insufficient resolution in the existing technology, and achieving intelligent perception with high resolution and high response speed .

CN109061606BActive Publication Date: 2025-01-07SUTENG INNOVATION TECHNOLOGY CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN201811091633.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2018-09-19
Publication Date
2025-01-07
Estimated Expiration
2038-09-19

AI Technical Summary

Technical Problem

The existing solution to integrate the laser radar and cameras into perceive the environment is not complete enough, and the advantages of both cannot be fully utilized, resulting in insufficient perception of the environment and insufficient resolution and response speed.

Method used

Provide an intelligent sensing lidar system, including a perceptron and an intelligent controller, which can be a solid-state lidar and a camera. The intelligent controller adjusts the detection and imaging performance of the perceptron based on the perceived environmental information to improve resolution and Response speed, realize intelligent perception.

Benefits of technology

By integrating the advantages of lidar and cameras, the perceived resolution and fineness of the environment can be improved, and high resolution and frame rate of key scanning areas can be achieved, data processing time is optimized, bandwidth is reduced, and timeliness is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN109061606B_ABST
    Figure CN109061606B_ABST
Patent Text Reader

Abstract

The embodiments of the present invention disclose an intelligent sensing laser radar system and an intelligent sensing laser radar control method, wherein the system includes: a sensor for sensing the environment; and an intelligent controller for adjusting the detection performance of the sensor according to the information of the environment sensed by the sensor. The sensor in the embodiments of the present invention may include multiple sensors, so the advantages of multiple sensors can be integrated to improve the resolution and precision of the sensed environment. In addition, the embodiments of the present invention can also adjust the detection performance of the sensor according to the environmental information sensed by the sensor to achieve intelligent sensing.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of perception, and in particular to an intelligent perception laser radar system and an intelligent perception laser radar control method. Background Art

[0002] LiDAR is a radar system that emits laser beams to detect target characteristics such as position and speed. Its working principle is to first emit a detection laser beam to the target, and then compare the received signal reflected from the target with the transmitted signal. After appropriate processing, relevant information about the target can be obtained, such as target distance, direction, altitude, speed, attitude, and even shape parameters.

[0003] LiDAR can obtain high-precision three-dimensional spatial information, but its vertical resolution is not enough, and its perception of the environment is not fine enough. In addition, the point cloud information obtained by LiDAR does not contain color information, so the effective recognition rate of traffic signs, traffic lights and other information is low. Cameras can obtain rich two-dimensional color information from the real world, which is of great help in perceiving the world, but cameras can only obtain two-dimensional information and have a slow response speed.

[0004] In order to utilize the advantages of both lidar and cameras at the same time, the lidar and cameras can be integrated with each other. However, the solutions for integrating lidar and cameras to perceive the environment in the existing technology are not perfect, cannot fully utilize the advantages of both, and the perception of the environment is not intelligent enough. Summary of the invention

[0005] The embodiments of the present invention provide an intelligent perception laser radar system and an intelligent perception laser radar control method, which can integrate different sensors and have a more intelligent perception of the environment.

[0006] In order to solve the above technical problems, the embodiments of the present invention disclose the following technical solutions:

[0007] To solve the above problems, the present invention provides the following solutions:

[0008] In a first aspect, an intelligent perception laser radar system is provided, the system comprising:

[0009] Sensors, used to sense the environment;

[0010] The intelligent controller is used to adjust the detection performance of the sensor according to the information of the environment sensed by the sensor.

[0011] Optionally, the sensor includes:

[0012] Solid-state laser radar, used to detect the object being measured;

[0013] A camera is used to image the object to be measured and classify the object to be measured according to the image of the object to be measured.

[0014] Optionally, the intelligent controller adjusts the detection performance of the sensor according to the information of the environment sensed by the sensor, including:

[0015] The intelligent controller adjusts the detection performance of the solid-state laser radar according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar; and / or

[0016] The intelligent controller adjusts the imaging performance of the camera according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar; and / or

[0017] The intelligent controller adjusts the detection performance of the solid-state laser radar and the imaging performance of the camera according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar.

[0018] Optionally, the sensor senses the environment, including:

[0019] The sensor senses the detection distance, including long-distance detection, and / or medium-distance detection, and / or short-distance detection;

[0020] The sensing detection range of the sensor includes wide horizontal range detection and / or narrow horizontal range;

[0021] The sensor senses the key scanning area.

[0022] Optionally, the intelligent controller adjusts the detection performance of the solid-state laser radar, including:

[0023] Adjusting the detection distance of the solid-state laser radar;

[0024] Adjusting the detection range of the solid-state laser radar;

[0025] The resolution of the solid-state laser radar is adjusted so that the solid-state laser radar adopts high resolution in the key scanning area.

[0026] Optionally, the intelligent controller adjusts the detection performance of the solid-state laser radar, including:

[0027] Adjusting the scanning mode of the solid-state laser radar so that the solid-state laser radar focuses on scanning the key scanning area;

[0028] Adjusting the laser power of the solid-state laser radar;

[0029] Adjusting the energy superposition method of the data collected by the solid-state laser radar;

[0030] Adjusting the pixel superposition method of the data collected by the solid-state laser radar;

[0031] Adjust the scanning range of the solid-state laser radar.

[0032] Optionally, the intelligent controller adjusts the imaging performance of the camera, including:

[0033] Adjusting the imaging range of the camera;

[0034] adjusting the imaging depth of the camera;

[0035] Adjusting the resolution of the camera so that the camera uses a high resolution in the key scanning area;

[0036] The imaging frame number of the camera per unit time is adjusted so that the camera uses a high frame number in the key scanning area.

[0037] In a second aspect, a smart sensing laser radar control method is provided, the method comprising:

[0038] Sensors sense the environment;

[0039] The intelligent controller adjusts the detection performance of the sensor according to the information of the environment sensed by the sensor.

[0040] Optionally, the sensor senses the environment, including:

[0041] Solid-state laser radar detects the object being measured;

[0042] The camera images the object to be measured, and classifies the object to be measured according to the image of the object to be measured.

[0043] Optionally, the intelligent controller adjusts the detection performance of the sensor according to the information of the environment sensed by the sensor, including:

[0044] The intelligent controller adjusts the detection performance of the solid-state laser radar according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar; and / or

[0045] The intelligent controller adjusts the imaging performance of the camera according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar; and / or

[0046] The intelligent controller adjusts the detection performance of the solid-state laser radar and the imaging performance of the camera according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar.

[0047] An embodiment of the present invention discloses an intelligent perception laser radar system, including: a sensor for perceiving an environment; and an intelligent controller for adjusting the detection performance of the sensor according to the information of the environment perceived by the sensor. The sensor in the embodiment of the present invention may include multiple sensors, so the advantages of multiple sensors can be integrated to improve the resolution and precision of the perceived environment. In addition, the embodiment of the present invention can also adjust the detection performance of the sensor according to the environmental information perceived by the sensor to achieve intelligent perception. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0049] Figure 1 Shown is a schematic diagram of an intelligent sensing laser radar system according to an embodiment of the present invention;

[0050] Figure 2 Shown is a schematic diagram of an application scenario of an embodiment of the present invention. DETAILED DESCRIPTION

[0051] The following embodiments of the present invention provide an intelligent perception laser radar system and an intelligent perception laser radar control method, which can improve the resolution and fineness of the perceived environment, and can also adjust the detection performance of the sensor according to the environmental information perceived by the sensor to achieve intelligent perception.

[0052] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0053] Figure 1 FIG. 1 is a schematic diagram of an intelligent sensing laser radar system according to an embodiment of the present invention. Figure 1 As shown, the system comprises:

[0054] A sensor 110, used for sensing the environment;

[0055] The intelligent controller 120 is used to adjust the detection performance of the sensor according to the information of the environment sensed by the sensor.

[0056] In the embodiment of the present invention, the sensor 110 includes:

[0057] A solid-state laser radar 111, used for detecting an object to be detected;

[0058] The camera 112 is used to image the object to be measured and classify the object to be measured according to the image of the object to be measured.

[0059] Figure 1 The sensor 110 and the intelligent controller 120 in the embodiment can be integrated together, or can be separately arranged. The present invention is reasonable. The intelligent sensing laser radar system can be arranged on the roof as shown in 1, or can be arranged at other positions.

[0060] Figure 1 The two sectors in the figure can represent the sensing range of different sensors.

[0061] The intelligent sensing laser radar system of the embodiment of the present invention includes: a sensor for sensing the environment; and an intelligent controller for adjusting the detection performance of the sensor according to the information of the environment sensed by the sensor. The sensor in the embodiment of the present invention may include multiple sensors, such as solid-state laser radar and camera, so that the advantages of multiple sensors can be integrated to improve the resolution, precision, response speed, etc. of the sensed environment. In addition, the embodiment of the present invention can also adjust the detection performance of the sensor according to the environmental information sensed by the sensor to achieve intelligent perception of the environment.

[0062] In an embodiment of the present invention, the perception of the object to be measured by the solid-state laser radar and the camera can be processed separately first and then fused. For example, the solid-state laser radar detects the speed, position, etc. of the object to be measured, the camera images the object to be measured, classifies the object, and then classifies and tracks the object to be measured based on the detection results. Alternatively, the fusion processing can be directly performed, for example, the point cloud detected by the solid-state laser radar and the imaging of the object to be measured by the camera are superimposed to form a colored point cloud. Through the processing of the colored point cloud, the classification of the measured object, the ranging, tracking, and alarm of the measured object are realized.

[0063] In an embodiment of the present invention, the intelligent controller adjusts the detection performance of the sensor according to the information of the environment sensed by the sensor, including:

[0064] The intelligent controller adjusts the detection performance of the solid-state laser radar according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar; and / or

[0065] The intelligent controller adjusts the imaging performance of the camera according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar; and / or

[0066] The intelligent controller adjusts the detection performance of the solid-state laser radar and the imaging performance of the camera according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar.

[0067] That is, in the embodiment of the present invention, there may be many types of sensors, for example, the sensor may be a solid-state laser radar, which may be a MEMS laser radar, an OPA laser radar, etc., or the sensor may be a camera, a video camera, a camera, or other imaging device. In the embodiment of the present invention, the performance of any sensor and all other sensors may be automatically adjusted according to the perception results of any sensor; or the performance of any sensors and all other sensors may be automatically adjusted according to the perception results of any sensors; or the performance of a certain sensor may be automatically adjusted according to the perception results of any one or any several sensors.

[0068] In the embodiment of the present invention, the sensor senses the environment, including:

[0069] The sensor senses the detection distance, including long-distance detection, and / or medium-distance detection, and / or short-distance detection;

[0070] The sensing detection range of the sensor includes wide horizontal range detection and / or narrow horizontal range;

[0071] The sensor senses the key scanning area.

[0072] Different detection distances and detection ranges are suitable for different detection targets. For example, on highways, sensors are required to detect long distances, but with a narrow horizontal detection range. In complex urban road environments, sensors are required to detect medium distances, but with a wide horizontal range. In this case, the key scanning areas may be directly in front and to the left and right sides. If it is automatic delivery, the sensors detect medium and short distances, with a wide horizontal range. In this case, the key scanning areas may be road signs or road signs.

[0073] The perception of the key scanning area can be confirmed by analyzing the objects being measured in the previous time period, or can be confirmed by the number, changes, etc. of the objects being measured in the previous time period, or can be confirmed by other methods, which will not be elaborated here.

[0074] In the embodiment of the present invention, the intelligent controller can adjust the detection performance of the sensor and the detection performance of the solid-state laser radar, including:

[0075] Adjusting the detection distance of the solid-state laser radar;

[0076] Adjusting the detection range of the solid-state laser radar;

[0077] The resolution of the solid-state laser radar is adjusted so that the solid-state laser radar adopts high resolution in the key scanning area.

[0078] In an embodiment of the present invention, the intelligent controller adjusts the detection performance of the solid-state laser radar, and further includes:

[0079] Adjusting the scanning mode of the solid-state laser radar so that the solid-state laser radar focuses on scanning the key scanning area;

[0080] Adjusting the laser power of the solid-state laser radar;

[0081] Adjusting the energy superposition method of the data collected by the solid-state laser radar;

[0082] Adjusting the pixel superposition method of the data collected by the solid-state laser radar;

[0083] Adjust the scanning range of the solid-state laser radar.

[0084] With the rapid development of solid-state LiDAR technology, high resolution and high frame rate are inevitable trends, but high resolution and high frame rate will lead to oversampling of solid-state LiDAR data. Through the feedback of the sensor, the embodiment of the present invention can sense the key scanning area, thereby improving the resolution and frame rate of the key scanning area, and at the same time can adjust the energy superposition method and pixel superposition method of the key scanning area; for non-key scanning areas, the resolution and frame rate can be reduced, and the energy superposition method and pixel superposition method of the non-key scanning area can be adjusted. The above method can solve the problems of oversampling and undersampling in the data acquisition process, so that while improving the detection precision, it can optimize the data processing time, reduce the bandwidth, and improve timeliness.

[0085] In an embodiment of the present invention, the detection distance, detection range, and resolution of the solid-state laser radar can be changed by changing the driving voltage, current, and the like, or the energy superposition method, pixel superposition method, and the like can be adjusted through an algorithm, or the detection performance of the solid-state laser radar can be adjusted through other methods.

[0086] In an embodiment of the present invention, the intelligent controller adjusts the imaging performance of the camera, including:

[0087] Adjusting the imaging range of the camera;

[0088] adjusting the imaging depth of the camera;

[0089] Adjusting the resolution of the camera so that the camera uses a high resolution in the key scanning area;

[0090] The imaging frame number of the camera per unit time is adjusted so that the camera uses a high frame number in the key scanning area.

[0091] For example, on a highway, the imaging range can be the range of road signs, and if it is on a complex urban road, the imaging range can be limited to the traffic lights and road signs. Similarly, based on the sensor's perception information, the performance of the camera can be adjusted to solve the problems of oversampling and undersampling during data collection, thereby improving the detection precision while optimizing data processing time, reducing bandwidth, and improving timeliness.

[0092] Figure 2 FIG. 1 is a schematic diagram of an application scenario of an embodiment of the present invention. Figure 2 As shown, the scanning range of the solid-state laser radar is a rectangle 210, and the scanning range of the camera is a circle 220. In the intelligent sensing laser radar system of the embodiment of the present invention, according to the environment sensed by the solid-state laser radar and the camera, the intelligent controller confirms the key scanning area 230 of the current time period, adjusts the solid-state laser radar and the camera, and performs a key scanning on the key scanning area 230.

[0093] Figure 2 In FIG. 2 , points represent the density of point cloud data. A sparser point cloud represents a lower resolution, while a denser point cloud in the key scanning area 230 represents a higher resolution in the area.

[0094] As the application scenario changes, the key scanning area can also change. Figure 2 The 240 in FIG. 240 can be regarded as a key scanning area in the next time period. For easy distinction, the border of the area is a dotted line.

[0095] An embodiment of the present invention provides an intelligent perception laser radar system, including a sensor and an intelligent controller. The sensor is used to perceive the environment. The intelligent controller adjusts the detection performance of the sensor according to the information of the environment perceived by the sensor, so that the sensor can detect according to needs and the environment. The detection performance can be adjusted in real time to improve accuracy, precision and timeliness, thereby obtaining more and more effective information.

[0096] Corresponding to the above-mentioned intelligent perception laser radar system, an embodiment of the present invention further provides an intelligent perception laser radar control method, the method comprising:

[0097] Sensors sense the environment;

[0098] The intelligent controller adjusts the detection performance of the sensor according to the information of the environment sensed by the sensor.

[0099] In the embodiment of the present invention, the sensor senses the environment, including:

[0100] Solid-state laser radar detects the object being measured;

[0101] The camera images the object to be measured, and classifies the object to be measured according to the image of the object to be measured.

[0102] In an embodiment of the present invention, the intelligent controller adjusts the detection performance of the sensor according to the information of the environment sensed by the sensor, including:

[0103] The intelligent controller adjusts the detection performance of the solid-state laser radar according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar; and / or

[0104] The intelligent controller adjusts the imaging performance of the camera according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar; and / or

[0105] The intelligent controller adjusts the detection performance of the solid-state laser radar and the imaging performance of the camera according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar.

[0106] The embodiments of the present invention disclose an intelligent sensing laser radar system and an intelligent sensing laser radar control method, including: a sensor for sensing the environment; and an intelligent controller for adjusting the detection performance of the sensor according to the information of the environment sensed by the sensor. The sensor in the embodiments of the present invention may include multiple sensors, so the advantages of multiple sensors can be integrated to improve the resolution and precision of the sensed environment. In addition, the embodiments of the present invention can also adjust the detection performance of the sensor according to the environmental information sensed by the sensor to achieve intelligent perception.

[0107] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus necessary general hardware, and the general hardware includes general integrated circuits, general CPUs, general memories, general components, etc., and of course, it can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc., but in many cases the former is a better implementation method. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a storage medium, such as a read-only memory (ROM), a random access memory (RAM), a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention or some parts of the embodiments.

[0108] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0109] The above-described embodiments of the present invention do not constitute a limitation on the protection scope of the present invention. Any modification, equivalent replacement and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. An intelligent sensing laser radar system, characterized in that: The system comprises: A sensor, used to sense the environment, and the sensor is also used to confirm a key scanning area according to the number of objects to be detected; The sensor includes a solid-state laser radar and a camera, wherein the solid-state laser radar is used to detect the object to be detected, and the camera is used to image the object to be detected, and classify the object to be detected according to the imaging of the object to be detected; An intelligent controller, used to adjust the detection performance of the sensor according to the information of the environment sensed by the sensor; The intelligent controller is used to adjust the detection performance of the sensor, including: the intelligent controller is used to adjust the resolution of the solid-state laser radar, wherein the resolution of the solid-state laser radar in the key scanning area is greater than the resolution in the non-key scanning area; the intelligent controller is also used to adjust the number of imaging frames per unit time of the camera, wherein the number of imaging frames per unit time of the camera in the key scanning area is greater than the number of imaging frames per unit time of the non-key scanning area.

2. The system according to claim 1, characterized in that The solid-state laser radar is a MEMS laser radar or an OPA laser radar.

3. The system according to claim 1, characterized in that The intelligent controller adjusts the detection performance of the sensor according to the information of the environment sensed by the sensor, including: The intelligent controller adjusts the detection performance of the solid-state laser radar according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar; and / or The intelligent controller adjusts the imaging performance of the camera according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar; and / or The intelligent controller adjusts the detection performance of the solid-state laser radar and the imaging performance of the camera according to the classification of the measured object obtained by the camera and / or the measured object obtained by the solid-state laser radar.

4. The system according to claim 1, characterized in that The sensor senses the environment, including: The sensor senses the detection distance, including long-distance detection, and / or medium-distance detection, and / or short-distance detection; The sensing detection range of the sensor includes wide horizontal range detection and / or narrow horizontal range detection.

5. The system according to claim 3, characterized in that The intelligent controller adjusts the detection performance of the solid-state laser radar, including: Adjusting the detection distance of the solid-state laser radar; Adjust the detection range of the solid-state laser radar.

6. The system according to claim 5, characterized in that The intelligent controller adjusts the detection performance of the solid-state laser radar, including: Adjusting the laser power of the solid-state laser radar; Adjusting the energy superposition method of the data collected by the solid-state laser radar; Adjusting the pixel superposition method of the data collected by the solid-state laser radar; Adjust the scanning range of the solid-state laser radar.

7. The system according to claim 6, characterized in that The intelligent controller adjusts the imaging performance of the camera, including: Adjusting the imaging range of the camera; adjusting the imaging depth of the camera; The resolution of the camera is adjusted so that the camera uses a high resolution in the key scanning area.

8. An intelligent sensing laser radar control method, characterized in that: The method comprises: The sensor senses the environment, and the sensor determines the key scanning area according to the number of objects to be detected; The sensor includes a solid-state laser radar and a camera, and the sensor senses the environment including: the solid-state laser radar detects the object to be measured; the camera images the object to be measured, and classifies the object to be measured according to the imaging of the object to be measured; The intelligent controller adjusts the detection performance of the sensor according to the information of the environment sensed by the sensor; The intelligent controller adjusts the detection performance of the sensor including: the intelligent controller adjusts the resolution of the solid-state laser radar, wherein the resolution of the solid-state laser radar in the key scanning area is greater than the resolution in the non-key scanning area; the intelligent controller adjusts the number of imaging frames per unit time of the camera, wherein the number of imaging frames per unit time of the camera in the key scanning area is greater than the number of imaging frames per unit time of the non-key scanning area.

Citation Information

Patent Citations

  • Interaction method and system used for vehicle test of intelligent vehicle

    CN105938052A

  • Intelligent sensing laser radar system

    CN209117856U