Vehicle radar and camera target fusion method, device, equipment and medium
The camera obtains road images and target information, adjusts the radar angle to integrate radar point cloud information, solves the blind spot problem of vehicle radar when body posture and road changes, and improves the target fusion accuracy and safety of intelligent driving system.
Patent Information
- Application Number
- CN202410991316.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-23
- Publication Date
- 2024-11-08
AI Technical Summary
When the existing vehicle radar changes body posture and road conditions, there are many blind spots and cannot accurately determine the target. Especially when uphill or downhill, the target point cloud information cannot be collected, resulting in the target integration of the intelligent driving system. precise.
The camera obtains road images and target information, adjusts the radar angle to obtain the target's radar point cloud information, and fuses the radar point cloud information with the target information to improve the radar acquisition accuracy. Specific steps include obtaining road images, extracting target position information, calculating the angle required for radar, controlling air suspension to adjust the radar angle, and acquiring and fusing radar point cloud information.
It improves the accuracy of radar point cloud information collection and target fusion accuracy, enables intelligent driving systems to make more accurate judgments and improves intelligent driving safety.
Smart Images

Figure CN118915070A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of vehicle radar and camera target fusion, and in particular to a vehicle radar and camera target fusion method, device, equipment and medium. Background Art
[0002] With the rapid development of smart cars, smart driving systems are also constantly being updated. How to make smart driving systems collect, process, and execute arbitration more quickly and accurately is the direction that the industry has been working towards.
[0003] Although smart driving vehicles are currently equipped with front radars for longitudinal function control of the vehicle, the radar angle is fixed. As the vehicle body posture changes, road conditions change, etc., there are many blind spots collected to a certain extent, which are not enough to determine whether they are precise targets. Summary of the invention
[0004] In view of the above shortcomings of the prior art, the present invention provides a method, device, equipment and medium for fusing vehicle radar and camera targets to improve the technical problem of many blind spots in vehicle radar collection when the vehicle body posture changes, road conditions change, etc.
[0005] To achieve the above-mentioned purpose and other related purposes, the present invention provides a vehicle radar and camera target fusion method, comprising acquiring a road image in front of a vehicle; acquiring target information in the road image, wherein the target information includes target position information; adjusting a radar angle according to the road image and the target position information; acquiring radar point cloud information of the target, and fusing the radar point cloud information with the target information.
[0006] In an exemplary embodiment of the present application, adjusting the radar angle according to the road image and the position information of the target includes: acquiring the road slope according to the road image; obtaining the required adjustment angle of the radar according to the road slope and the position information of the target; obtaining the required adjustment heights of the front and rear air suspensions according to the required adjustment angle of the radar and the front and rear air suspension travel margins; and controlling the front and rear air suspensions to adjust the required adjustment heights respectively, so that the radar adjusts the required adjustment angle.
[0007] In an exemplary embodiment of the present application, obtaining the required adjustment angle of the radar according to the road slope and the position information of the target includes: obtaining a radar pre-adjustment angle according to the road slope and the current target position information; obtaining the time required for radar adjustment unit angle according to the front and rear air suspension travel margin; obtaining the radar pre-adjustment time according to the radar pre-adjustment angle and the time required for radar adjustment unit angle; predicting the position information of the subsequent frame target after the radar pre-adjustment time according to the current target position information and the position information of the previous frame target; obtaining the required adjustment angle of the radar according to the road slope and the position information of the subsequent frame target.
[0008] In an exemplary embodiment of the present application, the location information of the target includes the distance between the target and the vehicle.
[0009] In an exemplary embodiment of the present application, adjusting the radar angle according to the road image and the position information of the target includes: acquiring the road slope and the distance between the vehicle and the foot of the slope according to the road image; obtaining the required adjustment angle of the radar according to the road slope, the distance between the vehicle and the foot of the slope, and the target position information; obtaining the required adjustment heights of the front and rear air suspensions according to the required adjustment angle of the radar and the front and rear air suspension travel margins; and controlling the front and rear air suspensions to adjust the required adjustment heights respectively, so that the radar adjusts the required adjustment angle.
[0010] In an exemplary embodiment of the present application, obtaining the required adjustment angle of the radar according to the road slope, the distance between the vehicle and the foot of the slope, and the target position information includes: obtaining the required angle of the radar according to the road slope, the distance between the vehicle and the foot of the slope, and the target position information; obtaining the current angle of the radar according to the vehicle inertial sensor; and obtaining the required adjustment angle of the radar according to the required angle of the radar and the current angle of the radar.
[0011] In an exemplary embodiment of the present application, the target position information includes the distance between the target and the foot of the slope. The present application also provides a vehicle radar and camera target fusion device, including: a road image acquisition module, used to acquire a road image in front of the vehicle; an image information processing module, which acquires target information in the road image, wherein the target information includes the position information of the target; a radar angle adjustment module, which adjusts the radar angle according to the road image and the position information of the target; and a target fusion module, which acquires radar point cloud information of the target and fuses the radar point cloud information with the target information.
[0012] The present application also provides an electronic device, which includes: one or more processors; a storage device for storing one or more programs, and when the one or more programs are executed by the one or more processors, the electronic device implements the vehicle radar and camera target fusion method as described in any one of the above.
[0013] The present application also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor of a computer, the computer is enabled to execute any one of the above-mentioned vehicle radar and camera target fusion methods.
[0014] In combination with the prior art, the beneficial effects of the present invention are:
[0015] When existing vehicles are going uphill or downhill, the field of view of the front radar is limited, resulting in the inability to collect point cloud information of targets on the uphill or downhill slopes, and thus the front camera and the front radar cannot be accurately fused. Compared with the front radar, the front camera has a longer detection distance and a wider range. The present application first obtains target information through the image collected by the front camera. The target information includes the location information of the target, and then adjusts the angle of the radar according to the road image and the location information of the target, so that the radar collects the point cloud information of the target, and then fuses the radar point cloud information and the target information for output, increasing the radar point cloud information to improve the accuracy of target fusion, so that the intelligent driving system can make more accurate judgments and improve the safety of intelligent driving. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0017] Figure 1 An exemplary vehicle radar and camera target fusion method of the present application is shown;
[0018] Figure 2 yes Figure 1 A flowchart of step S130 in the illustrated embodiment in an exemplary embodiment;
[0019] Figure 3 yes Figure 2 A flowchart of step S220 in the illustrated embodiment in an exemplary embodiment;
[0020] Figure 4 yes Figure 1 A flowchart of step S130 in the illustrated embodiment in another exemplary embodiment;
[0021] Figure 5 yes Figure 4 A flowchart of step S420 in the illustrated embodiment in an exemplary embodiment;
[0022] Figure 6A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown. DETAILED DESCRIPTION
[0023] The following is an explanation of the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the features in the following embodiments and the embodiments can be combined with each other without conflict. It should also be understood that the terms used in the embodiments of the present invention are intended to describe specific embodiments, rather than to limit the scope of protection of the present invention. The test methods for which specific conditions are not specified in the following examples are usually carried out under conventional conditions or according to the conditions recommended by the manufacturers.
[0024] When numerical ranges are given in the embodiments, it should be understood that, unless otherwise specified in the present invention, both endpoints of each numerical range and any value between the two endpoints can be selected. Unless otherwise defined, all technical and scientific terms used in the present invention are familiar to those skilled in the art and the description of the present invention, and any methods, equipment and materials of the prior art similar or equivalent to the methods, equipment and materials described in the embodiments of the present invention can also be used to implement the present invention.
[0025] It should be noted that the terms such as "upper", "lower", "left", "right", "middle" and "one" etc. used in this specification are only for the convenience of description and are not intended to limit the scope of implementation of the present invention. Changes or adjustments to their relative relationships, without substantially changing the technical content, should also be regarded as the scope of implementation of the present invention.
[0026] With the rapid development of smart cars, smart driving systems are also constantly being updated. How to make smart driving systems collect, process, and execute arbitration more quickly and accurately is the direction that the industry has been working on. Although smart driving vehicles are currently equipped with front radars for vehicle function control, as the body posture changes and road conditions change, the collection points are insufficient to a certain extent, resulting in insufficient determination of precise targets. For example, when the road ahead is an uphill section, the front radar is not sufficient to collect the target point cloud information on the ramp ahead in the longitudinal direction, and thus cannot be fused with the information collected by the front-view camera; similarly, if the vehicle is on a downhill ramp and there is a flat road ahead, the front radar is also unable to collect the target point cloud information on the flat road ahead.
[0027] In view of this, the present invention provides a vehicle radar and camera target fusion method to improve the accuracy of radar point cloud acquisition and improve the accuracy of target fusion.
[0028] See also Figure 1 , Figure 1 An exemplary vehicle radar and camera target fusion method of the present application is shown, and the specific steps are as follows:
[0029] Step S110: Acquire a road image in front of the vehicle.
[0030] Compared with radar, camera has a larger detection range and detection length. Through the camera, the road image in front of the vehicle can be obtained in advance, such as information such as the ramp ahead.
[0031] Step S120: Acquire target information in the road image, where the target information includes target location information.
[0032] By processing the road image in front of the vehicle acquired by the camera, the target information in the road image can be obtained, such as vehicle information, obstacle information, pedestrian information, etc. in the road image. The target information includes the position information of the target, such as the distance information between the target and the vehicle. Furthermore, if the target is on a ramp, the position information of the target can also include the position of the target on the ramp. For example, if the front is uphill, the position information of the target can include the distance between the target and the foot of the slope; for example, if the vehicle is going downhill on the ramp and the target is on the flat road in front of the ramp, the target information can include the distance between the target and the foot of the slope, etc. By obtaining the position information of the target, the radar angle of the vehicle can be adjusted according to the position information of the target.
[0033] Step S130: adjusting the radar angle according to the road image and the position information of the target.
[0034] The road information is obtained based on the road image, and the angle of the radar is adjusted in combination with the target's position information so that the radar can detect the target and obtain the radar point cloud information of the target.
[0035] Step S140: Acquire radar point cloud information of the target, and merge the radar point cloud information with the target information.
[0036] The radar point cloud information of the target is obtained by adjusting the angle of the radar, and the radar point cloud information is integrated with the target information obtained by the forward-looking camera to obtain the fusion perception information of the target. By fusing the radar and camera data, the advantages of both are fully utilized to make up for their respective shortcomings, so as to obtain a more comprehensive and accurate understanding of the target object.
[0037] The vehicle radar and camera target fusion method of the present application first utilizes the advantages of the long detection distance and wide range of the forward-looking camera to obtain the road image in front of the vehicle, and then extracts the target information, which includes the position information of the target. The angle of the radar is then adjusted according to the road conditions and the position information of the target, so that the radar can detect the target, thereby obtaining the radar point cloud information of the target, and improving the comprehensive and accurate understanding of the target object.
[0038] See also Figure 2 ,yes Figure 1 In the flowchart of step S130 in the illustrated embodiment in an exemplary embodiment, adjusting the radar angle according to the road image and the position information of the target specifically includes the following steps:
[0039] Step S210: Acquire the road slope according to the road image.
[0040] For example, the front-view camera performs denoising, contrast enhancement and other processing on the captured image, and then identifies features such as road edges and lane lines through image processing algorithms, and calculates the road slope based on the features and depth information extracted from the road image. Furthermore, the accuracy of the road slope can be improved through stereo vision.
[0041] Step S220: Obtaining the radar adjustment angle required according to the road slope and the position information of the target.
[0042] In an exemplary embodiment of the present application, the position information of the target includes the distance between the target and the vehicle. The angle between the vehicle and the target is obtained by measuring the slope of the road, the distance between the target and the vehicle, and the distance between the vehicle and the foot of the road slope. The angle required to adjust the radar is obtained in combination with the detection angle of the radar so that the radar can detect the target on the ramp, thereby obtaining radar point cloud information of the target on the ramp.
[0043] Step S230: Obtain the required adjustment heights of the front and rear air suspensions respectively according to the required adjustment angle of the radar and the front and rear air suspension travel margins.
[0044] The front and rear air suspensions have a certain travel margin, that is, the air suspension allows the wheels to move up and down within the maximum range relative to the vehicle body. The air suspension is adjusted according to the adjustment angle required by the radar, such as by adjusting the front or rear wheels separately by inflating and deflating the air, so that the vehicle body posture is adjusted, thereby driving the vehicle's front radar to adjust the angle and adjust the detection angle of the front radar so that the front radar can detect the target object and obtain the point cloud information of the target object.
[0045] Step S240: Control the front and rear air suspensions to adjust the required adjustment heights respectively, so that the radar adjusts the required adjustment angle.
[0046] During the air suspension adjustment process, the front suspension can be adjusted separately, the rear suspension can be adjusted separately, or the front and rear suspensions can be adjusted simultaneously to take into account the adjustment efficiency, adjustment range, and the comfort of the vehicle's passengers. After the air suspension is adjusted, the radar is adjusted to the required adjustment angle to obtain the radar point cloud information of the target object.
[0047] See also Figure 3 , Figure 3 yes Figure 2 The flowchart of step S220 in the illustrated embodiment in an exemplary embodiment. In order to take into account both the adjustment speed of the air suspension and the accuracy of radar detection, the movement of the target object is judged so that the angle after the radar adjustment can detect the target object and reduce over-adjustment, thereby increasing the speed of radar adjustment and improving the comfort of the driver and passengers. The specific steps are as follows:
[0048] Step S310: obtaining a radar pre-adjustment angle according to the road slope and the position information of the current target.
[0049] First, according to the road slope, the position information of the current target, and the distance between the vehicle and the foot of the slope or the distance between the target and the foot of the slope, the angle between the vehicle and the target in the current frame is obtained, and then the radar pre-adjustment angle is obtained.
[0050] Step S320: Obtain the time required for the radar to adjust a unit angle according to the front and rear air suspension travel margins.
[0051] According to the air suspension travel margin and the inflation and deflation speed of the air suspension, the time required for the radar to adjust a unit angle can be obtained.
[0052] Step S330: Obtain radar pre-adjustment time according to the radar pre-adjustment angle and the time required for the radar to adjust a unit angle.
[0053] Step S340: predicting the position information of the next frame target after the radar pre-adjustment time according to the current target position information and the position information of the previous frame target.
[0054] Based on the position information of the current target and the position information of the target in the previous frame, the moving speed and movement trend between the vehicle and the target can be obtained. Based on the pre-adjustment time of the radar, the predicted position information of the target when the radar is adjusted to the pre-adjustment angle can be obtained.
[0055] Step S350: Obtain the required adjustment angle of the radar according to the road slope and the position information of the target in the subsequent frame.
[0056] According to the slope of the road and the position information of the target in the rear frame, that is, according to the slope of the road and the predicted position information of the target, the required adjustment angle of the radar is recalculated, and then the angle of the radar is adjusted according to the required radar adjustment angle. The efficiency of radar adjustment can be improved, and useless radar adjustment can be reduced. By combining the adjustment speed of the air suspension, the adjustment range of the air suspension can be reduced while the radar can detect the target, thereby improving the adjustment efficiency.
[0057] See also Figure 4 , Figure 4 yes Figure 1 Step S130 in the illustrated embodiment is a flow chart in another exemplary embodiment. In another exemplary embodiment of the present application, adjusting the radar angle according to the road image and the position information of the target includes the following steps:
[0058] Step S410: Acquire the road slope and the distance between the vehicle and the foot of the slope according to the road image.
[0059] Step S420: Obtain the radar adjustment angle required according to the road slope, the distance between the vehicle and the foot of the slope, and the target position information.
[0060] The target location information includes at least one of the distance between the target and the vehicle and the distance between the target and the foot of the slope. The angle between the target and the vehicle can be obtained according to the road slope, the distance between the vehicle and the foot of the slope, and the target location information, and then the radar adjustment angle can be obtained according to the radar detection angle and detection distance.
[0061] Step S430: Obtain the required adjustment heights of the front and rear air suspensions respectively according to the required adjustment angle of the radar and the front and rear air suspension travel margins.
[0062] During adjustment, you can adjust the height of the front air suspension individually, you can also adjust the height of the rear air suspension individually, or you can adjust the height of the front air suspension and the rear air suspension separately to increase the adjustment speed.
[0063] Step S440 controls the front and rear air suspensions to adjust the required adjustment heights respectively, so that the radar adjusts the required adjustment angle.
[0064] By inflating and deflating the air suspension to adjust its height, the radar can adjust the required angle, so that the radar can also detect the target and obtain radar point cloud information of the target. By fusing the radar point cloud information with the target information obtained by the front camera, a more accurate and comprehensive perception of the target can be obtained.
[0065] See also Figure 5 , Figure 5 yes Figure 4Step S420 in the illustrated embodiment is a flowchart in an exemplary embodiment. In an exemplary embodiment of the present application, obtaining the radar adjustment angle required according to the road slope, the distance between the vehicle and the foot of the slope, and the target position information includes the following steps:
[0066] Step S510: Obtain the required angle of the radar according to the road slope, the distance between the vehicle and the foot of the slope, and the target position information.
[0067] Step S520: Obtain the current angle of the radar according to the vehicle inertial sensor.
[0068] When the vehicle is on a slope and the target object is on the road outside the slope, the vehicle's inclination angle can be obtained through the vehicle's inertial sensor, and then the current angle of the radar can be obtained.
[0069] Step S530: obtaining the radar adjustment angle required according to the radar required angle and the radar current angle.
[0070] In an exemplary embodiment of the present application, the target position information includes the distance between the target and the foot of the slope. The present application also provides a vehicle radar and camera target fusion device, including: a road image acquisition module, used to acquire a road image in front of the vehicle; an image information processing module, which acquires target information in the road image, wherein the target information includes the position information of the target; a radar angle adjustment module, which adjusts the radar angle according to the road image and the position information of the target; and a target fusion module, which acquires radar point cloud information of the target and fuses the radar point cloud information with the target information.
[0071] An embodiment of the present application also provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the electronic device implements the vehicle radar and camera target fusion method provided in the above-mentioned embodiments.
[0072] Figure 6 The structure diagram of the computer system suitable for implementing the electronic device of the embodiment of the present application is shown. It should be noted that: Figure 6 The computer system 600 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0073] like Figure 6As shown, the computer system 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 602 or the program loaded from the storage part 608 to the random access memory (RAM) 603, such as executing the method described in the above embodiment. In the RAM 603, various programs and data required for system operation are also stored. The CPU 601, ROM 602 and RAM 603 are connected to each other through a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.
[0074] The following components are connected to the I / O interface 605: an input section 606 including a keyboard, a mouse, etc.; an output section 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 608 including a hard disk, etc.; and a communication section 609 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the I / O interface 605 as needed. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 610 as needed so that a computer program read therefrom is installed into the storage section 608 as needed.
[0075] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 609, and / or installed from a removable medium 611. When the computer program is executed by a central processing unit (CPU) 601, various functions defined in the system of the present application are executed.
[0076] It should be noted that the computer-readable medium shown in the embodiment of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable computer program is carried. This propagated data signal can take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. A computer program contained on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.
[0077] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0078] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.
[0079] Another aspect of the present application further provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor of a computer, the computer executes the vehicle radar and camera target fusion method as described above. The computer-readable storage medium may be included in the electronic device described in the above embodiment, or may exist independently without being assembled into the electronic device.
[0080] Another aspect of the present application further provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the vehicle radar and camera target fusion method provided in each of the above embodiments.
[0081] The vehicle radar and camera target fusion method of the present invention can obtain radar point cloud information of target objects on or below the slope by adjusting the angle of the radar, and then obtain a clearer and more accurate perception of the target object by fusing the radar point cloud information with the target information. Therefore, the present invention effectively overcomes some practical problems in the prior art and has a high utilization value and use significance. The above embodiments are only illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with this technology may modify or change the above embodiments without violating the spirit and scope of the present invention. Therefore, all equivalent modifications or changes made by those with ordinary knowledge in the relevant technical field without departing from the spirit and technical ideas disclosed by the present invention should still be covered by the claims of the present invention.
Claims
1. A vehicle radar and camera target fusion method, It is characterized in that include: Acquire a road image in front of the vehicle; Acquire target information in the road image, wherein the target information includes location information of the target; adjusting the radar angle according to the road image and the position information of the target; Acquire radar point cloud information of the target, and fuse the radar point cloud information with the target information.
2. The vehicle radar and camera target fusion method according to claim 1, It is characterized in that Adjusting the radar angle according to the road image and the position information of the target includes: Acquiring a road slope according to the road image; Obtaining the required adjustment angle of the radar according to the road slope and the position information of the target; The required adjustment heights of the front and rear air suspensions are obtained according to the required adjustment angle of the radar and the travel margin of the front and rear air suspensions; Control the front and rear air suspensions to adjust the required heights respectively, so that the radar can adjust the required angles.
3. The vehicle radar and camera target fusion method according to claim 2, It is characterized in that Obtaining the required adjustment angle of the radar according to the road slope and the position information of the target includes: Obtaining a radar pre-adjustment angle according to the road slope and the position information of the current target; The time required for the radar to adjust a unit angle is obtained according to the front and rear air suspension travel margins; Obtaining a radar pre-adjustment time according to the radar pre-adjustment angle and the time required for the radar to adjust a unit angle; Predicting the position information of the next frame target after the radar pre-adjustment time according to the current target position information and the previous frame target position information; The required adjustment angle of the radar is obtained according to the road slope and the position information of the target in the subsequent frame.
4. The vehicle radar and camera target fusion method according to claim 1, It is characterized in that The location information of the target includes the distance between the target and the vehicle.
5. The vehicle radar and camera target fusion method according to claim 1, It is characterized in that Adjusting the radar angle according to the road image and the position information of the target includes: Acquire the road slope and the distance between the vehicle and the foot of the slope according to the road image; Obtaining the required adjustment angle of the radar according to the road slope, the distance between the vehicle and the foot of the slope, and the target position information; The required adjustment heights of the front and rear air suspensions are obtained according to the required adjustment angle of the radar and the travel margin of the front and rear air suspensions; Control the front and rear air suspensions to adjust the required heights respectively, so that the radar can adjust the required angles.
6. The vehicle radar and camera target fusion method according to claim 5, It is characterized in that Obtaining the required adjustment angle of the radar according to the road slope, the distance between the vehicle and the foot of the slope, and the target position information includes: Obtaining the required angle of the radar according to the road slope, the distance between the vehicle and the foot of the slope, and the target position information; Get the current angle of the radar based on the vehicle inertial sensor; The required adjustment angle of the radar is obtained according to the required angle of the radar and the current angle of the radar.
7. The vehicle radar and camera target fusion method according to claim 5, It is characterized in that The target location information includes the distance between the target and the foot of the slope.
8. A vehicle radar and camera target fusion device, It is characterized in that include: A road image acquisition module, used to acquire a road image in front of the vehicle; An image information processing module is used to obtain target information in the road image, wherein the target information includes location information of the target; A radar angle adjustment module, which adjusts the radar angle according to the road image and the position information of the target; The target fusion module obtains radar point cloud information of the target and fuses the radar point cloud information with the target information.
9. An electronic device, It is characterized in that The electronic device comprises: one or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, enables the electronic device to implement the vehicle radar and camera target fusion method as described in any one of claims 1 to 7.
10. A computer-readable storage medium, It is characterized in that A computer program is stored thereon, and when the computer program is executed by a processor of a computer, the computer is enabled to execute the vehicle radar and camera target fusion method according to any one of claims 1 to 7.
