Environmental perception method based on machine vision and millimeter wave radar data fusion

A millimeter-wave radar and data fusion technology, applied in the reflection/re-radiation of radio waves, instruments, computer parts, etc., can solve problems such as difficulty in meeting the accuracy and reliability requirements of the perception system, and improve reliability and effectiveness. , the effect of increasing stability and reducing the amount of calculation

CN111505624AActive Publication Date: 2020-08-07CHINA AUTOMOTIVE ENG RES INST +1
7 Cites 9 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Publication Date
2020-08-07

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention relates to the technical field of sensor data processing, in particular to an environmental perception method based on machine vision and millimeter wave radar data fusion. The method comprises a data acquisition step of acquiring the data of a radar system and a vision system; a data association matching step of obtaining the target object data lists detected by the two sensing systems, and performing matching association on the target object data detected by the two sensing systems; a target object tracking step of performing matching tracking on the target object, and updatingthe life cycle state of the target object; and a target object data fusion step of fusing the data signals of the target object outputted by the radar system and the visual system. According to the environment sensing method based on machine vision and millimeter wave radar data fusion, the advantages and disadvantages of two sensing systems of a vision system and a radar system can be fused to achieve the purpose of accurately sensing environment information, and the problem that a single-characteristic sensor is difficult to meet the precision and reliability requirements of a sensing system is solved.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the technical field of sensor data processing, in particular to an environment perception method based on machine vision and millimeter wave radar data fusion. Background technique

[0002] Cars have become an important part of transportation and an important choice for people to travel. As the number of automobiles continues to increase, traffic safety and energy consumption have increasingly become the main factors restricting the development of the automobile industry. The emergence of new energy, intelligence, and networking technologies for automobiles provides a solution to the above problems. "Intelligent networked vehicles" is an important development direction in the future, and intelligent networked electric vehicles have become a research hotspot in the automotive industry.

[0003] The key to the breakthrough of intelligent driving vehicles is to build high-precision, high-reliability and real-time environmental p...

Examples

Embodiment

[0058] Such as figure 1 , figure 2 with image 3 As shown, a kind of environment perception method based on machine vision and millimeter-wave radar data fusion of this embodiment includes the following contents:

[0059] The data acquisition step obtains the data of the millimeter wave radar system and the vision system (Mobileye);

[0060] The data association matching step is to obtain the target object data list detected by the two sensing systems, and perform matching and association on the target object data detected by the two sensing systems;

[0061] Target tracking step, matching and tracking the target, updating the life cycle status of the target;

[0062] The target data fusion step is to fuse the data signals of the target output by the millimeter wave radar system and the vision system.

[0063] Specifically, the data association matching steps include:

[0064] S100: Unify the coordinates of Mobileye and millimeter-wave radar, and screen the target, and i...