Radar generated color semantic image system and method based on conditional generative adversarial network

A color map and radar technology, applied in the fields of sensors and artificial intelligence, can solve problems such as incomplete road environment information, increased load on unmanned vehicles' battery life calculation chips, and inaccurate accuracy, so as to avoid imaging uncertainty and inaccuracy. The effects of stability, elimination of road shadows, and high efficiency
CN107862293AActive Publication Date: 2018-03-30BEIHANG UNIV
7 Cites 75 Cited by

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
BEIHANG UNIV
Publication Date
2018-03-30

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a radar generated color semantic image system and method based on a conditional generative adversarial network, which belong to the technical fields of sensors and artificial intelligence. The system includes a data acquisition module based on radar point cloud and a camera, an original radar point cloud up-sampling module, a model training module based on a conditional generative adversarial network, and a model using module based on a conditional generative adversarial network. The method provided by the invention includes the following steps: constructing a radar point cloud-RGB image training set; constructing a conditional generative adversarial network based on a convolutional neural network to train a model; and finally, enabling the model to generate a colorroad scene image with meanings in real time in a vehicle environment by using sparse radar point cloud data and the trained conditional generative adversarial network only, and using the color road scene image in automatic driving and auxiliary driving analysis. The network efficiency is higher. The adjustment of network parameters can be speeded up, and an optimal result can be obtained. High accuracy and high stability are ensured.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to a radar-based color semantic image generation system and method based on Generative Adversarial Networks (cGANs), belonging to the technical field of sensors and artificial intelligence. Background technique

[0002] In the field of unmanned driving, laser radar (LIDAR) and optical camera are the main sensor devices for unmanned vehicles to perceive the surrounding environment. Vehicle lidar in the form of point cloud, such as figure 1 As shown, the point cloud construction is carried out on the surrounding environment within a certain range, and the perception range is about tens to two hundred meters; while the optical camera can image the surrounding environment to obtain color pictures, such as figure 2 As shown, the perception accuracy and perception distance are related to the optical imaging elements, generally up to hundreds to thousands of meters.

[0003] The laser radar perceives the obstacles in the surrounding e...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More