Laser radar environment sensing method and system based on deep learning

A technology of lidar and environment perception, applied in the field of deep learning, can solve problems such as troubles, and achieve the effect of low algorithm difficulty, low development and maintenance costs, and high precision of semantic segmentation

Inactive Publication Date: 2020-11-27
苏州富洁智能科技有限公司
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the prior information is not static. If a new traffic light does not have prior information entered, it will cause trouble when the self-driving vehicle encounters it.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Laser radar environment sensing method and system based on deep learning
  • Laser radar environment sensing method and system based on deep learning
  • Laser radar environment sensing method and system based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0043] The present invention mainly has following aspects function:

[0044] (1) Spherical mapping of lidar data

[0045] (2) Semantic Segmentation

[0046] (3) Accuracy analysis

[0047] 1 The overall technical design of the system

[0048] Such as figure 1 As shown, among them, the lidar point cloud is first mapped to a depth map, and the depth map is input into the model for speculation to obtain a semantic segmentation map. Finally, the semantic segmentation map is mapped to a semantic segmentation point cloud map.

[0049] 2 The design and principle of each module:

[0050] 2.1 Spherical mapping principle:

[0051] First, each point p of the lidar radar i =(x, y, z), from the spherical coordinate system to the image coordinate system, the present invention proposes the following formula:

[0052]

[0053] Where (u, v) represents the image coordinates, Indicates the height and width of the distance image representation after mapping, f=f in the formula up +f ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a laser radar environment sensing method and system based on deep learning. The method comprises the following steps: step 1, mapping laser radar point cloud into a depth map;converting each point of the laser radar from a spherical coordinate system to an image coordinate system; 2, executing a depth map semantic segmentation step; and step 3, mapping the semantic segmentation graph into a semantic segmentation point cloud graph. Laser radar spherical mapping is adopted, a stable mapping formula is used, the algorithm difficulty is low, and the development and maintenance cost is low; semantic segmentation is high in precision and multiple in segmentation types; and environment recognition data suitable for the automatic driving automobile is formed, so that the automatic driving automobile can identify surrounding objects conveniently.

Description

technical field [0001] The present invention relates to the field of deep learning, in particular to a deep learning-based lidar environment perception method and system. Background technique [0002] The United States is the country with the most in-depth research on autonomous vehicles. Its research on autonomous vehicles began in the 1970s and 1980s, and has been in a high-speed development stage since the 1980s. The DAPAR program of the US Department of Defense is extremely It has greatly promoted the development of self-driving cars and obtained a series of major research results. Domestic research on self-driving cars started in the 1980s, including research by National University of Defense Technology, Nanjing University of Science and Technology, and Tsinghua University. Until 2003, the National University of Defense Technology and FAW Group Corporation jointly developed the automatic driving system for Hongqi vehicles, marking that my country's automobile automatic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06T7/11G06T7/136G06N3/04G06N3/08G01S17/931G01S7/48
CPCG06T7/11G06T7/136G06N3/08G01S17/931G01S7/4802G06T2207/10028G06T2207/10044G06T2207/20076G06T2207/20081G06T2207/20084G06T2207/30252G06V20/56G06N3/047G06N3/045
Inventor 徐江梁昊
Owner 苏州富洁智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products