Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distance measuring method based on monocular camera and laser radar

A monocular camera and lidar technology, which is used in distance measurement, image enhancement, image analysis, etc., can solve the problem of low ranging accuracy, and achieve the effect of reducing the amount of calculation, reliable results, and high precision

Pending Publication Date: 2021-11-23
ZHEJIANG LEAPMOTOR TECH CO LTD
View PDF7 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The main purpose of the present invention is to solve the problem of low ranging accuracy of laser radar or camera alone, and provides a ranging method based on monocular camera and laser radar, which fully combines the advantages of monocular camera and laser radar, and integrates target detection The output results of the model and depth complement the model to achieve object-level distance measurement, with reliable results and high precision

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distance measuring method based on monocular camera and laser radar
  • Distance measuring method based on monocular camera and laser radar
  • Distance measuring method based on monocular camera and laser radar

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0026] Such as figure 1 Shown, a kind of ranging method based on monocular camera and lidar comprises the following steps: Step S1) collects historical traffic scene image data by the monocular camera installed on the car and processes historical image data; Step S2) Collect historical traffic scene point cloud data through the lidar installed on the car and process the historical point cloud data; step S3) build an initial target detection model and an initial depth completion model based on a deep convolutional neural network; step S4) use the processing The final historical image data trains the initial target detection model to obtain the trained target detection model, and the target detection model is used to obtain the information of obstacles in the traffic scene; step S5) trains the initial depth completion model with the processed his...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a distance measuring method based on a monocular camera and a laser radar. The distance measuring method comprises the following steps: firstly, collecting historical traffic scene image data and point cloud data; processing the data, and respectively training an initial target detection model and an initial depth completion model by using the processed historical image data and historical point cloud data; obtaining a trained target detection model and a depth completion model, wherein the target detection model takes real-time image data as input and outputs information of obstacles in the traffic scene, the depth completion model takes the real-time image data and the real-time sparse depth map as input, outputs a dense depth map; and finally calculating the distance of an obstacle in the traffic scene according to the output of the target detection model and the depth completion model. The advantages of the monocular camera and the laser radar are fully combined, the output results of the target detection model and the depth completion model are fused, object-level distance measurement is realized, the result is reliable, and the precision is high.

Description

technical field [0001] The invention relates to the technical field of intelligent driving, in particular to a ranging method based on a monocular camera and a laser radar. Background technique [0002] A smart driving car is a car that uses on-board sensors to achieve assisted driving or even unmanned driving through intelligent algorithms. Vehicle-mounted sensors include cameras, millimeter-wave radars, ultrasonic radars, lidars, infrared sensors, etc. Each sensor independently collects surrounding environment information, applies algorithms to extract useful information, and fuses the extracted useful information to accurately assist the car in making decisions and control, so as to achieve the purpose of intelligent driving. The key technologies of intelligent driving include perception, fusion, decision-making, control, etc., and distance measurement is an extremely important part of the perception module. It can transmit the distance information of obstacles to the de...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/521G06K9/62G06N3/04G01C3/00G01S17/08
CPCG06T7/521G01S17/08G01C3/00G06T2207/10028G06T2207/20081G06T2207/20084G06N3/045G06F18/214Y02T10/40
Inventor 黄刚
Owner ZHEJIANG LEAPMOTOR TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products