Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for pedestrian detection in front of vehicle based on lidar and binocular camera

A technology of laser radar and binocular camera, which is applied to computer components, character and pattern recognition, instruments, etc., can solve problems such as inability to satisfy the integrity and reliability of information perception, limited radar information, and inaccurate detection results

Active Publication Date: 2017-12-12
CHANGAN UNIV
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Most of the existing pedestrian detection devices in front of vehicles are based on monocular cameras, but the visual information is greatly affected by environmental factors, such as rain and smog; some use radar information to detect pedestrians, but the amount of radar information is limited and cannot be used alone As a pedestrian detection device; Aiming at the problem that a single sensor cannot satisfy the integrity and reliability of information perception, a pedestrian detection method that fuses multiple sensors has emerged, but the algorithm design and hardware design are not the same, and the detection effect is not accurate enough

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for pedestrian detection in front of vehicle based on lidar and binocular camera
  • Method and system for pedestrian detection in front of vehicle based on lidar and binocular camera
  • Method and system for pedestrian detection in front of vehicle based on lidar and binocular camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0109] In the method for detecting pedestrians in front of a vehicle with a laser radar and a binocular camera in this embodiment, the data acquisition device used includes two LMS111 laser radars installed at two places in front of the vehicle, an LMS511 laser radar installed in the middle of the front of the vehicle, and a The Bumblebee2 stereo camera in the middle of the back of the interior rearview mirror, a gigabit network switch connected to three lidars and cameras, a server connected to the gigabit network switch, a generator and a UPS. Among them, the laser scanning plane of the LMS511 long-distance lidar is parallel to the plane of the vehicle base, the laser scanning plane of the LMS111 short-distance radar on the left is obliquely downward by 8°, and the laser scanning plane of the LMS111 short-distance radar on the right is obliquely upward by 8°. The field of view of the binocular camera can cover the lateral 66° range in front of the vehicle to meet the needs of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the field of automobile active safety, and specifically discloses a method and system for detecting pedestrians in front of a vehicle based on a laser radar and a binocular camera. The data collected by the radar and the binocular camera are processed to obtain the distance, azimuth and speed value of the pedestrian relative to the vehicle; the Kalman filter is used to correct the obtained pedestrian information. The invention comprehensively uses stereo vision technology and remote sensing technology, integrates laser radar and binocular vision information, has high measurement accuracy, high pedestrian detection accuracy rate, and can effectively reduce the occurrence rate of traffic accidents.

Description

technical field [0001] The invention belongs to the field of safe driving of automobiles, specifically relates to stereo vision technology and remote sensing technology, and is a device and method for detecting pedestrians in front of a vehicle by fusing information from a laser radar and a binocular camera. Background technique [0002] The rapid development of my country's economy, the continuous improvement of people's living standards, and the rapid development of the transportation industry and the automobile industry have all contributed to the continuous increase in the number of motor vehicles in our country. By the end of 2013, the number of automobiles in my country was as high as 137 million, and vehicle collision accidents occurred frequently. In a complex traffic environment, how to ensure the safety of pedestrians and the safety of vehicles and drivers is particularly important during vehicle driving. However, when the driver is fatigued or negligent for a whi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/103G06V20/56G06V10/751G06V2201/07G06F18/23213G06F18/24137
Inventor 赵祥模徐志刚闵海根张立成周经美杨澜康俊民孟凡林尚旭明赵佳乐刘慧琪王振
Owner CHANGAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products