Heavy-duty lorry driving barrier detection and tracking method based on binocular fisheye camera

A technology of obstacle detection and binocular fish, which is applied in image enhancement, image analysis, image data processing, etc., can solve the problem of no camera description, etc., and achieve the effect of fast calculation speed, good robustness, and less calculation amount

Inactive Publication Date: 2016-06-15
SOUTHWEST JIAOTONG UNIV
View PDF11 Cites 63 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] Patent CN201110193257X (publication number CN102874196A) proposes a car collision avoidance method based on machine vision. This method not only obtains the distance between the obstacle and the car through stereo vision information, but also calculates the safety range, but does not monitor the camera. The preprocess...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Heavy-duty lorry driving barrier detection and tracking method based on binocular fisheye camera
  • Heavy-duty lorry driving barrier detection and tracking method based on binocular fisheye camera
  • Heavy-duty lorry driving barrier detection and tracking method based on binocular fisheye camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0067] A specific embodiment of the present invention is a binocular fisheye-based method for detecting and tracking obstacles in a truck, comprising the following steps:

[0068] A reversing obstacle information collection

[0069] When the car's electronic control center detects that the car's gear is in reverse gear, it starts two all-weather infrared fisheye cameras with the same sampling frequency installed at both ends of the truck's rear to obtain real-time video of the car.

[0070] B binocular fisheye camera calibration

[0071] Firstly, the single-objective calibration is carried out to obtain the internal parameters of the camera (focal length, the principal point of the camera center, and the distortion vector) and the external parameters (rotation matrix and translation vector).

[0072] Since the fisheye camera has a wide imaging field of view and high distortion characteristics, the present invention proposes an algorithm that utilizes a specific ellipse calibr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a heavy-duty lorry driving barrier detection and tracking method based on a binocular fisheye camera, and belongs to the technical field of traffic vehicle active safety. The method mainly comprises the steps: starting two calibrated and corrected infrared fisheye cameras, disposed at two ends of the tail of a vehicle, to synchronously collect back-up environment image information when the back-up of a heavy-duty lorry is detected, outputting a back-up information after jointing, and displaying the back-up image on a display screen of a cab. A binocular fisheye visual system is used for obtaining the initial position and distance of a to-be-tracked barrier object, and then a video target tracking algorithm combined with the low-rank matrix theory based on particle filtering is used for achieving the tracking of a barrier, achieves the real-time updating of an image template in a tracking process, and detects whether there is a new barrier or not. When a vehicle is detected to turn around, a supersonic radar is started to detect that there is a barrier in a one-meter range beside the lorry, the position of the barrier is displayed and the early warning is sent. The method is mainly used for a large-size lorry.

Description

technical field [0001] The invention relates to a method for detecting and tracking obstacles in a truck based on a binocular fisheye camera technical background [0002] With the rapid development of China's logistics industry, the demand for heavy-duty trucks is also increasing, and the body of the trucks is getting longer and longer, and the cargo capacity is also increasing. Traffic accidents caused by heavy-duty trucks are also increasing, and the consequences It is generally very serious, especially the collision accidents caused by improper operation of reversing and turning account for a considerable proportion. Equivalent to driving straight ahead, it is very difficult to back up and turn a truck. Because the body is too long and the volume of the cargo box is too large, the blind area is very large when reversing and turning. Generally, it is difficult to see the rear of the truck and the sides of the truck. objects and pedestrians, resulting in more and more coll...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/00G06T7/20G06T5/00G06T5/10
CPCG06T5/002G06T5/10G06T2207/10021G06T2207/30244G06T2207/30252G06T2207/30261
Inventor 张祖涛王富斌李晏君刘昱岗张效良胡广地朱鑫王媛许永生
Owner SOUTHWEST JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products