Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Pedestrian three-dimensional detection tracking method and system based on top view angle

A three-dimensional detection and pedestrian technology, applied in image data processing, instrument, character and pattern recognition, etc., can solve the problems of occlusion and adhesion between pedestrians, easy to miss detection, etc., to overcome missed detection, less foreground noise points, and improve recall rate. Effect

Active Publication Date: 2021-05-07
SUN YAT SEN UNIV
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, most of the mainstream pedestrian detection algorithms are researched on the more flexible oblique angle of view pedestrian detection, and the disadvantage of this angle of view is that the occlusion and adhesion between pedestrians are serious, and it is easy to miss detection. Pedestrian detection based on the top view is also a pedestrian detection task. A special application scenario, but few people have done research on this aspect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pedestrian three-dimensional detection tracking method and system based on top view angle
  • Pedestrian three-dimensional detection tracking method and system based on top view angle
  • Pedestrian three-dimensional detection tracking method and system based on top view angle

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. For the step numbers in the following embodiments, it is only set for the convenience of illustration and description, and the order between the steps is not limited in any way. The execution order of each step in the embodiments can be adapted according to the understanding of those skilled in the art sexual adjustment.

[0044] refer to figure 1 , the present invention provides a pedestrian three-dimensional detection and tracking method based on the top view, the method includes the following steps:

[0045] S1. Perform stereo correction and stereo matching processing on the left and right images acquired by the binocular camera to obtain a depth map;

[0046] S2. Carry out hole filling to the depth map, and convert to obtain the height map;

[0047] S3. Modeling the height map based on the MOG2 background modeling method to obtai...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a pedestrian three-dimensional detection tracking method and system based on a top visual angle. The method comprises the following steps: performing stereo correction and stereo matching processing on left and right images acquired by a binocular camera; filling holes and converting to obtain a height map; modeling the height map to obtain a two-dimensional height foreground map; projecting and converting into a two-dimensional plane point cloud projection drawing under a top view angle, and detecting to obtain a three-dimensional coordinate point of the head of the pedestrian; mapping the three-dimensional coordinate points of the heads of the pedestrians back to the two-dimensional image coordinate system, and positioning a bounding box of each pedestrian; and performing inter-frame pedestrian matching tracking by combining the three-dimensional coordinate point of the pedestrian head and the positioned pedestrian bounding box. According to the invention, the problem of missing detection caused by shielding among pedestrians can be effectively overcome, and the recall rate of pedestrian detection is improved. The pedestrian three-dimensional detection tracking method and system based on the top view angle can be widely applied to the field of pedestrian detection.

Description

technical field [0001] The invention relates to the field of video image processing, in particular to a method and system for three-dimensional detection and tracking of pedestrians based on a top view. Background technique [0002] As a hot research direction of computer vision, pedestrian detection is widely used in our daily life. The pedestrian detection problem can be divided into pedestrian detection from a top view and pedestrian detection from an oblique view according to the position and viewing angle of the camera. At present, most of the mainstream pedestrian detection algorithms are researched on the more flexible oblique angle of view pedestrian detection, and the disadvantage of this angle of view is that the occlusion and adhesion between pedestrians are serious, and it is easy to miss detection. Pedestrian detection based on the top view is also a pedestrian detection task. A special application scenario, but few people have done research on this aspect at p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/246G06T7/13G06T7/194G06T7/73G06T7/80G06K9/00G06K9/46
CPCG06T7/246G06T7/13G06T7/194G06T7/73G06T7/80G06T2207/30196G06T2207/10016G06T2207/10028G06V40/103G06V10/50G06V10/56Y02T10/40
Inventor 郑慧诚苏志荣
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products