Parallax image generation method and system based on binocular stereo vision matching

A binocular stereo vision and parallax image technology, applied in the field of image processing, can solve problems such as inability to accurately find matching points, failure to solve binocular stereo matching, lack of texture areas and surface reflective areas, etc.

Active Publication Date: 2019-07-12
BEIJING TSINGMICRO INTELLIGENT TECH CO LTD
View PDF9 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, the current binocular stereo matching method has the following shortcomings: Although the CNN-based matching method improves the matching speed and accuracy, it does not solve the essential problems of binocular stereo

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Parallax image generation method and system based on binocular stereo vision matching
  • Parallax image generation method and system based on binocular stereo vision matching
  • Parallax image generation method and system based on binocular stereo vision matching

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0108] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0109] Although the current CNN-based matching method improves the matching speed and accuracy, it does not solve the essential problem of binocular stereo matching. In occluded areas, repeating pattern areas, areas lacking texture, and surface reflective areas, matching points cannot be accurately found, and stereo matching is required. The post-processing steps, such as sub-pixel enhancement, filter noise reduction, refinement and other operations, are cumber...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a parallax image generation method and system based on binocular stereo vision matching. The parallax image generation method comprises the steps of obtaining a pair of speckleimages, wherein the pair of speckle images are images of speckles captured by an object through a pair of binocularly calibrated cameras under the irradiation of a set light beam; inputting the pair of speckle images into a preset deep learning neural network to generate corresponding parallax images, wherein the deep learning neural network is obtained by training a plurality of pairs of speckleimages. According to the method and the system, a pair of speckle images is used as input, a parallax image is directly output through binocular vision stereo matching network (deep learning neural network) processing, end-to-end calculation of the parallax image and an end-to-end network design framework are realized, post-processing steps of stereo matching, such as sub-pixel enhancement, filtering and noise reduction, refinement and the like, are eliminated, and the operation overhead is greatly reduced.

Description

technical field [0001] The invention belongs to the field of image processing, and more specifically relates to a parallax image generation method, system, electronic equipment and readable medium based on binocular stereo vision matching. Background technique [0002] The rapid development of depth sensors has brought new changes to the field of computer vision, and depth estimation information has been fully applied to solutions to problems related to autonomous driving, 3D reconstruction, behavior recognition, and liveness detection. At present, mainstream depth sensors mainly include four types of technologies: time of flight (ToF), lidar, structured light and binocular stereo vision. [0003] The technical steps of binocular stereo vision include: camera calibration to obtain camera parameters; epipolar line correction to make the epipolar lines of the left and right cameras horizontal; image pixel matching after correction to obtain disparity map; depth information obt...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/80
CPCG06T2207/20081G06T2207/20084G06T7/85
Inventor 冯进丽尹首一赵新超欧阳鹏李秀东王博
Owner BEIJING TSINGMICRO INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap