Parallax image splicing and visualization method based on multiple pairs of binocular cameras

A binocular camera and parallax image technology, which is applied to details involving image stitching, image communication, image enhancement, etc., can solve problems such as time-consuming

Active Publication Date: 2020-04-24
DALIAN UNIV OF TECH
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The image coordinate system transformation process requires pre-registration, and it takes a lot of time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Parallax image splicing and visualization method based on multiple pairs of binocular cameras
  • Parallax image splicing and visualization method based on multiple pairs of binocular cameras
  • Parallax image splicing and visualization method based on multiple pairs of binocular cameras

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] The present invention proposes a parallax image stitching and visualization method based on multiple pairs of binocular cameras, which is described in detail in conjunction with the accompanying drawings and embodiments as follows:

[0065] The present invention uses multiple pairs of binocular cameras placed horizontally as the imaging system to collect multi-viewpoint images, wherein K 1 is the internal parameters of the first binocular camera, K 2 is the internal parameter of the second binocular camera. The resolution of each binocular camera is 1024*768, and the frame rate of the video is greater than 20 frames per second. The system reference structure is as follows figure 2 . On this basis, calculate the spatial transformation relationship R and T between each pair of binocular cameras, and calculate the homography matrix H between the images through the distance d between R and T and the imaging plane, and calculate the image based on the intermediate image ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a parallax image splicing and visualization method based on multiple pairs of binocular cameras, and belongs to the field of image processing and computer vision. The method comprises the following steps: firstly, solving a position relationship between binocular cameras by using a calibration algorithm, and solving a homography matrix between images by using prior information; transforming a camera coordinate system of the depth image by using the internal parameters and the external object parameters of the camera; calculating an overlapping region ROI of the images by using a homography matrix between the images, establishing an energy model, and performing solving by using a graph cut algorithm. The graph cut algorithm is high in time complexity and depends on the number of nodes of a graph, the image is layered, solved layer by layer and iterated, and a local optimal solution approximate to a global optimal solution is solved; image coordinate system transformation is performed on the depth images by using the homography matrix, and splicing seams are synthesized to realize seamless panoramic depth image splicing; and finally, the depth information of the parallax image is superposed on the visible light image. According to the invention, large-visual-field-angle panoramic parallax image display is realized, the algorithm of the invention is real-time, and large-parallax seamless panoramic parallax image splicing and visualization are realized.

Description

technical field [0001] The invention belongs to the field of image processing and computer vision, and specifically relates to a method of calculating the homography matrix between images through the external parameters rotation vector R and translation vector T between cameras, and using graph cuts to find the best splicing between images Seam, and then use R and T, homography matrix and the best transition area to stitch the parallax image, and finally display the parallax image and visible light image fusion. Background technique [0002] At this stage, unmanned driving technology is developing rapidly, and unmanned driving technology needs to ensure safety, but simply using visible light images cannot locate obstacles well, obtain obstacle distances, and accurately locate its own vehicle. With the improvement of parallax image technology based on binocular cameras, parallax images are also used as basic data in the field of unmanned driving. However, limited by the accu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/40G06T7/80
CPCG06T3/4038G06T7/85G06T2207/20221G06T7/593G06T2207/10012G06T2200/32G06T2207/20021G06T2207/10024H04N13/243H04N13/239H04N13/246H04N13/156G06T7/11H04N13/15
Inventor 樊鑫刘日升李卓宵仲维罗钟铉
Owner DALIAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap