Device and method for extracting high-resolution depth map in real time based on image matching

A high-resolution, extraction device technology, applied in image communication, electrical components, stereo systems, etc., can solve the problems of low efficiency of 3DTV depth extraction, can not meet real-time applications, etc., to achieve functional updates, easy to carry and install, and easy to upgrade. Effect

Inactive Publication Date: 2013-06-19
SHANGHAI UNIV
View PDF3 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide a device and method for real-time extraction of high-resolution depth maps based on image

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Device and method for extracting high-resolution depth map in real time based on image matching
  • Device and method for extracting high-resolution depth map in real time based on image matching
  • Device and method for extracting high-resolution depth map in real time based on image matching

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] refer to figure 1 , a device for real-time extraction of high-resolution depth maps based on image matching, including a binocular SDI camera (1) and an FPGA development board (2), characterized in that the binocular SDI camera (1) is unidirectionally connected to the FPGA development board (2), the FPGA development board is unidirectionally connected to a 3DTV encoding server (3); the binocular SDI camera (1) is used to acquire images, and the depth real-time extraction is realized on the FPGA development board (2), and the real-time transmission of the depth map is obtained to the 3DTV encoding server.

Embodiment 2

[0030] This embodiment is basically the same as Embodiment 1, and the special feature is: the binocular SDI camera adopts Panasonic AG-3DA1MC binocular high-definition camera. The camera can output high-definition video through SDI, and the two channels of video have undergone image correction and can be directly stereo matched. The FPGA development board adopts EP2AGX260 FPGA chip, and the chip is bidirectionally connected to 1GB DDR2 SODIMM as a data buffer module. The front end of the FPGA development board is designed with two SDI receiving modules. The LMH0344 equalizer performs DC recovery on the SDI signal. The LMH0341 deserializer automatically detects the input data rate and extracts the clock; The image is output to the 3DTV encoding server.

Embodiment 3

[0032] This high-resolution depth map real-time extraction method based on image matching uses the above-mentioned device for real-time extraction of the depth map. The special feature is that it is realized by designing a digital circuit in the FPGA chip. The operation steps are as follows:

[0033] Ⅰ. SDI analysis: analyze the two synchronous SDI video inputs after deserialization into video data signals;

[0034] Ⅱ. Matching cost estimation: Realize the construction of matching cost function and the estimation of matching cost by means of digital circuit;

[0035]Ⅲ. WTA Optimal Selection-Generate Depth Map: Select the optimal match within the parallax range in a digital circuit.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a device and a method for extracting a high-resolution depth map in real time based on image matching. The device comprises a binocular SDI (serial digital interface) camera and an FPGA (field programmable gate array) development board, wherein the binocular SDI camera is unidirectionally connected with the FPGA development board through two BNCs (bayonet nut connectors), and the FPGA development board is unidirectionally connected with a 3DTV (three-dimensional television) encoder server through a PCIE (peripheral component interface express) interface. The binocular SDI camera is used for acquiring images, the depth map is extracted on the FPGA development board in real time, and the acquired depth map is transmitted to the encoder server in real time. The method includes the operation steps: I, SDI analysis; II, stereoscopic matching; and III, WTA (wireless telephony application) optimal choice and depth map generation. High-resolution dual SDI input can be directly received, the high-definition video depth map is extracted in real time, the binocular SDI camera can be inserted onto a PC (personal computer) main board, the obtained depth map is directly inputted to the encoder server through the PCIE interface, and 3DTV application and implementation and popularization of real scenario reproduction are greatly accelerated.

Description

technical field [0001] The invention relates to the field of 3DTV. Based on the principle of image matching, it is applied to fast depth extraction of dual-view or multi-view video at the front end of 3DTV, that is, a device and method for real-time extraction of high-resolution depth maps based on image matching. Background technique [0002] Dual-view or multi-view video 3DTV real-time display system includes front-end video acquisition, encoding transmission, decoding display and other parts. The data volume of multi-view video is much larger than that of single-view video. For example, there are 9 viewpoints in a multi-viewpoint. If the 9 viewpoints are encoded based on the H.264 simulcast method, the original data volume will be 9 times. In view of this, in 2009 JVT and MPEG launched the MVD (multi-view + depth) data mode. In this mode, in addition to the texture color video of the original viewpoint, a corresponding depth map video is attached to each viewpoint on th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N13/00H04N13/02
Inventor 王建伟滕国伟鲁超邹雪妹李火生成益龙路龙龙崔大海
Owner SHANGHAI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap