Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

3D (three-dimensional) reconstruction method for stereo/multi-view videos based on FPGA (field programmable gata array)

A multi-view video and stereoscopic video technology, applied in stereo systems, image communication, electrical components, etc., can solve problems such as difficult to meet real-time requirements and a large amount of calculation, and achieve the effect of improving the void repair algorithm and reducing the number of voids.

Inactive Publication Date: 2012-07-11
ZHEJIANG UNIV
View PDF6 Cites 29 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The drawing technology based on the depth image, the filling technology of the image content in the hollow area, and the rearrangement and combination technology of the RGB components involved in the above all require a large amount of calculation, so it is difficult to meet the real-time requirements.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • 3D (three-dimensional) reconstruction method for stereo/multi-view videos based on FPGA (field programmable gata array)
  • 3D (three-dimensional) reconstruction method for stereo/multi-view videos based on FPGA (field programmable gata array)
  • 3D (three-dimensional) reconstruction method for stereo/multi-view videos based on FPGA (field programmable gata array)

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0072] 1) The left and right camera images with an image resolution of 640×360 are used as input images, figure 2 (a) is the left camera image, figure 2 (b) is the right camera image.

[0073] 2) Encapsulate the two-way camera image sequence in BT1120 data format, and transmit it to FPGA for processing through Gigabit Ethernet. The PC transmits a data frame of 1920×360×2, and expands it to a data frame of 1920×1080×2 under the linux system of the FPGA development board.

[0074] 3) Data are respectively written into corresponding SRAMs, and then stereo matching is performed. image 3 That is the flow chart of stereo matching. Figure 4 (a) is the disparity map of the left image, Figure 4 (b) is the disparity map of the right image.

[0075] 4) After the disparity map is obtained, the multi-viewpoint reconstruction operation is performed. Figure 5 It is the flow chart of multi-view reconstruction. Each row of data is mapped to 8 viewpoints according to the camera par...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a 3D (three-dimensional) reconstruction method for stereo / multi-view videos based on an FPGA (field programmable gata array), which comprises the following steps: 1) carrying out stereo shooting on a natural scene by using a binocular camera; 2) through a gigabit Ethernet, transmitting two channels of color image information in a BT1120 data forma to the FPGA for processing; 3) through stereo matching, obtaining two channels of depth information of camera images; 4) according to an algorithm, carrying out multi-view reconstruction and view compositional operation; and 5) carrying out outputting through a HDMI (high-definition multimedia interface), and providing multi-view stereo display on a naked-eye 3D display device. According to the invention, the binocular camera is adopted for carrying out stereo shooting, so that the stereo display of a real scene can be realized; due to the parallel architecture of the high-efficiency algorithm and the FPGA, an effect of real-time display can be achieved; and the 3D stereo display device can provide a multi-user & multi-angle naked-eye multi-view stereo display effect.

Description

technical field [0001] The invention relates to a method for multi-viewpoint free stereoscopic reconstruction and display, in particular to a method for 3D reconstruction from FPGA-based stereoscopic video to multi-viewpoint video. Background technique [0002] Three-dimensional stereoscopic technology is not a new product, in fact, it has a history of nearly 170 years. In 1838, the world's first stereo image pair was born under the pen of British scholar Charles Wheatstone. After that, 3D movies slowly entered people's sight. In the 20th century, the continuous development of flat-screen TV technology and the TV manufacturers' pursuit of differentiation and product added value have become a powerful driving force for the worldwide 3D research boom. The color separation method in the 1950s, the light separation method in the 1960s, and the current popular time-division stereoscopic imaging technology have successively become the focus of 3D research and have been successfu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N13/00H04N13/04
Inventor 金鹏飞姚少俊付航李东晓王梁昊张明
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com