Signal processing method of interactive three-dimensional video system

A 3D video and signal processing technology, applied in digital video signal modification, stereo system, image communication, etc., can solve problems such as difficulty in satisfying users' stereo sense and viewpoint interaction

Active Publication Date: 2015-01-21
北京飞天云动科技有限公司
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The current two-dimensional video system is difficult to meet the user's needs for three-dimensionality and viewpoint interaction when presenting natural scenes.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Signal processing method of interactive three-dimensional video system
  • Signal processing method of interactive three-dimensional video system
  • Signal processing method of interactive three-dimensional video system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments.

[0052] Interactive 3D video systems such as figure 1 As shown, it is mainly composed of a 3D video encoding module on the server side, a viewpoint decoding module on the user side, an arbitrary viewpoint rendering module and a video display module. A signal processing method in an interactive three-dimensional video system proposed by the present invention comprises the following steps:

[0053] ① Acquire K color images of K reference viewpoints at time t whose color space is YUV and their corresponding K depth images, and record the color image of the kth reference viewpoint at time t as Denote the depth image of the kth reference viewpoint at time t as Among them, K≥2, 1≤k≤K, the initial value of k is 1, i=1, 2, and 3 respectively represent the three components of the YUV color space, and the first component of the YUV color space is the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a signal processing method of an interactive three-dimensional video system. The signal processing method comprises the following steps of: firstly, taking multiple virtual viewpoints between each two adjacent reference viewpoints as auxiliary viewpoints, obtaining the residual image of each auxiliary view point, then encoding each color image, each depth image and each residual image by using a three-dimensional video coding module of a server, transmitting each color image, each depth image and each residual image to a user side, decoding each coded image by using a viewpoint decoding module of the user side, finally generating reference viewpoint signals and auxiliary viewpoint signals by any viewpoint drawing modules, and transmitting the reference viewpoint signals and the auxiliary viewpoint signals to a video display module for display. The signal processing method has the advantages that as the server only needs to transmit the residual images containing less information content as the auxiliary viewpoint information, the coding complexity of the system server is reduced, and as virtual viewpoint signals can be generated at the server only through simple three-dimensional mapping and add operation, the requirements on user side systems are reduced, thus the complexity of the interactive three-dimensional video system is reduced.

Description

technical field [0001] The invention relates to a multi-viewpoint video system technology, in particular to a signal processing method in an interactive three-dimensional video system. Background technique [0002] Since the beginning of this century, with the digital 2D (two-dimensional) video technology becoming more and more mature, as well as the rapid development of computer, communication and network technology, people have a strong demand for a new generation of video systems. The current two-dimensional video system is difficult to meet the user's needs for three-dimensionality and viewpoint interaction when representing natural scenes. The interactive 3D video system is more and more popular because it can provide a brand-new visual experience with three-dimensionality and viewpoint interaction. It has broad application prospects. [0003] For the performance evaluation of 3D video coding, there are usually multiple technical indicators, such as rate-distortion pe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N13/00H04N15/00H04N19/597
Inventor 邵枫蒋刚毅郁梅李福翠彭宗举
Owner 北京飞天云动科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap