Multichannel video stream encoder and decoder based on deep image rendering

A video coding and video streaming technology, applied in image communication, digital video signal modification, television, etc., can solve storage and transmission problems, and achieve the effect of low bit rate and good stereoscopic visual experience

Active Publication Date: 2008-11-19
万维显示科技(深圳)有限公司
View PDF0 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Triangle mesh is used to approximate the object surface piecewise linearly. The error caused by this approximation is closely

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multichannel video stream encoder and decoder based on deep image rendering
  • Multichannel video stream encoder and decoder based on deep image rendering

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0077] Fig. 1 is a schematic diagram of a multi-channel video stream encoder according to the present invention. The multi-channel video stream encoder compresses and encodes the input multi-channel video stream and camera parameters, and outputs the encoded compressed code stream. The encoder includes an image correction unit 11 , a channel selection unit 12 , a depth generation unit 13 , an auxiliary channel prediction unit 14 , a central channel encoding unit 15 , an auxiliary channel encoding unit 16 , a channel reconstruction unit 17 and a multiplexer 18 .

[0078] Referring to Figure 1, the encoder encodes a multi-channel video stream including the following 11 steps:

[0079] Step 1: The image correction unit 11 receives the input multi-channel video stream and camera parameters, and corrects the image frames according to a standard correction algorithm. The result of the correction is that at the same moment, for image frames of different channels, their corresponding...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses multi-channel video stream encoder and decoder based on the depth image rendering. When encoding the video stream, the multi-channel video stream encoder and decoder can also encode the central channel video stream image frame and the depth map according to the video encoding standard method; the predicting map of the neighboring auxiliary channel to be encoded can be obtained by adopting the depth image rendering technology according to the image frame and the depth map after the channel is reconstructed, and converting, quantizing and entropy encoding can be performed to the shielding information. When the multi-channel video compression code is decoded by the multi-channel video stream encoder and decoder, the physiologic tendency of the human visual system can be utilized, and a virtual channel positioned at the center position of the two neighboring channels can be obtained by adopting the depth image rendering technology according to the image frames and the depth maps of the two neighboring channels. At the display terminal where the decoder of the invention is adopted to output the video stream, each vertical visual point is composed of a high-quality channel and a virtual channel, and the audience can get the good vertical visual experience.

Description

technical field [0001] The invention relates to motion image processing technology, in particular to a multi-channel video stream encoder and decoder based on depth image rendering. Background technique [0002] Television systems have evolved from black and white to color, from analog to digital. The 2D TV system developed so far provides viewers with flat images, while the 3D TV system will be able to provide viewers with a viewing experience closer to natural vision. Therefore, it will be a natural and expected evolution from the two-dimensional system to the three-dimensional system, which is the development of the current two-dimensional digital TV system. [0003] Research on the Human Visual System (HVS, Human Visual System) has shown that when two eyes observe the same object, there is parallax in the two images formed. There are two theories for the formation of human stereo vision: Fusion Theory believes that if the two eyes are respectively observed to have diff...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N7/26H04N13/00H04N19/124H04N19/13H04N19/184H04N19/42H04N19/503H04N19/70H04N19/91
Inventor 骆凯李东晓张明何赛军石冰冯雅美谢贤海朱梦尧
Owner 万维显示科技(深圳)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap