Multi-viewpoint Video Encoding Using Synthetic Image Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional multi-viewpoint video encoding methods require handling different bit depths for differential and non-differential images, leading to increased circuit and equipment size, and inefficient encoding due to useless signal encoding at maximum or minimum pixel values.
Innovation Solution
A video encoding apparatus that generates a synthetic image using disparity information between reference and target camera images, predicts a differential image by adding the synthetic image to the predicted differential image, and encodes the prediction residual, allowing for efficient encoding without increasing bit depth and reducing circuit size.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional multi-viewpoint video encoding methods are used to encode differential images, then encoding efficiency is improved by removing temporal redundancy, but circuit and equipment size increase due to handling different bit depths
Solution Approach 1:
The patent changes the parameter of bit depth handling by encoding differential images as prediction residuals of the original images rather than as separate differential signals. This allows the encoder to process all images at the same bit depth, eliminating the need for separate processing paths for different bit depths and thereby reducing circuit complexity while maintaining encoding efficiency.
Solution Approach 2:
The patent merges the encoding processes for differential images and original images into a single unified process. By treating differential image encoding as part of the prediction residual calculation for original images, the system combines multiple processing streams into one, reducing the number of separate circuits and equipment components needed.
2Measurement precision
If differential images are encoded separately with increased bit depth, then prediction accuracy is improved, but encoding efficiency decreases due to useless signal encoding at maximum or minimum pixel values
Solution Approach 1:
The patent extracts only the useful prediction residual information from the differential image encoding process. By encoding only the difference between predicted and actual pixel values rather than the full differential image signal, the system removes useless signal components (especially at maximum and minimum pixel values) while retaining the essential prediction accuracy information.
Solution Approach 2:
The patent changes the encoding parameter from encoding full differential image signals with increased bit depth to encoding prediction residuals at the original bit depth. This parameter change eliminates the encoding of useless signal components while maintaining prediction accuracy through the residual-based encoding approach.
Data Source
AI summary
A video encoding apparatus used in encoding of a multi-viewpoint image. The apparatus generates a synthetic image for a camera used for obtaining an encoding target image, by using an already-encoded reference camera image having a viewpoint different from the viewpoint of the camera used for obtaining the encoding target image, and disparity information between the reference camera image and the encoding target image, thereby encoding the encoding target image. A predicted image for a differential image between an input image of an encoding target area to be encoded and the synthetic image generated therefor is generated, and a predicted image for the encoding target area, which is represented by the sum of the predicted differential image and the synthetic image for the encoding target area, is generated. A prediction residual represented by a difference between the predicted image for the encoding target area and the encoding target image of the encoding target area is encoded.