Multiview 3D Image Encoding Using Depth-Based Angular Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3D displays face challenges with excessive transmission bandwidth and limited system performance due to the processing and transmission of a large number of views, leading to reduced image quality and increased complexity.
Innovation Solution
A multiview 3D image encoding method that calculates perceived angular resolution based on depth information, configures encoding parameters for each object in blocks, and selectively encodes and transmits data to minimize redundant information, using a system with multiple capturing devices, a multiplexing device, and a frame buffer device to manage different encoding parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a large number of views are provided to improve image resolution and depth performance, then image quality is improved, but transmission bandwidth and processing complexity increase excessively
Solution Approach 1:
The patent applies local quality by calculating perceived angular resolution for each object in image blocks based on depth information, and configuring different encoding parameters for different objects. This allows high-resolution encoding for objects requiring it (such as those with large depth values) while using lower encoding parameters for objects where high resolution is not needed, thereby reducing overall transmission bandwidth while maintaining image quality where important.
2Measurement precision
If a large number of views are processed to improve depth of field and viewing region, then 3D performance is improved, but information processing operations increase excessively
Solution Approach 1:
The patent changes encoding parameters dynamically based on the perceived angular resolution calculated from depth information. By adjusting encoding parameters according to the actual visual requirements of objects in different depth regions, the system reduces unnecessary processing operations for views that do not contribute significantly to depth perception, thereby improving processing efficiency while maintaining depth of field performance.
3Measurement precision
If encoding parameters are increased to maintain image quality for all objects, then image quality is preserved, but transmission bandwidth is wasted on redundant information
Solution Approach 1:
The patent extracts and removes redundant information by calculating perceived angular resolution for each object and selectively applying encoding parameters only where necessary. Objects with large depth values or those requiring high resolution for accurate representation receive full encoding treatment, while objects with small depth values or those that can be adequately represented at lower resolution have their encoding parameters reduced, thereby removing redundant transmission bandwidth.
Data Source
AI summary
A multiview 3D image encoding method, apparatus, system and storage medium are provided. The encoding method may include the steps of acquiring image data, and obtaining depth information containing a depth value of each pixel in an image based on the image data; grouping the image data into blocks, and calculating a perceived angular resolution of each object in blocks based on the depth information of each object in blocks respectively, where the perceived angular resolution of an object in blocks is a required maximum angular resolution that enables identification of the object in blocks; and configuring a respective encoding parameter for each object in blocks based on the perceived angular resolution of a respective one object in blocks, where the encoding parameter is configured such that a requirement of respective encoding parameter for a respective object in blocks with a respective perceived angular resolution is met.