3D Display Viewpoint Synthesis With Local Resolution Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The inefficiency of processor performance in video communication systems due to the use of multiple high-resolution cameras leads to increased end-to-end delay, lag, and frame loss in 3D video calls, particularly in 3D remote communication systems.
Innovation Solution
A display method that determines the current display mode, obtains multiple frame color images from different viewing angles, generates left-eye and right-eye viewpoint maps based on depth information, and synthesizes these maps into a three-dimensional image, optimizing image processing and reducing the need for high hardware requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple high-resolution cameras are used to capture multi-angle data for 3D video communication, then the immersion and interaction quality of 3D display is improved, but the processor performance becomes insufficient leading to increased end-to-end delay and frame loss
Solution Approach 1:
The display area is segmented into multiple resolution zones: a first display area with first resolution and a second display area with second resolution. This segmentation allows the system to allocate high resolution resources only to critical regions (such as speaker faces) while using lower resolution for background areas, thereby reducing overall processing load and end-to-end delay while maintaining visual quality where it matters most.
Solution Approach 2:
Different resolution qualities are applied to different spatial locations of the display. The first display area (containing important visual elements like faces) receives high resolution treatment, while the second display area (background regions) receives lower resolution treatment. This local quality differentiation optimizes the balance between visual experience and processing performance.
2Measurement precision
If multiple high-resolution cameras are used to capture multi-angle data, then the quality of 3D image synthesis is improved, but the hardware cost and power consumption increase
Solution Approach 1:
The imaging system is segmented into multiple cameras with different resolution capabilities. Instead of using multiple high-resolution cameras, the system employs a combination of high-resolution and low-resolution cameras, reducing the total power consumption while maintaining adequate image quality through intelligent synthesis of data from these diverse sources.
Solution Approach 2:
The system changes the resolution parameter across different cameras and display areas. By using low-resolution cameras for non-critical views and high-resolution cameras only where necessary, the system reduces overall power consumption while maintaining the required image quality for 3D synthesis.
3Adaptability or versatility
If the display renders images with fixed resolution suitable for display, then the display compatibility is improved, but the processor performance becomes insufficient leading to lag in video communication
Solution Approach 1:
The display output is segmented into multiple resolution zones that can be independently processed. This allows the system to maintain display compatibility by providing appropriately sized images for different display areas while reducing the total processing burden on the processor, thereby eliminating lag.
Solution Approach 2:
Instead of processing the entire display area at high resolution, the system applies partial high-resolution processing only to the first display area where visual quality is most critical, while using lower resolution for the second display area. This partial action approach maintains display compatibility while significantly improving processing efficiency.
Data Source
AI summary
The present application proposes a display method, including determining a current display mode of a display at a display end, wherein the current display mode is one of at least two display modes, and each mode indicates definition information related to resolution of an image to be displayed, obtaining multiple current frame color images of a scene through multiple image acquisition devices at the acquisition end, determining current frame depth maps at the locations of at least three image acquisition devices, so as to obtain current frame depth information for the scene, generating left-eye and right-eye viewpoint maps corresponding to human eye positioning coordinate data based on the current frame depth information, the current frame color images obtained through the at least three image acquisition devices and the human eye positioning coordinate data, and synthesizing the generated left-eye viewpoint map and the right-eye viewpoint map into a three-dimensional image.