3D Image Signal Processing Using Camera Parameters for Bandwidth Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current stereoscopic 3D display systems require significant bandwidth for transmitting multiple image signals, making commercialization of multi-view video challenging due to increased data processing demands and high equipment costs.
Innovation Solution
A method for processing 3D image signals that reduces the amount of information transmitted by using camera parameters to generate virtual view images, allowing receivers to synthesize 3D content from partial image data, including depth information and additional information like occlusion details, thereby reducing bandwidth requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If multiple image signals are transmitted for stereoscopic 3D display, then 3D image quality is improved, but bandwidth requirement increases
Solution Approach 1:
The patent extracts only the essential camera parameters (focal length, optical center, etc.) from the complete image data and transmits them separately. The actual image data is transmitted in a reduced format, allowing the receiver to reconstruct the full 3D image by combining the extracted parameters with the reduced image data, thereby reducing bandwidth while maintaining 3D image quality
Solution Approach 2:
The patent creates a virtual copy of the image reconstruction process at the receiver端. Instead of transmitting complete image data for all views, the system transmits camera parameters and base image data, enabling the receiver to generate virtual views by applying the camera parameters to reconstruct the images, thus reducing transmission bandwidth while preserving image quality
2Adaptability or versatility
If multi-view video is implemented with multiple cameras, then viewpoint freedom is improved, but equipment cost increases
Solution Approach 1:
The patent introduces camera parameters as an intermediary element that mediates between the limited physical cameras and the desired multi-view output. By transmitting camera parameters (position, orientation, focal length) along with base image data, the system enables the receiver to virtually generate images from multiple viewpoints without requiring physical cameras at all those positions, thus achieving viewpoint freedom while reducing equipment complexity
Solution Approach 2:
The patent utilizes parameter changes in camera characteristics (position, orientation, focal length) to generate different virtual views. By varying these camera parameters in the reconstruction process at the receiver, the system can produce images from multiple viewpoints using the same physical camera setup, thereby achieving multi-view capability without proportionally increasing equipment cost
3Loss of information
If complete image data is transmitted for all views, then image completeness is improved, but data processing load increases
Solution Approach 1:
The patent segments the complete image data into two components: essential camera parameters (transmitted separately and concisely) and base image data (transmitted in reduced format). The receiver reconstructs complete image data by combining these segments, ensuring image completeness while reducing the total data processing load during transmission and initial processing
Data Source
AI summary
A method for processing a 3D image signal and an image display device for implementing the method are provided. The 3D image signal processing method is implemented by the 3D image display device. Although an image signal transmission side transmits information to be included in a plurality of image signals, while omitting a portion of the information, a receiver can synthesize the transmitted information to reproduce an image. The device restores at least one image from a broadcast signal, and additionally generates an image at a virtual camera view from the restored image and displays it three-dimensionally. To this end, the image display device receives a broadcast signal and obtains at least one set of camera parameters from signaling information. Then, the image display device generates a virtual view image according to the camera parameters, and formats the virtual view image and the broadcast image included in the broadcast signal three-dimensionally.