Occlusion Image Selection for Spherical Display Bandwidth
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In MPEG-DASH systems, client devices often fail to acquire suitable occlusion images due to insufficient bandwidth, leading to incomplete display of full spherical images, especially when only texture information from the main image is transmitted without accompanying occlusion information.
Innovation Solution
An image processing apparatus and method that selects and acquires a suitable occlusion image based on viewpoint position information included in the MPD file, using occlusion coordinate information and depth level information to prioritize occlusion images for transmission, ensuring efficient bandwidth utilization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If multiple occlusion images are transmitted to enable looking-in display, then the display quality and realism are improved, but the transmission bandwidth requirement increases
Solution Approach 1:
Instead of transmitting all occlusion images uniformly, the system selectively transmits only the necessary occlusion image based on the user's viewpoint position. The MPD file includes viewpoint position information that enables the client to identify which occlusion image corresponds to the current viewing direction, thereby reducing unnecessary bandwidth consumption while maintaining display quality.
Solution Approach 2:
The system segments the occlusion images into multiple versions, each associated with specific viewpoint positions. The MPD file structures this information to allow selective acquisition, dividing the full set of occlusion images into manageable segments that can be transmitted based on actual viewing requirements rather than transmitting everything at once.
2Productivity
If the client device acquires only texture information of the main image to save bandwidth, then the transmission efficiency is improved, but the occlusion region information is lost
Solution Approach 1:
The server preliminarily provides viewpoint position information in the MPD file before the actual image transmission. This allows the client device to pre-determine which occlusion image is needed based on the user's viewpoint position, enabling efficient bandwidth utilization by acquiring only the necessary occlusion information rather than attempting to acquire all possible occlusion images.
3Reliability
If the client device attempts to acquire all occlusion images, then the completeness of occlusion region information is improved, but the bandwidth consumption increases excessively
Solution Approach 1:
The system dynamically adjusts the acquisition behavior based on real-time viewpoint position information provided in the MPD file. Instead of statically acquiring all occlusion images, the client dynamically selects and acquires only the occlusion image corresponding to the current viewpoint position, making the acquisition process adaptive to actual viewing needs and reducing unnecessary bandwidth consumption.
Data Source
AI summary
There is provided an image processing apparatus and method, a file generation apparatus and method, and a program that enable a suitable occlusion image to be obtained. The image processing apparatus includes an MPD file processing unit configured to select an occlusion image to be acquired, on the basis of information regarding a viewpoint position of the occlusion image included in an MPD file, from among a plurality of the occlusion images indicated by the MPD file. The present technology can be applied to a client device.