Virtual Viewpoint Image Transparency Adjustment for Resolution Masking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In virtual viewpoint video image generation, the image quality is compromised when the virtual camera is positioned close to the object, resulting in reduced resolution and a sense of incongruity for the user, as the technique cannot surpass the resolution of the real camera's captured image.
Innovation Solution
An image processing apparatus that adjusts the transparency of objects based on their distance from the virtual camera, making objects closer to the camera more transparent to minimize the visibility of reduced resolution, thereby improving image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the virtual camera is positioned close to the object to improve the feeling of being at a live performance, then the immersion and engagement of the user are enhanced, but the image resolution is reduced because the captured image must be enlarged, resulting in a sense of incongruity
Solution Approach 1:
The patent applies transparency changes to objects based on their distance from the virtual camera. Objects closer to the virtual camera are rendered with higher transparency, which masks the reduced resolution caused by enlarging captured images. This visual effect resolves the contradiction by maintaining the immersive close positioning while hiding the degradation in image quality through transparency modulation.
2Reliability
If the technique of PTL 1 is applied to generate virtual viewpoint video images, then a sense of discomfort from 3D view is suppressed, but the problem of reduced image quality when the virtual camera is close to the object remains unsolved
Solution Approach 1:
The patent implements local quality by applying different transparency levels to different regions of the image based on distance from the virtual camera. Specifically, objects at specific distances are rendered with higher transparency while other regions maintain normal opacity. This localized approach addresses the image quality issue only where it occurs (near the virtual camera) without affecting the overall 3D viewing comfort achieved by PTL 1.
3Length of stationary object
If drawing is performed by enlarging the captured image by the real camera to achieve closer virtual camera positioning, then the virtual camera can be placed at shorter distances, but the image resolution is reduced accordingly
Solution Approach 1:
The patent uses transparency modulation (a form of optical property change) to mask the resolution loss that occurs when enlarging captured images. By making objects at specific distances more transparent, the visual artifacts and pixelation from enlargement become less noticeable, allowing the virtual camera to be positioned closer without sacrificing perceived image quality.
Data Source
AI summary
The image processing apparatus that generates a virtual viewpoint image includes a generation unit. The generation unit generates a virtual viewpoint image in which in accordance with a virtual viewpoint specified by the virtual viewpoint information. The degree of transparency of a specific object at a position a specific distance apart from a position of a first virtual viewpoint in a virtual viewpoint image in accordance with the first virtual viewpoint corresponding to a first angle of view, which is generated by the generation unit, is higher than a degree of transparency of an object at a position the specific distance apart from a position of a second virtual viewpoint in a virtual viewpoint image in accordance with the second virtual viewpoint corresponding to a second angle of view larger than the first angle of view.