Virtual Viewpoint Image Obstruction Removal
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for generating virtual viewpoint images can result in reduced quality when a normal image capturing camera is included in the image capturing range of a virtual viewpoint image generation camera, leading to incongruity and potential obstructions in the virtual viewpoint image.
Innovation Solution
An information processing apparatus that obtains and compares viewpoint information from both virtual and normal image capturing cameras, controlling the output to exclude the normal camera from the virtual viewpoint image when their viewpoints are similar, thereby maintaining image quality and avoiding obstructions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a normal image capturing camera is used to capture images in addition to virtual viewpoint image generation cameras, then the versatility and flexibility of image capture is improved, but the quality of the virtual viewpoint image deteriorates when the normal camera is included in the image capturing range
Solution Approach 1:
The patent introduces an image processing apparatus as an intermediary that receives images from both virtual viewpoint image generation cameras and normal image capturing cameras. This intermediary processes and determines which images to output, preventing the normal camera from being included in the virtual viewpoint image while maintaining the flexibility of using multiple camera types. The intermediary resolves the conflict between versatility and image quality.
Solution Approach 2:
The patent implements dynamic switching between virtual viewpoint images and normal captured images based on real-time conditions. The image processing apparatus dynamically determines which image source to use, allowing the system to adapt to different scenarios. When the normal camera is not in the capturing range, virtual viewpoint images are used; when it is, the system switches to normal captured images, maintaining quality while preserving versatility.
2Ease of operation
If the normal image capturing camera is included in the virtual viewpoint image, then the ease of operation is improved by having a single output stream, but the reliability of the image content deteriorates due to potential obstructions and incongruity
Solution Approach 1:
The patent implements a feedback mechanism where the image processing apparatus continuously monitors the capturing range and determines whether the normal image capturing camera is included. Based on this feedback, the system automatically switches between virtual viewpoint images and normal captured images. This feedback loop ensures reliable image content by preventing obstructions while maintaining simple operation through automatic switching.
3Manufacturing precision
If automatic switching between virtual viewpoint images and normal captured images is implemented, then the image quality is maintained, but the device complexity increases
Solution Approach 1:
The patent makes the image processing apparatus multi-functional by enabling it to process both virtual viewpoint images and normal captured images through a single system. This universal approach maintains image quality while avoiding the need for separate complex systems for each image type. The single image processing apparatus handles multiple functions, reducing overall system complexity despite the switching mechanism.
Data Source
AI summary
The information processing apparatus obtains first viewpoint information for specifying a virtual viewpoint corresponding to a virtual viewpoint image and second viewpoint information representing a viewpoint of a first image capturing apparatus existing in an image capturing range of a second image capturing apparatus that is used for generating the virtual viewpoint image and performs control so that the image captured by the first image capturing apparatus is output in a case where a position of the first image capturing apparatus specified by the second viewpoint information is included in a field of view of the virtual viewpoint specified by the first viewpoint information.