Virtual Viewpoint Image Quality Deterioration Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for generating virtual viewpoint images from multiple camera sources struggle to easily identify and address quality deterioration issues, such as exposure differences and unexpected obstacles, which affect the quality of the final virtual image.
Innovation Solution
An information processing apparatus that determines and displays the contribution of each camera's image to the virtual viewpoint image, allowing users to easily identify the cause of quality deterioration by highlighting images with higher contribution degrees and their positional relationships.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple cameras are used to generate virtual viewpoint images, then the viewpoint flexibility and imaging coverage are improved, but the difficulty of detecting and measuring quality deterioration causes increases
Solution Approach 1:
The patent segments the virtual viewpoint image generation process by identifying and displaying individual captured images from each camera that contribute to the virtual viewpoint image. This segmentation allows users to visually separate and examine each component image, making it easier to detect quality issues in specific cameras rather than analyzing the composite virtual image as a whole.
Solution Approach 2:
The patent implements a feedback mechanism by displaying the identified captured images alongside or associated with the virtual viewpoint image. This visual feedback loop provides users with immediate information about which source images contribute to the virtual viewpoint, enabling them to quickly identify quality deterioration causes such as exposure differences or unexpected subjects in specific camera feeds.
2Adaptability or versatility
If multiple cameras are used to generate virtual viewpoint images, then the imaging coverage and viewpoint options are improved, but the complexity of the system increases
Solution Approach 1:
The patent introduces an intermediary processing step that automatically identifies and extracts the specific captured images contributing to the virtual viewpoint image. This intermediary function mediates between the complex multi-camera input system and the user, automatically handling the complexity of image source tracking while providing simplified visual feedback to users.
3Adaptability or versatility
If captured images with different exposure levels are used, then the adaptability to different lighting conditions is improved, but the manufacturing precision and quality consistency of the virtual image deteriorates
Solution Approach 1:
The patent addresses exposure differences by displaying the individual captured images in a manner that allows users to visually compare and identify exposure variations. By making the exposure differences visible through the display of source images, users can detect and address quality consistency issues while maintaining the system's adaptability to different lighting conditions.
Data Source
AI summary
An information processing apparatus includes one or more memories storing instructions, and one or more processors executing the instructions to determine, among a plurality of captured images obtained by a plurality of image capturing apparatuses, a display target image related to a virtual viewpoint image, based on a position of a virtual viewpoint and a view direction from the virtual viewpoint, the virtual viewpoint image being generated based on the display target image and the position of the virtual viewpoint and the view direction from the virtual viewpoint, and to cause a displaying unit to display the determined display target image in a displaying mode according to a degree of contribution of the determined display target image to generation of the virtual viewpoint image.