Virtual Viewpoint Image Quality Selection for Partial Regions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for generating virtual viewpoint images from multiple camera captures lack efficient mechanisms for determining and displaying image quality information, particularly for specific regions within the image, which hinders the creation of high-quality virtual viewpoint videos.
Innovation Solution
An image processing system that includes processors to acquire and analyze virtual viewpoint images, determine a specific virtual viewpoint based on user input, and display image quality information for partial regions, utilizing a graphical user interface to select and adjust the angle of view for optimal image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple virtual viewpoint images are generated from multiple cameras, then the availability of viewpoint options increases, but the difficulty of selecting high-quality images increases
Solution Approach 1:
The patent replaces manual image quality assessment with automated computer-based image quality evaluation. The system uses image quality evaluation units to automatically assess multiple virtual viewpoint images based on quantitative criteria, substituting human judgment with computational analysis to efficiently identify high-quality images among many options.
Solution Approach 2:
The patent introduces image quality information as an intermediary between the multiple virtual viewpoint images and the final selection. This intermediary provides quantitative metrics that facilitate objective comparison and selection of high-quality images, bridging the gap between having many viewpoint options and efficiently selecting the best ones.
2Loss of information
If image quality information is displayed for all virtual viewpoint images, then the completeness of information increases, but the complexity of the display system increases
Solution Approach 1:
The patent extracts and displays only the most relevant image quality information for the selected virtual viewpoint image rather than displaying all possible information for all images. This extraction approach maintains information completeness for the user's needs while reducing display complexity by showing only essential quality metrics for the current selection.
Solution Approach 2:
The patent applies different display strategies for different regions of the interface: comprehensive image quality information is provided for selected images where users need detailed assessment, while unselected images receive simplified or aggregated information. This local differentiation optimizes information completeness where needed while minimizing complexity elsewhere.
3Measurement precision
If quantitative image quality evaluation is performed, then the precision of image selection increases, but the processing time increases
Solution Approach 1:
The patent performs preliminary image quality evaluation on multiple virtual viewpoint images during the generation phase, before final selection is needed. By pre-computing quality metrics and storing them, the system avoids time-consuming real-time analysis when users need to select images, thus maintaining high precision while reducing perceived processing time.
Solution Approach 2:
The patent implements a two-stage evaluation process where a quick preliminary assessment filters out obviously low-quality images, and detailed quantitative evaluation is performed only on promising candidates. This partial application of full evaluation reduces overall processing time while maintaining selection precision for the final chosen images.
Data Source
AI summary
An image processing system includes one or more memories storing instructions, and one or more processors executing the instructions to acquire a plurality of virtual viewpoint images generated based on a plurality of captured images obtained by a plurality of image capturing apparatuses performing image capture, determine a specific virtual viewpoint image of the plurality of virtual viewpoint images based on a first user operation, and display image quality information indicating an image quality of a partial region specified based on a second user operation, the partial region being in the specific virtual viewpoint image.