Virtual Viewpoint Setting via Common Image Area Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual viewpoint video image techniques face challenges in reproducing high-quality images due to blind areas between camera captures and decreased resolution when the virtual camera moves closer to objects, leading to repeated path adjustments without confirming the correspondence between virtual viewpoint positions and image quality.
Innovation Solution
A setting apparatus that determines common image capturing areas among multiple cameras and uses a graphical user interface to allow users to set virtual viewpoint parameters, visualizing these areas to help users recognize and adjust camera paths and heights effectively.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of moving object
If the virtual camera moves closer to objects to capture detailed views, then the field of view increases, but the degree of resolution decreases causing image blur
Solution Approach 1:
The system divides the image capturing scene into multiple common image capturing areas, each associated with different camera groups having different resolutions. By segmenting the virtual camera path into sections passing through different common image capturing areas, the system can dynamically adjust resolution based on position, thereby maintaining high resolution in critical areas while expanding overall field of view.
Solution Approach 2:
The system changes the resolution parameter dynamically based on the virtual camera's position within different common image capturing areas. When the virtual camera is positioned in areas captured by high-resolution camera groups, the system applies higher resolution processing, and adjusts resolution for areas captured by lower resolution camera groups, thus optimizing the balance between field of view and image quality.
2Ease of operation
If the path of the virtual camera is set without considering blind areas and resolution issues, then the setting process is simple, but the image quality of the virtual viewpoint video image deteriorates
Solution Approach 1:
The system performs preliminary determination of common image capturing areas and their associated resolutions before the user sets the virtual camera path. By pre-calculating and displaying these areas on the GUI, the system provides users with advance information about resolution characteristics at different positions, enabling informed path planning without requiring complex iterative adjustments.
Solution Approach 2:
The system provides visual feedback on the GUI by displaying common image capturing areas and their resolution characteristics. This feedback mechanism allows users to adjust the virtual camera path based on expected image quality at different positions, thereby improving image quality without significantly increasing operational complexity.
3Measurement precision
If the virtual camera path is set repeatedly to achieve optimal image quality, then the image quality improves, but the time and effort required for setting increases
Solution Approach 1:
The system determines and displays common image capturing areas and their resolution characteristics in advance, before the user finalizes the virtual camera path. This preliminary information provision enables users to set an optimal path in fewer iterations, reducing the time and effort required for path configuration while maintaining high image quality.
Data Source
AI summary
A setting apparatus sets a virtual viewpoint corresponding to a virtual viewpoint image that is generated based on images obtained by image capturing from a plurality of directions. The setting apparatus includes one or more hardware processors, and one or more memories that store instructions executable by the one or more hardware processors to cause the setting apparatus to determine a common image capturing area that is included within each of a plurality of fields of view, of a plurality of image capturing apparatuses used for obtaining at least a part of the plurality of captured images, and to cause a graphical user interface (GUI), used for setting the virtual viewpoint, to identifiably display the determined common image capturing area. In addition, the setting apparatus sets of the virtual viewpoint according to a user input based on the GUI identifiably displaying the determined common image capturing area.