Virtual Viewpoint Gaze Direction Selection from Multi-Camera Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies lack an efficient method to determine the line-of-sight direction of a virtual viewpoint for generating virtual viewpoint videos, particularly in environments with multiple imaging devices capturing different perspectives.
Innovation Solution
An information processing apparatus and method that evaluates an imaging target region from various line-of-sight directions using multiple images from different viewpoints, calculates an evaluation score based on predefined criteria, and decides the line-of-sight direction of a virtual viewpoint to generate a virtual viewpoint video.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple imaging devices are used to capture different perspectives, then the quality and comprehensiveness of virtual viewpoint videos is improved, but the complexity of determining the optimal line-of-sight direction increases
Solution Approach 1:
The system automatically evaluates imaging target regions from multiple line-of-sight directions and decides the optimal line-of-sight direction without requiring manual intervention. The evaluation unit and decision unit work autonomously to select the best viewpoint based on predefined evaluation items, allowing the system to serve itself in determining optimal viewing angles.
Solution Approach 2:
The system performs preliminary evaluation of multiple line-of-sight directions before generating the virtual viewpoint video. By pre-evaluating imaging target regions from different perspectives and storing evaluation results, the system prepares optimal viewpoint information in advance, reducing real-time processing complexity when videos are generated.
2Productivity
If manual selection of viewpoint directions is used, then the complexity of the system is reduced, but the productivity and quality of virtual viewpoint video generation decreases
Solution Approach 1:
The patent replaces manual mechanical selection of viewpoint directions with an automated information processing system. The evaluation unit automatically assesses multiple line-of-sight directions based on evaluation items, and the decision unit algorithmically determines the optimal direction, substituting human judgment with computational evaluation to improve productivity.
Solution Approach 2:
The system implements feedback mechanisms where evaluation results from multiple line-of-sight directions are fed back into the decision-making process. The evaluation unit continuously assesses different viewpoints and provides feedback to the decision unit, which adjusts and selects the optimal line-of-sight direction based on accumulated evaluation information, enabling iterative optimization.
Data Source
AI summary
An information processing apparatus includes a processor and a memory connected to or incorporated in the processor. The processor evaluates an imaging target region from a plurality of line-of-sight directions on the basis of one or more evaluation items by using a plurality of images obtained by imaging the imaging target region with a plurality of imaging devices having different viewpoints, and decides a line-of-sight direction of a virtual viewpoint, which is used to generate a virtual viewpoint video, on the basis of an evaluation result.