Virtual Viewpoint Image Generation for Multi-Event Comparison
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional virtual viewpoint image generation systems face difficulties in comparing image capturing targets that differ in image capturing location or time point, making it inconvenient for users to compare specific player performances across different events, such as a preliminary game and a final game, due to complex virtual viewpoint control operations.
Innovation Solution
An image processing apparatus that acquires data from multiple directions, modifies position and time information, and generates a virtual viewpoint image based on user-specified viewpoint information, allowing for the combination of images from different capturing situations, including those captured at different locations and times, to facilitate easy comparison.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If separate virtual viewpoint images are displayed for different image capturing situations (different locations or time points), then each image can be viewed from its own optimized virtual viewpoint, but the user operation becomes complicated and comparison becomes difficult
Solution Approach 1:
The patent combines multiple virtual viewpoint images from different image capturing situations (different locations or time points) into a single composite virtual viewpoint image. This merging approach allows users to compare multiple capturing targets simultaneously without switching between separate images, thereby simplifying operations while maintaining the ability to view from optimized viewpoints for each situation.
2Adaptability or versatility
If multiple virtual viewpoint images are displayed separately for comparison, then each image maintains its own viewpoint settings, but the user has difficulty comparing images and control operations become complicated
Solution Approach 1:
The patent creates a universal virtual viewpoint image that can simultaneously display multiple image capturing targets from different situations while maintaining individual viewpoint optimizations. This multi-functional approach allows a single image to serve multiple comparison purposes, reducing system complexity while preserving viewpoint customization capabilities for each capturing situation.
3Ease of operation
If virtual viewpoint images from different locations and times are combined, then comparison becomes easy, but the processing complexity increases
Solution Approach 1:
The patent introduces a composite image generation process that acts as an intermediary between multiple source images and the final comparison view. This intermediary process automatically handles the complex task of integrating images from different locations and times into a unified virtual viewpoint image, thereby simplifying user operations while managing processing complexity through automated synthesis.
Data Source
AI summary
An image processing apparatus includes data acquisition units configured to acquire data that is based on first image capturing from a plurality of directions, and on second image capturing from a plurality of directions, a modification unit configured to modify at least one of position information and time information about the data acquired by the second data acquisition unit in association with at least one of position information and time information about the data acquired by the first data acquisition unit, and a generation unit configured to generate a virtual viewpoint image that contains an image of an object captured in the first image capturing and an image of an object captured in the second image capturing, based on the data acquired by the first data acquisition unit, the data acquired by the second data acquisition unit, and the information modified by the modification unit.