Virtual Viewpoint Synchronization for Seamless Multi-View Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for generating virtual viewpoint videos from multi-viewpoint videos can confuse viewers by disrupting their sense of direction and location, especially when switching between virtual and actual camera views during events like sports games.
Innovation Solution
An information processing apparatus with an identification unit for camera position and orientation, a reception unit for switching operations, and a determination unit to synchronize the virtual viewpoint with the actual camera's position and orientation, ensuring a seamless transition between camera views.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual camera videos are added to provide unrealistic viewpoints, then the realistic sensation for viewers is improved, but the viewer may be confused by losing the direction and location in and from which the videos have been captured
Solution Approach 1:
The patent introduces an actual camera video as an intermediary element between the virtual camera video and the viewer. When switching from virtual to actual camera video, the system provides a transitional view that maintains direction and location information, preventing viewer confusion while still allowing access to unrealistic viewpoints through the virtual camera
Solution Approach 2:
The system provides feedback to the viewer about the camera position and orientation during switching operations. By displaying information about the direction and location from which videos are captured, the system maintains spatial awareness and prevents loss of orientation information
2Reliability
If the virtual camera video is switched to actual camera video, then the realistic sensation is improved, but the transition may cause viewer confusion if the compositions do not match
Solution Approach 1:
The patent performs preliminary actions by adjusting the virtual camera video composition to match the actual camera video composition before the switching operation occurs. This preparation ensures a smooth transition and prevents viewer confusion by maintaining compositional consistency across the switch
Solution Approach 2:
The system takes preliminary anti-action by pre-adjusting the virtual camera parameters (position, orientation, zoom) to counteract potential discontinuities that would occur during switching. This anticipatory adjustment prevents the harmful effect of composition mismatch and spatial disorientation
Data Source
AI summary
An information processing apparatus comprises an identification unit configured to identify a position and an orientation of an image capturing apparatus; a reception unit configured to receive an input associated with a switching operation for switching an image to be output between a captured image acquired by the image capturing apparatus and a virtual viewpoint image generated based on a plurality of captured images captured from different directions; and a determination unit configured to determine a position and an orientation of a virtual viewpoint corresponding to the virtual viewpoint image such that, in a specific period after the input associated with the switching operation is received, the position and the orientation of the virtual viewpoint and the identified position and the identified orientation of the image capturing apparatus match each other.