Virtual Viewpoint Key Frame Reordering for Reverse Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques face difficulties in setting virtual viewpoint information for generating virtual viewpoint images that combine forward and reverse playback of the same scene, particularly when using the key frame method, as they do not account for reverse playback scenarios effectively.
Innovation Solution
An information processing apparatus that includes a key frame generation unit, a determination unit, and an information generation unit to create and manage virtual viewpoint information based on user-designated virtual viewpoints and playback directions, allowing for the generation of virtual viewpoint images that can be played back in both forward and reverse directions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the key frame method is used to generate virtual viewpoint information, then the virtual viewpoint can be set at arbitrary positions, but it becomes difficult to set virtual viewpoint information for reverse playback scenarios
Solution Approach 1:
The patent applies dynamics by making the key frame arrangement adaptive to playback direction. The system dynamically reorders key frames based on whether forward or reverse playback is selected, allowing the same key frame data to serve both playback directions effectively. This resolves the contradiction by enabling reverse playback capability without adding permanent structural complexity to the key frame setting process.
Solution Approach 2:
The patent changes the parameter arrangement order of key frames based on playback direction. By reversing the temporal parameter sequence when reverse playback is selected, the system enables reverse playback functionality without requiring separate key frame settings, thus maintaining ease of operation while expanding adaptability.
2Adaptability or versatility
If virtual viewpoint information is manually set for each playback direction, then reverse playback can be supported, but the operator's workload increases significantly
Solution Approach 1:
The patent makes the key frame generation unit universal by designing it to handle both forward and reverse playback with a single set of key frame settings. The determination unit automatically adapts the key frame arrangement based on playback direction, eliminating the need for separate manual configurations and significantly reducing operator workload while maintaining full functionality.
Solution Approach 2:
The system performs self-service by automatically reordering key frames according to playback direction without requiring manual intervention. The determination unit autonomously determines the appropriate key frame arrangement, saving operator time and effort while ensuring correct virtual viewpoint information is generated for the selected playback direction.
3Ease of manufacture
If key frames are arranged in fixed temporal order, then the setup process is simple, but seamless reverse playback cannot be achieved
Solution Approach 1:
The patent transforms the static key frame arrangement into a dynamic one that adapts to playback direction. The system maintains simple initial setup with fixed temporal ordering but introduces dynamic reordering capability when reverse playback is selected, achieving seamless reverse playback without complicating the initial key frame setup process.
Solution Approach 2:
The patent prepares key frames in standard temporal order as a preliminary step, which simplifies the initial setup process. The determination unit then performs the necessary reordering action based on playback direction, allowing the system to maintain simplicity in key frame creation while enabling flexible playback options.
Data Source
AI summary
To make it possible to easily perform setting of virtual viewpoint information relating to playback of a virtual viewpoint image. A key frame is generated in which parameters representing a position of a virtual viewpoint and an orientation of the virtual viewpoint are associated with time in a period during which image capturing is performed by a plurality of imaging devices. Then, a playback direction of a plurality of key frames is determined. Then, based on the plurality of key frames and the playback direction, virtual viewpoint information representing transition of the virtual viewpoint is generated.