Virtual Viewpoint Path Editing With Reference Image Comparison
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies lack the ability to efficiently compare and manipulate virtual viewpoint paths and reference images in virtual viewpoint videos, limiting user interaction and editing capabilities.
Innovation Solution
An information processing apparatus and method that displays virtual viewpoint paths and reference images, allowing users to change reproduction positions, adjust path properties, and generate virtual viewpoint videos by combining selected paths.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If multiple virtual viewpoint paths are displayed simultaneously in the standard image, then user interaction and editing capabilities are enhanced, but the display becomes cluttered and difficult to interpret
Solution Approach 1:
The patent segments the display into multiple functional regions: a standard image display region showing the imaging region, a virtual viewpoint path display region overlaying paths, a reference image display region showing individual reference images, and a reproduction position indicator. This segmentation allows multiple virtual viewpoint paths to be displayed simultaneously without cluttering the entire interface, as each element has its designated space.
Solution Approach 2:
The patent adds temporal dimension to the display by showing reference images corresponding to different reproduction positions along the virtual viewpoint paths. Users can interactively change reproduction positions, and the system displays corresponding reference images, transforming a static 2D display into an interactive 4D experience (spatial x temporal).
2Measurement precision
If reference images are displayed for each reproduction position, then users can accurately compare and select virtual viewpoint paths, but the information processing load increases
Solution Approach 1:
The system pre-calculates and stores reference images for multiple reproduction positions along each virtual viewpoint path. When users interactively change reproduction positions, the pre-prepared reference images are immediately displayed without requiring real-time rendering, thus maintaining high comparison accuracy while reducing processing load during interaction.
Solution Approach 2:
The patent creates simplified copy representations (reference images) of the virtual viewpoint videos at specific reproduction positions. These reference images serve as lightweight proxies that allow users to compare different paths without processing the full high-resolution video data, reducing information processing requirements while maintaining comparison accuracy.
3Adaptability or versatility
If users can freely change reproduction positions and manipulate paths, then editing flexibility is improved, but the system complexity increases
Solution Approach 1:
The patent implements dynamic virtual viewpoint paths where reproduction positions can be freely changed along the paths. The system dynamically updates the display of reference images and reproduction position indicators based on user interactions, allowing flexible editing while managing complexity through event-driven updates rather than continuous processing.
Solution Approach 2:
The patent introduces an intermediary user interface layer that mediates between user input and the complex video processing system. The interface includes interactive elements for changing reproduction positions, selecting paths, and manipulating virtual viewpoint parameters, shielding users from underlying system complexity while enabling flexible editing operations.
Data Source
AI summary
An information processing apparatus generates a virtual viewpoint video based on a virtual viewpoint by using a motion picture obtained by imaging an imaging region with a plurality of imaging devices. The information processing apparatus displays, on a display, a standard image corresponding to the imaging region, a plurality of virtual viewpoint paths disposed in the standard image and representing a trajectory of movement of the virtual viewpoint, an indicator indicating a reproduction position of the virtual viewpoint video, and a reference image based on a virtual viewpoint image viewed from the virtual viewpoint corresponding to the reproduction position of the virtual viewpoint path among a plurality of virtual viewpoint images configuring the virtual viewpoint video.