Multi-Camera Virtual Viewpoint Editing With Reference Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies lack the ability to efficiently compare and manipulate virtual viewpoint paths and reference images in virtual viewpoint videos generated from multiple camera perspectives, limiting user interaction and editing capabilities.
Innovation Solution
An information processing apparatus and method that displays virtual viewpoint paths and reference images, allowing users to change reproduction positions, adjust path positions and shapes, and generate virtual viewpoint videos by combining selected paths.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If multiple virtual viewpoint paths are displayed and manipulated, then user interaction and editing capabilities are enhanced, but device complexity increases
Solution Approach 1:
The system segments virtual viewpoint paths into discrete, manipulatable elements that can be individually selected, moved, and edited. Each path is treated as an independent object that can be manipulated without affecting other paths, enabling intuitive user interaction while managing system complexity through modular organization
Solution Approach 2:
The system introduces an intermediary user interface layer that mediates between user input and the complex underlying processing of multiple virtual viewpoint paths. This interface provides simplified manipulation methods (such as visual selection and movement) that hide the complexity of path generation and processing from the user
2Measurement precision
If reference images are displayed for each reproduction position, then video comparison and editing are improved, but information processing load increases
Solution Approach 1:
The system applies local quality by displaying reference images selectively at specific reproduction positions rather than uniformly across all positions. This allows precise comparison where needed while reducing the overall information processing load by limiting the number of reference images that must be generated and managed
Solution Approach 2:
The system implements partial action by providing reference images for only the necessary reproduction positions rather than all possible positions. This selective approach maintains video comparison accuracy for critical frames while reducing the excessive processing burden of generating reference images for every possible viewpoint and position
Data Source
AI summary
An information processing apparatus generates a virtual viewpoint video based on a virtual viewpoint by using a motion picture obtained by imaging an imaging region with a plurality of imaging devices. The information processing apparatus displays, on a display, a standard image corresponding to the imaging region, a plurality of virtual viewpoint paths disposed in the standard image and representing a trajectory of movement of the virtual viewpoint, an indicator indicating a reproduction position of the virtual viewpoint video, and a reference image based on a virtual viewpoint image viewed from the virtual viewpoint corresponding to the reproduction position of the virtual viewpoint path among a plurality of virtual viewpoint images configuring the virtual viewpoint video.