Virtual Viewpoint Parameter Management for Seamless Playback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional technologies for generating virtual viewpoint images are cumbersome, requiring users to spend significant effort in setting and editing virtual viewpoints, especially when adjusting parameters like position, direction, and angle of view over time.

Innovation Solution

An information processing apparatus that stores and manages parameters for virtual viewpoint image generation, allowing users to easily switch and reproduce virtual viewpoint images by associating time and camera parameters, enabling seamless playback and editing of virtual viewpoint content without complex operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If users manually set all parameters (position, direction, angle of view) for virtual viewpoint images at each time point, then the virtual viewpoint image can be accurately generated, but the operation becomes cumbersome and time-consuming

Engineering Contradiction:
Improveaccuracy of virtual viewpoint image generationVSAvoidease of setting virtual viewpoint parameters
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system pre-stores parameter sets (position, direction, angle of view) corresponding to different time points in advance. When a user wants to generate a virtual viewpoint image for a specific time, the system automatically retrieves and applies the pre-stored parameters, eliminating the need for manual setting while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates and stores copies of parameter sets for different time points. Instead of manually recreating parameters each time, the system uses stored parameter copies that represent previously optimized virtual viewpoint settings, allowing quick retrieval and application without redundant manual configuration.

Inventive Principle:
Principle #26Copying

2Manufacturing precision

If users re-set all virtual viewpoint parameters for each time point, then the virtual viewpoint can be accurately reproduced, but the time required for editing increases significantly

Engineering Contradiction:
Improveaccuracy of virtual viewpoint reproductionVSAvoidtime spent on parameter setting and editing
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

Parameter sets for multiple time points are prepared and stored in advance during the content creation phase. During editing, users can directly access these pre-prepared parameters for any time point, eliminating the need to re-set parameters and significantly reducing editing time while maintaining reproduction accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system stores copied parameter sets for different time points that can be quickly retrieved during editing. Instead of manually re-setting parameters for each time point, editors can copy and apply pre-stored parameter sets, dramatically reducing the time required for virtual viewpoint editing while maintaining accuracy.

Inventive Principle:
Principle #26Copying

3Ease of operation

If the system stores and manages parameter sets for multiple time points, then virtual viewpoint images can be easily switched and reproduced, but the storage requirements and system complexity increase

Engineering Contradiction:
Improveease of switching virtual viewpoint imagesVSAvoidcomplexity of parameter management system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The parameter management system is segmented into discrete parameter sets, each corresponding to a specific time point. Each parameter set contains organized data (position, direction, angle of view) that can be independently stored, retrieved, and managed. This segmentation simplifies the overall system architecture by breaking down complex parameter management into manageable units.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The parameter storage system serves multiple functions: storing parameters for different time points, enabling easy switching between time points, facilitating accurate reproduction of virtual viewpoints, and supporting efficient editing operations. This multi-functionality justifies the storage requirements by providing versatile capabilities that benefit various user operations.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11750851B2Information processing apparatus, information processing method, and storage medium
Publication Date: 2023.09.05 CANON KK
  • US11750851B2 patent drawing
  • US11750851B2 patent drawing
  • US11750851B2 patent drawing

AI summary

An apparatus 103 stores, in a storage unit, a plurality of parameters for generation of a virtual viewpoint image based on a plurality of captured images, the plurality of parameters including a parameter representing a time and a parameter representing a position of a virtual viewpoint and a direction of view from a virtual viewpoint corresponding to the time, and causes, in accordance with a switching operation performed while a virtual viewpoint image is being displayed on a display unit, the display unit to display a virtual viewpoint image corresponding to a parameter representing a time selected from the plurality of parameters stored in the storage unit based on the switching operation, and corresponding to a parameter representing a position of a virtual viewpoint and a direction of view from a virtual viewpoint corresponding to the virtual viewpoint image being displayed.