Virtual Camera Path Interpolation with Change Notification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for generating camera paths that align with user intent are burdensome, requiring significant effort and repetition in setting key frames to prevent abrupt changes in virtual viewpoint parameters, increasing user workload.

Innovation Solution

An information processing apparatus that generates virtual camera paths by interpolation using key frames, including a designation unit for user input, a specifying unit for calculating the number of frames between key frames, a change amount specifying unit for determining parameter changes per unit of time, and a notification unit to inform users of these changes, allowing for easier alignment with user intent.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If key frames are discretely selected and automatic interpolation is performed, then the quality of virtual viewpoint content is improved, but the user burden related to setting virtual viewpoints increases

Engineering Contradiction:
Improvequality of virtual viewpoint contentVSAvoiduser burden in setting virtual viewpoints
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system calculates and notifies the amount of change per unit time of virtual camera parameters between key frames, providing feedback to the user about the interpolation results. This allows users to understand the effect of their key frame settings without repeatedly performing preview displays, thereby reducing operational burden while maintaining content quality.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary calculation of the amount of change in virtual camera parameters between key frames before the user finalizes the settings. By notifying users of these changes in advance, users can make informed decisions about key frame placement without needing to repeatedly preview the entire content, thus reducing the number of iterative operations required.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If preview display is performed repeatedly to confirm parameter changes, then the alignment with user intent is improved, but the time and effort required increases

Engineering Contradiction:
Improvealignment with user intentVSAvoidtime and effort for repeated operations
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The notification unit provides immediate feedback to users about the amount of change in virtual camera parameters between key frames. This feedback mechanism allows users to confirm whether the interpolation aligns with their intent without performing time-consuming preview displays, significantly reducing the time and effort required while maintaining alignment with user intent.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system replaces the mechanical process of repeatedly performing preview displays with an information-based notification system that calculates and presents the amount of parameter change. This substitution eliminates the need for repeated rendering and playback operations, reducing time consumption while providing sufficient information for users to verify alignment with their intent.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Manufacturing precision

If correction of key frames is repeated to prevent abrupt changes, then the quality of camera path is improved, but the operational complexity increases

Engineering Contradiction:
Improvequality of camera pathVSAvoidoperational complexity in setting key frames
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system notifies users of the amount of change in virtual camera parameters between key frames, providing feedback that helps users understand whether abrupt changes will occur. This enables users to make appropriate adjustments to key frame settings based on the notified information, improving camera path quality without requiring complex repeated correction operations.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11831852B2Information processing apparatus, method of controlling information processing apparatus, and storage medium
Publication Date: 2023.11.28 CANON KK
  • US11831852B2 patent drawing
  • US11831852B2 patent drawing
  • US11831852B2 patent drawing

AI summary

An information processing apparatus for generating a virtual camera path by interpolation using a plurality of key frames to be a reference in the virtual camera path that indicates a path of a position of a virtual camera, comprising: a designation unit configured to accept a key frame designation operation in accordance with a user operation; a specifying unit configured to specify the number of frames between a first key frame that has already been set and a second key frame designated by the user operation; a change amount specifying unit configured to specify an amount of change per unit of time of a virtual camera parameter between the first and second key frames based on the number of frames specified by the specifying unit; and a notification unit configured to notify, to a user, the specified amount of change.