Virtual Camera Orientation Correction for Direct Path Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for generating camera paths in virtual viewpoint images can produce redundant paths when moving a virtual camera from a current position to a preset position, particularly in real-time applications like sports broadcasting, where efficient and direct transitions are necessary.

Innovation Solution

The system employs a method to correct the orientation parameters of the virtual camera by ensuring the difference between the current and preset positions is within 180° or less, allowing for direct and efficient camera path generation by adjusting the pan, tilt, and roll values, thereby avoiding unnecessary rotations and generating a shorter path.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If spline interpolation is used to generate camera path between key frames, then the camera path is smooth and continuous, but redundant movements are generated when moving to preset position

Engineering Contradiction:
Improvecamera transition speedVSAvoidtime for redundant camera movements
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The patent changes the orientation parameters (pan, tilt, roll) of the virtual camera to ensure the difference between current and preset positions is within 180° or less. This parameter adjustment prevents redundant rotations and generates a more efficient camera path by selecting the shortest rotational direction.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

Instead of allowing the camera to rotate freely in any direction, the patent inverts the conventional approach by constraining the rotation to always take the shorter path (≤180°). This inversion of the rotation direction logic eliminates redundant movements and optimizes the transition efficiency.

Inventive Principle:
Principle #13The other way round (Inversion)

2Ease of manufacture

If conventional key frame interpolation method is used, then the camera path generation is simple, but the path becomes redundant and inefficient

Engineering Contradiction:
Improveease of camera path generationVSAvoidefficiency of camera transition
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent modifies the orientation parameters (pan, tilt, roll) by ensuring the angular difference remains within 180°. This simple parameter constraint maintains ease of implementation while dramatically improving transition efficiency by eliminating redundant rotations.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces dynamic adjustment of camera orientation parameters based on the relationship between current and preset positions. The system automatically determines the optimal rotation direction and magnitude, making the camera path adaptive and efficient without complex manual intervention.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP4451667A1Information processing apparatus for virtual viewpoint images, control method, and program for the same
Publication Date: 2024.10.23 CANON KK
  • EP4451667A1 patent drawingFigure 1
  • EP4451667A1 patent drawingFigure 2
  • EP4451667A1 patent drawingFigure 3A~3B

AI summary

An information processing apparatus (203) includes one or more memories storing instructions and one or more processors executing the instructions to: obtain a user operation; set, based on the obtained user operation, positions and orientations of a plurality of virtual cameras in a virtual viewpoint image generated from a plurality of images captured by a plurality of image capturing apparatuses; generate a camera path from the positions and the orientations of the plurality of virtual cameras; and select a procedure for generating the camera path between generating the camera path using the set positions and orientations of the plurality of virtual cameras and generating the camera path using the set positions and orientations of the virtual cameras and a preset position and orientation of a virtual camera.