Virtual Camera Path Generation for Dynamic Camerawork Sharing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods fail to effectively share the motion of a virtual camera that changes with time, such as panning, tilting, zooming, or bullet time motion, making it difficult for users to share and replay camerawork with temporal operations like stopping or reversing the image.

Innovation Solution

An information-processing apparatus generates and provides camera path information that represents changes in the position and posture of a virtual viewpoint over time, allowing for the sharing and replaying of complex camerawork without sharing the entire virtual viewpoint image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the entire virtual viewpoint image is shared to enable sharing of camera motion, then the completeness of shared information is improved, but the data communication volume increases significantly

Engineering Contradiction:
Improvecompleteness of shared camera motion informationVSAvoiddata communication volume
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential camera path information (position, posture, and timing data) from the complete virtual viewpoint image sequence. Instead of sharing the entire image data, the system extracts and transmits only the metadata describing camera motion, significantly reducing data volume while preserving the ability to reproduce the desired camera perspective through rendering.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the camera motion into discrete path points and parameters rather than sharing continuous image streams. The camera path is represented as a series of keyframes with associated metadata, allowing selective transmission of only the necessary motion information while the actual image rendering is performed locally or on demand.

Inventive Principle:
Principle #1Segmentation

2Quantity of substance

If camera path information is extracted and shared instead of the entire image, then data communication volume is reduced, but the complexity of reproducing the complete camerawork increases

Engineering Contradiction:
Improvedata communication volumeVSAvoidcomplexity of reproducing camerawork
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent introduces a camera path information representation as an intermediary between the original virtual viewpoint images and the reproduction system. This intermediary layer (containing position, posture, and timing data) serves as a bridge that enables reconstruction of camera motion without requiring transmission of the actual image data, simplifying the reproduction process while reducing data requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transforms the representation from pixel-based image data to parameter-based camera path data. By changing the fundamental parameters from image content to camera motion parameters (position coordinates, orientation angles, timing information), the system achieves compact representation that is easier to transmit and reproduce while maintaining the essential camerawork characteristics.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If user interaction is required to specify camera position and posture, then the flexibility of customization is improved, but the ease of operation deteriorates

Engineering Contradiction:
Improveflexibility of camera view customizationVSAvoidease of camera path specification
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent implements self-service functionality where the system automatically generates and shares camera path information without requiring manual user input for each camera parameter. The system captures the camera motion characteristics during recording and automatically creates shareable path data, eliminating the need for users to manually specify camera position and posture while maintaining full customization flexibility.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11622099B2Information-processing apparatus, method of processing information, and program
Publication Date: 2023.04.04 CANON KK
  • US11622099B2 patent drawing
  • US11622099B2 patent drawing
  • US11622099B2 patent drawing

AI summary

An information-processing apparatus generates camera path information that represents changes with time in the position and posture of a virtual viewpoint and provides another apparatus with the generated camera path information.