Virtual Camera Alignment Correction for CG Video Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Accurate alignment between a user's device in a real space and a virtual camera in a virtual space is challenging, leading to deviations that hinder the generation of desired computer-generated (CG) videos.

Innovation Solution

An information processing system comprising an acquisition unit for real-space device position information, a trajectory generation unit for virtual-space movement, a modification unit to correct virtual-camera position information, and a storage unit to hold and correct movement trajectories, enabling precise alignment and desired CG video generation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If motion capture or device tracking is used to control virtual camera position and posture, then the ease of operation is improved, but measurement precision deteriorates due to alignment deviations between real and virtual spaces

Engineering Contradiction:
Improveease of operationVSAvoidmeasurement precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system captures images from multiple cameras, detects the actual position and posture of the holding device, compares it with the expected position based on motion capture data, and generates correction values to compensate for alignment deviations. This feedback loop continuously refines the alignment between real and virtual spaces.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system replaces direct mechanical tracking with an image-based detection and correction system. Instead of relying solely on motion capture devices, it uses multiple cameras to visually detect and correct alignment deviations, substituting mechanical tracking with optical measurement and computational correction.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If multiple cameras are used to detect device position and posture, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvemeasurement precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The multiple cameras serve multiple functions: they detect the position and posture of the holding device, capture images for alignment correction, and provide redundant measurement data. This multi-functionality justifies the added complexity by consolidating several measurement tasks into a single system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Manufacturing precision

If alignment correction is performed continuously, then manufacturing precision is improved, but loss of time increases due to processing requirements

Engineering Contradiction:
Improvemanufacturing precisionVSAvoidloss of time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system pre-calculates correction values based on detected alignment deviations and applies them proactively to maintain accurate alignment. By performing correction in advance and continuously, it prevents drift accumulation without requiring excessive real-time processing during critical operations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3996052B1Information processing system, information processing method, and program
Publication Date: 2024.05.08 SONY GROUP CORP
  • EP3996052B1 patent drawingFigure 1
  • EP3996052B1 patent drawingFigure 2~3
  • EP3996052B1 patent drawingFigure 4

AI summary

It is possible to generate a CG video desired by a user. An information processing system according to an embodiment includes: an acquisition unit (13) that acquires first position information of a device existing in a real space, the first position information regarding the real space; a trajectory generation unit (15) that generates a movement trajectory of a viewpoint set in a virtual space on the basis of the first position information, the movement trajectory regarding the virtual space; a first modification unit (15) that modifies second position information of the viewpoint in the virtual space, the second position information regarding the virtual space; and a correction unit (22) that corrects the movement trajectory on the basis of the modification of the second position information.