Virtual Camera Simulation via Physical Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current motion capture systems for simulating virtual cameras in motion pictures and video games require pre-determined camera positions and angles, limiting creativity and immersion, as they do not allow for dynamic camera movement post-motion capture session.

Innovation Solution

A system that tracks the position and orientation of a physical camera within a physical volume, simulating the movement of a virtual camera within a 3D environment, enabling dynamic camera placement and capture of cinematic shots, including first-person views and various angles, using position and orientation trackers, a processor, and a display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If pre-determined camera positions and angles are used in motion capture systems, then the system complexity is reduced and ease of operation is improved, but adaptability and creative control are limited

Engineering Contradiction:
Improveease of operationVSAvoidadaptability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system transitions from static pre-determined camera positions to dynamic real-time camera tracking. The physical camera's position and orientation are continuously tracked during motion capture sessions, allowing directors to adjust camera angles and movements dynamically while capturing performance data, thereby resolving the contradiction between operational simplicity and adaptability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system creates a virtual camera that copies the movement and orientation of a physical reference camera. By tracking the physical camera's six-degree-of-freedom motion and replicating it in the virtual environment, the system enables adaptive camera control without requiring complex manual positioning, thus improving both adaptability and ease of operation.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If real-time camera tracking is implemented in motion capture systems, then adaptability and creative control are improved, but device complexity and measurement precision requirements increase

Engineering Contradiction:
ImproveadaptabilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system employs a multi-functional tracking infrastructure that simultaneously captures position, orientation, and movement data for multiple cameras and objects. The tracking system serves multiple purposes including real-time camera control, performance capture, and virtual camera synchronization, thereby managing complexity through consolidated functionality while enabling adaptive camera work.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system introduces a virtual camera as an intermediary between the physical reference camera and the final rendered output. This virtual camera acts as a mediator that receives tracking data from the physical camera and translates it into appropriate camera control for the motion capture session, simplifying the overall system architecture while maintaining adaptability.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If multiple virtual camera movements are simulated simultaneously, then adaptability and creative control are improved, but processing time and productivity are reduced

Engineering Contradiction:
ImproveadaptabilityVSAvoidproductivity
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The system performs preliminary tracking and simulation of multiple virtual camera movements during the motion capture session itself rather than in post-production. By capturing all camera angle data in real-time during the performance session, the system enables directors to review and select multiple camera angles immediately, improving productivity by eliminating time-consuming post-processing while maintaining full adaptability.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9299184B2Simulating performance of virtual camera
Publication Date: 2016.03.29 SONY INTERACTIVE ENTERTAINMENT LLC
  • US9299184B2 patent drawing
  • US9299184B2 patent drawing
  • US9299184B2 patent drawing

AI summary

Simulating performance of a virtual camera operating inside a 3-D environment having scenes generated for motion pictures and video games including: tracking position and orientation of an object within a physical volume of space; placing the virtual camera within the virtual 3-D environment corresponding to the tracked position of the object within the physical volume of space; capturing shots within a field of view of the virtual camera, wherein the field of view of the virtual camera is measured in accordance with the tracked position and orientation of the object; and displaying the captured shots of the 3-D environment captured with the virtual camera.