Synchronized Volumetric Camera Arrays for Multi-Actor 3D Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video capture systems are inadequate for capturing video content in customizable and organic ways, as they often require actors to remain confined to a single position and fail to capture comprehensive three-dimensional coverage from multiple angles, especially when multiple people are involved.

Innovation Solution

A system comprising multiple sets of controllably moveable cameras on structures, including floor, side, and overhead positions, synchronized by a controller to track and capture an entity from various angles, combining video feeds into a three-dimensional model.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple cameras are positioned at different angles to capture comprehensive three-dimensional coverage, then the video capture completeness is improved, but the system complexity increases

Engineering Contradiction:
Improvevideo capture completenessVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system divides the capture apparatus into multiple independent camera units positioned at different angles (front, side, overhead, floor cameras), each capturing a specific portion of the scene. These segmented camera units work together to provide comprehensive three-dimensional coverage while maintaining individual simplicity and independence

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple video feeds from cameras positioned at different angles are merged and synchronized to create a unified three-dimensional representation of the scene. The system combines front cameras, side cameras, overhead cameras, and floor cameras into a cohesive capture system that provides complete volumetric coverage

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If cameras are made controllably moveable to track entities freely moving within space, then the adaptability is improved, but the device complexity increases

Engineering Contradiction:
Improvetracking capabilityVSAvoidcamera control complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system employs dynamically controllable cameras that can move and adjust their positions in real-time to track entities as they move freely within the capture space. The cameras transition from static to dynamic positioning, allowing them to follow actors' movements and maintain optimal capture angles throughout the performance

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The camera system incorporates feedback mechanisms where the controllably moveable cameras receive real-time information about entity positions and adjust their own positioning accordingly. This feedback loop enables the cameras to automatically track moving entities while adapting to changing spatial relationships within the capture volume

Inventive Principle:
Principle #23Feedback

3Measurement precision

If multiple video feeds are combined into a three-dimensional model, then the representation quality is improved, but the processing complexity increases

Engineering Contradiction:
Improvethree-dimensional representation qualityVSAvoidvideo processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system transforms multiple two-dimensional video feeds from different camera angles into a three-dimensional volumetric representation of the scene. By adding the spatial dimension of depth and volume, the system creates an immersive three-dimensional model that preserves the complete spatial relationships and movements captured by the distributed camera array

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS20250373953A1Large-scale multi-actor volumetric video capture
Publication Date: 2025.12.04 NETFLIX INC
  • US20250373953A1 patent drawing
  • US20250373953A1 patent drawing
  • US20250373953A1 patent drawing

AI summary

A system includes a first structure that houses first cameras, where each camera is controllably moveable in synchronization with second cameras on a second structure and with third cameras on a third, overhead structure. The first, second, and third sets of cameras are controllably directed toward a specified entity. The second set of cameras are controllably moveable in synchronization with the first and third sets of cameras, and the third, overhead cameras are controllably moveable in synchronization with the first and second sets of cameras. The system also includes a controller configured to generate and send control signals to the first, second, and third sets of cameras to track the specified entity as the specified entity moves within a defined space that is observable by the first, second, and third sets of cameras in the first, second, and third structures. Various other apparatuses and devices are also disclosed.