Virtual Camera Volumetric Capture View Frustum Culling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional volumetric capture systems require multiple cameras, leading to redundant data capture and necessitate full recapture of data when camera settings change.

Innovation Solution

A system that uses a virtual camera to selectively activate cameras from a virtual view, allowing for the re-framing of captured data without re-capturing new data by defining a view frustum that intersects with the physical cameras.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple cameras are used to capture the subject with full coverage, then the coverage and reliability of capture are improved, but the quantity of data captured increases significantly with redundant information

Engineering Contradiction:
Improvecapture coverageVSAvoiddata quantity
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent extracts and utilizes only the necessary portions of data from multiple cameras by implementing selective camera activation based on view frustum culling. Cameras are individually evaluated and activated only when their captured data contributes to the current view, removing redundant data capture while preserving complete coverage where needed.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different activation states to different cameras based on their specific contribution to the current view. Each camera is evaluated independently using view frustum intersection tests, allowing the system to optimize data capture locally for each camera rather than uniformly activating all cameras, thereby reducing overall data quantity while maintaining necessary coverage.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If camera settings such as focal length are changed, then the adaptability and versatility of the capture system are improved, but the loss of time increases due to necessary recapture of entire performance

Engineering Contradiction:
Improvecamera settings flexibilityVSAvoidrecapture time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent performs preliminary capture of data from multiple cameras with various settings stored for later use. When camera setting changes are needed, the system can switch between pre-captured data sets from different cameras rather than requiring recapture, having already performed the comprehensive data collection in advance.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates virtual copies of camera views through the virtual camera system that can replicate the appearance of physical cameras with different settings. These virtual camera copies allow reframing and re-rendering of captured performances with adjusted focal lengths and parameters without requiring actual recapture of the performance.

Inventive Principle:
Principle #26Copying

3Loss of information

If all cameras are activated during capture, then the completeness of captured data is improved, but the use of energy and processing power increases

Engineering Contradiction:
Improvedata completenessVSAvoidprocessing energy
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The patent extracts and processes only the essential camera data by implementing view frustum-based culling. The system calculates the view frustum for the current camera angle and selectively activates only those physical cameras whose capture volume intersects with the frustum, extracting necessary data while discarding redundant camera inputs to reduce processing energy consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

4Productivity

If a virtual camera system is implemented to selectively activate cameras, then the productivity and efficiency of data capture are improved, but the device complexity increases

Engineering Contradiction:
Improvecapture efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces a virtual camera as an intermediary between the user and the physical camera array. The virtual camera calculates view frustums and determines which physical cameras should be activated based on geometric intersection tests. This intermediary layer automates the complex decision-making process of camera selection, improving productivity while managing system complexity through algorithmic control rather than manual configuration.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12206838B2View-independent multi-camera volumetric capture system
Publication Date: 2025.01.21 SONY GROUP CORP
  • US12206838B2 patent drawing
  • US12206838B2 patent drawing
  • US12206838B2 patent drawing

AI summary

Reducing data used during capture in a physical capture volume by selectively activating image capture devices from a virtual view, including: setting up a virtual camera to receive information about and visualize the physical capture volume and a plurality of image capture devices in the virtual view; providing, to the virtual camera, the virtual view of the physical capture volume with a capability to move around the physical capture volume and activate or deactivate each of the plurality of image capture devices; calculating a view frustum, wherein the view frustum is a region of 3-D space within the physical capture volume that would appear on a view screen of the virtual camera; and defining the view frustum of the virtual camera which intersects with the plurality of image capture devices defined in the virtual view.