Volumetric 3D Transmission via Optimal Camera Subset Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The transmission of volumetric 3D content over 5G networks is inefficient due to the large amount of data involved, leading to potential bandwidth issues and processing delays.

Innovation Solution

A method that determines an optimal subset of cameras from a camera rig to capture and transmit a partial volumetric 3D model based on the viewer's selected view, allowing for efficient data processing and transmission by using only necessary camera data, and compressing the model before sending it over the network.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a full set of cameras is used to capture volumetric 3D content, then the completeness and quality of the 3D model is improved, but the amount of data to be transmitted increases significantly

Engineering Contradiction:
Improve3D model qualityVSAvoiddata volume
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The system extracts only the essential camera views needed to reconstruct the 3D model from the full set of camera data. By identifying and removing redundant camera information, the patent transmits only the necessary data subset while preserving sufficient quality for accurate 3D reconstruction, directly resolving the contradiction between model completeness and data volume.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the complete camera dataset into essential and non-essential portions. By dividing the full camera set and selectively transmitting only the critical segments required for 3D reconstruction, the system maintains manufacturing precision while reducing the quantity of transmitted data.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If all camera data is transmitted over the 5G network, then the completeness of the volumetric 3D content is improved, but the network bandwidth consumption increases

Engineering Contradiction:
Improvecontent completenessVSAvoidbandwidth usage
Core Design Contradiction:
Loss of informationVSLoss of energy

Solution Approach 1:

The system extracts and transmits only the essential camera data required for volumetric 3D reconstruction, removing redundant information. This extraction approach prevents information loss of critical content while significantly reducing the energy consumption and bandwidth usage associated with transmitting the complete dataset.

Inventive Principle:
Principle #2Taking out (Extraction)

3Manufacturing precision

If a full volumetric 3D model is transmitted, then the detail and quality of the 3D content is improved, but the processing time and computational resources increase

Engineering Contradiction:
Improve3D model detailVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent extracts only the essential view data from the complete camera rig information, transmitting a reduced dataset that contains sufficient detail for quality 3D reconstruction. This extraction eliminates unnecessary computational overhead while preserving the manufacturing precision needed for detailed 3D content.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11790601B2Minimal volumetric 3D on demand for efficient 5G transmission
Publication Date: 2023.10.17 SONY GROUP CORP
  • US11790601B2 patent drawing
  • US11790601B2 patent drawing
  • US11790601B2 patent drawing

AI summary

A minimal volumetric 3D transmission implementation enables efficient transmission of a 3D model to a client device. A volumetric 3D model is generated using a camera rig to capture frames of a subject. A viewer is able to select a view of the subject. A system determines an optimal subset of cameras of the camera rig to utilize to capture frames to generate the volumetric 3D model based on the viewer's selected view. The volumetric 3D model is transmitted to the user device. If the user changes the view, the process repeats, and a new subset of cameras are selected to generate the volumetric 3D model at a different angle.