3D Model Generation Using Vertex Extraction for Low-Latency Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional technologies face challenges in transmitting real-time three-dimensional video streams due to the large amount of data required, leading to significant delays and making live 3D transmissions over internet bandwidths impractical.
Innovation Solution
The approach generates a 3D model of an object using a 3D engine, which defines the object's vertices and color values, reducing data transmission by representing the object as a point cloud, and allows for real-time updating of the model's appearance based on captured facial expressions and movements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Shape
If three-dimensional video streams are transmitted using conventional methods, then the object is depicted in three dimensions, but the data transmission requires large bandwidth and causes significant delays
Solution Approach 1:
The patent segments the three-dimensional object representation into essential geometric components (vertices, edges, faces) and only transmits the critical data defining these elements. Instead of transmitting complete volumetric data or high-resolution 3D video streams, the system transmits segmented geometric primitives that can be reconstructed into 3D representations, dramatically reducing data volume while preserving the three-dimensional depiction capability.
Solution Approach 2:
The patent extracts only the essential geometric information needed to represent three-dimensional objects - specifically vertex coordinates, color values, and spatial relationships - from complete 3D video data. By taking out and transmitting only these critical parameters rather than full volumetric datasets, the system achieves real-time 3D transmission with minimal bandwidth requirements and latency.
2Loss of information
If complete 3D video data is transmitted, then the object representation is comprehensive, but the data volume is too large for internet bandwidth
Solution Approach 1:
The patent creates simplified geometric copies or representations of three-dimensional objects using vertex-based models. Instead of transmitting complete high-fidelity 3D video data, the system transmits copied geometric information (vertex positions, color values, spatial coordinates) that reproduces the essential appearance and form of objects. These geometric copies are sufficient for visual representation while occupying minimal data space for internet transmission.
3Productivity
If real-time 3D streaming is achieved through data reduction, then transmission latency is reduced, but the model generation complexity increases
Solution Approach 1:
The patent changes the parameter representation from complete volumetric data to simplified geometric parameters (vertex coordinates, color values, spatial positions). By transforming the data structure into parameter-based vertex models, the system enables rapid processing and real-time transmission. The parameter changes allow for efficient mathematical operations and straightforward reconstruction, reducing computational complexity despite the real-time requirements.
Data Source
AI summary
A device for generating a model of an object with superposition image data in a virtual environment includes an image capturing element configured to generate an image data stream of the object as well as a calculating unit configured to extract, from the image data stream, a model of the object from a real environment, to insert the extracted model into the virtual environment, and to superpose at least part of the model with superposition image data so as to generate the model of the object with superposition image data in the virtual environment, and a display element configured to display the model of the object with superposition image data in the virtual environment.