3D Training Image Generation for Low-Latency Deep Learning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing computing systems struggle to efficiently process large 3D data sets for augmented, virtual, and mixed reality applications due to memory and processing constraints, leading to latency issues that can cause user discomfort and inefficiencies in handling volumetric data.
Innovation Solution
A sparse volumetric data structure, such as a sparse sexaquaternary tree format, is used to represent objects, allowing for reduced storage and faster processing by tagging voxels as occupied or empty, and utilizing hardware acceleration to enable real-time updates in AR, VR, and MR systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a separate GPU and computer vision subsystem are used in parallel, then processing capability is improved, but memory requirements and system complexity increase
Solution Approach 1:
The patent combines computer vision processing and graphics rendering into a single unified pipeline that shares memory resources and processing stages. The voxel data structure serves both vision and rendering purposes simultaneously, eliminating the need for separate subsystems while maintaining parallel processing capabilities through efficient memory sharing between different processing stages.
2Measurement precision
If dense volumetric data structures are used, then measurement precision is improved, but memory requirements increase
Solution Approach 1:
The patent applies different levels of voxel resolution to different spatial regions based on their importance. High-resolution voxels are used only in regions containing relevant objects or features, while lower-resolution or empty voxels are used in irrelevant regions. This localized quality adjustment maintains measurement precision where needed while dramatically reducing overall memory requirements for the volumetric data structure.
3Speed
If real-time processing is implemented, then speed is improved, but latency increases due to memory constraints
Solution Approach 1:
The patent segments the volumetric data processing into discrete, independently processable voxel operations that can be executed in parallel. By breaking down complex 3D scene operations into individual voxel-level tasks (such as occupancy testing, ray traversal, and rendering operations), the system achieves real-time processing speeds while minimizing latency through efficient memory access patterns and parallel execution of segmented operations.
Data Source
AI summary
A machine learning system is provided to enhance various aspects of machine learning models. In some aspects, a substantially photorealistic three-dimensional (3D) graphical model of an object is accessed and a set of training images of the 3D graphical mode are generated, the set of training images generated to add imperfections and degrade photorealistic quality of the training images. The set of training images are provided as training data to train an artificial neural network.


