3D Training Image Generation for Low-Latency Deep Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing computing systems struggle to efficiently process large 3D data sets for augmented, virtual, and mixed reality applications due to memory and processing constraints, leading to latency issues that can cause user discomfort and inefficiencies in handling volumetric data.

Innovation Solution

A sparse volumetric data structure, such as a sparse sexaquaternary tree format, is used to represent objects, allowing for reduced storage and faster processing by tagging voxels as occupied or empty, and utilizing hardware acceleration to enable real-time updates in AR, VR, and MR systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a separate GPU and computer vision subsystem are used in parallel, then processing capability is improved, but memory requirements and system complexity increase

Engineering Contradiction:
Improveprocessing capabilityVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent combines computer vision processing and graphics rendering into a single unified pipeline that shares memory resources and processing stages. The voxel data structure serves both vision and rendering purposes simultaneously, eliminating the need for separate subsystems while maintaining parallel processing capabilities through efficient memory sharing between different processing stages.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If dense volumetric data structures are used, then measurement precision is improved, but memory requirements increase

Engineering Contradiction:
Improvespatial resolutionVSAvoidmemory requirements
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent applies different levels of voxel resolution to different spatial regions based on their importance. High-resolution voxels are used only in regions containing relevant objects or features, while lower-resolution or empty voxels are used in irrelevant regions. This localized quality adjustment maintains measurement precision where needed while dramatically reducing overall memory requirements for the volumetric data structure.

Inventive Principle:
Principle #3Local quality

3Speed

If real-time processing is implemented, then speed is improved, but latency increases due to memory constraints

Engineering Contradiction:
Improveprocessing speedVSAvoidlatency
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The patent segments the volumetric data processing into discrete, independently processable voxel operations that can be executed in parallel. By breaking down complex 3D scene operations into individual voxel-level tasks (such as occupancy testing, ray traversal, and rendering operations), the system achieves real-time processing speeds while minimizing latency through efficient memory access patterns and parallel execution of segmented operations.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12566961B2Deep learning system
Publication Date: 2026.03.03 MOVIDIUS LTD
  • US12566961B2 patent drawing
  • US12566961B2 patent drawing
  • US12566961B2 patent drawing

AI summary

A machine learning system is provided to enhance various aspects of machine learning models. In some aspects, a substantially photorealistic three-dimensional (3D) graphical model of an object is accessed and a set of training images of the 3D graphical mode are generated, the set of training images generated to add imperfections and degrade photorealistic quality of the training images. The set of training images are provided as training data to train an artificial neural network.