3D Environment Reconstruction for Obstacle-Aware Item Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional systems for tracking and locating items in environments are limited in precision and cannot account for obstacles, often requiring tracking devices on each item and failing to provide accurate, obstacle-aware navigation.

Innovation Solution

A 3D reconstruction of the environment is generated from sensor data, allowing objects to be detected and tracked within a 3D representation, with attributes like size, shape, and location determined to plan precise routes while considering environmental geometry and user data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional tracking devices (Bluetooth, GPS, RFID) are used on each item, then item location can be indicated, but the precision is limited and cannot provide specific position information

Engineering Contradiction:
Improveitem location precisionVSAvoidtracking device requirement
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent creates a digital twin (3D representation) of the physical environment where items can be tracked and located. Instead of relying on tracking devices attached to each item, the system captures images and sensor data to generate a virtual copy of the environment, allowing precise location determination through image processing and feature matching without requiring physical tracking devices on every item.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces mechanical/electronic tracking devices with an optical and computational system. Instead of using Bluetooth, GPS, or RFID hardware on each item, the system uses cameras, sensors, and image processing algorithms to detect and track items, substituting physical tracking mechanisms with optical field-based detection and computational analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If 2D maps are used for route planning, then general direction can be provided, but obstacles and environmental features cannot be accounted for

Engineering Contradiction:
Improveroute planning accuracyVSAvoidenvironmental modeling complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent transitions from 2D map-based navigation to 3D environment representation. By capturing depth information, spatial relationships, and vertical dimensions through multi-camera systems and sensor fusion, the system creates a three-dimensional model that accurately represents obstacles, terrain, and environmental features, enabling more reliable route planning that accounts for real-world spatial constraints.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent performs preliminary environmental scanning and 3D model generation before route planning. The system proactively captures images and sensor data to build a detailed digital representation of the environment in advance, identifying obstacles and features beforehand, so that accurate and reliable route planning can be performed based on this pre-acquired spatial information.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If tracking devices are required on each item, then items can be tracked, but items without tracking devices cannot be located

Engineering Contradiction:
Improveitem tracking coverageVSAvoidtracking device infrastructure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal tracking system that can locate any item within the monitored environment without requiring item-specific tracking devices. The 3D representation and image processing system serves multiple functions: detecting items, determining their locations, tracking their movement, and providing navigation guidance, all through a single environmental modeling infrastructure rather than requiring different tracking mechanisms for different items.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12387373B23D environment reconstruction for persistent object tracking
Publication Date: 2025.08.12 NVIDIA CORP
  • US12387373B2 patent drawing
  • US12387373B2 patent drawing
  • US12387373B2 patent drawing

AI summary

In various examples, a 3D representation of an environment may be generated from sensor data, with objects being detected in the environment using the sensor data and stored as items that can be tracked and located within the 3D representation. The 3D representation of the environment and item information may be used to determine (e.g., identify or predict) a location or position of an item within the 3D representation and/or recommend a storage location for the item within the 3D representation. Using a determined location or position, one or more routes to the location through the 3D representation may be determined. Data corresponding to a determined route may be provided to a user and/or device. User preferences, permissions, roles, feedback, historical item data, and/or other data associated with a user may be used to further enhance various aspects of the disclosure.