Virtual Model Generation via Sensor Fusion and Spatial Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for generating virtual models of physical entities are inefficient and imprecise, particularly when objects are positioned far from the capturing point, leading to unsynchronized and less reliable measurements, which fail to produce accurate models.

Innovation Solution

A system and method utilizing a processing subsystem with input, model generation, model improvement, and model modification modules, employing artificial intelligence and sensor fusion to capture and process 2D and 3D data from multiple viewpoints, synchronizing data, and performing spatial mapping to generate and optimize virtual models, including object detection and segmentation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple approaches are used for recreating and modifying 3-D models, then more flexibility is provided, but measurement synchronization and precision deteriorate

Engineering Contradiction:
Improveflexibility in model recreationVSAvoidmeasurement synchronization
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system segments the 3-D modeling process into distinct functional modules: data capturing units for acquiring 2-D and 3-D annotated data, a processing subsystem for synchronization and spatial mapping, and a model generation module for creating virtual models. This segmentation allows each module to specialize in specific tasks, improving both flexibility and measurement precision simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a processing subsystem as an intermediary between data capturing units and model generation modules. This intermediary synchronizes data from multiple sources and performs spatial mapping, ensuring measurement precision while maintaining the flexibility of multiple modeling approaches.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of stationary object

If objects are positioned far away from capturing point, then larger coverage area is achieved, but model accuracy deteriorates

Engineering Contradiction:
Improvecoverage areaVSAvoidmodel accuracy
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The system merges data from multiple data capturing units positioned at different locations to capture objects far from any single capturing point. By combining 2-D and 3-D annotated data from multiple viewpoints through synchronization and spatial mapping, the system achieves both large coverage area and high model accuracy simultaneously.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent transitions from 2-D representations to 3-D virtual models through spatial mapping. This dimensional transformation allows the system to capture and represent objects accurately in three-dimensional space, maintaining precision even when objects are positioned far from individual capturing points.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If real-time interaction is implemented in VR, then user engagement is improved, but computational complexity increases

Engineering Contradiction:
Improveuser engagementVSAvoidcomputational complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-processing and synchronizing data from multiple capturing units before generating the final virtual model. The processing subsystem prepares data in advance through synchronization and spatial mapping, reducing computational complexity during real-time interaction while maintaining high user engagement.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a virtual copy of the physical entity through 3-D modeling. This virtual model can be manipulated and interacted with in real-time without requiring complex computations on the original physical object, thereby improving user engagement while managing computational complexity.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11908072B2System and method for generating and interacting with a virtual model of a physical entity
Publication Date: 2024.02.20 TOOLIQA INC
  • US11908072B2 patent drawing
  • US11908072B2 patent drawing
  • US11908072B2 patent drawing

AI summary

A system for generating and interacting with a virtual model of a physical entity is disclosed. The system includes a processing subsystem which includes an input module which receives preference(s) and data corresponding to parameter(s). The processing subsystem also includes a model generation module which performs a fusion operation on the data, thereby generating point cloud data and generates a crude virtual model corresponding to the physical entity. The processing subsystem also includes a model improvement module which performs cleaning and optimization of the crude virtual model, generates the virtual model, identifies multiple objects associated with the physical entity, and generates sub-virtual model(s) for the multiple objects. The processing subsystem also includes a model modification module which generates a trigger signal, receives modification-related input(s), and performs modification(s) on at least one of the virtual model and the sub-virtual model(s), thereby generating and interacting with the virtual model.