Scene Modelling System for Augmented Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modelling dynamic environments in augmented reality is computationally expensive, especially for large and evolving scenes, as existing methods require continuous updates of the entire scene, wasting resources and affecting realism.

Innovation Solution

A scene modelling system that decomposes the scene into objects based on changing parts, allowing only evolving objects to update their models, reducing computational resources and maintaining accuracy and realism by using sensors, connected objects, and cloud data providers to transmit and receive data on changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If the entire scene is continuously updated to maintain realism in dynamic environments, then the accuracy of the model is improved, but the computational resources and time required increase significantly

Engineering Contradiction:
Improvemodel accuracyVSAvoidcomputation time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The scene is segmented into multiple objects, each with its own model that can be independently updated. The system identifies and updates only those objects that have changed, rather than reprocessing the entire scene. This segmentation allows parallel processing and reduces the computational burden by focusing resources on specific changed regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs partial updates by processing only the necessary portions of the scene that have changed. Instead of executing a complete scene update, it applies actions selectively to modified objects, reducing overall computation time while maintaining model accuracy for the dynamic portions.

Inventive Principle:
Principle #16Partial or excessive action

2Manufacturing precision

If the entire scene is continuously updated to maintain realism in dynamic environments, then the accuracy of the model is improved, but the computational resources consumed increase significantly

Engineering Contradiction:
Improvemodel accuracyVSAvoidcomputational resources
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The scene is divided into independent object models that can be processed separately. By segmenting the scene graph into discrete objects with unique identifiers, the system can selectively update only those objects that have changed, avoiding the waste of computational resources on static portions of the scene.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs minimal necessary updates by processing only changed objects rather than the entire scene. This partial action approach reduces energy consumption and computational resource usage while maintaining the required model accuracy for dynamic elements.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If object models are updated frequently to reflect dynamic changes, then the realism of the augmented reality application is improved, but the complexity of the system increases

Engineering Contradiction:
ImproverealismVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system manages complexity by segmenting the scene into independent objects, each with its own model and update mechanism. This modular approach allows frequent updates of individual objects without increasing overall system complexity, as each object can be processed and updated independently.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements dynamic update mechanisms where objects can change their state and transmit change information autonomously. Connected objects automatically notify the scene modelling system of their status changes, enabling realistic dynamic behavior without requiring complex centralized control for every update.

Inventive Principle:
Principle #15Dynamics

4Manufacturing precision

If all objects in the scene are processed to maintain an accurate model, then the completeness of the model is improved, but the productivity of the system decreases

Engineering Contradiction:
Improvemodel completenessVSAvoidsystem efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The scene is segmented into independent objects that can be processed individually. This allows the system to maintain complete and accurate models of all objects while improving productivity by processing only those objects that have changed, rather than reprocessing the entire scene graph.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies partial processing by updating only the necessary subset of objects that have undergone changes. This maintains model completeness for dynamic elements while significantly improving system productivity by avoiding redundant processing of static objects.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20230103081A1Method and apparatus for modelling a scene
Publication Date: 2023.03.30 INTERDIGITAL CE PATENT HOLDINGS SAS
  • US20230103081A1 patent drawing
  • US20230103081A1 patent drawing
  • US20230103081A1 patent drawing

AI summary

According to embodiments, a scene modelling system may (e.g., initially) obtain and (e.g., subsequently) update a model of a scene based on data describing the scene. The data describing the scene may be received from any of sensors and objects, for example, located in the scene. The scene may comprise a set of connected and unconnected objects. An object may be associated with its own part of the model that may have been built, for example in an initialization phase. A connected object may transmit its (e.g., part of) model to the scene modelling system (e.g., on demand or upon detection of any change). An unconnected object (e.g., and its status) may be recognized in the scene from an image of the object, for example, captured in the scene.