Real-time Texture Mapping for Augmented Reality Systems

Solution Overview

Problem

Current augmented reality systems face challenges in real-time texture mapping, requiring frequent re-recognition and re-rendering of virtual objects, which can be resource-intensive and lead to lag or inaccuracies when textures change.

Innovation Solution

The system employs a viewing device with an optical sensor, texture extraction module, and texture mapping module that captures and dynamically updates the texture of real-world objects in real-time, allowing for continuous mapping and rendering of virtual objects without the need for repeated recognition or re-rendering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If frequent re-recognition and re-rendering are performed to maintain texture accuracy, then texture mapping precision is improved, but system resource consumption increases and processing speed decreases

Engineering Contradiction:

Improvetexture mapping precisionVSAvoidprocessing speed

Core Design Contradiction:

Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary recognition of the real-world object once, extracts its texture information, and stores it for subsequent use. When the virtual object needs to be rendered, the system directly applies the pre-extracted texture without performing recognition again, thus maintaining texture accuracy while avoiding repeated processing overhead.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system creates a copy of the extracted texture information and applies it to the virtual object. This copying approach allows the texture to be updated efficiently without requiring re-recognition of the real-world object, maintaining precision while improving processing speed.

Inventive Principle:

Principle #26Copying

2Measurement precision

If frequent re-recognition and re-rendering are performed to maintain texture accuracy, then texture mapping precision is improved, but system complexity and computational overhead increase

Engineering Contradiction:

Improvetexture mapping precisionVSAvoidsystem complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary recognition of the real-world object once, extracts its texture information, and stores it for subsequent use. When the virtual object needs to be rendered, the system directly applies the pre-extracted texture without performing recognition again, thus maintaining texture accuracy while avoiding repeated processing overhead.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system extracts the texture information from the real-world object as a separate, independent data element. This extracted texture can be stored and reused multiple times without requiring the complex recognition process to be repeated, thereby reducing system complexity while maintaining precision.

Inventive Principle:

Principle #2Taking out (Extraction)

3Speed

If real-time texture extraction and mapping is implemented, then responsiveness and user experience are improved, but computational resource consumption increases

Engineering Contradiction:

ImproveresponsivenessVSAvoidcomputational resource consumption

Core Design Contradiction:

SpeedVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary recognition of the real-world object once, extracts its texture information, and stores it for subsequent use. When the virtual object needs to be rendered, the system directly applies the pre-extracted texture without performing recognition again, thus maintaining texture accuracy while avoiding repeated processing overhead.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system maintains continuous texture mapping by reusing the extracted texture information across multiple rendering cycles. This continuous application of the same texture data ensures responsive updates without requiring repeated extraction operations, thereby maintaining responsiveness while reducing computational resource consumption.

Inventive Principle:

Principle #20Continuity of useful action

Data Source

PatentUS9659381B2Real time texture mapping for augmented reality system

Publication Date: 2017.05.23 META PLATFORMS TECHNOLOGIES LLC

AI summary

A system and method for real-time texture mapping for an augmented reality system are described. A viewing device includes an optical sensor to capture an image of a real-world object. A texture extraction module extracts a texture of the image of the real-world object. A recognition module identifies the real-world object based on the captured image. A texture mapping module retrieves a virtual object corresponding to the identified real-world object, maps the texture to the virtual object, dynamically updates the texture to the virtual object in real time, and generates a visualization of the virtual object in a display of the viewing device.