AR Processing Device Point Cloud Matching

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing augmented reality processing technologies face difficulties in accurately superimposing virtual objects onto physical objects across changing environments, requiring extensive recalibration and resource-intensive point cloud image reconstruction.

Innovation Solution

An augmented reality processing device and method that captures environment images, generates point cloud images, and uses feature sets and transformation matrices to superimpose virtual objects onto physical objects, allowing for seamless adaptation across environment changes without re-establishing point cloud images for new environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional augmented reality processing is used to superimpose virtual objects onto physical objects in changing environments, then virtual object superimposition can be achieved, but extensive recalibration and resource-intensive point cloud image reconstruction are required

Engineering Contradiction:

Improvevirtual object superimposition efficiencyVSAvoidrecalibration time

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary action by capturing a first environment image and generating an original point cloud image in advance. This pre-captured data serves as a reference that can be reused when the environment changes, eliminating the need for immediate recalibration and enabling rapid virtual object superimposition in new environments.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system creates a copy of the physical object's point cloud data from the first environment image. This point cloud copy contains geometric features that can be matched against the second environment image, allowing the system to transfer the virtual object superimposition from the original environment to the new environment without reconstructuring the point cloud from scratch.

Inventive Principle:

Principle #26Copying

2Measurement precision

If traditional augmented reality processing is used to superimpose virtual objects onto physical objects in changing environments, then virtual object superimposition can be achieved, but resource-intensive point cloud image reconstruction is required

Engineering Contradiction:

Improvevirtual object superimposition accuracyVSAvoidprocessing resource consumption

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

Instead of reconstructuring point cloud images in the second environment, the system copies and reuses the original point cloud data from the first environment image. This copying approach maintains measurement precision for virtual object superimposition while dramatically reducing processing resource consumption by avoiding redundant point cloud reconstruction.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The system changes the processing parameter from full point cloud reconstruction to point cloud matching and transformation matrix calculation. By transforming the problem from generating new point cloud data to matching existing point cloud data with the second environment image, the system achieves the same superimposition accuracy with significantly lower computational resources.

Inventive Principle:

Principle #35Parameter changes

3Use of energy by moving object

If point cloud matching and transformation matrix calculation are used, then resource-saving superimposition is achieved, but environment changes must be handled

Engineering Contradiction:

Improveprocessing resource consumptionVSAvoidenvironment change adaptation

Core Design Contradiction:

Use of energy by moving objectVSAdaptability or versatility

Solution Approach 1:

The system achieves universality by creating a methodology that works across different environments. The point cloud matching and transformation matrix calculation approach is environment-agnostic, allowing the same processing logic to handle various environmental changes while maintaining resource efficiency. The feature extraction and matching process adapts to different scenes without requiring environment-specific processing.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS11663752B1Augmented reality processing device and method

Publication Date: 2023.05.30 INSTITUTE FOR INFORMATION INDUSTRY

AI summary

An augmented reality processing device is provided, comprising an image capturing circuit and a processor. The processor is connected to the image capturing circuit, and execute operations of: generating an original point cloud image according to the first environment image and a physical object in the first environment image; generating an expanded point cloud image corresponding to the physical object from the second environment image according to the first environment image and the physical object point cloud set, and generating a superimposed point cloud image according to the expanded point cloud image and the original point cloud image; and generating a transformation matrix according to the original point cloud image and the expanded point cloud image, and superimposing a virtual object to the second environment image according to the superimposed point cloud image and the transformation matrix.