AR Floorplan Matrix Generation for Spatial Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Generating a three-dimensional model of a physical space for augmented reality systems is time-intensive and often inaccurate due to the difficulty in creating a mechanism for converting between physical and virtual locations.

Innovation Solution

An augmented reality system generates a transformation matrix based on a received floorplan with location markers, using pose data from images of these markers to create an affine transformation between physical and virtual spaces, and updates this matrix to improve accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a user manually creates a virtual model of physical space, then the model can be generated, but the process is time-intensive

Engineering Contradiction:
Improveaccuracy of virtual modelVSAvoidtime to generate virtual model
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-placing location markers in the physical space and pre-creating a 2D floorplan with indicated marker positions. This preparation work is done before the actual virtual model generation, so when images are captured, the transformation matrix can be automatically generated without time-consuming manual modeling.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses a 2D floorplan as a copy or representation of the physical space layout. This 2D copy serves as a template that, when combined with captured images of location markers and pose data, enables automatic generation of the 3D virtual model and transformation matrix, eliminating the need for manual 3D modeling.

Inventive Principle:
Principle #26Copying

2Ease of operation

If a mechanism is created to convert between physical and virtual locations, then location mapping is enabled, but the mechanism is difficult to create and generally inaccurate

Engineering Contradiction:
Improveease of creating transformation mechanismVSAvoidaccuracy of location conversion
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system introduces location markers as intermediary objects that physically exist in the environment and are detected by the camera. These markers serve as mediators between the physical space and the virtual model, providing reliable reference points for accurate location conversion. The markers' known positions in both the physical space and the 2D floorplan enable precise calculation of the transformation matrix.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system uses feedback from captured images of location markers to automatically adjust and refine the transformation matrix. By comparing the detected marker positions in images with their known positions in the floorplan and pose data, the system can verify and improve the accuracy of the transformation mechanism without manual intervention.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20240296257A1Floorplan Transformation Matrix Generation for Augmented-Reality System
Publication Date: 2024.09.05 ARWAY CORP
  • US20240296257A1 patent drawing
  • US20240296257A1 patent drawing
  • US20240296257A1 patent drawing

AI summary

An augmented reality (AR) system creates a transformation matrix for conversions between real and virtual spaces based on a given floorplan indicating the physical locations of location markers. These markers may include machine-readable labels or identifiable landmarks. The AR system receives images of the physical space from a content-generating device, along with each image's pose data, indicating the device's position when capturing the image. The system generates a transformation matrix by comparing pose data for each image to the floorplan's indicated location marker. The system may update a position component based on discrepancies between predicted and actual physical locations. This transformation matrix, associated with the specific physical space, is stored for future use.