AR Object Scaling via Distance Index for Real-World Dimensions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality systems struggle to accurately display objects with real-world dimensions, leading to confusion in size and placement, as they do not account for the depth and dimensions of other objects in the live view or image, resulting in inconsistent rendering across different camera perspectives.

Innovation Solution

An augmented reality system that includes a camera, a 2D display coordinate system, and a controller configured to receive images, recognize objects, determine distances, and calculate scaling factors to accurately position and size objects in real-world dimensions within the 3D AR coordinate system, ensuring consistent display across different viewpoints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If objects are rendered onto the display without considering real world dimensions, then the augmented reality display can be simplified, but users become confused by relative size and distance

Engineering Contradiction:
Improvedisplay rendering simplicityVSAvoidreal world dimension information
Core Design Contradiction:
Ease of manufactureVSLoss of information

Solution Approach 1:

The system changes the rendering parameters of displayed objects by calculating distance scaling factors based on the depth coordinate and camera distance. Objects are scaled according to their real-world dimensions and distance from the camera, transforming the display from a fixed 2D representation to a dynamically scaled 3D-aware representation that preserves real-world dimensional information.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If objects are placed in augmented reality space without accounting for camera perspective differences, then the placement process is simplified, but placement consistency across different viewpoints deteriorates

Engineering Contradiction:
Improveobject placement speedVSAvoidplacement consistency
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system performs preliminary calculations of the distance scaling factor and 2D display position before rendering the object. By pre-computing these transformation parameters based on the 3D AR position and camera characteristics, the system ensures consistent placement across different viewpoints while maintaining efficient processing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system transitions from 2D display coordinates to 3D AR coordinate system by introducing the depth coordinate dimension. This dimensional transformation allows objects to be placed consistently in 3D space while accounting for camera perspective, resolving the inconsistency problem in 2D-based placement.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Device complexity

If the display does not account for depth coordinate, then the display processing is simplified, but the displayed object cannot represent real world dimensions accurately

Engineering Contradiction:
Improvedisplay processing complexityVSAvoidreal world dimension accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The distance scaling factor acts as an intermediary parameter that bridges the 3D AR coordinate system and 2D display coordinate system. It translates depth information into appropriate scaling factors, enabling accurate representation of real-world dimensions while maintaining manageable display processing complexity through a single calculated parameter.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11494997B1Augmented reality system with display of object with real world dimensions
Publication Date: 2022.11.08 TP LAB INC
  • US11494997B1 patent drawing
  • US11494997B1 patent drawing
  • US11494997B1 patent drawing

AI summary

An augmented reality (AR) system includes a display having a 2D display coordinate system and a controller. The controller receives from an image having a 3D AR coordinate system, recognizes a first object in the image, determines a first distance to a viewpoint, and receives an instruction to display a second object image on the display, which includes a 3D AR position of the second object with a depth coordinate indicating a second distance to the viewpoint. The controller retrieves dimensions of the second object, obtains a distance index for the camera, calculates a distance scaling factor, calculates a 2D display position for the 3D AR position, calculates display dimensions for the second object, generates a display object image by scaling the second object image to the display dimensions, and displays the display object image onto the display based on a comparison of the first distance and the second distance.