AR Height Estimation Using Virtual Position Guides

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for measuring the height of 3D objects, such as humans, using a mobile device camera require user-provided height references or physical scale guides, introducing user friction and inaccuracies, especially when users are unsure of their own height or lack access to reference objects.

Innovation Solution

A system and method utilizing Augmented Reality (AR) and Computer Vision (CV) techniques to measure the height of 3D objects by generating a position guide on a mobile device's screen, allowing users to position themselves or objects accurately without physical references, using camera intrinsic data and object detection models to calculate real-world heights from pixel dimensions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If physical scale guides or reference objects are used for height measurement, then measurement precision is improved, but device complexity and ease of operation deteriorate due to requiring additional physical objects and user setup steps

Engineering Contradiction:
Improveheight measurement accuracyVSAvoiduser friction
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent uses a virtual position guide (a digital copy or representation) displayed on the mobile device screen to replace physical scale guides. The position guide is generated based on camera intrinsic data and provides virtual markers that users can align with the subject, eliminating the need for physical reference objects while maintaining measurement accuracy

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical/physical system of using physical scale guides with an optical/digital system. The position guide is rendered on the device display and overlaid on the camera view, substituting physical alignment tools with digital visual cues that guide users through the measurement process without requiring physical objects

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If user-provided height references are required, then measurement precision is improved, but ease of operation deteriorates due to requiring accurate user knowledge of their own height

Engineering Contradiction:
Improvenormalization accuracyVSAvoiduser knowledge requirement
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system performs self-calibration by using the detected position of the subject within the position guide to automatically determine scaling factors. Instead of requiring users to input their height, the system uses the known dimensions of the position guide in the camera view and the subject's position relative to it to calculate measurements automatically

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The position guide acts as an intermediary element between the camera and the subject. It provides a known reference framework that mediates the measurement process, allowing the system to calculate real-world dimensions from pixel measurements without requiring direct user input about their height

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If AR position guide is generated using camera intrinsic data, then ease of operation is improved, but device complexity increases due to requiring access to camera parameters and AR rendering capabilities

Engineering Contradiction:
Improvesetup simplicityVSAvoidsystem requirements
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent leverages the mobile device's existing camera and display components to perform multiple functions: the camera captures images for both subject detection and position guide rendering, while the display shows both the live view and the overlaid position guide. This multi-functionality reduces the need for additional specialized hardware despite the increased software complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10636158B1Methods and systems for height estimation from a 2D image using augmented reality
Publication Date: 2020.04.28 BODYGRAM INC
  • US10636158B1 patent drawing
  • US10636158B1 patent drawing
  • US10636158B1 patent drawing

AI summary

A mobile computing device used for measuring the height of an object, such as a human user, may be positioned on a reference surface, such as the ground plane. The reference surface is detected and a position guide is generated in an augmented reality (AR) plane on a display of the mobile computing device. The AR plane enables the object being measured to be positioned at a measurement position located at a predefined distance along the reference surface from the mobile computing device. The top and bottom of the object are detected in an image taken by the mobile computing device. The height of the object is measured based on the predefined distance and a distance between the top and bottom of the object in the image. The height of the object can also be measured with assistance from software development kits (SDKs) included in the mobile computing device.