Camera Height Variation Minimization for AR Distance Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality systems using a single camera struggle to accurately determine the distance to physical objects in the real world, leading to incorrect scaling of virtual elements and user frustration due to variations in camera height.

Innovation Solution

A method that utilizes a front-facing camera to align the user with the device, then uses a rear-facing camera to capture image data, combining image analysis and inertial sensors to minimize camera height variations and accurately determine object distance through geometric relationships.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single camera is used in conventional augmented reality systems, then the device complexity is reduced, but the measurement precision of distance to objects deteriorates

Engineering Contradiction:
Improvecamera system complexityVSAvoiddistance measurement precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent divides the camera system into two separate cameras: a first camera (e.g., front-facing) for capturing user alignment data and a second camera (e.g., rear-facing) for capturing object image data. This segmentation allows each camera to serve a specific function, improving overall measurement precision while keeping individual camera units simple and manageable.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary processing system that receives data from both cameras and inertial sensors, then computes camera height and object distance through geometric relationships. This intermediary computation layer integrates multiple data sources to achieve precise distance measurement without requiring a single complex camera system.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If camera height is not controlled, then the ease of operation is improved, but the measurement precision of object distance deteriorates

Engineering Contradiction:
Improvedevice handling easeVSAvoidobject distance measurement precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent implements a feedback mechanism where the system continuously monitors camera height through image analysis and inertial sensor data, then uses this information to compensate for height variations in distance calculations. This feedback loop maintains measurement precision even when camera height varies during normal device handling.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary alignment operations using the first camera to establish the user's position and orientation before capturing object data with the second camera. This preliminary action sets up reference data that enables accurate distance measurement regardless of subsequent camera height variations during object capture.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If virtual element scaling is adjusted for camera height variations, then the measurement precision of object distance is improved, but the device complexity increases

Engineering Contradiction:
Improveobject distance measurement precisionVSAvoidsystem processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical height adjustment mechanisms with computational methods. Instead of physically adjusting camera height or using multiple complex sensors, the system uses image processing algorithms and inertial sensor fusion to calculate and compensate for height variations, achieving precise measurement through software rather than hardware complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10037614B2Minimizing variations in camera height to estimate distance to objects
Publication Date: 2018.07.31 AMAZON TECH INC
  • US10037614B2 patent drawing
  • US10037614B2 patent drawing
  • US10037614B2 patent drawing

AI summary

Approaches provide for minimizing variations in the height of a camera of a computing device when estimating the distance to objects represented in image data captured by the camera. For example, a front-facing camera of a computing device can be used to capture a live camera view of a user. An application can analyze the image data to locate features of the user's face for purposes of aligning the user with the computing device. As the position and/orientation of the device changes with respect to the user, the image data can be analyzed to detect whether a location of a representation of a feature of the user aligns with the alignment element. Once the feature is aligned with the alignment element, a rear-facing camera (or other camera) can capture second image data of an object. The second image data can be analyzed to determine a geometric relationship between the rear-facing camera and the object, and the geometric relationship can be used to determine a distance to the object with respect to the computing device.