Relative Distance Identification via Parallax and Motion Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality applications in cell phones struggle to accurately and efficiently determine the closest object to the camera's view, especially when the device is in motion, due to limitations in detecting changes in position and parallax effects, which can lead to misidentification of moving objects as close objects.

Innovation Solution

A system and method that utilize a camera, motion detection components, and a processor to capture sequential images, calculate relative distances based on parallax and device movement, and identify the closest object by analyzing the sequence of images and movement data, providing information simultaneously with image capture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If augmented reality applications transmit images to a server for object detection and recognition, then object information can be provided to the user, but the system response time increases and real-time identification is delayed

Engineering Contradiction:
Improveobject identification accuracyVSAvoidsystem response time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system segments object identification into two parts: simple objects are identified locally by the mobile device processor for immediate feedback, while complex objects requiring advanced recognition are transmitted to remote servers. This segmentation allows the system to maintain real-time responsiveness for simple cases while still achieving high accuracy for complex objects through server-based processing.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If the device uses motion detection components to track device movement, then parallax effects can be compensated, but the device complexity increases

Engineering Contradiction:
Improvedistance measurement accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses motion detection components as intermediary devices that track device movement and provide data to the processor. The processor then uses this motion data to calculate parallax effects and compensate for them in distance measurements. This intermediary approach allows accurate distance measurement without requiring complex hardware modifications.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If the system calculates distance values based on parallax and device movement, then the closest object can be accurately identified, but the processing complexity and computational requirements increase

Engineering Contradiction:
Improverelative distance calculation accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-processing image data and motion detection data as they are captured, preparing them for distance calculation. The processor continuously tracks device movement and pre-calculates parallax compensation factors before actual object identification is needed. This preliminary processing reduces the computational burden during real-time object identification.

Inventive Principle:
Principle #10Preliminary action

4Ease of operation

If the system provides object information simultaneously with image capture, then user experience is improved, but the processing speed and system performance requirements increase

Engineering Contradiction:
Improveuser experienceVSAvoidprocessing speed
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The system applies local quality by providing different levels of information processing to different objects based on their characteristics. Simple objects that are easily identifiable receive minimal processing and are returned immediately, while complex objects undergo more extensive analysis. This allows the system to maintain high processing speed for simple cases while still providing comprehensive information for complex objects, thereby improving overall user experience without uniformly increasing processing requirements.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate and timely identification of the closest object to the camera, reducing the likelihood of mistaking moving objects for close objects, and providing users with relevant information in real-time, even when the device is in motion.

Implementation Method 1

The relative distance is then determined based on the parallax effect and the detected device movement

Methodology Applied
Scientific EffectParallax: Parallax

Data Source

PatentUS10297084B2Identification of relative distance of objects in images
Publication Date: 2019.05.21 GOOGLE LLC
  • US10297084B2 patent drawing
  • US10297084B2 patent drawing
  • US10297084B2 patent drawing

AI summary

In one aspect, a hand-held device is provided with a display, camera, motion detector and processor. The processor receives a sequence of images from the camera, the relative distance to the object based on the parallax associated with two or more images of the sequence and the motion of the camera is determined, and the image is augmented and displayed based on the relative distances.