Depth Sensor Measurement with Graphical Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Estimating volume and mass measurements for cooking or home improvement projects using a single camera is challenging and often inaccurate, as existing methods rely on eyeballing or simple visual estimation, which can be futile.

Innovation Solution

A system utilizing an electronic device equipped with one or more processors, non-transitory memory, and a depth sensor to obtain depth information and determine measurements of physical objects, accompanied by graphical overlays to aid users in completing tasks, such as measuring ingredients or following recipes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single camera is used for volume and mass measurement, then device complexity is reduced, but measurement precision deteriorates

Engineering Contradiction:
Improvedevice complexityVSAvoidmeasurement precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent combines multiple measurement modalities (depth sensing, optical imaging, and graphical overlay systems) into a single integrated device. This merging approach allows the system to achieve accurate volume and mass measurements while maintaining relatively simple device architecture, resolving the contradiction between device complexity and measurement precision.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces graphical overlays as an intermediary element that bridges the gap between simple visual estimation and precise measurement. These overlays provide reference frames and measurement indicators that enhance measurement accuracy without requiring complex additional hardware, thus resolving the contradiction between device simplicity and measurement precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If visual estimation methods are used, then ease of operation is improved, but measurement precision deteriorates

Engineering Contradiction:
Improveease of operationVSAvoidmeasurement precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system performs automated measurements and generates graphical overlays without requiring user intervention for calibration or complex operations. The device automatically captures depth information, processes images, and presents measurement results, making the operation as easy as visual estimation while achieving precision far beyond manual methods.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent implements feedback through graphical overlays that provide real-time measurement information and guidance to users. This feedback mechanism allows users to perform simple operations while the system continuously refines and communicates precise measurements, resolving the contradiction between ease of operation and measurement precision.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If depth sensors and graphical overlays are added, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvemeasurement precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent designs the electronic device to perform multiple functions: depth sensing, optical imaging, measurement calculation, and graphical overlay generation. This multi-functionality allows the system to achieve high measurement precision while consolidating components into a single universal device rather than requiring separate specialized equipment for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides accurate volume and mass measurements, enhancing the precision and efficiency of cooking and home improvement tasks by overlaying graphical guidance onto the physical environment, allowing users to accurately measure and prepare ingredients.

Implementation Method 1

obtaining depth information, via the depth sensor, associated with the physical environment

Methodology Applied
Scientific EffectTime of Flight: Time of Flight

Data Source

PatentUS11954876B2Method and device for measuring physical objects
Publication Date: 2024.04.09 APPLE INC
  • US11954876B2 patent drawing
  • US11954876B2 patent drawing
  • US11954876B2 patent drawing

AI summary

The method performed at an electronic device including one or more processors, a non-transitory memory, and a depth sensor includes: obtaining a task associated with a physical object within a physical environment; obtaining a task associated with a physical object within a physical environment; obtaining depth information, via the depth sensor, associated with the physical environment; determining one or more measurements for the physical object based at least in part on the depth information; generating a graphical overlay for the task based at least in part on the task associated with the physical object and the one or more measurements for the physical object; and causing presentation of the graphical overlay relative to a representation of the physical object, wherein the representation is obtained using sensor readings of the physical object.