User Location Detection via Object Interaction Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems require significant processing and power resources to determine user location in a physical environment, especially when using mixed reality headsets, as they need to construct maps using computationally-intensive techniques while tracking user location simultaneously.

Innovation Solution

The system determines user location within a physical environment by detecting interactions with objects using sensor data from image, motion, and audio sensors, leveraging an object relationship model to identify positional relationships and provide context-based content based on user interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If computationally-intensive map construction techniques are used to determine user location, then location accuracy is improved, but processing power consumption increases

Engineering Contradiction:
Improveuser location accuracyVSAvoidprocessing power consumption
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The patent extracts the essential information needed for location determination from the full environmental map by focusing on object interactions and relationships rather than processing the complete map data. This selective extraction approach maintains location accuracy while significantly reducing computational requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the location determination process into discrete object interaction detection steps rather than using a monolithic map construction approach. By breaking down the complex task into smaller, manageable interactions with individual objects, the system achieves accurate localization with lower processing power consumption.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If comprehensive environmental mapping is performed to track user location, then location tracking accuracy is improved, but processing resources increase

Engineering Contradiction:
Improvelocation tracking accuracyVSAvoidprocessing resources
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Instead of processing the entire environmental map uniformly, the patent applies local quality analysis by examining only the specific regions and objects relevant to current user interactions. This localized approach maintains tracking accuracy for the user's immediate surroundings while reducing overall processing resource consumption.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent employs partial action by processing only the necessary portion of environmental data required for location tracking, rather than comprehensively mapping the entire environment. This selective processing achieves sufficient accuracy for tracking purposes without the excessive computational resources required for full environmental mapping.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20240212201A1User location determination based on object interactions
Publication Date: 2024.06.27 APPLE INC
  • US20240212201A1 patent drawing
  • US20240212201A1 patent drawing
  • US20240212201A1 patent drawing

AI summary

Various implementations disclosed herein include devices, systems, and methods that determine a user location within a physical environment. For example, an example process may include obtaining an object relationship model representing positional relationships between objects of a set of objects within a physical environment. The process may further include obtaining sensor data of the physical environment. The process may further include detecting an interaction of a user with an object of the set of objects within the physical environment based on the sensor data. The process may further include determining a location of the user within the physical environment based on a location associated with the object in the physical environment.