Spatial Audio Cues Guide Users to Objects in Artificial Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for locating lost or misplaced physical objects are inefficient and ineffective, often relying on user memory, retracing steps, or remote locating applications that may fail due to signal issues or provide inaccurate location information.

Innovation Solution

An artificial reality system uses spatial audio cues to guide users to a physical object with a trackable feature by receiving information about the object, determining its most recent location, and communicating turn-by-turn directions or spatialized sound beacons to the user.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If remote locating applications are used to locate a mobile device, then location information can be obtained, but the location information may not be available due to signal issues, device being off, or battery exhaustion

Engineering Contradiction:
Improveavailability of location informationVSAvoiddependency on remote locating applications
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The physical object itself (mobile device) performs the location tracking function through its built-in GPS and communication capabilities, eliminating the need for external remote locating applications. The device autonomously determines and transmits its location without requiring third-party services or additional software installations.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

A dedicated locating system acts as an intermediary between the physical object and the user. This system includes location tracking components that automatically monitor the object's position and communicate with the user's device, providing location information without requiring the user to manually check remote applications or rely on signal-based tracking.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If remote locating applications are used, then location information can be obtained, but the location information may be approximate covering a large area

Engineering Contradiction:
Improveaccuracy of location informationVSAvoidtime to locate the object
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system provides continuous feedback about the physical object's location through real-time or near-real-time location updates. This feedback mechanism allows the user to track the object's movement and receive notifications when it arrives at specific destinations, enabling precise location tracking without time loss.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary location tracking and stores location history data before the user needs to locate the object. By pre-tracking the object's movement and maintaining location records, the system can provide immediate and accurate location information when requested, eliminating the need for time-consuming manual search processes.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If users retrace their steps to locate a physical object, then the object can be found, but it takes a long time and is inefficient

Engineering Contradiction:
Improvespeed of locating the objectVSAvoidtime to retrace steps
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent replaces the mechanical process of physically retracing steps with an electronic location tracking system. The system uses GPS, communication protocols, and computational algorithms to determine and communicate the object's location, eliminating the need for manual physical search and significantly reducing the time required to locate the object.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Ease of operation

If users rely on memory to locate a physical object, then the object can be found, but it is difficult and unreliable

Engineering Contradiction:
Improveease of locating the objectVSAvoidreliability of location recall
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system creates a digital copy of the physical object's location information and transmits it to the user's device. This digital replica of location data provides accurate and reliable location information without relying on human memory, making the location process both easy and reliable.

Inventive Principle:
Principle #26Copying

Data Source

PatentEP4439013A1Guiding a user of an artificial reality system to a physical object having a trackable feature using spatial audio cues
Publication Date: 2024.10.02 META PLATFORMS TECHNOLOGIES LLC
  • EP4439013A1 patent drawingFigure 1
  • EP4439013A1 patent drawingFigure 2A
  • EP4439013A1 patent drawingFigure 2B

AI summary

An artificial reality system receives information identifying a physical object and location information describing a geographical location associated with the artificial reality system, in which the information identifying the physical object includes a trackable feature associated with the physical object. Upon receiving a request from a user to locate the physical object, the artificial reality system determines a most recent geographical location associated with the physical object based at least in part on the trackable feature and the location information. The artificial reality system then communicates a set of spatial audio cues to the user, in which the set of spatial audio cues guides the user to the most recent geographical location associated with the physical object.