Wearable Machine Perception Subsystem for Unobstructed User Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional virtual and augmented reality systems fail to accurately capture a user's environment, are often bulky and obstructive, hindering interaction with the surroundings and reducing the quality of feedback provided.

Innovation Solution

A wearable apparatus with a machine-perception subsystem that captures visual and audio information about the local environment, an experience-analysis subsystem that infers contextual information, and a non-visual communication subsystem that outputs this information without obstructing the user's view, allowing for enhanced interaction and feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If traditional virtual reality systems use large visual displays to provide immersive content, then the quality of digital content delivery is improved, but the user's field of view is obstructed and interaction with the surrounding environment is hindered

Engineering Contradiction:
Improvequality of digital content deliveryVSAvoiduser interaction with surrounding environment
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system segments the information delivery channels by separating visual display from audio feedback. The wearable apparatus includes audio output devices that deliver digital content through sound while maintaining visual openness, allowing users to receive immersive content without visual obstruction.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from relying primarily on visual dimension for content delivery to incorporating the audio dimension. By delivering digital content through audio feedback rather than visual displays, the system provides immersive experience while preserving the user's visual field of view.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If augmented reality systems incorporate audio systems to provide feedback, then the quality of sensory feedback is improved, but the user's ability to hear surrounding sounds is inhibited

Engineering Contradiction:
Improvequality of sensory feedbackVSAvoidinterference with hearing surrounding sounds
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The audio output devices are designed to dynamically adjust their operation based on environmental conditions. The system can modulate audio output levels and characteristics to provide necessary feedback while minimizing interference with ambient sound perception, allowing users to maintain awareness of surrounding sounds.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The audio feedback is delivered with localized precision targeting specific frequency ranges and spatial directions. By providing audio feedback in a localized manner rather than omnidirectional output, the system enhances sensory feedback quality while preserving the user's ability to hear surrounding sounds in other frequency ranges and directions.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If environment capture systems use multiple sensors and cameras to accurately capture the local environment, then the measurement precision is improved, but the device complexity and weight increase

Engineering Contradiction:
Improveaccuracy of environment captureVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The wearable apparatus incorporates multi-functional sensors that serve multiple purposes. For example, cameras and microphones are used not only for environment capture but also for machine perception of user context, social interaction analysis, and navigation assistance, reducing the need for separate specialized devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system merges multiple capture functions into integrated sensor arrays. Cameras, microphones, depth sensors, and other detection devices are combined into a unified environment capture system that processes multiple data streams simultaneously, reducing overall system complexity compared to separate dedicated devices.

Inventive Principle:
Principle #5Merging (Combining)

4Ease of operation

If the wearable apparatus is designed to be lightweight and portable for extended wear, then the ease of operation is improved, but the computing power and sensor capabilities are reduced

Engineering Contradiction:
Improvecomfort for extended wearVSAvoidcomputing power and sensor capabilities
Core Design Contradiction:
Ease of operationVSPower

Solution Approach 1:

The system performs preliminary processing of sensor data locally using optimized algorithms and hardware acceleration. By pre-processing data at the edge device rather than requiring all data to be transmitted and processed remotely, the system maintains high computational effectiveness while minimizing the power requirements of onboard processing components.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system replaces computationally intensive mechanical or electronic processing with efficient software-based algorithms and neural network inference. By using optimized machine learning models that run on low-power hardware, the system achieves advanced environment understanding and machine perception capabilities without requiring heavy processing equipment.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables improved machine perception and interaction by providing accurate and unobtrusive feedback, enhancing social interactions and AI assistance through contextual information and predictions, while being portable and comfortable for extended use.

Implementation Method 1

the output transducer may be positionable against a tragus of a user's ear to mechanically vibrate the tragus to produce one or more sound waves that travel down an ear canal of the user's ear toward an eardrum

Methodology Applied
Scientific EffectMechanical vibration: Vibration

Implementation Method 2

an audio localization subsystem that has two or more input transducers attached to the wearable apparatus and configured to enable directional detection of a sound within the local environment

Methodology Applied
Scientific EffectAcoustic detection: Sound

Data Source

PatentUS11816886B1Apparatus, system, and method for machine perception
Publication Date: 2023.11.14 META PLATFORMS TECHNOLOGIES LLC
  • US11816886B1 patent drawing
  • US11816886B1 patent drawing
  • US11816886B1 patent drawing

AI summary

A system may include a wearable apparatus dimensioned to be worn by a user about an axial region of the user’s body such that, when the wearable apparatus is worn by the user, the user’s field of view into a local environment is substantially free of a view of the wearable apparatus. The system may also include a machine-perception subsystem that is coupled to the wearable apparatus and that gathers information about the local environment by observing the local environment. Additionally, the system may include an experience-analysis subsystem that infers, based on the information about the local environment and information about the user, contextual information about an experience of the user in the local environment. Furthermore, the system may include a non-visual communication subsystem that outputs the contextual information about the experience of the user. Various other apparatuses, systems, and methods are also disclosed.