Low Friction Human-Machine Interaction Architecture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional human-machine interaction systems in artificial reality are limited by high user friction due to restricted input and output channels, lack of contextual awareness, and inability to adapt to user needs, leading to inefficient and frustrating interactions.

Innovation Solution

A low friction human-machine interaction system that uses multimodal interaction to assess semantic-based queries, providing proactive and adaptive interfaces to refine and disambiguate user intentions through machine learning models, such as decision trees, to determine recommended digital actions and minimize user friction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional human-machine interaction systems are used in artificial reality, then the system structure is simple and input/output channels are limited, but user friction is high and interaction efficiency is low

Engineering Contradiction:
Improveinteraction efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The interaction system is segmented into multiple independent modules including semantic query assessment module, machine learning model module, proactive interface module, and digital action determination module. Each module handles specific functions independently, improving interaction efficiency without requiring complete system redesign.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary actions by assessing semantic-based queries and predicting user intentions before actual interactions occur. Machine learning models pre-process user input patterns and prepare recommended digital actions in advance, reducing friction during real-time interaction.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If traditional interaction systems with restricted input/output channels are used, then the system is easy to implement, but user expressiveness and contextual awareness are limited

Engineering Contradiction:
Improveuser expressivenessVSAvoidinteraction system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The interaction system is designed with multi-functionality to handle diverse input modalities (voice, text, gestures) and output formats (visual, auditory, haptic). The semantic query assessment mechanism universally processes different user expressions and translates them into actionable digital commands, enhancing user expressiveness without requiring separate systems for each modality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

A semantic intermediary layer is introduced between user input and system execution. This intermediary assesses semantic-based queries, disambiguates user intentions, and translates natural language inputs into structured digital actions, enabling rich user expressiveness while maintaining manageable system complexity through standardized processing protocols.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If traditional interaction systems without contextual awareness are used, then the system is simple and fast to process, but user friction increases due to inability to adapt to user needs

Engineering Contradiction:
Improveuser frictionVSAvoidcontextual processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system implements feedback loops where machine learning models continuously analyze user interactions, assess semantic queries, and adjust digital action recommendations based on observed user behavior patterns. This contextual feedback mechanism reduces user friction by adapting to individual user needs while maintaining processing efficiency through iterative learning rather than complex real-time analysis.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The interaction system performs self-service by automatically assessing semantic queries and determining appropriate digital actions without requiring extensive manual configuration or complex contextual processing. Machine learning models enable the system to serve itself by learning from interaction data and improving user friction reduction capabilities autonomously.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20240403772A1Goal-driven human-machine interaction architecture, and systems and methods of use thereof
Publication Date: 2024.12.05 META PLATFORMS TECHNOLOGIES LLC
  • US20240403772A1 patent drawing
  • US20240403772A1 patent drawing
  • US20240403772A1 patent drawing

AI summary

A method includes assessing a semantic-based query for a user that includes user goals and assessing probability values and first goal probability values, both of which are associated with active digital actions. The method includes generating a decision engine to determine a user friction value and second goal probability values associated with the user goals using the first goal probability values and the probability values. Further, the method includes determining the user friction value and the second goal probability values using the first goal probability values and the probability values. Moreover, the method includes determining a plan of digital actions based on the user friction value, the second goal probability values, and the user goals. Furthermore, the method includes, in response to determining the user friction value exceeds a predetermined threshold, generating a query to adjust the active digital actions based on the semantic-based query for the user.