Syndicating Direct and Indirect Interactions in CMR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Interaction with objects in computer-mediated reality (CMR) environments is often cumbersome and error-prone due to the lack of precise tactile feedback and ambiguity in user intention, leading to misunderstandings between users and computing devices.

Innovation Solution

The implementation of a system that syndicates direct and indirect interactions in CMR environments, allowing computing devices to determine options for indirect interaction based on characteristics of direct interactions, and modifying the environment accordingly, providing users with intuitive and precise control through the combination of direct and indirect interaction methods.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If direct interaction with CMR objects is used, then ease of operation is improved, but measurement precision deteriorates due to lack of tactile feedback

Engineering Contradiction:
Improveease of interactionVSAvoidprecision of interaction
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary system that translates direct hand gestures into precise indirect interaction commands. The computing device acts as a mediator between the user's direct interaction attempts and the CMR environment, using computer vision and machine learning to interpret gesture intentions and convert them into accurate manipulation commands, thereby bridging the precision gap without sacrificing ease of operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements a feedback loop where the computing device provides visual feedback about detected gestures and their interpreted meanings to the user. This allows users to verify their interaction intentions are correctly understood and adjust their gestures accordingly, improving measurement precision while maintaining the simplicity of direct interaction methods.

Inventive Principle:
Principle #23Feedback

2Ease of operation

If direct interaction methods are used, then ease of operation is improved, but reliability deteriorates due to error-prone interactions

Engineering Contradiction:
Improveease of interactionVSAvoidreliability of interaction
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The computing device serves as a reliable intermediary that validates and verifies interaction commands before executing them. The system uses multiple detection methods and confirmation protocols to ensure that direct interaction gestures are correctly interpreted and that the resulting indirect interaction commands accurately reflect user intent, thereby improving reliability without complicating the interaction process.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary validation of detected gestures against expected interaction patterns and contexts before executing commands. By anticipating potential errors and implementing preventive verification steps, the system reduces erroneous interactions while maintaining the simplicity of direct manipulation methods for users.

Inventive Principle:
Principle #9Preliminary anti-action

3Measurement precision

If indirect interaction options are added to guide users, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improveprecision of interactionVSAvoidcomplexity of interaction system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system provides self-service guidance by automatically detecting user gestures and presenting only the most relevant indirect interaction options based on the detected gesture type and context. The computing device autonomously determines which precision-enhancing options to offer, reducing the apparent complexity for users while maintaining high measurement precision through context-aware option presentation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The interaction system dynamically adapts the level of guidance and available options based on the detected gesture confidence and context. When gestures are clearly detected, fewer options are presented; when ambiguity exists, more guidance options become available. This dynamic adjustment optimizes precision enhancement while minimizing perceived system complexity for users.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10417827B2Syndication of direct and indirect interactions in a computer-mediated reality environment
Publication Date: 2019.09.17 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10417827B2 patent drawing
  • US10417827B2 patent drawing
  • US10417827B2 patent drawing

AI summary

In various embodiments, computerized methods and systems for syndicating direct and indirect interactions with objects in a computer-mediated environment to facilitate precise interactions with the objects in the computer-mediated environment are provided. The system detects a direct interaction with an object in the computer-mediated reality environment. The direct interaction may be a natural or hypernatural interaction. Subsequently, the system may determine various options of indirect interaction with the object related to the direct interaction. The indirect interaction may be generated by a controller. Upon receiving an indirect interaction, the system may modify the object based on the syndication of the direct interaction and the indirect interaction.