Mixed-Reality Avatar State Detection and Behavior Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mixed-reality social networks face challenges due to physical attrition and sensory isolation, where users must periodically disconnect from virtual environments, leading to unnatural avatar behavior and missed social interactions, as existing solutions only distinguish between active and passive states without accounting for users who may be available but not actively engaging.

Innovation Solution

A system that detects an available state of a user by monitoring physical and virtual activity, generates natural behavior for the user's avatar, and notifies the user of interactions, allowing the avatar to remain interactive and aware of surroundings even without motion data, using machine learning models to simulate active participation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the system monitors only active user states, then the system complexity is reduced, but the reliability of avatar behavior representation deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoidavatar behavior representation
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The system dynamically adjusts avatar behavior based on the user's state transitions between active, passive, and available modes. The avatar's interaction capabilities and responsiveness are modified according to the detected user state, allowing the system to maintain reliable representation without requiring complex monitoring of all possible user conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The user state space is segmented into three distinct states: active, passive, and available. This segmentation allows the system to apply different behavior rules and monitoring levels for each state, reducing overall system complexity while maintaining reliable avatar representation through state-specific handling.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If the system generates automated avatar behavior during passive state, then the loss of social interaction is reduced, but the device complexity increases

Engineering Contradiction:
Improvesocial interactionVSAvoiddevice complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

During passive state, the system generates partial automated behaviors that are sufficient to maintain basic social interaction rather than implementing full active engagement. The avatar performs limited actions such as maintaining position, basic gestures, and selective response to interactions, which reduces the complexity burden while preventing complete loss of social connection.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system introduces an intermediary automated behavior generation layer that mediates between the user's passive physical state and the social interaction requirements. This intermediary layer translates user availability into appropriate avatar behaviors, managing the complexity of social interaction maintenance without requiring direct user control.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If the system implements three-state detection (active, passive, available), then the adaptability of avatar behavior is improved, but the difficulty of detecting and measuring user state increases

Engineering Contradiction:
Improveavatar behavior adaptabilityVSAvoiduser state detection
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The user state detection is segmented into three distinct categories with specific detection criteria for each: active state detected through motion data and interaction patterns, passive state detected through lack of motion but continued system engagement, and available state detected through specific user indications. This segmentation makes the detection process more manageable and less complex than attempting to continuously analyze all possible user conditions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts the detection sensitivity and methods based on the current state transitions. The available state serves as a transitional buffer that allows flexible interpretation of user intent, making the overall detection system more adaptable without requiring overly complex measurement mechanisms for each individual state transition.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20240312142A1Mixed-reality social network avatar via congruent learning
Publication Date: 2024.09.19 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US20240312142A1 patent drawing
  • US20240312142A1 patent drawing

AI summary

According to one embodiment, a method, computer system, and computer program product for adjusting an audible area of an avatar's voice is provided. The present invention may include detecting an available state of a user participating in a mixed-reality environment; generating behavior for a user avatar representing the user in the mixed-reality environment; controlling the user avatar to perform the generated behavior; monitoring the mixed-reality environment to identify if a participant is interacting with the user avatar; and responsive to detecting an interaction between a participant and the user avatar, notifying the user of the detected interaction.