Dynamically Morphing XR Assistant Avatars for Application Contexts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems face challenges in dynamically morphing virtual assistant avatars to adapt to changes in context and seamlessly integrate with different applications, leading to suboptimal user interaction and engagement.

Innovation Solution

The system customizes XR assistant avatars based on context changes and application switches by using rendering specifications provided by application developers, allowing for intelligent and proactive interaction through a hybrid architecture that leverages both client-side and server-side processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the virtual assistant avatar uses a fixed form and rendering specification, then the system complexity is reduced and ease of manufacture is improved, but the adaptability to different contexts and applications deteriorates

Engineering Contradiction:
Improveadaptability to context changesVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The virtual assistant avatar transitions from a static fixed form to a dynamic morphing form that can adapt its appearance based on context changes and application switches. The system dynamically adjusts avatar characteristics including form, pose, and rendering specification in response to environmental cues and user interactions, resolving the contradiction between adaptability and complexity by making the system flexible rather than rigid.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes multiple parameters of the virtual assistant avatar simultaneously including form geometry, pose orientation, and rendering specification to achieve context-appropriate appearances. By coordinating changes across these parameters based on contextual information, the system achieves high adaptability while managing complexity through integrated parameter control rather than independent adjustments.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If the system implements dynamic morphing of virtual assistant avatars with multiple rendering specifications, then the adaptability and user engagement are improved, but the device complexity and integration difficulty increase

Engineering Contradiction:
Improveintegration with different applicationsVSAvoidintegration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The virtual assistant avatar system is designed to serve multiple applications and contexts through a single unified architecture that supports various rendering specifications. The avatar can function across different applications (messaging, media playback, notifications) by adapting its form and rendering properties, eliminating the need for separate avatar implementations for each application and thereby reducing overall integration complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system introduces an intermediary layer that manages the complexity of morphing transformations between different avatar forms and rendering specifications. This intermediary handles the coordination of form changes, pose adjustments, and rendering updates, shielding application developers from the underlying complexity while enabling seamless integration across diverse applications.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If the virtual assistant avatar morphs dynamically based on context changes, then the user engagement and interaction quality are improved, but the processing time and loss of time increase

Engineering Contradiction:
Improveuser interaction qualityVSAvoidprocessing time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system pre-prepares multiple avatar forms and rendering specifications in advance, so when context changes occur, the avatar can transition to the appropriate pre-loaded form rather than generating it from scratch. This preliminary preparation significantly reduces the processing time required for morphing while maintaining high-quality user interaction and engagement.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The avatar morphing process is designed to be continuous and smooth rather than discrete and abrupt, maintaining visual coherence throughout the transformation. By ensuring continuous useful action in the morphing process, the system minimizes perceptible delays and maintains user engagement without significant time loss, as the transitions appear natural and uninterrupted.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS12353897B2Dynamically morphing virtual assistant avatars for assistant systems
Publication Date: 2025.07.08 META PLATFORMS INC
  • US12353897B2 patent drawing
  • US12353897B2 patent drawing
  • US12353897B2 patent drawing

AI summary

In one embodiment, a method includes rendering for displays of an extended-reality (XR) display device a first output image of an XR assistant avatar within an environment in a field of view of a first user of the XR display device, wherein the XR assistant avatar has a first form and a first pose with respect to the first user and is interactable by the first user to access an assistant system, detecting a change in a context of the first user with respect to the environment, determining whether to morph the XR assistant avatar based on the detected change in the context of the first user, and rendering a second output image of the XR assistant avatar for the displays of the XR display device, wherein the XR assistant avatar is morphed to have a second form and a second pose with respect to the first user.