Avatar Appearance Control via Gaze-Driven Interface Dynamics

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current methods for interacting with virtual avatars and user representations in computer systems are cumbersome, inefficient, and error-prone, leading to a significant cognitive burden on users and inefficient use of computer resources, particularly in battery-operated devices.

Innovation Solution

The system concurrently displays an avatar and a user interface with controls for editing its appearance, detecting user inputs to change the avatar's appearance, and provides feedback by initially displaying controls in a reduced prominence state before increasing their visibility based on user interaction, using a combination of display generation components, eye-tracking, hand-tracking, and tactile output generators.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional methods for interacting with virtual avatars are used, then users can control avatar appearance, but the interaction process becomes cumbersome and requires multiple inputs

Engineering Contradiction:

Improveease of avatar appearance editingVSAvoidtime required for interaction

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The system pre-configures avatar appearance options and controls their visibility based on predicted user needs. By preparing and positioning controls in advance rather than requiring users to search for them, the system reduces interaction time while maintaining ease of operation.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system provides feedback by detecting user gaze direction and interaction history to dynamically adjust control visibility and positioning. This feedback mechanism allows the system to anticipate user needs and present relevant controls proactively, reducing the number of inputs required and minimizing interaction time.

Inventive Principle:

Principle #23Feedback

2Ease of operation

If controls are always displayed with full visibility, then users can easily access controls, but user attention is distracted from the primary content

Engineering Contradiction:

Improveaccessibility of controlsVSAvoiddistraction from primary content

Core Design Contradiction:

Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The control visibility is made dynamic rather than static. Controls transition between hidden and visible states based on detected user gaze direction and interaction context. This dynamic behavior allows controls to be accessible when needed while minimizing distraction during content viewing.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system introduces gaze detection as an intermediary mechanism between the user and the controls. Instead of requiring direct interaction with visible controls, the system uses gaze detection to mediate control activation, allowing users to access controls through natural eye movement without constant visual attention on the controls themselves.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Measurement precision

If the system requires multiple sequential inputs to achieve desired outcomes, then precise control is achieved, but cognitive burden on users increases

Engineering Contradiction:

Improveprecision of controlVSAvoidcomplexity of interaction sequence

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The system merges multiple control functions into a single interface element or gesture. By combining related controls and merging them with gaze detection, the system achieves precise control outcomes through fewer, more intuitive inputs rather than requiring multiple sequential actions.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The control system is designed with multi-functionality where a single gaze-based interaction can trigger multiple related actions or access multiple control options simultaneously. This universal approach reduces the cognitive burden by eliminating the need to navigate through multiple sequential input steps.

Inventive Principle:

Principle #6Universality (Multi-functionality)

4Adaptability or versatility

If comprehensive controls are always visible, then all avatar editing options are accessible, but the user interface becomes cluttered and complex

Engineering Contradiction:

Improvecompleteness of control optionsVSAvoidcomplexity of user interface

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The control interface is segmented into multiple layers or states. Comprehensive controls are available but organized in a hierarchical manner where only relevant controls are displayed at any given time. Gaze detection enables users to access additional control layers without overwhelming the interface with all options simultaneously.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Different regions of the interface have different levels of control density and visibility. The system applies local quality by making controls more prominent or visible only in specific contexts based on user gaze and interaction history, while keeping other areas simpler. This maintains completeness of controls while reducing overall interface complexity.

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS20240257486A1Techniques for interacting with virtual avatars and/or user representations

Publication Date: 2024.08.01 APPLE INC

AI summary

The present disclosure generally relates to techniques for interacting with virtual avatars and/or user representations.