3D Avatar Pose Tracking for Simpler XR Modification

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for modifying avatars in extended reality environments are cumbersome, inefficient, and create a significant cognitive burden on users due to unnatural movements, insufficient feedback, and complex manipulation of virtual objects, leading to energy waste and suboptimal user experiences.

Innovation Solution

Implement improved methods and interfaces using computer systems with touch-sensitive displays, eye-tracking, hand-tracking, and tactile output generators to efficiently update avatar poses based on user movements, providing intuitive and natural interactions while reducing the number and nature of user inputs, and conserving power.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional methods are used to modify avatars in extended reality environments, then avatar manipulation functionality is provided, but user interaction efficiency deteriorates due to cumbersome and complex operations

Engineering Contradiction:

Improveuser interaction efficiencyVSAvoidoperation complexity

Core Design Contradiction:

ProductivityVSEase of operation

Solution Approach 1:

The system automatically detects user pose changes through cameras and machine learning models, and autonomously updates the virtual avatar without requiring manual controls. The user simply needs to perform the pose, and the system self-adjusts the avatar to match, eliminating complex manipulation operations.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical control interfaces (buttons, sliders, drag-and-drop) with automatic computer vision-based pose detection. The system uses cameras and machine learning algorithms to detect user pose changes and automatically updates the virtual avatar, substituting mechanical interaction with automated digital processing.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Use of energy by moving object

If conventional avatar modification methods are used, then basic avatar control is achieved, but energy consumption increases due to prolonged interaction time and processing

Engineering Contradiction:

Improveenergy consumptionVSAvoidinteraction time

Core Design Contradiction:

Use of energy by moving objectVSLoss of time

Solution Approach 1:

The system performs preliminary pose detection and analysis in real-time as the user moves, rather than waiting for manual input commands. By continuously monitoring user pose through cameras and automatically updating the avatar, the system eliminates the time lag between user intent and avatar response, reducing both interaction time and energy waste from prolonged processing.

Inventive Principle:

Principle #10Preliminary action

3Reliability

If detailed pose tracking is implemented, then avatar realism is improved, but device complexity increases due to multiple sensors and processing requirements

Engineering Contradiction:

Improveavatar realismVSAvoidsystem complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the pose detection functionality from complex sensor arrays and isolates it to camera-based vision systems with machine learning models. By using external cameras (or device cameras) combined with AI processing, the system achieves detailed pose tracking without requiring complex integrated sensor suites, thereby reducing device complexity while maintaining avatar realism.

Inventive Principle:

Principle #2Taking out (Extraction)

Data Source

PatentUS20250245942A1Devices, methods, and graphical user interfaces for modifying avatars in three-dimensional environments

Publication Date: 2025.07.31 APPLE INC

AI summary

The present disclosure relates to techniques for improving a user experience for modifying display of an avatar in XR environments. In some embodiments, the techniques include modifying a portion of an avatar based on one or more heuristics. In some embodiments, the techniques include modifying a portion of an avatar after tracking is lost.