Avatar Control via Motion Sensing and Spatial Distortion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing user interfaces for interacting with virtual and augmented reality environments are cumbersome, inefficient, and limited, providing insufficient feedback for displaying virtual objects like avatars and requiring complex, tedious, and error-prone methods that create a significant cognitive burden on users.

Innovation Solution

A computer system with improved methods and interfaces for displaying virtual objects, including avatars, that provide efficient and intuitive interaction by using a representation of a user with multiple representation portions, where the system detects movement and spatially distorts the representation based on the user's physical movement, and adapts the display of controls based on user input and gaze direction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional user interfaces are used for interacting with virtual reality environments, then the system can display virtual objects, but the interaction becomes cumbersome and creates significant cognitive burden on users

Engineering Contradiction:
Improveease of interactionVSAvoidcomplexity of control methods
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system provides visual feedback by displaying a representation of the user's body in the virtual environment that moves in response to detected physical movements. This feedback loop allows users to intuitively control the avatar without complex input methods, as the avatar naturally mirrors their physical actions in real-time

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces complex mechanical input devices (controllers, joysticks, buttons) with motion sensing technology that captures natural body movements. The system uses cameras and sensors to detect physical movements and automatically translate them into virtual avatar actions, eliminating the need for users to manually operate complex control interfaces

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If detailed feedback is provided for displaying virtual objects, then the display accuracy improves, but the system becomes more complex and error-prone

Engineering Contradiction:
Improvedisplay accuracyVSAvoidcomplexity of display control
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system automatically generates and updates the visual representation of the user's body in the virtual environment based on real-time motion detection. The avatar self-updates its position, orientation, and appearance without requiring manual configuration or complex control logic, as the system automatically translates detected movements into corresponding visual changes

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If comprehensive control methods are provided for virtual objects, then the functionality increases, but the interaction time and energy consumption increase

Engineering Contradiction:
ImprovefunctionalityVSAvoidinteraction time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system continuously tracks and responds to the user's body movements throughout the entire interaction session. The motion sensing and avatar updating occur in real-time without interruption, allowing users to perform multiple actions seamlessly without pausing or resetting, thereby reducing total interaction time while maintaining full functionality

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS12287913B2Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments
Publication Date: 2025.04.29 APPLE INC
  • US12287913B2 patent drawing
  • US12287913B2 patent drawing
  • US12287913B2 patent drawing

AI summary

The present disclosure generally relates to techniques and user interfaces for controlling and displaying representations of user in environments, such as during a live communication session and/or a live collaboration session.