User-to-Avatar Action Mapping for Gaze-Aligned Orientation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In virtual environments, avatars often become mis-oriented due to camera offsets relative to the user, leading to inconsistent or unintentional movements and interactions, which can cause confusion and frustration, especially in scenarios like the metaverse.
Innovation Solution
A system that corrects avatar orientation by analyzing user gaze, environmental data, and intentional/unintentional actions, using sensors and machine learning to adjust avatar positions and block unintended movements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If camera is positioned offset from user to enable virtual environment capture, then user actions can be recorded, but avatar orientation becomes mis-aligned with user gaze direction
Solution Approach 1:
The patent introduces an intermediary computational process that receives raw camera data and user gaze information, then processes this data to calculate corrected avatar orientation. This intermediary layer mediates between the offset camera position and the virtual avatar, transforming misaligned data into accurate orientation representation without requiring physical repositioning of the camera.
Solution Approach 2:
The system dynamically adjusts orientation parameters by calculating the angular difference between user gaze direction and camera viewing angle. It applies rotational transformation parameters to the avatar's orientation data, effectively changing the orientation parameters from camera-based coordinates to user-gaze-based coordinates, thereby resolving the misalignment issue.
2Adaptability or versatility
If all user movements are mapped to avatar actions, then user experience is immersive, but unintended actions are reproduced causing confusion
Solution Approach 1:
The patent implements a feedback mechanism where the system continuously monitors user actions, compares them against defined criteria for intentional behavior, and adjusts avatar reproduction accordingly. This feedback loop allows the system to distinguish between intentional and unintentional actions, reproducing only those that meet the intentionality threshold, thereby maintaining both immersion and reliability.
Solution Approach 2:
The system performs preliminary analysis of user actions before mapping them to avatar behaviors. By pre-evaluating actions against intentionality criteria and filtering out unintentional movements before they reach the avatar, the system prevents confusion-causing actions from being reproduced while maintaining immersive experience for legitimate user interactions.
3Device complexity
If camera position is fixed relative to device, then device structure is simple, but avatar orientation cannot adapt to different user positions
Solution Approach 1:
The patent transforms the static camera-position-to-avatar-mapping relationship into a dynamic system that continuously adapts based on real-time user gaze detection. The avatar orientation is no longer fixed relative to camera position but dynamically adjusts according to detected user gaze direction, allowing the system to adapt to different user positions and viewing angles without physical camera repositioning.
Data Source
AI summary
Methods, apparatus, systems, and articles of manufacture for user-to-avatar mapping and adjustment are disclosed. An example apparatus includes processor circuitry to at least one of instantiate or execute the machine readable instructions to: determine a dissonance between a first orientation of a user in a real-world environment and a second orientation of an avatar in a virtual environment, the avatar corresponding to the user; determine an avatar adjustment value based on the dissonance; and apply the avatar adjustment value to the avatar model to change the second orientation.