Avatar Control via Facial Orientation and Distance Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional avatar manipulation technologies, such as those using head-mounted devices or hand-held controllers, are inconvenient for users within a metaverse.
Innovation Solution
An avatar control device that captures a user's face image, acquires initial setting information for a reference posture, and uses posture information to control the avatar's movement within a virtual space, including forward/backward movement and directional changes based on the user's face orientation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a head-mounted device or hand-held controller is used to manipulate an avatar, then the avatar can be controlled within the virtual space, but the user experiences inconvenience due to the need to attach or hold the manipulation device
Solution Approach 1:
The patent extracts the manipulation function from physical devices (head-mounted devices, controllers) and transfers it to the user's face itself. The face becomes the manipulation interface through camera-based detection of facial movements, expressions, and orientations, eliminating the need for external manipulation devices while maintaining precise avatar control capability
Solution Approach 2:
The user's face serves dual purposes: it is both the identity representation in the virtual space and the manipulation controller. By detecting facial movements and expressions, the system enables the face to control the avatar independently, making the manipulation process self-service and eliminating the need for separate control devices
2Ease of operation
If conventional manipulation devices are used, then avatar control is achievable, but the user convenience is reduced due to the cumbersome nature of attaching or holding devices
Solution Approach 1:
The system performs preliminary detection and recognition of the user's face and facial features before manipulation begins. By pre-establishing the facial model and detection parameters, the system eliminates the need for time-consuming device attachment procedures, allowing users to start manipulating their avatars immediately through natural facial movements
Solution Approach 2:
The patent replaces mechanical manipulation systems (physical controllers, head-mounted devices) with an optical detection system. A camera captures facial images, and image processing algorithms detect facial movements and expressions, substituting mechanical interaction with optical-field-based control that requires no physical device attachment
Data Source
AI summary
An avatar control device for controlling an avatar to be displayed within a virtual space acquires a face image of a user captured by a camera, acquires initial setting information indicating a reference posture of a face of the user, acquires posture information indicating a posture of the face of the user for the camera on the basis of the face image, and controls forward or backward movement of the avatar within the virtual space on the basis of a distance between the camera and the face of the user indicated in the initial setting information and the posture information; and controls a movement direction of the avatar within the virtual space on the basis of an orientation of the face of the user for the camera.


