Telepresence Robot Housing for HMD-Driven Facial Expression Sync
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current tele-existence systems using robots as avatars struggle to provide a realistic and immersive experience due to limitations in replicating human-like motion and sound source localization, particularly in head-mounted displays (HMDs), leading to incongruous interactions between users and their remote robotic representations.
Innovation Solution
A robot system equipped with an actuator apparatus and a housing that can change posture, incorporating a motor, transmission member, and state information acquisition unit to control facial expressions and emotions, along with a phase difference amplification mechanism for sound processing, to synchronize the robot's movements and sounds with the user's HMD data, enhancing the tele-existence experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a robot is used as an avatar in tele-existence systems, then the user can communicate with people at a distant place, but the robot cannot realistically replicate human-like facial expressions and emotions
Solution Approach 1:
The system captures facial expression information and emotion information from the user in real-time and feeds it back to control the robot's facial movements and expressions, creating a closed-loop system that enables realistic replication of human-like expressions and emotions in the remote avatar
Solution Approach 2:
The system creates a digital copy of the user's facial expressions and emotions by capturing visual and emotional data, then reproduces these copied expressions on the robot's face through controlled movement of facial features, enabling realistic avatar representation
2Adaptability or versatility
If the robot housing posture is changed to match user head movements, then the tele-existence experience is improved, but the system complexity increases
Solution Approach 1:
The HMD serves multiple functions: it displays the robot's camera feed to the user, tracks the user's head movements through sensors, and transmits this positional information to the robot for posture adjustment, consolidating multiple functions into a single wearable device
Solution Approach 2:
The HMD acts as an intermediary device that bridges the user and the robot, capturing head movement data and relaying it to the robot's control system, thereby simplifying the overall system architecture by centralizing the interaction interface
3Ease of operation
If the transmission member is made torsionally elastic to transmit motor rotation, then the facial expression control is improved, but the manufacturing precision requirements increase
Solution Approach 1:
The transmission member's material properties are changed to possess torsional elasticity, allowing it to flex and transmit rotational motion from the motor to the facial features while accommodating manufacturing tolerances and enabling more natural facial expressions
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system effectively replicates the user's facial expressions and sound localization, allowing for a more immersive and realistic interaction between the user and their remote robotic avatar, improving communication and presence in various environments.
Implementation Method 1
The transmission member is a member that deforms torsionally and elastically
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Convenience and usefulness of a tele-existence system are enhanced taking notice of the possibility by collaboration of tele-existence and a head-mounted display apparatus. A movable member is supported for pivotal motion on a housing (20). In the housing, a driving motor and a transmission member for transmitting rotation of the driving motor to the movable member are provided. A state information acquisition unit acquires facial expression information and/or emotion information of a user who wears a head-mounted display apparatus (100). A driving controlling unit controls rotation of the driving motor on the basis of the facial expression information and/or the emotion information.