Voice Assistant Recipient Identification With Wearable IMU Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing voice assistants struggle to understand the context of user conversations accurately, leading to reduced user experience due to misinterpretation of commands, especially when recipient names are not explicitly mentioned.
Innovation Solution
A method and electronic device that utilize inertial measurement unit (IMU) sensor data from user accessories to create a virtual map of relative locations and identities, enabling enhanced interaction by correlating this data with monitored conversations to execute voice commands accurately.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If voice assistant relies on explicit mention of recipient names, then command accuracy is improved, but user convenience deteriorates as users must explicitly state names for every action
Solution Approach 1:
The system performs preliminary actions by establishing a virtual map and pre-identifying multiple users and their locations before the actual command is given. The voice assistant proactively determines user identities and spatial relationships in advance, so when a command is issued, the recipient can be automatically identified without requiring explicit name mention, thus improving both accuracy and convenience
Solution Approach 2:
The patent introduces an intermediary system consisting of the virtual map, IMU sensors, and machine learning models that mediate between the user's voice command and the action execution. This intermediary layer automatically processes the context, identifies recipients, and resolves ambiguities, allowing the voice assistant to understand implicit commands accurately while maintaining ease of use
2Measurement precision
If voice assistant uses camera-based AR glasses to identify recipients, then recipient identification accuracy is improved, but device complexity and camera management requirements worsen
Solution Approach 1:
The patent replaces the mechanical/optical camera-based AR system with an electronic sensor-based system using IMU (inertial measurement units) and wireless communication. Instead of relying on camera hardware to track and identify users, the system uses wearable devices with IMU sensors that communicate location and movement data wirelessly, thereby reducing device complexity while maintaining or improving identification accuracy
Solution Approach 2:
The patent makes the wearable devices serve multiple functions: they act as both communication devices and sensing devices for location tracking and motion detection. The same IMU sensors that monitor user movement during conversations also provide data for recipient identification and spatial mapping, eliminating the need for separate camera hardware and reducing overall system complexity
3Loss of information
If voice assistant monitors multiple users and updates virtual map dynamically, then contextual understanding is improved, but processing time and computational resources increase
Solution Approach 1:
The system performs preliminary processing by continuously maintaining the virtual map and pre-processing IMU sensor data in the background. User identities, locations, and spatial relationships are established and updated in advance during conversations, so when a command is issued, the contextual information is already ready for immediate processing, reducing the processing time required for command execution without compromising contextual understanding
Solution Approach 2:
The patent implements periodic updates of the virtual map and sensor data processing at scheduled intervals rather than continuous real-time processing. The system periodically monitors user positions and conversation contexts, updating the virtual map at optimal moments, which reduces computational load and processing time while maintaining accurate contextual information for voice commands
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances user experience by accurately identifying recipients and executing commands based on contextual interactions among multiple users, improving the effectiveness of voice assistants in collaborative environments.
Implementation Method 1
determining at least one of position information and direction information of at least one second electronic device connected to the first electronic device of the first user using a wearable device inertial measurement unit (IMU) sensor data
Data Source
AI summary
Embodiments herein disclose a method for an enhanced interaction with a voice assistant using user accessories data by a first electronic device. The method includes detecting an utterance from a first user, where the utterance comprises a data item indicative of an identity of at least one second user. Further, the method includes determining at least one of position information and direction information of at least one wearable electronic device connected to the first electronic device of the first user. Further, the method includes determining the identity of the at least one second user indicated in the utterance of the first user based on at least one of the position and the direction of the at least one wearable electronic device connected to the first electronic device.