Sensor-Based HCI for Hands-Busy Real-Time Message Handling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face inconvenience in interacting with electronic devices when their hands are occupied, leading to delayed processing of events and affecting user experience.
Innovation Solution
The method and apparatus utilize body actions, such as head turning or device movement, to infer user intentions and process events like viewing messages or waking up voice assistants without direct screen interaction, using sensors like millimeter-wave radar or lidar to detect changes and prioritize real-time events.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If users perform direct interaction actions (tapping screen) to operate electronic devices, then operation precision is improved, but ease of operation deteriorates when hands are occupied
Solution Approach 1:
The patent introduces body action detection as an intermediary mechanism between the user and the electronic device. Instead of requiring direct hand interaction with the screen, the system detects body actions (head turning, body leaning) through sensors and translates them into interaction commands, thereby maintaining operation precision while improving ease of operation when hands are occupied
Solution Approach 2:
The patent replaces the mechanical direct-touch interaction system with a sensor-based detection system. By using cameras, depth sensors, and other detection devices to capture body actions and convert them into control signals, the system eliminates the need for manual screen tapping while preserving operational accuracy
2Productivity
If the electronic device processes all events immediately, then productivity is improved, but device complexity increases due to need for event prioritization
Solution Approach 1:
The patent applies preliminary action by detecting body actions before the user performs direct interaction with the device. By anticipating user intentions through body action detection (such as head turning toward the device), the system can pre-prepare to process relevant events, improving productivity while managing complexity through predictive rather than reactive processing
Solution Approach 2:
The system implements feedback mechanisms where detected body actions provide real-time information about user intentions. This feedback loop allows the electronic device to dynamically adjust which events to process and prioritize, improving processing efficiency while managing complexity through intelligent event selection based on user state
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach reduces the interaction path for users, allowing them to process events more efficiently and enhances the intelligent experience by aligning with their intentions, thus improving user interaction with electronic devices.
Implementation Method 1
using sensors like millimeter-wave radar or lidar to detect changes
Implementation Method 2
using sensors like millimeter-wave radar or lidar to detect changes
Data Source
AI summary
This application provides a human-computer interaction method and apparatus. The method includes: obtaining a first change, where the first change includes at least one of a body action change of a user, a location change of at least a part of a body of the user relative to the electronic device, a location change of the electronic device, and a location change of the electronic device relative to the user; and processing a target event, where the target event is viewing a real-time message on the electronic device. According to the method and the apparatus provided in embodiments of this application, the electronic device can infer an interaction intention of the user based on the first change, to process an event that the user expects to process. In this way, intelligent experience of using the electronic device by the user can be improved.