Gesture Recognition via Motion Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Handheld computing devices face challenges in accurately interpreting user gestures due to accidental or unintentional contact with the display surface, leading to mistaken input events and user frustration, especially when complex gestures are required.
Innovation Solution
The computing device integrates movement-type input mechanisms, such as accelerometers and gyro devices, to recognize intentional gestures that incorporate device movement as an integral part, distinguishing between foreground and background movements to accurately interpret and execute user inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the computing device uses contact-type input mechanisms to recognize gestures, then the device can interpret user inputs, but accidental or unintentional contact with the display surface causes mistaken input events and user frustration
Solution Approach 1:
The patent combines contact-type input mechanisms with movement-type input mechanisms to create a unified gesture recognition system. By merging touch data from the display surface with motion data from accelerometers and gyro devices, the system can distinguish between intentional gestures and accidental contacts, resolving the contradiction between maintaining simple contact input and improving input accuracy
Solution Approach 2:
The patent introduces movement-type input mechanisms as intermediary sensors that mediate between the contact input and the final gesture interpretation. These intermediary sensors provide additional contextual information about device motion, allowing the system to filter out accidental contacts while preserving legitimate gestures
2Reliability
If the computing device requires complex gestures to distinguish intentional input, then accidental inputs are reduced, but user difficulty in remembering and executing gestures increases
Solution Approach 1:
The patent adds a new dimension to gesture recognition by incorporating device movement in three-dimensional space. Instead of relying solely on two-dimensional touch patterns that require complex finger movements, the system utilizes the third dimension of device orientation and motion, allowing simple touches combined with natural device movements to convey intentional gestures
Solution Approach 2:
The patent makes the gesture recognition system dynamic by continuously monitoring device motion characteristics. The system adapts its interpretation of contact inputs based on real-time movement data, allowing the complexity threshold for intentional gestures to vary dynamically rather than requiring consistently complex patterns
3Adaptability or versatility
If the computing device uses predefined intentional gestures, then input mechanisms are expressive, but similar gestures are mistakenly interpreted and user frustration increases
Solution Approach 1:
The patent makes the movement-type input mechanisms serve multiple functions: they both detect intentional gestures and filter accidental contacts. This multi-functionality allows the system to maintain a rich set of predefined gestures while improving interpretation accuracy through the additional motion context provided by the universal movement sensors
Data Source
Figure 1
Figure 2
Figure 3A~3
AI summary
A computing device is described herein which accommodates gestures that involve intentional movement of the computing device, either by establishing an orientation of the computing device and/or by dynamically moving the computing device, or both. The gestures may also be accompanied by contact with a display surface (or other part) of the computing device. For example, the user may establish contact with the display surface via a touch input mechanism and/or a pen input mechanism and then move the computing device in a prescribed manner.