Auditory Feedback for Gesture Recognition in Compact Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face difficulties in confirming whether operations are correctly performed in regions that cannot be visually recognized, leading to unintended gestures being recognized and functions being executed differently from the user's intent, especially with devices like headphones where direct touch operations are challenging.
Innovation Solution
An information processing device with a control unit that dynamically controls the output of notification information based on the position of a recognized operation object, allowing users to confirm intended operations by associating sounds with specific gestures, regions, and movement directions, enabling execution of device functions corresponding to the intended operation regions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Shape
If operation regions are made visually unrecognizable to improve device aesthetics or compactness, then device appearance is improved, but user ability to confirm operation location deteriorates
Solution Approach 1:
The patent implements auditory feedback by outputting notification sounds that correspond to different operation regions. When a user performs a gesture in a specific region, the device outputs a notification sound that provides feedback about the operation location, enabling users to confirm their operation position without visual recognition of the regions.
2Area of stationary object
If touch-sensitive surfaces are made smaller to improve device compactness, then device size is reduced, but user ability to perform and confirm gestures deteriorates
Solution Approach 1:
The patent outputs notification sounds based on the position where gestures are detected on the touch-sensitive surface. Even with a small surface area, users can confirm the location of their gestures through auditory feedback, maintaining ease of operation despite reduced surface size.
Solution Approach 2:
The patent replaces visual feedback mechanisms with acoustic feedback mechanisms. Instead of relying on visual display or physical indicators on the touch surface, the system uses sound output to convey operation location information, enabling effective interaction with compact surfaces.
3Adaptability or versatility
If operation regions are defined in non-visual spaces (e.g., air space for gesture recognition), then device versatility is improved, but user ability to confirm operation region deteriorates
Solution Approach 1:
The patent outputs notification sounds that correspond to different spatial regions where gestures can be performed. When a gesture is detected in a specific air space region, the system provides auditory feedback indicating the detected region, enabling users to understand where their gestures are being recognized even in non-visual three-dimensional spaces.
Data Source
AI summary
Provided is an information processing device and an information processing method, the information processing device including a control unit that, on the basis of a position of a recognized operation object, dynamically controls output of an information associated with at least one operation region in which the recognized operation object is located, the control unit being configured to, in a case where the recognized operation object is located in the operation region, control execution of a device function corresponding to the operation region in which the recognized operation object is located, and the operation region including a region incapable of being visually recognized by a user.