Multimodal Hand Biometric Sensor for XR Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional digital device controllers, such as keyboards and handheld controllers, introduce a redundant layer of technology between users and devices, limiting hand mobility and being device-specific, which impedes human-machine interaction in extended reality applications.
Innovation Solution
A multimodal biometric measurement apparatus that includes a mounting component, wrist contour sensors, bioacoustic sensors, and inertial measurement units, processing concurrent sensor data streams to directly translate user actions into machine commands without interfering with hand use.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a dedicated physical controller is used to control digital devices, then control functionality is provided, but hand mobility is limited and device versatility is reduced
Solution Approach 1:
The patent implements a universal control system using wearable sensors (IMU, capacitive, flex, acoustic) that can detect multiple types of hand gestures and movements, enabling a single device to control various digital devices including smartphones, computers, and televisions without requiring different dedicated controllers for each device type
Solution Approach 2:
The patent extracts the control functionality from traditional dedicated physical controllers and relocates it to wearable sensor systems on the user's hand, eliminating the need for separate controller devices and freeing up hand mobility while maintaining control capabilities
2Device complexity
If a dedicated physical controller is used, then control input is received, but the controller adds a redundant layer between user and device
Solution Approach 1:
The patent removes the intermediate controller layer by placing sensors directly on the user's hand, enabling direct detection of hand movements and gestures without requiring a separate physical controller, thus reducing system complexity and improving directness of interaction
Solution Approach 2:
The patent uses wearable sensors as a minimal intermediary layer that closely follows hand movements, providing a more direct mapping between user intent and device response compared to traditional controllers, thereby reducing the perceptual and physical distance between user and device
3Adaptability or versatility
If a dedicated controller is used, then device-specific control is achieved, but adaptability to different devices is limited
Solution Approach 1:
The patent designs a universal sensor system with multiple sensor types (IMU for motion, capacitive sensors for touch, flex sensors for finger bending, acoustic sensors for clapping) that can detect various gesture types, making the controller adaptable to control multiple different device types without requiring device-specific controllers
Solution Approach 2:
The patent implements dynamic gesture recognition that can identify and adapt to different types of hand movements and gestures in real-time, allowing the system to accommodate various control scenarios across different devices through a single adaptable controller design
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables seamless and versatile control of devices by directly digitizing hand movements and gestures, enhancing user interaction in extended reality environments without restricting hand use or device specificity.
Implementation Method 1
the first sensor data stream indicates a change in a wrist contour of the user as a result of a muscle and/or tendon movement of the user
Implementation Method 2
at least one bioacoustic sensor comprising a vibration sensor
Implementation Method 3
at least one inertial measurement unit, IMU, comprising an accelerometer and gyroscope
Data Source
AI summary
According to an example aspect of the present invention, there is provided an input device and corresponding method which digitizes and transforms minute hand movements and gestures into user interface commands without interfering with the normal use of one's hands. The device and method may, for example, determine user actions based on detected user action characteristics from a plurality of sensors, where the sensors are preferably of different types.