Wearable Touch Recognition Using Camera Tracking Beyond Sensor Range
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable devices struggle to accurately recognize touch inputs from external objects, particularly when the object is positioned at a distance beyond the reach of conventional sensors, leading to inefficiencies in augmented and virtual reality experiences.
Innovation Solution
A wearable device equipped with a camera positioned opposite to the display, capable of identifying visual objects corresponding to external objects at a distance, and providing feedback based on their movement as touch inputs, using a combination of camera and sensor tracking depending on the object's distance from the device surface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional sensors are used for touch input recognition, then the device can detect touch inputs within reach distance, but it cannot accurately recognize touch inputs from external objects positioned beyond reach distance
Solution Approach 1:
The patent divides the detection space into two segments: a near field detected by conventional sensors and a far field detected by the camera. This segmentation allows each component to operate in its optimal range, with the camera handling distant objects and sensors handling close objects, thereby extending overall detection capability while maintaining accuracy.
Solution Approach 2:
The camera acts as an intermediary device that bridges the gap between conventional sensors and distant external objects. By capturing visual information of objects beyond sensor reach and processing this data to infer touch intent, the system extends detection range without compromising recognition accuracy.
2Adaptability or versatility
If the camera is positioned toward a direction different from the display direction, then the device can identify external objects at a distance, but the alignment between visual identification and touch input mapping becomes more complex
Solution Approach 1:
The system employs feedback mechanisms where the camera continuously monitors external object positions and provides real-time coordinate data. This feedback loop enables dynamic adjustment of the mapping relationship between visual space and touch input space, allowing the system to handle the directional misalignment between camera and display while maintaining accurate touch recognition.
Solution Approach 2:
The patent introduces a third spatial dimension by utilizing the camera's independent viewing angle. Instead of relying solely on the display's two-dimensional coordinate system, the system incorporates depth and angular information from the camera, creating a three-dimensional mapping model that resolves the directional discrepancy between camera and display orientations.
3Adaptability or versatility
If the system uses camera-based tracking for distant objects, then it extends detection range, but the response time and tracking precision may be reduced compared to direct sensor contact
Solution Approach 1:
The patent merges camera-based tracking with sensor-based detection into a unified touch recognition system. By combining the strengths of both approaches—camera's extended range and sensors' high precision and fast response—the system achieves reliable touch recognition across all distances. The hybrid approach compensates for the camera's limitations in response time and precision through sensor data integration.
Solution Approach 2:
The system performs preliminary tracking of external objects using the camera before actual touch occurs. This advance detection allows the system to predict touch location and prepare for incoming input, reducing effective response time. By pre-positioning virtual objects and anticipating user intent, the system maintains reliability even when using camera-based detection for distant objects.
Data Source
AI summary
A wearable device may obtain an image, while a screen is displayed, using a camera. The wearable device may identify a visual object corresponding to an external object from the image. The wearable device may display, at a first location of a portion of the visual object corresponding to a portion of the external object farther than a reference distance from a second surface, a pointer on the screen. The wearable device may recognize the external object contacted on the second surface according to movement from outside the reference distance, as a touch input at a second location identified based on a path of the movement and the first location, and provide feedback with respect to the touch input.