Wearable Virtual Keyboard Input Detection Using Brightness Edges
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices struggle to accurately identify and execute user inputs in virtual environments, particularly when interacting with external objects in augmented reality systems.
Innovation Solution
A wearable device equipped with communication circuitry, a camera, and a display, which identifies a marker displayed on an external device, detects the edge of an external object using pixel brightness differences, and executes input functions based on a virtual keyboard, utilizing an indicator to represent the object's position and receiving touch events.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a virtual keyboard is displayed in an augmented reality environment, then user interaction capability is improved, but input accuracy deteriorates due to difficulty in identifying user inputs in virtual space
Solution Approach 1:
The patent introduces an external electronic device (such as a smartphone or tablet) as an intermediary to display the virtual keyboard. This external device serves as a mediator between the user and the AR environment, providing a tangible display surface that makes it easier to identify and interact with virtual keyboard keys, thereby resolving the contradiction between enhanced interaction capability and maintained input accuracy
Solution Approach 2:
The patent projects the virtual keyboard from the two-dimensional AR display space onto the physical surface of an external electronic device. This dimensional transition from virtual air-space to physical device surface provides users with a more stable and identifiable reference frame for input, improving measurement precision while maintaining the versatility of AR interaction
2Measurement precision
If edge detection using pixel brightness differences is implemented, then object detection capability is improved, but processing complexity increases
Solution Approach 1:
The patent replaces complex mechanical or computational object recognition systems with a simpler optical-based edge detection method using pixel brightness differences. By leveraging the inherent optical contrast at object boundaries, the system achieves effective object detection without requiring sophisticated image processing algorithms or additional sensors, thus improving detection capability while controlling processing complexity
Solution Approach 2:
The patent utilizes the natural optical properties of objects (brightness differences at edges) to perform self-detection without requiring external assistance or complex processing. The image data from the camera automatically provides the necessary contrast information for edge detection, allowing the system to achieve accurate object detection while minimizing additional processing requirements
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances user interaction in virtual environments by accurately detecting and executing inputs on virtual keyboards, improving the user experience in augmented reality systems.
Implementation Method 1
detecting an edge of a visual object representing an external object, by using information representing a brightness difference of each of pixels included in an image of the camera
Data Source
AI summary
A wearable device is provided. The wearable device includes a communication circuit, a camera, a display, memory, including one or more storage media, storing instructions, and a processor communicatively coupled to the communication circuitry, the camera, the display, and the memory, wherein the instructions, when executed by the processor, cause the wearable device to transmit, to an external electronic device, information about a marker, display a virtual keyboard through the display based on the marker, use information indicating the difference in brightness of each pixel included in an image, so as to detect, when the virtual keyboard is displayed, the edge of a visual object indicating an external object, display an indicator, which is projected onto the virtual keyboard and indicates the location of the external object, and execute an input function, based on the virtual keyboard, based on receiving a signal for a touch event through the communication circuit.