Glasses Terminal Finger Gesture Input via Eye Reflection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional glasses-type terminals face difficulties in accurately performing character input operations due to homonyms in voice recognition, external noise interference, and the limited size of touch pads, leading to challenges in inputting data such as e-mail on a screen displayed in the user's field of view.
Innovation Solution
A glasses-type terminal equipped with a display apparatus, an image capturing apparatus to capture the user's eye and finger movements, an operation determination unit to identify the type of operation, an operation position identification unit to determine the operation position, and an input control unit to recognize and control input instructions, allowing users to perform operations on a virtual confirmation screen similar to a typical touch panel.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If voice operations are used for character input, then hands-free operation is enabled, but recognition accuracy decreases due to homonyms and external noise
Solution Approach 1:
The patent introduces an image capturing apparatus as an intermediary to detect finger gestures and eye movements, which then serve as input signals to the system. This mediator translates physical gestures into digital commands, providing an alternative input method that avoids voice recognition issues while maintaining hands-free operation capability.
Solution Approach 2:
The patent replaces the voice-based acoustic input system with an optical detection system using image capturing apparatus. This substitution transitions from acoustic field interaction to optical field interaction, enabling more accurate detection of user intent through visual tracking of finger and eye movements.
2Ease of operation
If a touch pad is provided on the temple for operations, then direct screen interaction is enabled, but the small size limits character input capability
Solution Approach 1:
The patent transitions from two-dimensional touch pad interaction to three-dimensional spatial interaction by tracking finger movements in space and mapping them to the virtual screen. This dimensional expansion allows the limited touch pad area to control a much larger virtual display area through coordinate transformation and gesture recognition.
Solution Approach 2:
The patent creates a virtual copy of the screen in the user's field of view that can be interacted with using natural hand gestures. This virtual screen copy maintains the full resolution and size of the original display while allowing interaction through augmented reality, effectively bypassing the physical size constraints of the embedded touch pad.
3Adaptability or versatility
If a small display using a prism is located in front of the eye, then the terminal can be worn like glasses, but the display size is limited
Solution Approach 1:
The patent projects a virtual image of the screen content into the user's field of view, creating a magnified optical copy that appears to float in mid-air. This virtual image copy provides a large display area while the physical display component remains small and wearable, resolving the contradiction between compact form factor and display size.
Solution Approach 2:
The patent uses optical projection to transfer the display from the physical dimension (small prism display) to the virtual dimension (large projected image in field of view). This dimensional transition allows the display content to appear much larger than the physical display component, enabling both wearable compactness and large display area.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables users to easily and accurately perform character input and various screen operations like enlargement and reduction by mimicking operations on a smartphone or tablet terminal, improving the accuracy and ease of inputting data on a virtual confirmation screen.
Implementation Method 1
capture an image of an eye of the user to acquire an image of the original screen (M) and a finger of the user or a specific input pointer reflected on the eye of the user
Data Source
Figure 1A~1B
Figure 2A~2B
Figure 3
AI summary
When an image capturing apparatus captures an image of an original screen and a finger reflected on an eye of a user, an operation determination unit determines the content of an operation performed with the finger based on image data of the captured image. An operation position identification unit generates data representing a position of the finger on the original screen based on the image data of the captured image. An input control unit recognizes a content of an input instruction corresponding to the operation performed with the finger, based on data on the content of the operation obtained by the operation determination unit, data on the position generated by the operation position identification unit, and data on the original screen stored in a storage unit, and controls the original screen to be displayed on a display apparatus according to the recognized content of the input instruction.