AR Virtual Key Superimposition for Secure PIN Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional security systems for inputting secret information, such as PINs or passwords, are vulnerable to spying as they either allow third parties to infer input information from hand movements or cannot completely prevent spying, despite measures like random key layouts or limited viewing angles.
Innovation Solution
An information processing apparatus and method utilizing Augmented Reality (AR) technology to superimpose virtual key information on a real input unit, allowing only the user to see the virtual keys, thereby preventing unauthorized inference of input data by comparing virtual key information with detected input position information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If virtual key information is displayed on a conventional display device, then users can see the key layout for input, but third parties can also spy on the input by viewing the display
Solution Approach 1:
The system segments the key layout information by displaying it only in the user's field of view through AR technology. The virtual keys are superimposed on the real input unit only where the user is looking, determined by gaze detection or head tracking, thus dividing the visibility into user-specific segments rather than universal display.
Solution Approach 2:
The patent introduces an intermediary AR display system that acts as a mediator between the user and the input unit. This intermediary layer projects virtual keys onto the real input unit, creating a combined view that is only visible to the user through the AR device, thereby preventing direct viewing by third parties while maintaining usability.
2Object-affected harmful factors
If the layout of input keys is randomly rearranged, then spying from hand movements is prevented, but the display still reveals input information when viewed alongside hand movements
Solution Approach 1:
The patent transitions the key layout from a static two-dimensional display to a dynamic augmented reality overlay that exists in the user's visual field. By using head tracking and gaze detection, the system creates a third dimension of control, where key positions are determined not just by fixed layout but by the user's viewing direction and attention, making it impossible for third parties to correlate hand movements with key positions.
3Object-affected harmful factors
If a limited viewing angle is used for the monitor, then spying frequency is reduced, but spying cannot be completely prevented
Solution Approach 1:
The AR display system applies local quality by making the virtual key information visible only in the specific local region of the user's field of view. Through head tracking and gaze detection, the system ensures that key layout information is projected only where the user is looking, creating a localized visibility zone that moves with the user's head and eyes, thus completely preventing third-party viewing regardless of their position.
Data Source
AI summary
A method is provided for recognizing input operations. The method comprises transmitting virtual key information defining a layout of virtual input keys. The method further comprises determining input position information based on a detected input member. The method also comprises determining a key input by comparing the virtual key information with the input position information.