XR Authentication via Visual Object Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional authentication methods in extended reality (XR) environments are inconvenient and impractical, particularly due to difficulties in text input and imprecise voice recognition, which can be observed by others and hinder secure user authentication.
Innovation Solution
A method involving a computing device that outputs an XR environment, determines images of objects within this environment, and uses image recognition algorithms to generate public and private keys based on these images, which are then used for secure communication with a server, allowing for secure authentication without requiring users to physically interact with input devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional authentication methods (username/password) are used in XR environments, then authentication can be performed, but user convenience deteriorates due to difficulty in locating and using physical keyboards
Solution Approach 1:
The patent replaces mechanical input methods (physical keyboards, motion controllers) with optical-based authentication. The system captures images of objects in the user's field of view and uses image recognition to generate authentication credentials, eliminating the need for physical interaction with input devices in the XR environment.
Solution Approach 2:
The system creates a copy of the visual environment by capturing images of objects within the user's field of view. These captured images are then processed through image recognition to extract authentication information, allowing the system to work with visual copies rather than requiring direct physical input.
2Ease of operation
If virtual keyboards are used for authentication in XR environments, then text input becomes possible, but usability deteriorates due to difficulties with current motion tracking technology
Solution Approach 1:
The patent substitutes motion-based interaction (requiring precise motion tracking) with vision-based authentication. Instead of tracking hand movements to type on a virtual keyboard, the system uses the device's camera to capture and recognize objects in the user's field of view, leveraging optical processing rather than mechanical motion tracking.
3Ease of operation
If voice recognition is used for authentication in XR environments, then hands-free input is achieved, but security deteriorates because voice can be heard by others around the user
Solution Approach 1:
The patent employs visual obfuscation techniques where the authentication interface dynamically changes the appearance of objects in the user's field of view. By randomizing which objects are highlighted or made recognizable, the system creates a visual code that only the user can interpret, preventing shoulder-surfing attacks while maintaining hands-free operation.
4Reliability
If image recognition algorithms are used to generate authentication keys, then security is improved through obfuscation of the selection process, but device complexity increases
Solution Approach 1:
The patent introduces an image recognition algorithm as an intermediary between the visual environment and the authentication system. This intermediary processes captured images, identifies objects, and generates authentication credentials based on the recognized content, thereby enhancing security through obfuscation while managing complexity through modular processing.
Data Source
AI summary
Methods and systems for secure authentication in an extended reality (XR) environment are described herein. An XR environment may be output by a computing device and for display on a device configured to be worn by a user. A first plurality of images may be determined via the XR environment. The first plurality of images may be determined based on a user looking at a plurality of objects, real or virtual, in the XR environment. The first plurality of images may be sent to a server, and the server may return a second plurality of images. A public key and private key may be determined based on different portions of each of the second plurality of images. The public key may be sent to the server to register and/or authenticate subsequent communications between the computing device and the server.