Augmented Reality Thought Control via EEG and Eye Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mobile device user interfaces require physical interaction, such as tapping or swiping, to activate features, which can be inconvenient when using the device with both hands, like when taking a picture, as it necessitates removing a hand to access commands.
Innovation Solution
A system and method that allows users to manipulate virtual objects in augmented reality using thought and visual gestures, enabling selection and activation of features without physical contact, through EEG brain wave sensors, heart rate monitoring, eye tracking, and location sensors, which communicate with a remote server to generate and display virtual objects based on brain activity and visual references.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If physical interaction (tapping or swiping) is required to activate features, then the user interface is simple and reliable, but the ease of operation deteriorates when using the device with both hands
Solution Approach 1:
The patent replaces mechanical touchscreen interaction (tapping/swiping with fingers) with a physiological detection system using EEG sensors to detect brain waves and eye tracking to detect gaze direction. This substitution enables hands-free operation while maintaining interface functionality, directly resolving the contradiction between ease of operation and device complexity.
Solution Approach 2:
The patent introduces intermediary components (EEG sensors, eye tracking camera, processor) that mediate between the user's intent and the device response. These intermediaries translate physiological signals into touchscreen commands, enabling operation without direct physical contact while managing the complexity through modular sensor and processing components.
2Adaptability or versatility
If EEG sensors and eye tracking are integrated for thought-based manipulation, then hands-free interaction is enabled, but the device complexity increases
Solution Approach 1:
The patent implements multi-functionality by using the mobile device's existing camera for both standard photography and eye tracking, and the processor for both general computation and EEG signal analysis. This universal approach enables hands-free operation while minimizing additional hardware complexity by repurposing existing components.
Solution Approach 2:
The patent merges multiple functions into unified components: the camera serves both as a photography tool and an eye tracking sensor, the processor handles both general operations and physiological signal analysis, and the touchscreen serves as both display and feedback mechanism. This merging reduces overall device complexity while achieving adaptability for thought-based manipulation.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables hands-free interaction with virtual objects and features in augmented reality, enhancing user convenience by allowing command activation through thought and visual gestures, improving usability when using mobile devices with both hands.
Implementation Method 1
A state of mind of a user is identified based on an intensity and a pattern of an output of electric waves from the user
Implementation Method 2
A gaze of the user on the display is detected
Implementation Method 3
heart rate monitoring
Data Source
AI summary
A system and method for manipulating a virtual object based on thought is described. A display of a device displays a first virtual object based on an identification of a physical object detected by the device. The device monitors brain activity data of a user of the device. The brain activity data is generated in response to the first virtual object being displayed in the display. The device identifies a second virtual object based on the brain activity data of the user of the device and displays the second virtual object in the display.