Augmented Reality Virtual Object Manipulation via Brain Activity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
User interfaces on mobile devices require physical interaction to activate commands, such as tapping a shutter button, which can be inconvenient when holding the device with both hands, and existing augmented reality systems do not effectively utilize user intent and brain activity to manipulate virtual objects.
Innovation Solution
A system and method that uses sensors to capture brain activity and visual gestures to manipulate virtual objects in augmented reality, allowing users to interact with virtual objects based on their intent and state of mind, without the need for physical touch input, by overlaying three-dimensional virtual objects on real-world images and modifying them in response to user brain activity and device movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If physical touch input is used to activate commands in mobile device applications, then the command activation is reliable and precise, but the ease of operation deteriorates when the user is holding the device with both hands
Solution Approach 1:
The patent replaces the mechanical touchscreen interaction system with a brain-computer interface system that detects neural signals directly. Brainwaves are captured through sensors and processed to activate commands, eliminating the need for physical contact with the device while maintaining reliable command activation through neural signal recognition.
Solution Approach 2:
The patent introduces brainwave signals as an intermediary between the user's intent and the device's response. Instead of direct finger-to-screen contact, the system captures neural signals from the brain, processes them through algorithms, and translates them into device commands, serving as a non-contact mediator that resolves the contradiction between hands-free operation and reliable command activation.
2Adaptability or versatility
If traditional touchscreen interface is used, then the device complexity remains low, but the adaptability to different user states (e.g., hands-free, focused attention) deteriorates
Solution Approach 1:
The patent implements a multi-functional input system that can detect and respond to various user states including hands-free conditions, focused attention, and different cognitive states. The brain-computer interface platform serves multiple purposes: capturing neural signals, processing different types of brainwave patterns, and activating相应 commands based on the detected user state, making the system universally adaptable to diverse usage scenarios.
Solution Approach 2:
The patent utilizes changes in brainwave parameters (frequency, amplitude, pattern) to detect different user states and adapt the interface accordingly. By monitoring parameters such as alpha waves associated with relaxation and focus, the system dynamically adjusts its behavior to match the user's current state, enabling adaptability through physiological parameter detection rather than mechanical interface changes.
3Ease of operation
If brain activity sensing is added to capture user intent, then the ease of operation improves for hands-free interaction, but the device complexity increases due to additional sensors and processing
Solution Approach 1:
The patent implements a self-calibrating brain-computer interface system that automatically adapts to individual user characteristics without requiring manual configuration. The system captures brainwave data, automatically processes and analyzes the neural patterns, and adjusts its detection algorithms to the user's specific brain signature, enabling hands-free operation while minimizing the complexity burden through automated self-configuration.
Data Source
Figure 1~2
Figure 3~5
Figure 6A
AI summary
A system and method for manipulating a virtual object based on intent is described. A reference identifier from a physical object is captured. The reference identifier is communicated via a network to a remote server. The remote server includes virtual object data associated with the reference identifier. The virtual object data is received at the computing device. The virtual image is displayed in a virtual landscape using the virtual object data. In response to relative movement between the computing device and the physical object caused by a user, the virtual image is modified. Brain activity data of the user is received. A state of the virtual object in the virtual landscape is changed based on the brain activity data.