Capacitive Gesture Control for 3D Aerial AR Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional augmented reality (AR) systems require users to constantly switch their line of sight between a 2D display and the real world, making it inconvenient and sometimes impossible to interact with AR applications, especially in scenarios where direct hand contact with the screen is not feasible, such as cooking or driving.
Innovation Solution
A system that detects non-contact hand gestures using capacitive sensing to control the aerial display of images in a 3D space above a touch screen, allowing users to interact with AR applications without touching the screen or looking at the display, using gestures like grab, pull, and crush to engage and disengage the aerial display mode.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional AR mode projects UI graphics on a 2D display screen, then users can see AR objects combined with real image, but users must frequently move line of sight between the display and the real world
Solution Approach 1:
The patent projects UI graphics and AR objects from a 2D display screen into 3D space above the display, allowing users to interact with virtual objects in three-dimensional space while maintaining a natural viewpoint of the real world, eliminating the need to shift gaze between screen and reality
2Adaptability or versatility
If users need to interact with AR application while cooking, then users can access cooking instructions, but users cannot physically touch the display screen due to dirty hands
Solution Approach 1:
The patent replaces mechanical contact-based touchscreen interaction with capacitive sensing that detects hand gestures and proximity without requiring physical contact, allowing users with dirty hands to interact with the interface by hovering or gesturing above the screen
Solution Approach 2:
The system introduces capacitive field detection as an intermediary between the user's hand and the touchscreen, enabling interaction through the detection of capacitive changes caused by proximity or gestures without direct contact
3Ease of operation
If users want to view AR content without looking at the display, then users can maintain focus on real world tasks, but traditional AR requires staring at the 2D display to see AR objects
Solution Approach 1:
The patent projects AR content into 3D space above the display, making virtual objects visible and interactable in the user's peripheral vision without requiring direct gaze at the screen, thus preventing loss of AR content visibility while enabling hands-free operation
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables users to interact with AR applications in a more intuitive and convenient manner by projecting images and UI elements into the 3D space, allowing hands-free control and reducing the need to constantly look at the screen, enhancing usability in various contexts.
Implementation Method 1
detecting a capacitive response of a non-contact gesture made by a user proximate to a touch sensing enabled display screen
Data Source
AI summary
A method for displaying aerial images includes detecting a capacitive response of a non-contact gesture made by a user proximate to a touch sensing enabled display screen, and in response to detecting the non-contact gesture, displaying one or more images in a three-dimensional (3D) space proximate to the display screen.