3D Virtual Keyboard via Barrier and Capacitive Sensing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current three-dimensional display devices lack the capability to seamlessly integrate interactive operations, such as inputting commands, without the need for physical contact, and struggle to provide an immersive out-of-screen virtual keyboard experience.
Innovation Solution
A three-dimensional display device incorporating a display module, a barrier module to create stereoscopic views, and a sensing module with capacitive sensing units or CMUT arrays to detect hovering actions, allowing users to interact with virtual input devices like keyboards without physical contact.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a traditional physical keyboard is used for interaction, then input accuracy is improved, but device portability and immersion are worsened
Solution Approach 1:
The patent creates a virtual copy of the keyboard interface in three-dimensional space that can be interacted with through sensing technology. Instead of using a physical keyboard, the system projects a virtual keyboard image and detects user input through capacitive or ultrasonic sensing, thereby achieving accurate input without requiring physical hardware
Solution Approach 2:
The patent replaces the mechanical keyboard system with a sensing-based interaction system. Physical key presses are substituted with touchless detection methods including capacitive sensing and CMUT (capacitive micromachined ultrasonic transducer) arrays that detect hovering actions, eliminating the need for mechanical components while maintaining input accuracy
2Ease of operation
If touchless sensing is implemented, then ease of operation is improved, but measurement precision is worsened
Solution Approach 1:
The sensing system is divided into multiple independent sensing units arranged in arrays. Capacitive sensing units are distributed across the display surface, and CMUT elements are arranged in arrays, allowing precise localization of touchless input by determining which specific sensing unit detects the hovering action
Solution Approach 2:
The system continuously monitors sensing signals from capacitive or CMUT sensors and provides real-time feedback to determine when a hovering action has occurred. The controller processes sensing signals to generate input commands, creating a closed-loop system that enhances detection accuracy through continuous monitoring and signal processing
3Adaptability or versatility
If out-of-screen virtual display is used, then immersion is improved, but device complexity is worsened
Solution Approach 1:
The patent extends the display from two-dimensional screen space into three-dimensional virtual space. The virtual keyboard is rendered with depth perception capabilities, creating an out-of-screen effect where the keyboard appears to float in front of the display, adding a spatial dimension to the user interface
Solution Approach 2:
The display module serves multiple functions: it displays visual content, projects virtual three-dimensional images, and acts as a sensing surface for touchless input detection. The barrier module simultaneously enables three-dimensional display and works with the sensing module to detect hovering actions, reducing overall system complexity through multi-functionality
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables users to interact with virtual input devices in three-dimensional space, enhancing user experience by allowing touchless input commands and providing an immersive out-of-screen virtual keyboard interface.
Implementation Method 1
the barrier module is configured to allow light emitted from the first set of pixels to be viewable only by a left eye of the viewer, and allow light emitted from the second set of pixels to be viewable only by a right eye of the viewer
Implementation Method 2
The sensing module includes a plurality of capacitive sensing units in a capacitive matrix. Each of the capacitive sensing units is configured to receive one of the scan signals generated by the sensing control module, to generate the sensing signal in response to detecting the object
Implementation Method 3
The capacitive sensing units are capacitive micromachined ultrasonic transducer (CMUT) arrays, and each of the CMUT arrays includes a plurality of CMUT units. Each of the CMUT arrays is configured to transmit ultrasonic waves and to receive refracted ultrasonic waves by the objects
Data Source
AI summary
Certain aspects direct to a three-dimensional display device, which includes a display module defining a plurality of pixels, a barrier module, a sensing module, and a controller. For a viewer of the display module, the barrier module allows the viewer to perceives light emitted from the display module to form left-eye and right-eye views to form a three-dimensional virtual image. The sensing module generates sensing signals in response to detecting an object. The controller is configured to generate display signals for the display module to control the pixels, receive the sensing signals from the sensing module, and generate an object coordinate according to the sensing signals. In response to a display instruction, the controller controls the display module to display a three-dimensional virtual input device. In response to the object coordinate matching coordinates of an input region of the three-dimensional virtual input device, the controller generates an input command.