Non-Touch Screen Gesture Control via Proximity Sensor Array
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing one-dimensional arrays of proximity sensors are not accurate enough to determine a two-dimensional location of a pointer within a two-dimensional plane, limiting the ability to enable touch screen functionality on non-touch screen devices and providing intuitive user interfaces that track user attention.
Innovation Solution
A user interface system incorporating a multi-faceted housing with an eye tracker and a proximity sensor, where the eye tracker identifies the user's gaze and the proximity sensor detects gestures, allowing the processor to map gestures to the appropriate application control, enabling intuitive touch screen functionality on non-touch screen devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a one-dimensional array of proximity sensors is used, then the device structure is simple, but the measurement precision of two-dimensional location is insufficient
Solution Approach 1:
The patent transitions from a one-dimensional array of proximity sensors to a two-dimensional array arrangement. This dimensional change enables the sensor system to accurately determine two-dimensional location coordinates (x, y) of the pointer tip on the touch screen surface, resolving the limitation of insufficient measurement precision while maintaining a relatively simple sensor array structure.
2Ease of operation
If non-touch screen devices are used, then the device simplicity is maintained, but the user interaction intuitiveness is limited
Solution Approach 1:
The patent replaces the need for a physical touch screen with an optical detection system using proximity sensors. The system detects gestures and pointer locations through light field changes in the air space above the display, enabling touch-like interaction on non-touch screen devices without requiring a capacitive or resistive touch panel structure.
3Measurement precision
If proximity sensors are used to detect gestures, then touch screen functionality is enabled, but the detection accuracy of gesture location is insufficient
Solution Approach 1:
The patent employs a two-dimensional array of proximity sensors that can simultaneously detect multiple gesture locations and track pointer tip coordinates (x, y) across the entire touch screen surface. This dimensional expansion enables accurate gesture location detection while maintaining high productivity through parallel detection capabilities across the sensor array.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate detection of gestures and user attention, allowing non-touch screen devices to function like touch screens, enhancing user interaction with swipe, pinch, and rotate gestures, and providing more intuitive interfaces.
Implementation Method 1
a light emitter mounted in the housing, the light emitter being operable when activated to project a light beam through the housing
Implementation Method 2
a light detector mounted in the housing, the light detector being operable when activated to output a measure of an amount of light arriving at the detector
Data Source
AI summary
A method for interacting with controls in a graphical user interface (GUI) having a plurality of GUI controls, the method includes identify one GUI control that a user is gazing at, from among a plurality of GUI controls presented on a display, detect user interface gestures performed by the user, when the detected gesture is performed in an airspace away from the display, apply a relative motion corresponding to the gesture to the identified GUI control, and when the detected gesture is performed by the user touching the display, apply a sequence of absolute display locations touched by the gesture to a GUI control presented at the touched locations that is different than the identified GUI control.