Optical Sensor Virtual Touch Screen Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a need for apparatus and methods that allow non-touch displays to be converted into touch displays, enabling user interaction in close proximity, as existing technologies require users to be at a distance for skeletal sensing or use separate input devices.
Innovation Solution
The use of one or more optical sensors, including depth sensors and cameras, to detect the position of a user's finger or pointer device relative to the display, providing indications and actions indicative of contact or selection within specific threshold distances, effectively converting non-touch displays into touch displays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If wireless motion sensors are used for skeletal sensing, then user interaction is enabled, but the user must be at a distance (more than 3 meters) from the display
Solution Approach 1:
The patent replaces wireless motion sensors with optical sensors (depth sensors and cameras) that use optical fields instead of mechanical/wireless sensing. This substitution enables the detection of finger positions and gestures at close proximity to the display surface, eliminating the need for users to be several meters away while maintaining interaction capability
Solution Approach 2:
The patent introduces optical sensors as an intermediary between the user's finger and the display. These sensors detect finger positions, gestures, and contact events by capturing optical information (depth maps, images) in the space between the finger and display, enabling touch interaction without direct physical contact or requiring distant skeletal sensing
2Ease of operation
If separate input devices (mouse or keyboard) are used, then input capability is provided, but direct interaction with the display is not possible
Solution Approach 1:
The patent makes the display serve multiple functions: it acts as both the visual output device and the input sensing surface. By placing optical sensors near the display, the system enables the display to detect finger positions, gestures, and contact events directly, combining the functions of display and touch input device into a single integrated system
Solution Approach 2:
The patent creates a virtual copy of touch interaction by using optical sensors to detect and track finger positions and gestures in the space near the display. This optical copying of finger movements allows the system to interpret these movements as touch inputs, enabling direct interaction without requiring physical contact with the display surface
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables any non-touch display to function as a touch display, allowing users to interact directly with the screen by detecting finger positions and providing feedback through visual cues and actions, enhancing user interaction capabilities.
Implementation Method 1
utilize one or more optical sensors to allow a non-touch display to behave like a touch display. In particular, an optical sensor is used to detect the position of a user's finger or other pointer device with respect to the display
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
Apparatus and methods are provided for converting a display into a touch display. One or more optical sensors are arranged proximate the display. A processor receives a signal from the optical sensor(s) and, based on the signal, executes instructions for: (i) determining a distance between a pointer device and a surface of the display signal; (ii) determining a position of the pointer device on the surface of the display; (iii) when the distance is less than a threshold detection distance and greater than a threshold touch distance, providing an indication on the display that the position of the pointer device has been determined; and (iv) when the distance is less than the threshold touch distance, taking an action indicative of contact between the pointer device and the surface of the display.