Dynamic Image Compensation for Pre-Touch Localization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for determining the location of an object relative to a reflective surface, such as a display screen, often require specialized and costly devices like stereoscopic cameras or time-of-flight cameras, or need to be integrated into the device, making it difficult to add this functionality to existing computing devices without altering their appearance or usability.
Innovation Solution
A method using a single camera positioned adjacent to the reflective surface to acquire images, subtract dynamic elements from the images to identify the object and its reflection, and calculate three-dimensional coordinates to determine the object's location, allowing for interaction without physical contact and integration into various devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If stereoscopic cameras or time-of-flight cameras are used to determine object location, then measurement precision is improved, but device complexity and cost increase
Solution Approach 1:
The patent uses a standard camera to capture images of the object and its reflection in the display screen, creating a virtual copy of the object through the reflection. This allows the system to determine 3D location using a simple single camera instead of complex stereoscopic or time-of-flight cameras, resolving the contradiction between measurement precision and device complexity
Solution Approach 2:
The display screen acts as an intermediary element that reflects light from the object back to the camera. This reflection mechanism enables the system to obtain depth information without requiring specialized cameras, thus maintaining measurement precision while reducing device complexity
2Ease of operation
If touch screen technology is integrated into the device, then ease of operation is improved, but the visual appearance and usability are altered
Solution Approach 1:
The system uses a standard camera that can serve multiple functions (capturing images for various purposes) while also enabling non-contact interaction. This eliminates the need for specialized touch screen integration, maintaining the device's original appearance and structure while adding interaction capability
Solution Approach 2:
The patent replaces the need for physical touch screen integration with an optical system using light reflection. This substitution allows the device to maintain its original mechanical structure and visual appearance while gaining touch-like interaction capabilities through non-contact object detection
3Adaptability or versatility
If dynamic elements are displayed on the reflective surface, then adaptability is improved, but measurement precision deteriorates due to interference with reflection identification
Solution Approach 1:
The system employs temporal sampling by capturing images at different time points and comparing them to identify reflections. By analyzing changes between frames, the system can distinguish actual object reflections from dynamic display elements, maintaining measurement precision while allowing adaptive display functionality
Solution Approach 2:
The system uses feedback from multiple image captures and comparison algorithms to distinguish between dynamic display elements and actual object reflections. This feedback mechanism allows the display to show dynamic content while the system continuously monitors and identifies true reflections for accurate location determination
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate determination of an object's location using a single camera, facilitating non-contact interaction with computing devices and preventing contamination, while being adaptable to different reflective surfaces and environments, such as medical facilities or kitchens.
Implementation Method 1
A variety of interfaces are used to allow users of computing devices to interact... Optical imaging to determine the location of the user's finger or a stylus relative to the screen
Data Source
AI summary
An aspect of the disclosure includes a method, a system and a computer program product for removing dynamic images when determining the position of an object relative to a reflective surface. The method includes acquiring a first image of an object and the reflective surface with a camera, the camera positioned adjacent the reflective surface. It is determined when a dynamic element is displayed on the reflective surface. A second image is generated by subtracting the dynamic element from the first image. The object is identified in one of the first image and second image. A reflection of the object on the reflective surface is identified in the second image. Three-dimensional coordinates of at least a portion of the object are determined based at least in part on the identifying of the object and the identifying of the reflection of the object.