Projected Screen Touch Detection Using Multi-Method Finger Classification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Projection devices struggle to distinguish between intended and unintended user touches on projected screens, particularly differentiating between touches by a user's finger and other objects.
Innovation Solution
The method employs a camera to capture images of an area illuminated by a light emitter, using multiple methods to determine the probability of a touch being intended by a user's finger, including visual-based, projection-based, position tracking-based, cluster-based, screen interaction-based, and user style-based approaches, with a result decision module to make a final determination.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a single method is used to detect touch on projected screen, then device complexity is reduced, but measurement precision deteriorates due to inability to distinguish intended from unintended touches
Solution Approach 1:
The touch detection system is segmented into multiple independent detection methods (visual-based, projection-based, position tracking-based, cluster-based, screen interaction-based, user style-based), each analyzing different aspects of touch characteristics. This segmentation allows the system to achieve high measurement precision through comprehensive analysis while managing complexity by processing results from separate modular components.
Solution Approach 2:
Multiple detection methods are merged into a unified touch determination system that combines their results. The processor integrates information from all six detection methods to make a comprehensive determination of whether a touch is intended or unintended, achieving superior measurement precision that no single method could provide alone.
2Measurement precision
If multiple detection methods are applied, then measurement precision improves for distinguishing touch types, but device complexity increases
Solution Approach 1:
The complex task of touch intent differentiation is segmented into six specialized detection methods, each handling specific aspects such as visual characteristics, projection patterns, position changes, cluster analysis, screen interactions, and user style patterns. This segmentation enables the system to achieve high measurement precision through specialized analysis while organizing complexity into manageable functional modules.
Solution Approach 2:
The processor acts as an intermediary that receives data from all six detection methods and synthesizes their results to determine touch intent. This intermediary role allows the system to integrate complex information from multiple sources into a unified determination, managing processing complexity through systematic data fusion.
3Measurement precision
If comprehensive analysis of touch characteristics is performed, then measurement precision improves, but loss of time increases due to multiple analysis methods
Solution Approach 1:
The comprehensive touch analysis is divided into six parallel detection methods that can operate simultaneously or in overlapping time windows. Each method analyzes specific touch characteristics independently, allowing the system to achieve high measurement precision through comprehensive analysis while minimizing time loss by processing multiple aspects of touch data concurrently rather than sequentially.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Effectively distinguishes between intended and unintended touches on projected screens, enhancing interaction accuracy by utilizing a combination of image processing techniques to assess touch intentions.
Implementation Method 1
an infrared camera of the projection device may obtain an image by obtaining infrared rays that are emitted from an infrared emitter and then reflected while a screen is being projected from the projection device
Implementation Method 2
obtaining an image of an area formed by light emitted by the light emitter through the camera
Data Source
AI summary
An electronic device according to an embodiment may comprise a projector configured to project a screen, a light emitter, a camera, and at least one processor. The at least one processor may be configured to obtain an image of an area formed by light emitted by the light emitter through the camera while the screen is projected by the projector. The at least one processor may be configured to obtain probabilities that a touch on the area corresponds to a touch by a user's finger using a plurality of methods based on the obtained image, wherein the probabilities are obtained based on performing the plurality of methods, respectively. The at least one processor may be configured to determine whether the touch on the area is the touch by the user's finger based on the obtained probabilities.


