Projected Screen Touch Detection Using Multi-Method Finger Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Projection devices struggle to distinguish between intended and unintended user touches on projected screens, particularly differentiating between touches by a user's finger and other objects.

Innovation Solution

The method employs a camera to capture images of an area illuminated by a light emitter, using multiple methods to determine the probability of a touch being intended by a user's finger, including visual-based, projection-based, position tracking-based, cluster-based, screen interaction-based, and user style-based approaches, with a result decision module to make a final determination.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a single method is used to detect touch on projected screen, then device complexity is reduced, but measurement precision deteriorates due to inability to distinguish intended from unintended touches

Engineering Contradiction:
Improvetouch detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The touch detection system is segmented into multiple independent detection methods (visual-based, projection-based, position tracking-based, cluster-based, screen interaction-based, user style-based), each analyzing different aspects of touch characteristics. This segmentation allows the system to achieve high measurement precision through comprehensive analysis while managing complexity by processing results from separate modular components.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple detection methods are merged into a unified touch determination system that combines their results. The processor integrates information from all six detection methods to make a comprehensive determination of whether a touch is intended or unintended, achieving superior measurement precision that no single method could provide alone.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If multiple detection methods are applied, then measurement precision improves for distinguishing touch types, but device complexity increases

Engineering Contradiction:
Improvetouch intent differentiation accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The complex task of touch intent differentiation is segmented into six specialized detection methods, each handling specific aspects such as visual characteristics, projection patterns, position changes, cluster analysis, screen interactions, and user style patterns. This segmentation enables the system to achieve high measurement precision through specialized analysis while organizing complexity into manageable functional modules.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The processor acts as an intermediary that receives data from all six detection methods and synthesizes their results to determine touch intent. This intermediary role allows the system to integrate complex information from multiple sources into a unified determination, managing processing complexity through systematic data fusion.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If comprehensive analysis of touch characteristics is performed, then measurement precision improves, but loss of time increases due to multiple analysis methods

Engineering Contradiction:
Improvetouch classification accuracyVSAvoidtouch detection response time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The comprehensive touch analysis is divided into six parallel detection methods that can operate simultaneously or in overlapping time windows. Each method analyzes specific touch characteristics independently, allowing the system to achieve high measurement precision through comprehensive analysis while minimizing time loss by processing multiple aspects of touch data concurrently rather than sequentially.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Effectively distinguishes between intended and unintended touches on projected screens, enhancing interaction accuracy by utilizing a combination of image processing techniques to assess touch intentions.

Implementation Method 1

an infrared camera of the projection device may obtain an image by obtaining infrared rays that are emitted from an infrared emitter and then reflected while a screen is being projected from the projection device

Methodology Applied
Scientific EffectLight emission and reflection: Light

Implementation Method 2

obtaining an image of an area formed by light emitted by the light emitter through the camera

Methodology Applied
Scientific EffectImage capture: Photography

Data Source

PatentUS20260050347A1Method for providing interaction with projected screen and electronic device supporting the same
Publication Date: 2026.02.19 SAMSUNG ELECTRONICS CO LTD
  • US20260050347A1 patent drawing
  • US20260050347A1 patent drawing
  • US20260050347A1 patent drawing

AI summary

An electronic device according to an embodiment may comprise a projector configured to project a screen, a light emitter, a camera, and at least one processor. The at least one processor may be configured to obtain an image of an area formed by light emitted by the light emitter through the camera while the screen is projected by the projector. The at least one processor may be configured to obtain probabilities that a touch on the area corresponds to a touch by a user's finger using a plurality of methods based on the obtained image, wherein the probabilities are obtained based on performing the plurality of methods, respectively. The at least one processor may be configured to determine whether the touch on the area is the touch by the user's finger based on the obtained probabilities.