Depth Sensing Module for Display Interaction Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing display technologies without native touch screen functionality face challenges in detecting interactions due to occlusion and cost constraints of implementing touch sensing capabilities, particularly on larger displays.

Innovation Solution

The implementation of a depth sensing module that projects light onto a display surface, using infrared emitters and image sensors to capture reflections and determine interaction points, combined with additional visible light sensors for enhanced fidelity and error reduction, allowing for interaction detection on displays without native touch capabilities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If touch sensing capabilities are implemented on displays, then interaction detection capability is improved, but device cost increases

Engineering Contradiction:
Improveinteraction detection capabilityVSAvoiddevice cost
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent replaces mechanical touch sensing systems with an optical detection system. A light source projects light onto the display surface, and a camera captures reflections to detect interactions. This substitution eliminates the need for expensive touch sensor layers while maintaining interaction detection capability through optical reflection analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates an optical copy or representation of the interaction through light reflection patterns. By capturing the reflection of projected light on the display surface, the system generates a visual copy of the interaction point that can be analyzed by image processing algorithms, enabling touch detection without physical sensors.

Inventive Principle:
Principle #26Copying

2Measurement precision

If depth sensing module is used to detect interactions, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improveinteraction point detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the camera serve multiple functions: it acts as both a standard display camera for capturing content and a depth sensor for interaction detection. By utilizing the camera's existing imaging capability for dual purposes, the system achieves precise interaction point detection without adding dedicated depth sensing hardware, thus reducing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses its own displayed content as the light source for interaction detection. The display itself projects light that reflects off interaction points, eliminating the need for separate external light sources. This self-service approach simplifies the system architecture while maintaining measurement precision.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution effectively identifies interaction points with increased fidelity and accuracy, enabling touch-like interactions on displays without native touch functionality, while reducing errors caused by occlusion and ambient light interference.

Implementation Method 1

using infrared emitters and image sensors to capture reflections and determine interaction points

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

The depth sensing module may include an infrared emitter to project light, as discussed above

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Data Source

PatentUS10101817B2Display interaction detection
Publication Date: 2018.10.16 INTEL CORP
  • US10101817B2 patent drawing
  • US10101817B2 patent drawing
  • US10101817B2 patent drawing

AI summary

Techniques for interaction detection are described herein. The techniques may include detecting, via a depth sensing module, a physical object at a plane of a display. The techniques may also include detecting, via the depth sensing module, a reflection of the physical object at the plane of the display. An interaction module may identify an interaction of the physical object with the display based on a meeting point of the detected physical object and the detected reflection.