Interactive Display Screen Camera Placement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing touch responsive systems for large display screens face challenges in scaling due to high resistivity of indium tin oxide electrodes and cost, as well as camera-based optical systems that add bezel height and are susceptible to occlusions and ghost touches.

Innovation Solution

The implementation of an interactive display with cameras mounted within or behind the display cover glass, using scattered light to determine touch locations accurately without increasing bezel height, and minimizing occlusion effects through image data analysis from a single or multiple cameras.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional projected capacitance is used for large displays, then multi-touch capability is achieved, but high resistivity of indium tin oxide electrodes degrades signal quality and increases cost

Engineering Contradiction:
Improvesignal qualityVSAvoidelectrode resistivity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces the electrical conductivity-based touch detection (projected capacitance through ITO electrodes) with an optical detection system using cameras to sense light scattering from touch interactions, thereby avoiding the resistivity limitations of ITO electrodes on large displays

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces light scattering as an intermediary mechanism between the touch interaction and the camera sensor, where the touch object scatters light from the display which is then detected by the camera, enabling touch detection without direct electrical contact

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If camera-based optical touch systems are implemented, then touch detection is enabled, but significant bezel height is added around the display

Engineering Contradiction:
Improvetouch detection capabilityVSAvoidbezel height
Core Design Contradiction:
ReliabilityVSLength of stationary object

Solution Approach 1:

The patent transitions the camera from a traditional side-mounted position (adding bezel height) to a position behind the display plane, utilizing the z-dimension (depth) rather than the lateral dimensions, thereby enabling touch detection without increasing bezel height

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent embeds the camera system within the display structure itself, positioning the camera behind the display cover glass and integrating it into the existing display layers, so the camera occupies space within the display thickness rather than adding external bezel height

Inventive Principle:
Principle #7Nested doll (Nesting)

3Measurement precision

If cameras are positioned to detect touch from the side, then touch location can be determined, but occlusions and ghost touches occur due to sideways view angle

Engineering Contradiction:
Improvetouch location accuracyVSAvoiddetection accuracy
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent inverts the traditional camera positioning approach by placing the camera behind the display rather than in front, allowing light scattered from touch interactions to travel through the display layers and reach the camera from the opposite direction, thereby eliminating occlusion issues

Inventive Principle:
Principle #13The other way round (Inversion)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate determination of touch locations on large area displays without significant cost or size increases, effectively addressing the limitations of traditional multi-touch systems and camera-based optical touch systems.

Implementation Method 1

at least some of the light scattered from the object may be received by the cover glass and directed toward the camera

Methodology Applied
Scientific EffectTotal internal reflection: Total Internal Reflection

Data Source

PatentUS9921688B2Large area interactive display screen
Publication Date: 2018.03.20 QUALCOMM INC
  • US9921688B2 patent drawing
  • US9921688B2 patent drawing
  • US9921688B2 patent drawing

AI summary

An interactive display, including a cover glass having a front surface that includes a viewing area provides an input/output (I/O) interface for a user of an electronic device. An arrangement includes a processor, a light source, and a camera disposed outside the periphery of the viewing area coplanar with or behind the cover glass. The camera receives scattered light resulting from interaction, with an object, of light outputted from the interactive display, the outputted light being received by the cover glass from the object and directed toward the camera. The processor determines, from image data output by the camera, an azimuthal angle of the object with respect to an optical axis of the camera and/or a distance of the object from the camera.