Object Sensing Apparatus Dynamic Light and Camera Calibration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing touch interaction technologies face challenges in accurately identifying object touch regions on displays due to issues like low resolution and brightness variations, which affect the ability to determine the position of objects touched or hovered over, especially when using infrared light sources and cameras.

Innovation Solution

The apparatus includes a display with a pattern layer, a light source, and cameras that emit and reflect infrared light, with a controller adjusting the light source's brightness and camera exposure time based on pattern images to optimize calibration and image quality, allowing for precise identification of object touch regions through computer vision methods.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a light source and camera are used to capture pattern images for object detection, then object touch region detection capability is enabled, but image quality deteriorates due to low resolution and brightness variations

Engineering Contradiction:
Improveobject touch region detection accuracyVSAvoidimage resolution and brightness consistency
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The controller dynamically adjusts the brightness of the light source and the exposure time of the camera based on the captured pattern image quality. When the pattern image is dim or low-resolution, the controller increases light source brightness and/or extends camera exposure time to improve image quality for accurate object detection

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system captures a pattern image, evaluates its quality (brightness and resolution), and uses this feedback to automatically adjust light source brightness and camera exposure parameters. This closed-loop control ensures optimal image quality for consistent object touch region detection

Inventive Principle:
Principle #23Feedback

2Illumination intensity

If the light source brightness is increased to improve image quality, then pattern image brightness improves, but energy consumption increases

Engineering Contradiction:
Improvepattern image brightnessVSAvoidlight source energy consumption
Core Design Contradiction:
Illumination intensityVSUse of energy by moving object

Solution Approach 1:

The light source brightness is made dynamic rather than fixed. The controller adjusts the light source intensity in real-time based on the actual imaging conditions and pattern image quality requirements, consuming more energy only when necessary for low-light conditions

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the operational parameters of the light source (brightness level) and camera (exposure time) based on detected pattern image quality. This allows the system to achieve adequate illumination with minimal energy consumption by using higher brightness only when the pattern image is dim

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If camera exposure time is extended to improve image quality, then pattern image resolution improves, but detection speed decreases

Engineering Contradiction:
Improvepattern image resolutionVSAvoidobject detection speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The camera exposure time is dynamically adjusted based on imaging conditions. The controller extends exposure time only when the pattern image is dim or low-resolution, and uses shorter exposure times when conditions are favorable, thus balancing image quality and detection speed

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enhances the accuracy and reliability of object touch region detection by compensating for image distortions and variations, ensuring high-resolution and appropriate brightness images are captured, thereby improving multi-touch interaction capabilities.

Implementation Method 1

a light source that emits infrared rays (IR) and an IR camera are used. More particularly, the digital pen emits IRs to recognize a pattern of a display, a camera captures an IR internally reflected by an IR emitter

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Implementation Method 2

a camera configured to generate a pattern image based on light reflected off of the pattern layer

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS9778796B2Apparatus and method for sensing object, and method of identifying calibration pattern in object sensing apparatus
Publication Date: 2017.10.03 SAMSUNG ELECTRONICS CO LTD
  • US9778796B2 patent drawing
  • US9778796B2 patent drawing
  • US9778796B2 patent drawing

AI summary

At least one example embodiment discloses an apparatus for sensing an object, the apparatus including a display, a light source configured to emit light toward the display, a pattern layer on the display, the pattern layer including a first pattern for identifying a position on the display, a camera configured to generate a pattern image based on light reflected off of the pattern layer, and a controller configured to adjust an operation of at least one of the light source and the camera based on a second pattern displayed in the pattern image.