Optical Object Recognition for Half-Shutter Input Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In electronic devices like smartphones, it is difficult to distinguish between half-shutter and full-shutter inputs without a physical shutter button, leading to challenges in predicting when a full-shutter input is provided and performing the half-shutter function effectively.

Innovation Solution

A method using optical object recognition, where a shutter button is displayed on a display panel with light sources, and images are obtained to detect a half-shutter input by determining the presence of a specific object state, allowing for the performance of half-shutter processes without a physical shutter button.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a physical shutter button is removed to increase display size and reduce device thickness, then device compactness and display area are improved, but the ability to distinguish half-shutter and full-shutter inputs deteriorates

Engineering Contradiction:
Improvedisplay areaVSAvoidinput distinction capability
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The patent merges the shutter button functionality with the display panel by implementing a virtual shutter button that uses the same touch sensor and optical object recognition sensor as the rest of the display. This allows the shutter button to be integrated into the display area without requiring separate physical components, thus maintaining input distinction capability while maximizing display size.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent replaces the mechanical physical shutter button with an optical detection system. The optical object recognition sensor detects the state of the object (finger) on the virtual shutter button area, distinguishing between half-press and full-press states through optical characteristics rather than mechanical movement, enabling input distinction without physical buttons.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If optical object recognition is implemented to detect half-shutter input, then input detection capability is improved, but power consumption increases due to continuous light source operation

Engineering Contradiction:
Improvehalf-shutter input detectionVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic action by controlling the light sources to be driven only when a touch input is detected or when the system is in an active state requiring input detection. The light sources are not continuously operated but are activated periodically or event-driven, reducing power consumption while maintaining the ability to detect half-shutter inputs when needed.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent applies preliminary action by performing preparatory image capturing functions (focus adjustment, exposure adjustment) when a half-shutter input is detected, rather than waiting for the full-shutter input. This preliminary processing reduces the overall power consumption by completing preparatory tasks during the half-press state when the device is already activated for detection.

Inventive Principle:
Principle #10Preliminary action

3Loss of time

If preparatory image capturing functions are performed during half-shutter state, then shooting preparation time is reduced, but processing time and complexity increase

Engineering Contradiction:
Improveshutter lagVSAvoidprocessing complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent implements preliminary action by performing focus adjustment, exposure adjustment, and other preparatory image capturing functions during the half-shutter state, before the actual full-shutter capture. This eliminates shutter lag by having the system ready to capture immediately when the user presses the shutter button fully, as all preparatory processing is already complete or in progress.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies dynamics by making the processing complexity adaptive - the system dynamically adjusts the level of processing based on the detected input state. During half-shutter state, preparatory processing is performed at a moderate level, and upon full-shutter detection, the system transitions to full capture processing. This dynamic approach manages complexity by spreading processing loads across different time states rather than performing all processing simultaneously.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables efficient identification of half-shutter inputs and reduces power consumption by performing preparatory image capturing functions like focus and exposure adjustments before actual image capture, maintaining device size and thickness without a physical shutter button.

Implementation Method 1

a shutter button is displayed on a display panel by driving a portion of a plurality of light sources included in the display panel

Methodology Applied
Scientific EffectLight emission from display panel light sources: Light Emitting Diode

Implementation Method 2

A first image is obtained based on reflected light received by an object recognition sensor through the object recognition window

Methodology Applied
Scientific EffectOptical detection and light reflection: Reflection

Data Source

PatentUS11347353B2Method of performing half-shutter function using optical object recognition and method of capturing image using the same
Publication Date: 2022.05.31 SAMSUNG ELECTRONICS CO LTD
  • US11347353B2 patent drawing
  • US11347353B2 patent drawing
  • US11347353B2 patent drawing

AI summary

Provided is a method of performing a half-shutter function using optical object recognition, the method including: displaying a shutter button on a display panel by driving a portion of a plurality of light sources included in the display panel, the portion of the plurality of light sources being disposed corresponding to an object recognition window of the display panel; obtaining a first image based on reflected light received by an object recognition sensor through the object recognition window while driving the portion of the plurality of light sources; determining whether the first image includes a first object, the first object having a half-shutter state; and based on a determination that the first image includes the first object having the half-shutter state, performing a half-shutter process.