Camera Module Gesture Control for Proximity-Based Device Interaction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional man-machine interfaces (MMIs) face limitations when manual manipulation of electronic devices is prevented, particularly in environments where loud noises or talking are not feasible, as they rely on manual input methods or voice control, which are inadequate in such scenarios.

Innovation Solution

A method and system utilizing a digital camera module and a sensor module in electronic devices to enable contactless control by capturing images of objects in proximity, such as hands or pens, and analyzing these images to perform control operations, allowing for gesture-based control of electronic devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual input devices (keyboard, mouse, touch screen) are used, then control precision is improved, but ease of operation deteriorates when manual manipulation is prevented

Engineering Contradiction:

Improvecontrol precisionVSAvoidease of operation

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces manual mechanical input devices (keyboard, mouse, touch screen) with an optical recognition system using a camera module to capture images of hand gestures or objects, thereby enabling control without physical contact while maintaining control precision through image analysis and pattern recognition

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If voice control is implemented, then ease of operation is improved in non-contact scenarios, but adaptability deteriorates in environments requiring no loud noises or talking

Engineering Contradiction:

Improveease of operationVSAvoidenvironmental adaptability

Core Design Contradiction:

Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent introduces an optical intermediary (camera module capturing images of hand gestures or objects) as a mediator between the user and the electronic device, enabling non-contact control that works in environments where voice control is inappropriate, thus improving both ease of operation and environmental adaptability

Inventive Principle:

Principle #24Intermediary (Mediator)

3Speed

If camera module is continuously active to capture gestures, then control responsiveness is improved, but energy consumption increases

Engineering Contradiction:

Improvecontrol responsivenessVSAvoidenergy consumption

Core Design Contradiction:

SpeedVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic action by activating the camera module only when a hand or object is detected in proximity to the device, rather than keeping it continuously active. This approach maintains control responsiveness by quickly capturing gestures when needed while significantly reducing energy consumption by keeping the camera off during normal operation

Inventive Principle:

Principle #19Periodic action

Data Source

PatentUS8896536B2Methods and systems for contactlessly controlling electronic devices according to signals from a digital camera and a sensor module

Publication Date: 2014.11.25 TAIWAN SEMICONDUCTOR MANUFACTURING CO LTD

AI summary

An embodiment of a method for contactlessly controlling an electronic apparatus, performed by a processor of the electronic apparatus. A camera module of the electronic apparatus is turned on to capture a series of images upon detecting that an object is in close proximity to the electronic apparatus. A contactless control procedure is performed while the camera module thereof is in use. The control operation comprises determining a control operation according to the captured images; performing the control operation to an electronic device of the electronic apparatus upon obtaining an instruction based on analyzing the captured images; and turning off the camera module responsive to not obtaining an instruction within a predetermined time period.