Gesture Control via Image Input for Intuitive Device Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current electronic devices lack intuitive and efficient methods for users to perform operations through gestures, limiting the convenience and speed of interacting with user interfaces.

Innovation Solution

An apparatus, method, and recording medium that utilize an input image to recognize and execute specific gestures, allowing users to control electronic devices by mapping gesture forms to corresponding operations, enabling easier operation of electronic devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional user interfaces are used, then device functionality is provided, but user operation convenience and interaction speed are limited

Engineering Contradiction:
Improveuser operation convenienceVSAvoidinteraction speed
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent replaces traditional mechanical input methods (keyboard, mouse, touch screen) with a camera-based gesture recognition system. The camera captures images of user gestures, and the system automatically recognizes and executes corresponding operations, eliminating the need for physical interaction with traditional input devices and significantly improving both ease of operation and interaction speed.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If gesture recognition is implemented, then operation convenience is improved, but device complexity increases

Engineering Contradiction:
Improvegesture-based controlVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent makes the existing camera serve multiple functions: its primary function for capturing images is enhanced with a secondary function for gesture recognition. By reusing the camera hardware and integrating gesture recognition software into the existing system, the patent avoids adding dedicated gesture sensing devices, thereby improving ease of operation while minimizing the increase in device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11513608B2Apparatus, method and recording medium for controlling user interface using input image
Publication Date: 2022.11.29 SAMSUNG ELECTRONICS CO LTD
  • US11513608B2 patent drawing
  • US11513608B2 patent drawing
  • US11513608B2 patent drawing

AI summary

A method of controlling a user interface using an input image is provided. The method includes storing operation executing information of each of one or more gesture forms according to each of a plurality of functions, detecting a gesture form from the input image, and identifying the operation executing information mapped on the detected gesture form to execute an operation according to a function which is currently operated.