Gesture Input via Video Capture for Display Devices

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing data input devices require dedicated hardware, are limited by environmental conditions such as weather, and restrict application scenarios due to spatial and directional constraints, especially in outdoor or public settings like video telephone conferences and digital signage.

Innovation Solution

A data input device that uses a position detection unit, drawing input detection unit, and image forming unit to capture and interpret user gestures without dedicated devices, allowing smooth data input by detecting positions and shapes of body parts through video capture, enabling operation in various orientations and environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a dedicated input device such as a pointer is used to input position information, then position input accuracy is improved, but application versatility deteriorates

Engineering Contradiction:

Improveposition input accuracyVSAvoidapplication versatility

Core Design Contradiction:

Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system allows multiple input methods including dedicated pointers and body part gestures to serve the same position input function, enabling the system to adapt to different application scenarios such as video conferences, presentations, and public displays without requiring separate dedicated devices for each scenario

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system captures images of body parts (face, hands, feet) and processes them as input devices, creating a virtual copy of the body part's position and movements to represent user input, thereby eliminating the need for physical dedicated input devices

Inventive Principle:

Principle #26Copying

2Speed

If an infrared beam is used for information transfer between the input device and the main unit, then communication speed is improved, but environmental adaptability deteriorates

Engineering Contradiction:

Improvecommunication speedVSAvoidenvironmental adaptability

Core Design Contradiction:

SpeedVSAdaptability or versatility

Solution Approach 1:

The system replaces the infrared beam communication mechanism with image capture and processing, substituting a mechanical/optical transmission system with a visual recognition system that is not affected by weather conditions, enabling outdoor and public space applications

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If a physical flat surface such as a desk or table is used as an information input surface, then drawing input accuracy is improved, but spatial flexibility deteriorates

Engineering Contradiction:

Improvedrawing input accuracyVSAvoidspatial flexibility

Core Design Contradiction:

Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system transitions from requiring a physical flat surface in three-dimensional space to using the two-dimensional display screen as the input surface, allowing users to interact from various distances and angles without needing a physical desk or table in front of them

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system captures images of body parts and uses the display screen itself as the reference surface for position detection, eliminating the need for a separate physical input surface and enabling flexible spatial arrangements

Inventive Principle:

Principle #26Copying

4Measurement precision

If a dedicated input device is required for each participant in a video telephone conference, then position input precision is improved, but device complexity deteriorates

Engineering Contradiction:

Improveposition input precisionVSAvoiddevice complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The display device integrates multiple functions including image display, image capture, and gesture recognition into a single unit, allowing all participants to use the same display device for input without requiring individual pointers or other dedicated input devices

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the display device's own image capturing device to detect gestures, eliminating the need for separate input devices and reducing overall system complexity while maintaining position input precision

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS10186057B2Data input device, data input method, and non-transitory computer readable recording medium storing data input program

Publication Date: 2019.01.22 SHARP KK

AI summary

In a data input device according to one aspect of the present invention, a position detection unit detects a first position based on a position of one part of a body of a user represented in a video captured by an image capturing device and a second position based on a position of another part of the body. A drawing input detection unit establishes, based on the first position, an input detection region in which a drawing input is detected, and detects, based on whether or not the second position is included in the input detection region, the drawing input. A position-of-interest detection unit detects a position-of-interest corresponding to the second position on an image display plane. An image forming unit forms an image indicating a position-of-interest in a case that the drawing input detection unit detects the drawing input.