Non-Contact Gesture Control via Image Feature Extraction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing systems fail to allow users to operate objects in real space without physical contact, limiting the convenience and versatility of interacting with devices and environments.

Innovation Solution

An information processing apparatus that detects user motion between a display surface and the object to be operated, allowing the user to perform actions without touching the display, by using a smartphone to capture images of the user's gestures and instructing the object to execute corresponding operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If contact-based operation through display surface is used, then operation reliability is ensured, but operation convenience and versatility are limited

Engineering Contradiction:

Improveoperation convenienceVSAvoidinteraction versatility

Core Design Contradiction:

Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent introduces an image processing apparatus as an intermediary that captures images of the user and the object, extracts feature amounts from these images, and determines operations based on the relationship between user features and object features. This intermediary system enables non-contact operation while maintaining reliability, resolving the contradiction between operation convenience and interaction versatility.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If non-contact gesture operation is implemented, then operation versatility is enhanced, but detection precision and reliability may deteriorate

Engineering Contradiction:

Improveinteraction versatilityVSAvoidgesture detection precision

Core Design Contradiction:

Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent replaces direct mechanical contact-based operation with an optical/image processing system. By using image capture and feature amount extraction instead of physical contact, the system achieves non-contact operation versatility while maintaining detection precision through sophisticated image analysis algorithms that extract meaningful features from captured images.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If complex image processing is used to detect user motion, then detection precision improves, but device complexity increases

Engineering Contradiction:

Improvemotion detection precisionVSAvoidprocessing system complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the necessary feature amounts from captured images that are relevant for determining user operations. By selectively extracting specific features rather than processing all image data, the system maintains high detection precision while reducing computational complexity and processing requirements.

Inventive Principle:

Principle #2Taking out (Extraction)

Data Source

PatentUS11265428B2Information processing apparatus and non-transitory computer readable medium for operating a target object in a real space through a virtual interface by detecting a motion of a user between a display surface displaying the virtual interface and the user

Publication Date: 2022.03.01 FUJIFILM BUSINESS INNOVATION CORP

AI summary

An information processing apparatus includes a detection unit and a control unit. The detection unit detects motion of a user made between a display surface that displays an image of an object to be operated and the user. The motion is made without contact with the display surface. The control unit instructs the object to execute an operation corresponding to the detected motion of the user.