Interactive Projector Hand Shape Recognition Display

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing systems require users to memorize relationships between hand shapes and processing contents, making it difficult to easily realize the corresponding operations.

Innovation Solution

A display method that captures an image of the hand, determines the distance between the hand and an operation surface, recognizes the hand shape, and displays a selected operation icon on the surface when the hand is separated by a certain threshold distance, allowing users to easily understand the available operations based on hand shape.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the system requires users to memorize relationships between hand shapes and processing contents, then the system can perform operations based on hand shape recognition, but the ease of operation deteriorates because users cannot easily realize the corresponding operations

Engineering Contradiction:

Improvehand shape recognition capabilityVSAvoiduser understanding of operation correspondence

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system displays the operation icon that corresponds to the recognized hand shape in advance, before the user performs the operation. This preliminary display action allows users to understand what operation will be executed without needing to memorize hand shape-meaning relationships, thereby resolving the contradiction between adaptability and ease of operation

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system provides visual feedback by displaying the operation icon on the screen when a specific hand shape is detected. This feedback mechanism informs users about the recognized hand shape and its corresponding operation, making the system more intuitive and easier to operate while maintaining hand shape recognition capability

Inventive Principle:

Principle #23Feedback

2Productivity

If the system displays operation icons only when the hand is in contact with the operation surface, then the system can perform operations, but the ease of operation deteriorates because users cannot easily understand available operations before contact

Engineering Contradiction:

Improveoperation execution efficiencyVSAvoiduser understanding of available operations

Core Design Contradiction:

ProductivityVSEase of operation

Solution Approach 1:

The system displays the operation icon in advance, before the user's hand contacts the operation surface. This preliminary display allows users to understand what operation is available and prepare accordingly, improving ease of operation while maintaining efficient operation execution

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the display timing of operation icons based on hand position and contact state. By displaying icons in the separate state before contact, the system adapts to user needs and provides better usability without compromising operational efficiency

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS11073949B2Display method, display device, and interactive projector configured to receive an operation to an operation surface by a hand of a user

Publication Date: 2021.07.27 SEIKO EPSON CORP

AI summary

A display method includes (a) capturing an image including a hand, (b) determining a first distance as a distance between the hand and an operation surface, (c) recognizing a shape of the hand based on the image, and (d) displaying an operation icon selected in accordance with the shape of the hand out of a plurality of operation icons on the operation surface in a case of a separate state in which the first distance exceeds a first distance threshold value determined in advance.