Gesture Motion Guide Display Control for Remote Input Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing gesture recognition systems for remote control devices do not clearly indicate which gesture motions are inputtable or whether a detected gesture motion has been correctly recognized and processed.

Innovation Solution

A display control device and method that displays a guide for gesture motions in a first state and changes the guide to a second state upon detection, corresponding to the detected gesture motion, allowing users to easily identify recognized inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a touch panel is used for gesture control, then the remote controller can perform gesture-based operations, but it becomes difficult to determine which gestures are inputtable and whether detected gestures are correctly recognized

Engineering Contradiction:
Improvegesture control capabilityVSAvoidfeedback information about gesture recognition
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent implements a feedback mechanism by displaying the detected gesture motion on the touch panel after detection. The display unit shows the recognized gesture in a second state, providing visual feedback to the user about whether the gesture was correctly detected and what control signal will be transmitted. This resolves the information loss problem by continuously informing users of the system's perception state.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent uses different display states (first state and second state) to indicate different conditions. The guide for gesture motion is displayed in a first state during normal operation, and changes to a second state when a gesture is detected, providing clear visual differentiation that helps users understand the system's response to their inputs.

Inventive Principle:
Principle #32Color changes

2Ease of operation

If gesture motions are detected without visual feedback, then the system remains simple to operate, but users cannot easily notice which gestures are inputtable or correctly recognized

Engineering Contradiction:
Improvegesture input simplicityVSAvoiduser confidence in gesture recognition
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

By displaying the detected gesture motion on the touch panel, the system provides reliable feedback that enhances user confidence. Users can see exactly what the system has detected and what action will be taken, making the interaction more trustworthy without adding significant complexity to the operation.

Inventive Principle:
Principle #23Feedback

3Stability of the object's composition

If the guide for gesture motion is always displayed in the same state, then the display is simple and consistent, but inputtable gestures are not easy to notice

Engineering Contradiction:
Improvedisplay consistencyVSAvoidgesture input visibility
Core Design Contradiction:
Stability of the object's compositionVSEase of operation

Solution Approach 1:

The patent makes the display dynamic by changing the guide's appearance from a first state to a second state when a gesture is detected. This dynamic behavior highlights the inputtable gestures and provides feedback without disrupting the overall consistency and stability of the display interface during normal operation.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9524095B2Display control device, display control method, and program
Publication Date: 2016.12.20 SONY GROUP CORP
  • US9524095B2 patent drawing
  • US9524095B2 patent drawing
  • US9524095B2 patent drawing

AI summary

The present technique relates to a display control device, a display control method, and a program that are capable of making inputtable gesture motions easy to notice. A display control unit causes a display unit to display a gesture motion guide in a first state. When a detecting unit for detecting gesture motions detects a predetermined gesture motion, the display control unit changes the guide corresponding to the detected gesture motion to a second state and then causes the display unit to display the guide. The technique according to this disclosure can be applied to an information processing terminal that includes a display unit, for example.