Wearable Display Gesture Input with Visual Posture Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users wearing wearable displays, such as head-mounted displays, face difficulties in inputting operations due to the lack of clear guidance on the extent of gestures required for interaction, leading to user stress and uncertainty.

Innovation Solution

An operation input apparatus and method that includes a posture acquisition unit, an operation input unit, and an indicator display unit, which acquires and displays the amount of posture change during gestures, allowing inputs only when the change exceeds a predetermined threshold, providing visual feedback to the user.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If gesture-based input is used in wearable displays, then hands-free operation is achieved, but user stress increases due to uncertainty about gesture magnitude

Engineering Contradiction:
Improvehands-free operationVSAvoiduser stress
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent implements real-time visual feedback by displaying an indicator that shows the current gesture magnitude and threshold requirement. This feedback loop allows users to see exactly how much movement is needed to trigger an operation, eliminating uncertainty and reducing stress while maintaining hands-free operation capability

Inventive Principle:
Principle #23Feedback

2Ease of operation

If gesture threshold is set low for easy input, then operation ease increases, but accidental inputs increase

Engineering Contradiction:
Improveoperation easeVSAvoidinput accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The visual indicator displays both the current gesture magnitude and the threshold value, allowing users to monitor their input in real-time. This transparency enables users to distinguish between intentional gestures (that meet the threshold) and accidental movements (that don't meet the threshold), improving input accuracy while maintaining ease of operation

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system prepares the threshold value in advance and displays it to the user before the gesture is completed. This allows users to adjust their gesture magnitude accordingly, ensuring that only deliberate actions trigger operations while preventing accidental inputs

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If external controllers are used for input, then input precision is maintained, but immersion experience is reduced

Engineering Contradiction:
Improveinput precisionVSAvoidimmersion experience
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The wearable display device itself performs the input detection function through built-in sensors, eliminating the need for external controllers. The system maintains input precision by using onboard sensors to detect head movements and other gestures, while simultaneously preserving immersion since users don't need to hold or look at external devices

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP3321776B1Operation input device and operation input method
Publication Date: 2020.09.30 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP3321776B1 patent drawingFigure 1
  • EP3321776B1 patent drawingFigure 2~3
  • EP3321776B1 patent drawingFigure 4

AI summary

A position and posture acquisition unit 730 acquires information on a posture of a user wearing a wearable display apparatus. An operation input unit 790 accepts an operation input through a gesture by the user. An indicator display unit 780 causes the wearable display apparatus to display an indicator indicating an amount of change in the posture of the user at the time the gesture is made. The operation input unit 790 accepts the operation input through the gesture when the amount of change in the posture exceeds a predetermined threshold value.