HMD Numerical Value Setting via Gesture Mode Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulty in performing delicate operations with virtual user interfaces, particularly in numerical value setting, due to the lack of tactile feedback, leading to slower and less accurate settings compared to non-virtual interfaces.

Innovation Solution

A control apparatus for a head-mounted display that displays the numerical value setting user interface at a remote position out of reach, allowing for gesture recognition to switch between rough and fine adjustment modes, and includes a mask processing unit to address the absence of tactile feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a virtual user interface is used for numerical value setting, then the user can operate the interface without physical contact, but the user lacks tactile feedback making delicate operations difficult

Engineering Contradiction:
Improvecontactless operationVSAvoidnumerical value setting accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent divides the numerical value setting operation into two distinct modes: rough adjustment mode for quick coarse adjustments and fine adjustment mode for precise setting. This segmentation allows the user to first rapidly approach the target value using rough adjustment, then switch to fine adjustment for accurate positioning, thereby achieving both efficiency and precision without tactile feedback

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent dynamically changes the adjustment granularity based on the current mode. In rough adjustment mode, larger value changes are permitted for quick positioning, while in fine adjustment mode, smaller value changes are enabled for precise setting. This dynamic adaptation of operation characteristics allows the system to optimize between speed and accuracy based on the user's current needs

Inventive Principle:
Principle #15Dynamics

2Loss of information

If the numerical value setting interface is displayed at a remote position, then the virtual objects remain visible, but the user has even less sense of touch for delicate operations

Engineering Contradiction:
Improvevisibility of virtual objectsVSAvoidoperational feel
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent implements visual feedback mechanisms to compensate for the lack of tactile feedback when operating at remote positions. The system provides clear visual indicators showing the current numerical value, the target value, and the user's progress toward the target. This enhanced visual feedback allows users to perform delicate operations accurately even without physical contact or proximity-based tactile sensation

Inventive Principle:
Principle #23Feedback

3Measurement precision

If the user performs repeated touch operations to set the numerical value, then the user can achieve accurate setting, but the setting process takes too much time

Engineering Contradiction:
Improvenumerical value setting accuracyVSAvoidtime for numerical value setting
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the setting process into two phases: rough adjustment phase for rapid approach to the target range, and fine adjustment phase for precise final positioning. This segmentation eliminates the need for repeated small adjustments by allowing the user to quickly cover large value ranges initially, then make precise final adjustments, significantly reducing total setting time while maintaining accuracy

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts the operation mode based on the user's needs. By allowing switching between rough and fine adjustment modes, the system enables the user to adapt the operation characteristics to the current situation - using rapid rough adjustments when far from the target and precise fine adjustments when接近 the target, thereby optimizing the balance between speed and accuracy

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3486750B1Image display system, control device for head-mounted display, and operating method and operating program for operating same
Publication Date: 2023.10.18 FUJIFILM CORP
  • EP3486750B1 patent drawingFigure 1
  • EP3486750B1 patent drawingFigure 2
  • EP3486750B1 patent drawingFigure 3

AI summary

There are provided an image display system, and a control apparatus for a head-mounted display and an operation method and an operation program therefor with which setting of a numerical value using a numerical value setting user interface, which is a virtual user interface, can be quickly and accurately performed. A second detection unit (71) detects a second gesture for switching between a rough adjustment mode in which the range of settable numerical values for a slide bar (45) is a first range or/and the unit change width for a numerical value is a first change width and a fine adjustment mode in which the range is a second range narrower than the first range or/and the unit change width is a second change width narrower than the first change width. A mode switching unit (74) switches between the rough adjustment mode and the fine adjustment mode in accordance with the second gesture. A display control unit (69) causes a rough adjustment slide bar (45A) and a fine adjustment slide bar (45B) to be selectively displayed on an HMD (11).