Dynamic Virtual Surface for Gesture Fatigue Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing gesture-based operation technologies for information processing apparatuses impose significant physical load on operators due to limited arm position and angle, leading to fatigue during prolonged use, and lack of physical feedback and accurate icon selection on two-dimensional displays.

Innovation Solution

An information processing apparatus and method that includes a hand-shape recognition unit to recognize operator hand shapes and a display control unit to dynamically move the position of operation objects on the screen based on hand position changes, allowing for reduced physical strain and improved interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If gesture operation is performed at a fixed position on the virtual operation surface, then the operation can be performed with a simple system configuration, but the arm position and angle are limited causing large physical load on the operator

Engineering Contradiction:
Improvesystem configurationVSAvoidphysical load on operator
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent applies the dynamics principle by making the virtual operation surface movable rather than fixed. The surface can be repositioned to different locations in the real space based on the operator's hand position, allowing the operator to perform gestures at comfortable locations while the system dynamically adjusts the virtual surface position accordingly.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent uses the camera as an intermediary to establish the relationship between the real space and virtual space. The camera captures the operator's hand position and uses this information to determine the position of the virtual operation surface, mediating between the physical gesture and the virtual interface position.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of manufacture

If the virtual operation surface position is fixed in real space, then the system is simple to implement, but the operator cannot move the position causing fatigue during prolonged operation

Engineering Contradiction:
Improvesystem implementationVSAvoidprolonged operation duration
Core Design Contradiction:
Ease of manufactureVSDuration of action of moving object

Solution Approach 1:

The virtual operation surface is designed to be dynamically repositionable rather than statically fixed. The system continuously tracks the operator's hand position and adjusts the virtual surface location in real-time, enabling prolonged operation without fatigue by allowing the operator to maintain comfortable arm positions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system automatically adjusts the virtual operation surface position based on the operator's natural hand position without requiring explicit commands. The camera-based tracking system self-adjusts the interface position to match the operator's comfortable gesture location, eliminating the need for manual repositioning operations.

Inventive Principle:
Principle #25Self-service

3Area of stationary object

If gesture operation is performed with limited arm position and angle, then the operation can be performed in a compact space, but the physical load such as arm fatigue becomes large

Engineering Contradiction:
Improveoperation spaceVSAvoidarm fatigue
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The patent transitions from a two-dimensional fixed screen interface to a three-dimensional virtual operation surface that can be positioned at various locations in real space. This dimensional extension allows the operator to perform gestures at multiple spatial locations, distributing the physical load across different arm positions and reducing fatigue.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The camera serves as an intermediary that maps the operator's hand position in real space to the virtual operation surface position. This mediation allows the operator to use natural arm movements in three-dimensional space while the system translates these movements to the appropriate virtual interface position, reducing the physical constraints on arm movement.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10514767B2Information processing apparatus and information processing method
Publication Date: 2019.12.24 SONY GROUP CORP
  • US10514767B2 patent drawing
  • US10514767B2 patent drawing
  • US10514767B2 patent drawing

AI summary

Provided is an information processing apparatus including: a hand-shape recognition unit configured to recognize a hand shape of an operator on a basis of measured information related to a hand of the operator; and a display control unit configured to move a display position of an operation object on a display screen according to a change in a position of the hand of the operator when the hand shape of the operator is a predetermined shape.