Dynamic Graphical Interface Scaling for Gesture Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Gesture-based user input systems face limitations when the user's position and angle relative to the display vary, leading to reduced effectiveness due to difficulties in maintaining clear graphical feedback, especially when the user steps away from the monitor.

Innovation Solution

A method using a spatial sensor to track the user's position and viewing angle, dynamically adjusting graphical interface objects such as size, orientation, and sensitivity to maintain visibility and usability regardless of distance or angle, ensuring that gestures can be accurately recognized and executed at various distances and angles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the user steps away from the display monitor to perform gestures, then the versatility and naturalness of gesture-based input is improved, but the graphical feedback becomes difficult to see and the interface effectiveness deteriorates

Engineering Contradiction:
Improvegesture-based input versatilityVSAvoidgraphical feedback visibility
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system dynamically adjusts graphical interface parameters (size, position, orientation) in real-time based on detected user position and viewing angle. As the user moves away from or changes angle relative to the display, the system automatically modifies the graphical feedback to maintain optimal visibility and interaction effectiveness throughout the entire interaction space.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes multiple graphical parameters simultaneously including size scaling, position adjustment, and orientation modification. By proportionally adjusting these parameters based on the user's spatial position, the system maintains consistent visual feedback quality whether the user is close to or far from the display, or viewing at different angles.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If the graphical interface objects are displayed at fixed size, then the interface design is simple, but the objects become invisible or unreadable when the user steps away from the display

Engineering Contradiction:
Improveinterface design complexityVSAvoidobject visibility
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

Instead of using fixed-size graphical objects, the system employs dynamically resizing objects that automatically adjust their size based on the user's distance from the display. This dynamic adaptation ensures objects remain visible and readable across the full range of user positions without requiring multiple fixed-size display layers.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements proportional scaling of graphical objects based on detected user position. As the user moves away from the display, objects are scaled up proportionally to maintain their visible size. This parameter change approach maintains simplicity while solving the visibility problem across different viewing distances.

Inventive Principle:
Principle #35Parameter changes

3Stability of the object's composition

If the gesture recognition sensitivity is fixed, then the system response is consistent, but the system cannot accurately recognize gestures when the user is at different distances from the display

Engineering Contradiction:
Improvegesture recognition consistencyVSAvoidgesture recognition accuracy
Core Design Contradiction:
Stability of the object's compositionVSMeasurement precision

Solution Approach 1:

The system dynamically adjusts gesture recognition sensitivity thresholds in real-time based on the user's detected position and viewing angle. This allows the system to maintain accurate gesture recognition across varying distances by adapting the sensitivity parameters to match the current interaction conditions, ensuring consistent and precise gesture detection throughout the interaction space.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS8890812B2Graphical user interface adjusting to a change of user's disposition
Publication Date: 2014.11.18 WELLS FARGO BANK NA
  • US8890812B2 patent drawing
  • US8890812B2 patent drawing
  • US8890812B2 patent drawing

AI summary

A user interface apparatus and a method for adjusting the apparatus are disclosed. A position and/or a viewing angle of the user is tracked, and graphical interface objects are adjusted to keep them visible at different user's distances and viewing angles. For example, as the user steps away from the display, the objects on the display can be proportionally enlarged to make them appear of the same size to the user. The sensitivity of a gesture recognition system to the user's movements and gestures can be also adjusted to facilitate manipulation of the objects by the user at different distances from the display of the graphical user interface.