Touch-Free Interface Using Visual Feedback for Ergonomic Motion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional computer interfaces, such as keyboards and mice, often require users to make awkward and ergonomically unsound gestures, leading to repetitive strain injuries and discomfort, while touch-free interfaces lack effective ergonomic design.

Innovation Solution

A touch-free user interface system that localizes human body parts using image processing and visual feedback to encourage ergonomically preferred positions and motions, utilizing cameras and light-bending apparatus to capture and interpret gestures, allowing users to interact with computers without the need for predefined device locations or configurations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional computer interfaces (keyboard, mouse) are used, then input functionality is provided, but users must make awkward and ergonomically unsound gestures leading to repetitive strain injuries

Engineering Contradiction:
Improveergonomic quality of gesturesVSAvoidrepetitive strain injuries
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent replaces mechanical input devices (keyboard, mouse) with an optical gesture recognition system. Cameras capture images of users' hands and arms, and image processing algorithms translate these visual inputs into computer commands, eliminating the need for physical contact and awkward positioning

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system introduces an intermediary layer between the user and the computer interface - a camera-based gesture recognition system that translates natural hand movements into digital commands. This intermediary allows users to interact with the computer using ergonomic, natural gestures rather than contorting their bodies to reach fixed input devices

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If touch-free interfaces are implemented, then ergonomic gestures are enabled, but the interface lacks predefined device locations and configurations

Engineering Contradiction:
Improvegesture freedomVSAvoidinterface configuration complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent transitions from two-dimensional fixed interface locations on a screen to three-dimensional gesture space in front of the camera. Users can interact with the interface using hand movements in multiple spatial dimensions, allowing natural gestures without being constrained to predefined screen positions

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system implements a dynamic interface where the virtual keyboard and control elements move and adapt based on the user's hand position and gestures. Rather than fixed locations, the interface elements dynamically respond to gesture inputs, providing both freedom of movement and structured interaction

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If visual feedback is provided to guide ergonomic positions, then user comfort is enhanced, but system complexity increases

Engineering Contradiction:
Improveuser comfortVSAvoidfeedback system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system incorporates real-time visual feedback through the display screen, showing users whether their gestures fall within ergonomic ranges. The feedback mechanism uses the existing display hardware to provide guidance, avoiding the need for additional complex feedback devices while still enhancing user comfort

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9857868B2Method and system for ergonomic touch-free interface
Publication Date: 2018.01.02 THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIV
  • US9857868B2 patent drawing
  • US9857868B2 patent drawing
  • US9857868B2 patent drawing

AI summary

With the advent of touch-free interfaces such as described in the present disclosure, it is no longer necessary for computer interfaces to be in predefined locations (e.g., desktops) or configuration (e.g., rectangular keyboard). The present invention makes use of touch-free interfaces to encourage users to interface with a computer in an ergonomically sound manner. Among other things, the present invention implements a system for localizing human body parts such as hands, arms, shoulders, or even the fully body, with a processing device such as a computer along with a computer display to provide visual feedback on the display that encourages a user to maintain an ergonomically preferred position with ergonomically preferred motions. For example, the present invention encourages a user to maintain his motions within an ergonomically preferred range without have to reach out excessively or repetitively.