Hand Recognition VRS Control Eliminates Remote Reliance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Deaf, hard of hearing, or speech-impaired individuals face difficulties in using video relay service (VRS) systems due to cumbersome remote control devices, which can be lost, require multiple steps for operation, and limit customization, especially in emergency situations.

Innovation Solution

A system that enables D-HOH-SI individuals to initiate and control VRS calls using hand recognition technology, eliminating the need for a separate remote control by integrating a camera and codec with a computer processing unit that interprets hand commands for menu selection and call control through various operating modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a remote control device is used to operate VRS system, then call control functions can be executed, but the device can be misplaced or lost rendering the system unusable

Engineering Contradiction:
Improvesystem usabilityVSAvoiddevice portability
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent extracts the control functionality from the separate remote control device and integrates it directly into the VRS terminal interface. The touchscreen display presents menu options and control interfaces that can be operated through touch, gesture, or voice commands, eliminating the dependency on a physical remote control that can be lost or misplaced.

Inventive Principle:
Principle #2Taking out (Extraction)

2Ease of operation

If multiple steps are required to make a call using remote control, then call control can be achieved, but call initiation time increases

Engineering Contradiction:
Improvecall control capabilityVSAvoidcall initiation time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent implements preliminary action by providing pre-configured contact information and frequently used communication options in the terminal interface. Users can select from pre-stored contacts and communication templates, eliminating the need to manually input numbers or navigate through multiple configuration steps during emergency situations.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If QWERTY keyboard is used on small remote control, then text input capability is provided, but typing speed decreases due to small keys and spelling errors

Engineering Contradiction:
Improvetext input capabilityVSAvoidtyping speed
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent replaces the mechanical keyboard input system with alternative input methods including touchscreen interface, gesture recognition, and voice-to-text conversion. These electronic and biometric input methods eliminate the physical constraints of small keyboard keys, allowing for faster and more accurate text input through larger touch targets or direct speech commands.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Ease of operation

If pre-programmed commands are used in remote control, then basic functions can be executed, but customization capability is limited

Engineering Contradiction:
Improvecommand executionVSAvoidcommand customization
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic adaptability by allowing users to customize the terminal interface with personal contacts, communication preferences, and frequently used commands. The system can adapt to individual user needs through configurable settings, custom contact lists, and personalized menu arrangements, transforming the static pre-programmed interface into a dynamic, user-adapted system.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution simplifies VRS communication by allowing D-HOH-SI individuals to control calls and access menu items through hand gestures, reducing the risk of device loss and improving call initiation speed, while enabling customization and emergency communication without the need for a remote control.

Implementation Method 1

A camera and codec are integrated with a computer processing unit

Methodology Applied
Scientific EffectVideo imaging:

Implementation Method 2

recognizing hand commands using the computer processing unit, wherein the computer processing unit executes computer commands to perform a hand recognition operation

Methodology Applied
Scientific EffectImage processing: Image Processing

Data Source

PatentUS10423237B2Gesture-based control and usage of video relay service communications
Publication Date: 2019.09.24 PURPLE COMMUNICATIONS INC
  • US10423237B2 patent drawing
  • US10423237B2 patent drawing
  • US10423237B2 patent drawing

AI summary

A method and system are disclosed for enabling members of the deaf, hard of hearing, or speech-impaired (D-HOH-SI) community to start and control communications conducted through a video relay service (VRS) without the need for a remote-control device. A combination of standard-ASL and non-ASL hand commands are interpreted using “hand recognition” (similar to “face recognition”) to control the operation of a VRS system through multiple operating modes. The “hand recognition” process employs a camera/codec connected to a CPU which executes commands which may be stored in a non-volatile computer-readable storage device.