Gesture-Based Braille Input on Touch Screens

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Visually impaired individuals face challenges in rapid text entry and data correction on touch screen-enabled devices, which are not optimized for Braille input, limiting their ability to effectively communicate and interact with computer systems.

Innovation Solution

A standard Braille user interface system for touch screen-enabled devices that allows users to input Braille text using gestures, enabling the creation of raised and non-raised dots through swipes, with options for character, word, sentence, and paragraph-level corrections, and conversion to other written languages like English.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional Braille writing system is used on touch screen devices, then written communication capability is maintained, but text entry speed is too slow

Engineering Contradiction:
Improvetext entry speedVSAvoidBraille input efficiency
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent replaces the traditional mechanical tactile Braille input method with a gesture-based touch screen interface. Users perform swipe gestures (e.g., swiping right for raised dots, swiping left for non-raised dots) to input Braille characters, eliminating the need for physical Braille keyboards or refreshable displays while maintaining Braille encoding capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system dynamically adapts the Braille input process by providing real-time audio feedback of entered characters and enabling multi-level correction capabilities. The interface allows users to review and correct input at character, word, sentence, or paragraph levels, making the input process flexible and adaptive to user needs.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If touch screen interface is used, then device versatility is improved, but data entry correction capability for Braille users deteriorates

Engineering Contradiction:
Improvedevice compatibilityVSAvoidtext correction capability
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system provides comprehensive audio feedback throughout the text entry and correction process. After each Braille character is input via gesture, the system audibly announces the entered character, allowing users to verify input accuracy. During correction modes, the system reads back text at character, word, sentence, or paragraph levels, enabling users to locate and correct errors effectively.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The correction capability is segmented into multiple levels: character-level correction, word-level correction, sentence-level correction, and paragraph-level correction. This segmentation allows users to choose the appropriate correction scope based on their needs, making the correction process more efficient and less overwhelming.

Inventive Principle:
Principle #1Segmentation

3Productivity

If gesture-based input is implemented, then text entry speed is improved, but learning curve increases

Engineering Contradiction:
Improvetext entry speedVSAvoiduser training requirement
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system provides built-in audio feedback that automatically announces each entered Braille character, allowing users to self-verify their input without external assistance. The system also offers automated correction modes that can identify and present errors to users, reducing the need for extensive training on proofreading and correction techniques.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10725651B2Gesture-based braille-to-text conversion system
Publication Date: 2020.07.28 CONCENTRIX CVG CUSTOMER MANAGEMENT GROUP INC
  • US10725651B2 patent drawing
  • US10725651B2 patent drawing
  • US10725651B2 patent drawing

AI summary

A Braille user interface for a Braille communication system on a touch screen-enabled electronic device with a touch screen and a touch screen-enabled interface. A user inputs a six-bit Braille character composed of raised dots and non-raised dots. Raised dot are created by a swipe in a first direction (say right) while non-raised dots may be created by a swipe in a second direction (say left). Swiping may be performed on an input area of the touch screen which is smaller than the touch screen. The user is offered an opportunity to perform a character check of entered Braille characters. A character check may include playing back the entered character and then offering the user the option of correcting that entered character.