Mobile Device Speech-to-Text Module for Hearing Impaired Users

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mobile wireless communications devices are not adequately designed for hearing and speech impaired users, relying on live agents for communication, which is not an automatic process and lacks integration of advanced voice-to-text technologies.

Innovation Solution

A mobile wireless communications device with a speech-to-text and text-to-speech module, a keyboard, display, and LED indicators that automatically invokes a handicap feature for speech-to-text and text-to-speech conversion upon incoming calls, enabling hearing and speech impaired users to communicate independently through text and visual cues.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a mobile wireless communications device is designed for typical users with hearing and speech capabilities, then the device structure remains simple and standard, but it becomes unusable or inadequate for hearing and speech impaired users

Engineering Contradiction:
Improveadaptability to hearing and speech impaired usersVSAvoiddevice structure complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The mobile device is designed to serve multiple user types through integrated modules. The speech-to-text module enables hearing impaired users to receive communications as text, while the text-to-speech module allows them to send communications by typing. These modules are integrated into the standard device architecture, allowing the same device to serve both typical and impaired users without requiring separate specialized devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces software-based intermediary modules (speech-to-text and text-to-speech converters) that mediate between the user and the communication network. These modules act as translators, converting speech to text for display to hearing impaired users and converting typed text to speech for transmission, thereby enabling impaired users to communicate through standard telephony infrastructure without requiring complex hardware modifications.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If live agents are used as intermediaries for hearing impaired users, then communication is enabled, but the process becomes manual and requires human intervention

Engineering Contradiction:
Improveease of communication operationVSAvoidautomation of communication process
Core Design Contradiction:
Ease of operationVSExtent of automation

Solution Approach 1:

The device enables hearing impaired users to independently communicate without requiring live agent assistance. The speech-to-text module automatically converts incoming speech to displayed text, and the text-to-speech module automatically converts typed user input to transmitted speech. This self-service capability eliminates the need for manual intermediary services while maintaining ease of operation for impaired users.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical/manual process of live agent intervention with automated electronic processing. Software-based speech recognition and synthesis algorithms substitute for human agents, automatically performing the translation functions that previously required manual human effort. This substitution maintains ease of operation while achieving full automation of the communication process.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If advanced voice-to-text technologies are integrated into mobile devices, then hearing impaired users can communicate independently, but the device complexity increases

Engineering Contradiction:
Improveindependent communication capabilityVSAvoidintegration complexity of processing modules
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges the speech-to-text and text-to-speech modules with the existing mobile device architecture. Rather than adding separate standalone systems, the converters are integrated into the device's processing unit, sharing resources such as the display, keyboard, and communication interfaces. This merging approach enables independent communication capability for hearing impaired users while minimizing the increase in overall device complexity.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Facilitates independent communication for hearing and speech impaired users by converting speech to text and text to speech, eliminating the need for live agents and providing visual indicators, thus enhancing accessibility and usability.

Implementation Method 1

a light emitting diode (LED) is carried by the housing and coupled to the processor, which is configured for generating a signal to the LED for activating the LED and displaying a light pattern indicative of speech

Methodology Applied
Scientific EffectLight emitting diode: Light Emitting Diode

Data Source

PatentEP2224427B1Mobile wireless communications device for hearing and/or speech impaired user
Publication Date: 2018.11.14 BLACKBERRY LTD
  • EP2224427B1 patent drawingFigure 1
  • EP2224427B1 patent drawingFigure 2
  • EP2224427B1 patent drawingFigure 3

AI summary

A mobile wireless communications device includes a housing and transceiver carried by the housing for transmitting and receiving radio frequency (RF) signals carrying communications data of speech. A processor is coupled to the transceiver for processing the communications data as speech that is transmitted and received to and from the transceiver. A keyboard and display is carried by the housing and connected to the processor. A speech-to-text and text-to-speech module converts communications data as speech received from the transceiver to text that is displayed on the display and converting text that is typed by a user on the keyboard in the communications data as speech to be transmitted from the transceiver as an RF signal.