Speech Clarity Feedback System for Hearing Loss

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Communication between hard-of-hearing individuals and those with normal hearing can be strained due to difficulties in understanding speech, as existing technologies primarily focus on 'hearing strategies' rather than 'speaking strategies', leading to frustration and stress, especially when repetition is necessary in conversations involving multiple speakers.

Innovation Solution

A system comprising computing programs that evaluates speech speed, pitch, and volume to provide feedback to speakers, assists them in speaking clearly, and records conversations for playback, allowing users to understand missed information, using devices like mobile phones, wearable devices, and hearing aids.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If speakers talk normally without adjustment, then conversation flows naturally, but hard-of-hearing listeners cannot understand the speech clearly

Engineering Contradiction:
Improvespeech clarityVSAvoidconversation naturalness
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system provides real-time feedback to speakers about their speech characteristics (speed, pitch, volume) and automatically adjusts speech parameters to optimize clarity for hard-of-hearing listeners while maintaining natural conversation flow

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically changes speech parameters including speed, pitch, and volume based on real-time analysis to enhance intelligibility for listeners with hearing difficulties without making the speaker sound unnatural

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If listeners ask for repetition multiple times to ensure understanding, then communication accuracy improves, but conversation becomes clunky and stressful

Engineering Contradiction:
Improvecommunication accuracyVSAvoidconversation efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary analysis of speech characteristics before communication issues arise and automatically adjusts speech parameters in advance to ensure clarity, eliminating the need for repeated requests for repetition

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system enables hard-of-hearing listeners to understand speech independently without needing to repeatedly ask for repetition, as the speech is automatically optimized for their hearing capabilities in real-time

Inventive Principle:
Principle #25Self-service

3Measurement precision

If speakers consciously speak more clearly when talking to hard-of-hearing people, then listening comprehension improves, but speakers become self-aware and speech becomes less natural

Engineering Contradiction:
Improvelistening comprehensionVSAvoidspeaking naturalness
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system provides automated feedback to speakers about their speech clarity without requiring self-awareness, using real-time analysis to adjust speech parameters while maintaining natural speaking behavior

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system handles the speech adjustment automatically without requiring speakers to consciously monitor or modify their own speech, eliminating the self-awareness barrier that reduces naturalness

Inventive Principle:
Principle #25Self-service

4Measurement precision

If the system analyzes and adjusts speech parameters in real-time, then speech clarity for hard-of-hearing listeners improves, but computational complexity increases

Engineering Contradiction:
Improvespeech intelligibilityVSAvoidsystem computation load
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system focuses on adjusting a limited set of key speech parameters (speed, pitch, volume) rather than analyzing all possible acoustic characteristics, reducing computational complexity while maintaining effective intelligibility improvement

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system applies speech parameter adjustments selectively and moderately, making only the necessary changes to improve clarity without over-processing the audio signal, thus balancing performance and computational load

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20230122715A1Methods to assist verbal communication for both listeners and speakers
Publication Date: 2023.04.20 SATO HIROKI
  • US20230122715A1 patent drawing
  • US20230122715A1 patent drawing
  • US20230122715A1 patent drawing

AI summary

Methods implemented in a system utilizing computing programs for a speaker and a listener in conversation are provided. Aspects include (i) a reminder provisioner for a speaker which is triggered according to speed, pitch or volume of the speaker's speech, (ii) a speech training provisioner for a speaker, and (iii) an application which records and plays back difficult conversation to understand.