Wireless Tongue Tracking for Silent Speech Interfaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current speech and language therapy systems lack effective methods for real-time, non-obtrusive tracking of tongue movements, particularly for individuals with voice disorders or those who have difficulty producing sounds inside the mouth, limiting their ability to communicate effectively.

Innovation Solution

A wireless tongue tracking system (TTS) that uses a tracer unit attached to the tongue and a plurality of sensors to detect its position and orientation in real-time, providing audiovisual biofeedback and enabling the creation of a silent speech interface for speech therapy and communication.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional speech therapy methods using mirrors and visual feedback are used, then speech sounds that are readily viewable can be effectively corrected, but sounds produced inside the mouth cannot be adequately addressed

Engineering Contradiction:
Improvetongue position detection accuracyVSAvoidinternal tongue movement measurement
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent replaces traditional mechanical visual feedback systems (mirrors) with a wireless electromagnetic tracking system. A tracer unit attached to the tongue contains a magnet that interacts with magnetic sensors, enabling non-contact, three-dimensional tracking of tongue movements that cannot be observed visually.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a tracer unit as an intermediary between the tongue and the measurement system. This tracer unit, containing a magnet, serves as a mediator that translates internal tongue movements into detectable magnetic field changes that can be captured by external sensors.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If sophisticated research tools like electromagnetic articulography are used to track tongue movements, then precise measurement can be achieved, but the systems become expensive and obtrusive

Engineering Contradiction:
Improvetongue movement tracking accuracyVSAvoidtracking system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the tracking system into separate modular components: a compact tracer unit attached to the tongue containing a magnet, and external wireless magnetic sensors. This segmentation allows the system to achieve research-grade precision while reducing overall complexity and cost compared to integrated electromagnetic articulography systems.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent replaces complex mechanical electromagnetic articulography systems with a simpler wireless magnetic tracking system using permanent magnets and magnetic field sensors, eliminating the need for complex electromagnetic coils and cables while maintaining measurement precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If clinicians use diagrams and low-tech means to demonstrate tongue placement, then basic guidance can be provided, but subtle differences between phonemes cannot be clarified

Engineering Contradiction:
Improvetherapy method simplicityVSAvoidphoneme differentiation accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent replaces static diagrams and low-tech visual aids with dynamic, real-time wireless tracking that provides continuous three-dimensional feedback on tongue position, enabling clinicians to demonstrate and verify subtle phonemic differences that cannot be captured by static images.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent implements real-time feedback by continuously tracking tongue position through the wireless tracer and sensor system, allowing clinicians to immediately observe and correct tongue placement errors, and enabling patients to see the precise differences between phonemes during therapy exercises.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables precise tracking and visualization of tongue movements, enhancing speech therapy by providing accurate biofeedback and allowing for the synthesis of speech from intended phonemes, thereby improving communication for individuals with speech and language impairments.

Implementation Method 1

The tracer unit can comprise a magnet and the motion of the tongue is traced by an array of magnetic sensors, which measure the magnetic field generated by the magnet.

Methodology Applied
Scientific EffectMagnetic field: Magnetic Field

Data Source

PatentUS9911358B2Wireless real-time tongue tracking for speech impairment diagnosis, speech therapy with audiovisual biofeedback, and silent speech interfaces
Publication Date: 2018.03.06 GEORGIA TECH RES CORP
  • US9911358B2 patent drawing
  • US9911358B2 patent drawing
  • US9911358B2 patent drawing

AI summary

A real-time wireless system for recording natural tongue movements in the 3D oral space. By attaching a small magnetic tracer to the tongue, either temporarily or semi-permanently, and placing an array of magnetic sensors around the mouth, the tracer can be localized with sub-millimeter precision. The system can also combine the tracer localization with acoustic, video, and flow data via additional sensors to form a comprehensive audiovisual biofeedback mechanism for diagnosing speech impairments and improving speech therapy. Additionally, the system can record tongue trajectories and create an indexed library of such traces. The indexed library can be used as a tongue tracking silent speech interface. The library can synthesize words, phrases, or execute commands tied to the individual patterns of magnetic field variations or tongue trajectories.