Augmentative Communication Device With Message Queue And Emotional Proxies

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Speech generating devices (SGDs) face challenges such as slow conversational throughput, inadequate emotional expression, and difficulty in directing messages to specific conversation partners, leading to undesired interactions and limitations in private communication for individuals with severe speech impairments.

Innovation Solution

The implementation of social cue proxies and emotional proxies within the SGDs, allowing users to indicate typing, speaking, or requesting assistance, and enabling the selection of emotions to be displayed, along with the ability to direct messages to specific partners and control privacy settings, using connected computing devices for discreet assistance in message composition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If users input text directly into the SGD device, then message composition is possible, but conversational throughput rate becomes very slow (8-10 words per minute) with dead time during input

Engineering Contradiction:
Improveconversational throughput rateVSAvoiddead time during text input
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system allows users to pre-compose messages asynchronously during dead time periods and store them in a message queue. When the user is ready to communicate, pre-composed messages can be quickly transmitted without real-time typing, significantly improving conversational throughput rate while utilizing otherwise wasted time productively.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

A message queue intermediary is introduced between the user and the conversation partner. The queue buffers pre-composed messages and manages their transmission, allowing users to decouple message composition from transmission timing. This intermediary enables batch processing of messages, improving overall communication efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If electronic voice output uses digitized recordings or speech synthesis, then natural speech sound is achieved, but emotional expression becomes inadequate

Engineering Contradiction:
Improvenatural speech sound qualityVSAvoidemotive aspects of speech
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system merges electronic voice output with visual emotional proxies (emojis, emojis, or custom graphics) displayed on the device screen or connected display. This combination preserves the natural speech sound quality while adding emotional context through visual indicators, compensating for the emotional information loss in synthesized speech.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system adds a visual dimension to the audio output by displaying emotional proxies on screens. This multi-dimensional approach (audio + visual) compensates for the emotional information deficit in electronic voice output, allowing conversation partners to perceive both the spoken message and the emotional intent simultaneously.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If SGD broadcasts inputted text at predefined volume to nearby individuals, then communication is possible, but directing messages to distinct conversation partners becomes difficult

Engineering Contradiction:
Improvebroadcast communication capabilityVSAvoidability to direct messages to specific partners
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system segments the communication audience into multiple conversation partners, each with their own device or interface. The SGD can selectively transmit messages to specific segmented recipients rather than broadcasting to all nearby devices simultaneously, enabling private or directed communication while maintaining the ease of broadcast operation when needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The message transmission system becomes dynamic, allowing users to adjust recipient selection based on communication context. The system can switch between broadcast mode (for general announcements) and targeted mode (for private conversations), adapting to different communication needs without requiring separate systems for each mode.

Inventive Principle:
Principle #15Dynamics

4Adaptability or versatility

If users switch to different portions of SGD software interface for texting or email, then alternative communication methods are available, but user autonomy increases operational complexity

Engineering Contradiction:
Improvealternative communication methodsVSAvoidsoftware interface navigation
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The SGD device integrates multiple communication functions (direct messaging, email, texting) into a single unified interface. Users can access all communication methods through consistent interaction patterns without switching between different software portions or devices, reducing operational complexity while maintaining versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system provides self-service capabilities where the SGD automatically manages message composition, transmission, and routing based on user input. This reduces the complexity of manual interface navigation by allowing the system to handle routine communication tasks autonomously while preserving user control over message content and recipient selection.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP3693847B1Facilitating awareness and conversation throughput in an augmentative and alternative communication system
Publication Date: 2023.09.06 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3693847B1 patent drawingFigure 1
  • EP3693847B1 patent drawingFigure 2
  • EP3693847B1 patent drawingFigure 3

AI summary

Speech generating devices, communication systems, and methods for communicating using the devices and systems are disclosed herein. In certain examples, a communication system is configured to receive a generated communication, establish a connection between a speech generating device and a computing device subsequent to receipt of the generated communication, and transmit the generated communication to the computing device. In other examples, a computing device is configured to establish a connection with a speech generating device, and receive a transmission generated by the speech generating device following the connection, the transmission including previously generated communications or real-time communication segments or proxies. In other examples, a speech generating device is configured to establish a connection with one or more computing devices, receive one or more suggestions from at least one computing device during generation of the communication, and display a suggestion on the display device as a shortcut input key.