Real-Time NLP Coaching for Autism Spectrum Disorder

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current natural language processing technologies lack effective methods to identify and coach participants in conversations exhibiting characteristics of autism spectrum disorder, particularly in real-time, to improve social interaction and recognition of conversational cues.

Innovation Solution

A system utilizing machine learning models trained on annotated conversations to evaluate textual data and provide feedback to participants, identifying features indicative of autism and suggesting corrective actions to enhance social norm compliance during interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If natural language processing technologies are used to analyze conversations, then conversational data can be processed and evaluated, but the system cannot effectively identify and coach participants exhibiting characteristics of autism spectrum disorder in real-time

Engineering Contradiction:
Improveidentification accuracy of autism characteristicsVSAvoidreal-time coaching capability
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system pre-trains machine learning models on annotated conversation datasets containing characteristics of autism spectrum disorder before deployment. This preliminary training enables the model to rapidly evaluate new conversations in real-time without requiring complex analysis during actual interaction, thus resolving the contradiction between identification accuracy and real-time performance

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements a feedback mechanism that provides immediate coaching recommendations to participants based on real-time analysis of their conversational patterns. The machine learning model continuously monitors conversation data and delivers targeted feedback, enabling both high accuracy in identifying autism characteristics and real-time coaching capability

Inventive Principle:
Principle #23Feedback

2Measurement precision

If machine learning models are trained on annotated conversations to improve identification accuracy, then the system can detect autism characteristics, but the complexity of the system increases

Engineering Contradiction:
Improvedetection accuracy of conversational cuesVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system extracts and isolates specific conversational features and patterns that are indicative of autism spectrum disorder characteristics, rather than analyzing entire conversation datasets. By focusing on key discriminative features such as turn-taking patterns, topic transitions, and linguistic markers, the system achieves high detection accuracy while maintaining manageable complexity

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The machine learning model is trained to identify and evaluate specific segments or features within conversations that are most indicative of autism characteristics, rather than treating the entire conversation as a single analysis unit. This segmentation approach improves detection accuracy by focusing on critical patterns while reducing overall system complexity

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10395552B2Coaching a participant in a conversation
Publication Date: 2019.08.27 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10395552B2 patent drawing
  • US10395552B2 patent drawing
  • US10395552B2 patent drawing

AI summary

Embodiments herein include a NLP application used to coach a participant who violates a social norm during a conversation. For example, the NLP application can evaluate the textual representation of the conversation to determine if the participant is exhibiting a characteristic of autism or other medical disorder which violates a social norm, and if so, inform the participant. Once a characteristic of autism is identified, a coaching application may output text that informs the participant what particular characteristic he is exhibiting—e.g., the participant is ignoring an attempt by another participant to change the topic of the conversation. In addition to providing notice, in one embodiment, the coaching application suggests a corrective action to the participant. For example, if the participant fails to provide an appropriate response to an emotional statement, the coaching action may suggest a sympathetic statement.