Remote Videoconference Physiological Data and Transcription Separation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional videoconferencing technologies fail to provide real-time feedback on the intelligibility of speech and physiological changes in remote participants, particularly in telehealth settings, leading to suboptimal communication quality and comprehension issues during mental health therapy sessions.

Innovation Solution

A system that utilizes speech-to-text conversion and real-time comparison of text fragments between the speaker and receiver, along with physiological data monitoring, to indicate the intelligibility and emotional state of remote participants, ensuring effective communication and therapy delivery.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional videoconferencing technologies are used, then basic communication is enabled, but speech intelligibility feedback and physiological data monitoring are not provided

Engineering Contradiction:

Improvecommunication reliabilityVSAvoidloss of speech intelligibility feedback

Core Design Contradiction:

ReliabilityVSLoss of information

Solution Approach 1:

The system implements real-time feedback by converting speech to text, comparing transmitted and received text fragments, and providing immediate intelligibility feedback to the speaker. This allows the speaker to know whether their speech was properly received and understood, resolving the information loss about communication quality.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent introduces intermediary components including speech-to-text conversion systems, text comparison mechanisms, and physiological data monitoring systems that act as mediators between speakers and listeners. These intermediaries provide indirect measurement and feedback of communication quality without requiring direct human assessment.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If conventional videoconferencing technologies are used, then basic telehealth sessions can be conducted, but real-time physiological data monitoring is not available

Engineering Contradiction:

Improvetelehealth functionalityVSAvoidloss of physiological state information

Core Design Contradiction:

Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system integrates multiple functions into a single platform: speech-to-text conversion, text comparison for intelligibility feedback, and physiological data monitoring. This multi-functional system serves both communication quality assurance and health monitoring purposes, enhancing telehealth versatility while preventing information loss.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines speech analysis and physiological data monitoring into an integrated system that simultaneously processes multiple data streams. This merging allows therapists to receive comprehensive real-time information about patient communication quality and physiological state, improving telehealth session effectiveness.

Inventive Principle:

Principle #5Merging (Combining)

3Measurement precision

If speech-to-text conversion and text comparison are implemented, then speech intelligibility feedback is provided, but system complexity increases

Engineering Contradiction:

Improvespeech intelligibility measurementVSAvoidsystem complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The system creates text copies of spoken speech and uses automated comparison algorithms to verify intelligibility. This copying approach enables precise measurement of speech transmission quality through automated text fragment comparison, achieving high measurement precision while managing complexity through algorithmic processing.

Inventive Principle:

Principle #26Copying

4Reliability

If real-time feedback on speech intelligibility and physiological changes is provided, then communication quality is enhanced, but data transmission requirements increase

Engineering Contradiction:

Improvecommunication qualityVSAvoiddata transmission volume

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The system extracts only the essential information needed for feedback: text fragments from speech-to-text conversion and key physiological data points. By extracting and transmitting only this critical subset of data rather than complete audio and video streams, the system provides comprehensive real-time feedback while minimizing data transmission requirements.

Inventive Principle:

Principle #2Taking out (Extraction)

Data Source

PatentUS11974063B2Reliably conveying transcribed text and physiological data of a remote videoconference party separately from video data

Publication Date: 2024.04.30 KOA HEALTH DIGITAL SOLUTIONS S L U

AI summary

Transcribed text and physiological data of a remote video conference participant are transmitted to a local device separately from the video data, which depicts the remote party during a time interval. An image of the video data is captured at a time instant within the time interval. A value of a remote party feature is determined remotely using the video data. The remote party feature can be the remote party's heart rate at the time instant. The value of the feature is received onto the local device. Audio data captures sounds spoken by the remote party and is converted by the remote device into words of text. The audio data converted into a particular word was captured at the time instant. The particular word is received onto the local device. The particular word and the value of the feature are displayed in association with one another on the local device.