Dynamic Protocol Switching for Online Meeting Reliability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems for online meetings face challenges in maintaining reliable communications during challenging network conditions, particularly due to lossy connections and jitter, which affect the transmission of audio and video content, and existing solutions do not effectively address these issues by failing to manage network communications centrally.

Innovation Solution

The system dynamically switches between UDP and TCP protocols for online meeting content transmission based on detected connectivity issues, converting audio to text and vice versa using STT and TTS codecs, allowing for more reliable data transmission and rendering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If UDP protocol is used for audio and video transmission, then transmission speed is improved, but reliability deteriorates due to packet loss and jitter

Engineering Contradiction:
Improvetransmission speedVSAvoiddata transmission reliability
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The system dynamically switches between UDP and TCP protocols based on real-time network conditions. When network quality is good, UDP is used for fast transmission; when network quality deteriorates, the system transitions to TCP for reliable delivery, making the protocol selection adaptive rather than static

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent introduces an intermediary mechanism (the protocol switching layer) that mediates between the application layer and transport layer. This intermediary monitors network conditions and selectively applies different transport protocols (UDP or TCP) to balance speed and reliability requirements

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If TCP protocol is used for text transmission, then reliability is improved, but transmission speed deteriorates

Engineering Contradiction:
Improvedata transmission reliabilityVSAvoidtransmission speed
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

The system applies different quality characteristics to different data types and network conditions. For text data over reliable connections, TCP is used; for audio/video over good connections, UDP is used. This localized optimization ensures each data stream uses the most appropriate protocol for its specific requirements

Inventive Principle:
Principle #3Local quality

3Reliability

If audio is converted to text and transmitted over TCP, then reliability of transmission is improved, but system complexity increases

Engineering Contradiction:
Improvecontent transmission reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system changes the format parameter of the content from audio to text, and the transport protocol parameter from UDP to TCP. These parameter changes enable reliable transmission of content data while maintaining audio playback capability through text-to-speech conversion at the receiving end

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11563784B2Caption assisted calling to maintain connection in challenging network conditions
Publication Date: 2023.01.24 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11563784B2 patent drawing
  • US11563784B2 patent drawing
  • US11563784B2 patent drawing

AI summary

Systems are provided for managing and coordinating STT/TTS systems and the communications between these systems when they are connected in online meetings and for mitigating connectivity issues that may arise during the online meetings to provide a seamless and reliable meeting experience with either live captions and/or rendered audio. Initially, online meeting communications are transmitted over a lossy connectionless type protocol/channel. Then, in response to detected connectivity problems with one or more systems involved in the online meeting, which can cause jitter or packet loss, for example, an instruction is dynamically generated and processed for causing one or more of the connected systems to transmit and/or process the online meeting content with a more reliable connection/protocol, such as a connection-oriented protocol. Codecs at the systems are used, when needed to convert speech to text with related speech attribute information and to convert text to speech.