Disrupted Video Stream Enhancement With Gesture-Aware Frame Replacement

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing teleconferencing technologies struggle to effectively address user dissatisfaction due to distracting or embarrassing gestures and facial expressions captured in disrupted video streams, which can persist and degrade the user experience.

Innovation Solution

A method and system that detect disruptions in video streams and analyze user depictions in frames. If a designated gesture or facial expression is detected, the frame is replaced with a generated or default image, ensuring a more professional and comfortable viewing experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If video streams are enhanced using existing enhancement models to remove noise or echoes, then audio and video quality is significantly improved, but distracting or embarrassing gestures and facial expressions in disrupted video streams persist and degrade user experience

Engineering Contradiction:

Improveaudio and video qualityVSAvoiddistracting or embarrassing gestures and facial expressions

Core Design Contradiction:

ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent extracts and removes harmful elements (distracting or embarrassing gestures and facial expressions) from the video stream by detecting them in disrupted video frames and replacing them with generated or default images, while preserving the rest of the video content

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces an intermediary system that sits between the video stream reception and display, analyzing disrupted frames, detecting harmful gestures or expressions, and selectively replacing only the problematic portions while maintaining the overall video flow

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If video frames are replaced to remove distracting gestures or expressions, then user satisfaction is improved, but additional processing complexity is introduced

Engineering Contradiction:

Improveuser satisfactionVSAvoidvideo frame processing complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent performs preliminary detection and analysis of video frames to identify disrupted frames containing distracting gestures or expressions before they are displayed, allowing for proactive replacement rather than reactive correction

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent creates replacement frames by generating synthetic images or using default images that copy the essential visual elements (such as background or neutral poses) to maintain visual consistency while removing harmful content

Inventive Principle:

Principle #26Copying

Data Source

PatentUS20250294114A1Enhancement of disrupted video streams

Publication Date: 2025.09.18 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

This document relates to enhancement of video signals. For instance, some implementations can detect a disruption to a video signal and then analyze a depiction of a user in a received frame of the video signal. Then, a determination can be made whether to replace the received frame with a replacement frame based on the depiction of the user. For instance, the received frame can be replaced when the received frame depicts the user having a particular gesture or facial expression that has been designated for replacement.