Live Video Overlay Generation via Server Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video editing systems are unable to provide real-time video enhancement capabilities for live video streams due to limited processing power on mobile devices, resulting in plain and unengaging broadcasts that lack relevant information.

Innovation Solution

A system and method that detect events associated with a live video stream, generate a video enhancement overlay with dynamic information, and display it alongside the live video content, enhancing the presentation without overwhelming mobile device resources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If conventional video editing systems are used to enhance live video streams, then video enhancement capabilities are provided, but the limited processing power of mobile devices is overwhelmed resulting in poor quality broadcast

Engineering Contradiction:
Improvevideo enhancement capabilityVSAvoidbroadcast quality
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The system segments the video enhancement process into two parts: real-time processing on the mobile device (capturing and transmitting raw video) and post-processing on a server (applying enhancements to the transmitted video). This segmentation allows complex enhancement operations to be performed without overwhelming the mobile device's processing power, thereby maintaining broadcast quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A server acts as an intermediary between the mobile device and the final video output. The mobile device transmits video data to the server, which then applies enhancements and returns the processed video. This intermediary approach enables sophisticated video processing while keeping the mobile device's processing load manageable.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of manufacture

If conventional video editing systems are used for live video, then video enhancement is attempted, but time-consuming user review and previewing prevents real-time enhancement

Engineering Contradiction:
Improvevideo enhancement capabilityVSAvoidreal-time processing speed
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The system performs preliminary actions by pre-defining multiple enhancement templates with different effects (e.g., black and white, sepia, vintage). Users can select from these pre-configured templates during live broadcasting without needing to review or preview each enhancement in real-time, enabling instant application of effects and maintaining real-time processing speed.

Inventive Principle:
Principle #10Preliminary action

3Use of energy by moving object

If plain video capture is used for live broadcasting, then mobile device processing resources are conserved, but the broadcast appears boring and unengaging to viewers

Engineering Contradiction:
Improveprocessing resource consumptionVSAvoidviewer engagement
Core Design Contradiction:
Use of energy by moving objectVSAdaptability or versatility

Solution Approach 1:

The system enables self-service by allowing users to easily select and apply enhancement templates through a simple user interface. The server automatically processes the selected enhancements and applies them to the live video stream. This automated approach provides engaging video content without requiring significant user effort or consuming excessive processing resources on the mobile device.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10425663B2Providing enhanced live video
Publication Date: 2019.09.24 META PLATFORMS INC
  • US10425663B2 patent drawing
  • US10425663B2 patent drawing
  • US10425663B2 patent drawing

AI summary

The present disclosure is directed toward systems and methods for providing an enhanced live video presentation to one or more viewers of a live video stream. In particular, the systems and methods described herein involve detecting a live video stream at an event and, based on received information about the event, generating a video enhancement overlay for the live video stream. In addition, the systems and methods involve providing, for display to one or more viewers, an enhanced live video presentation that includes the live video stream and the video enhancement overlay including information about the event. In this way, systems and methods described herein facilitate an enhanced user experience for broadcasters and viewers of live video content.