Video Frame Dependency Segmentation for QoS Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video streaming technologies fail to effectively differentiate the quality of service (QoS) for video streams on a per-frame basis, leading to unreliable transmission and increased costs due to uniform treatment of all frames, which results in noticeable glitches when key frames are dropped, affecting user experience and video analytics.

Innovation Solution

The proposed solution involves evaluating frame dependencies to prioritize and deliver high-coupling frames using more reliable mechanisms, such as QoS streaming protocols, replication, and caching at edge resources, while maintaining cost-effectiveness by only employing high-reliability delivery on high-priority frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If uniform transmission method is used for all video frames, then transmission cost is reduced, but quality of service deteriorates due to frame drops affecting dependent frames

Engineering Contradiction:
Improvequality of serviceVSAvoidtransmission complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments video frames into different priority levels (high-priority key frames and low-priority non-key frames) based on their dependency relationships. This segmentation allows differential transmission strategies to be applied: high-priority frames receive reliable transmission mechanisms while low-priority frames use cost-effective methods, thereby improving overall QoS without uniformly increasing complexity across all frames.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by assigning different transmission qualities to different frame types. High-priority frames (key frames) are transmitted with high reliability using QoS protocols and replication, while low-priority frames (non-key frames) use standard transmission. This localized quality differentiation resolves the contradiction by concentrating reliability resources where they are most needed rather than applying uniform complexity across all frames.

Inventive Principle:
Principle #3Local quality

2Reliability

If high-reliability transmission is applied to all frames, then quality of service is improved, but transmission cost increases

Engineering Contradiction:
Improvedelivery reliabilityVSAvoidtransmission cost
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent divides frames into high-priority and low-priority segments based on dependency analysis. Only high-priority frames (key frames that other frames depend on) receive high-reliability transmission treatments including QoS protocols and replication. Low-priority frames use standard transmission methods. This segmentation ensures delivery reliability for critical frames while avoiding unnecessary transmission costs for non-critical frames.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the transmission parameter (reliability level) based on frame priority. High-priority frames transmit with high reliability parameters (QoS protocols, replication), while low-priority frames use low reliability parameters (standard transmission). This parameter differentiation resolves the contradiction by matching transmission cost to actual frame importance rather than applying uniform high cost to all frames.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If key frames are transmitted with higher priority, then video rendering quality is improved, but transmission complexity increases

Engineering Contradiction:
Improvevideo rendering qualityVSAvoidframe classification complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary action by analyzing frame dependencies and classifying frames into priority levels before transmission begins. This pre-classification allows the transmission system to apply appropriate reliability measures in advance, ensuring high-priority frames receive adequate protection. The preliminary classification simplifies the transmission process rather than increasing complexity during actual transmission, as the prioritization logic is established beforehand.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary frame dependency analysis mechanism that mediates between the video source and transmission channel. This intermediary analyzes frame relationships, identifies key frames, and generates priority labels that guide transmission decisions. Rather than increasing transmission complexity, this intermediary layer provides structured information that simplifies the transmission process by enabling automated priority-based routing and reliability applications.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11373406B2Transmission, caching, and searching of video streams based on frame dependencies and content
Publication Date: 2022.06.28 INTEL CORP
  • US11373406B2 patent drawing
  • US11373406B2 patent drawing
  • US11373406B2 patent drawing

AI summary

In one embodiment, an apparatus comprises processing circuitry to: receive, via a network interface, a video stream comprising a plurality of video frames; identify a plurality of dependencies among the plurality of video frames; identify, based on the plurality of dependencies, a first subset of video frames to be transmitted using a first transmission method and a second subset of video frames to be transmitted using a second transmission method, wherein the first subset of video frames and the second subset of video frames are identified from the plurality of video frames, and wherein the first transmission method provides a higher quality of service than the second transmission method; transmit, via the network interface, the first subset of video frames to a corresponding destination using the first transmission method; and transmit, via the network interface, the second subset of video frames to the corresponding destination using the second transmission method.