Partial Frame Extraction for Bandwidth-Constrained Media Streaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High-resolution video streaming over wireless communication networks faces challenges due to the large bandwidth requirements, leading to inefficient use of resources and increased computational load, especially when transmitting full frames of high-definition or 4K2K videos.

Innovation Solution

A real-time video streaming system that extracts and transmits partial frames with a lower resolution based on user-defined gestures or interests, using a media source with multiple cameras capturing content from different angles, and transmitting only the buffer area surrounding the partial frame to optimize bandwidth usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If high-resolution video content is transmitted over wireless communication, then video quality is improved, but bandwidth consumption increases

Engineering Contradiction:
Improvevideo qualityVSAvoidbandwidth consumption
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The video frame is segmented into multiple regions of interest (ROIs) based on user gesture commands. Instead of transmitting the entire high-resolution frame, only the selected ROI portions are extracted and transmitted, maintaining video quality for relevant areas while reducing overall bandwidth consumption.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system extracts only the necessary partial frame data corresponding to the user's region of interest from the complete high-resolution video frame. This extraction process removes unnecessary data while preserving the essential visual information, resolving the contradiction between quality and bandwidth usage.

Inventive Principle:
Principle #2Taking out (Extraction)

2Loss of information

If full high-resolution frames are transmitted, then complete scene information is provided, but transmission time increases

Engineering Contradiction:
Improvescene information completenessVSAvoidtransmission time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system extracts only the relevant portion of the video frame that contains the user's region of interest. By removing unnecessary frame data while preserving essential scene information, the transmission time is reduced without significant loss of meaningful content.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of transmitting the complete frame, the system transmits only a partial frame containing the user's selected region of interest. This partial action approach reduces transmission time while maintaining sufficient scene information for the user's viewing needs.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If high-resolution video is processed and transmitted, then image detail is improved, but computational load increases

Engineering Contradiction:
Improveimage detailVSAvoidcomputational load
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system extracts only the necessary high-resolution data for the user's region of interest rather than processing and transmitting the entire high-resolution frame. This extraction approach maintains image detail quality for relevant areas while significantly reducing the computational load required for processing and transmission.

Inventive Principle:
Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces bandwidth consumption and computational resources by transmitting only the relevant data, allowing for efficient and real-time adjustment of the video stream according to user interests, enhancing the viewing experience while minimizing resource waste.

Implementation Method 1

receiving, by a plurality of radiation sensors (128) disposed on different spots on a virtual reality headset, the displayer device (120) being the virtual reality headset, a radiation from the radiation indicator at different time stamps

Methodology Applied
Scientific EffectRadiation detection: Absorption (EM radiation)

Data Source

PatentEP3065413B1Media streaming system and control method thereof
Publication Date: 2019.08.28 HTC CORP
  • EP3065413B1 patent drawingFigure 1
  • EP3065413B1 patent drawingFigure 2A~2B
  • EP3065413B1 patent drawingFigure 3

AI summary

A media streaming system, a media streaming method and a non-transitory computer readable storage medium thereof are disclosed. The media streaming system includes a media source and a displayer device. The media source is configured to provide a media content with a first resolution. The displayer device communicatively connected with the media source. The displayer device includes a display panel and a gesture input module. The display panel is configured to display with a second resolution lower than the first resolution. The gesture input module is configured to generate a gesture command. The media source is configured to extract a partial frame with the second resolution from the media content according to the gesture command. A relative location of the partial frame in the media content is determined by the gesture command. Data of the partial frame is transmitted from the media source to the displayer device.