Multimedia Streaming Frame Buffer Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional multimedia data streaming techniques often result in a distorted screen at startup due to the delay in adding decoded frames to the frame buffer, leading to a temporary delay in displaying multimedia content.

Innovation Solution

Implementing a system where a rendering service controls the timing of drawing a transparent area and a player window, ensuring that at least one frame associated with the multimedia data is decoded before rendering, thereby preventing distorted screens by notifying the decoding service and utilizing the status of the decoding process to synchronize the rendering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Shape

If a transparent area is drawn first and then a player window is drawn separately at a different drawing layer, then the display interface can be properly structured with overlapping layers, but the decoded frames take time to be added to the frame buffer causing a temporary delay and distorted screen at startup

Engineering Contradiction:
Improvedisplay interface structureVSAvoidstartup delay
Core Design Contradiction:
ShapeVSLoss of time

Solution Approach 1:

The patent applies preliminary action by checking whether at least one frame has been decoded before drawing the transparent area and player window. The rendering service notifies the decoding service to check decoding status in advance, and only proceeds with drawing operations after confirming that decoded frames are available in the frame buffer. This ensures the display interface is properly structured without causing startup delays or distorted screens.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If decoded frames are added to the frame buffer during streaming startup, then data loss and degradation are prevented, but the frames take time to be added causing a temporary delay in supplying decoded multimedia frames for displaying

Engineering Contradiction:
Improvedata integrityVSAvoidframe supply speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements feedback by establishing a notification mechanism where the rendering service checks the decoding status with the decoding service before proceeding with drawing operations. The decoding service provides feedback on whether frames have been successfully added to the frame buffer, and the rendering service adjusts its drawing timing based on this feedback. This ensures data integrity while optimizing frame supply speed by avoiding premature drawing operations.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If the player window is drawn to display decoded frames, then multimedia content can be presented to users, but at startup the screen appears distorted due to lack of decoded frames in the buffer

Engineering Contradiction:
Improvecontent display capabilityVSAvoidscreen display quality
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by performing a decoding status check before drawing the player window. The rendering service notifies the decoding service to verify whether at least one frame has been decoded and added to the frame buffer. Only after confirming frame availability does the system draw the player window to display multimedia content. This preliminary verification ensures both content display capability and screen display quality without distortion.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10805570B2System and method for streaming multimedia data
Publication Date: 2020.10.13 BANMA ZHIXING NETWORK HONGKONG CO LTD
  • US10805570B2 patent drawing
  • US10805570B2 patent drawing
  • US10805570B2 patent drawing

AI summary

A method for processing multimedia data is disclose, including: determining whether at least one frame associated with the multimedia data has been decoded; in response to the determination that the at least one frame associated with the multimedia data has been decoded, drawing a transparent area on a display interface; and instructing a multimedia data playing window and the at least one frame associated with the multimedia data to be drawn, wherein the transparent area and the multimedia data playing window overlap at different drawing layers.