Video Stream Backfill via Local Buffer Resend

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Network-based video streaming devices face data loss due to network disruptions, leading to incomplete video streams when connections are interrupted, and existing solutions fail to effectively recover the lost data.

Innovation Solution

Implementing a backfill process where buffered data is resent in a second media data stream, with more recently recorded data sent before less recently recorded data, to fill gaps in the stream, ensuring continuous playback by reversing the data transmission direction after network restoration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If network-based video streaming is implemented, then real-time data transmission is achieved, but data loss occurs during network disruptions

Engineering Contradiction:
Improvereal-time data transmissionVSAvoiddata completeness
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The system performs preliminary actions by continuously buffering video data in local storage before transmission. When network disruptions occur, previously buffered data can be resent to fill gaps, ensuring data completeness without compromising real-time streaming capability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

A buffer storage system acts as an intermediary between the video source and network transmission. This intermediary component stores video data temporarily, allowing for data recovery and retransmission during network disruptions, thus resolving the contradiction between real-time transmission and data reliability

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If data is resent in chronological order, then data integrity is maintained, but playback continuity is disrupted

Engineering Contradiction:
Improvedata integrityVSAvoidplayback continuity
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

Instead of resending data in traditional chronological order, the system inverts the approach by identifying gaps in the received data stream and filling them with the specific missing segments. This inverted gap-filling approach maintains both data integrity and playback continuity by only transmitting the necessary missing portions in the correct sequence

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The system changes the transmission parameter from strict chronological ordering to gap-based selective retransmission. By analyzing which time segments are missing and prioritizing those for retransmission, the system maintains data integrity while ensuring seamless playback without unnecessary delays

Inventive Principle:
Principle #35Parameter changes

3Reliability

If buffered data is used for backfill, then lost data is recovered, but transmission time increases

Engineering Contradiction:
Improvedata recoveryVSAvoidtransmission delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system applies partial action by selectively retransmitting only the specific data segments that were lost during network disruptions, rather than resending the entire buffered data set. This approach recovers lost data efficiently while minimizing additional transmission time

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system implements self-service by automatically detecting data gaps in the received stream and initiating targeted retransmission of missing segments without requiring external intervention. This automated gap-filling process recovers lost data with minimal impact on overall transmission timing

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11165843B2Backfill of video stream
Publication Date: 2021.11.02 GOOGLE LLC
  • US11165843B2 patent drawing
  • US11165843B2 patent drawing
  • US11165843B2 patent drawing

AI summary

This application is directed to a camera system having one or more processors, memory having a limited capacity, a camera element and a microphone. The camera system captures video and audio data in real-time via the camera element and the microphone, respectively. While capturing the video and audio data in real-time, the captured video and audio data are stored in the memory having the limited capacity, and sent to a remote server system via the communication interface for storage by the remote server system. The camera system determines that a portion of the video and audio data was not available at the remote server system. In accordance with a determination that at least some of the portion is still available in the memory having the limited capacity, the camera system resends the at least some of the portion from the memory to the remote server system via the communication interface.