Cloud Server Pre-loading for Streaming Content Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users experience significant latency and lag when interacting with cloud-based services for streaming content, such as music, due to the delay in processing commands and buffering content items in existing architectures.

Innovation Solution

Storing a small portion of each content item at the cloud server system allows for immediate playback by providing it to the computing device along with the initial response, reducing the need for the device to wait for network resources to obtain the same content from both the cloud services and the content source.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If cloud services process commands and stream content from remote content sources, then content can be accessed remotely without local storage, but user-perceived latency and lag time increase significantly

Engineering Contradiction:
Improveuser-perceived latencyVSAvoidsystem architecture complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The system pre-loads a portion of content items (e.g., first 10-15 seconds) and stores them in advance at the cloud server system. When a user requests content, the pre-loaded portion is immediately transmitted to the computing device, eliminating the need to wait for network buffering. This preliminary action directly reduces user-perceived latency while maintaining a manageable cloud storage footprint.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The content delivery process is segmented into two parts: a pre-loaded initial portion stored at the cloud server, and the remainder streamed from the content source. This segmentation allows the system to provide immediate playback of the initial portion while simultaneously buffering the rest, resolving the contradiction between fast access and complete content delivery.

Inventive Principle:
Principle #1Segmentation

2Speed

If the computing device buffers content from network resources, then complete content can be obtained, but playback delay increases due to network transmission time

Engineering Contradiction:
Improvecontent delivery speedVSAvoidbuffering time
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The cloud server system performs the buffering action in advance by pre-loading content portions before user requests. This shifts the buffering time from occurring at the device level (after user action) to occurring beforehand at the server level, making the content immediately available for fast delivery when needed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The cloud server system acts as an intermediary between the content source and the computing device. It pre-loads content from the content source and stores it temporarily, then delivers it immediately to the device. This intermediary role eliminates the direct network transmission delay that would otherwise occur between the content source and device.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Quantity of substance

If cloud services store and serve content directly, then local device storage is reduced, but network bandwidth consumption increases during playback

Engineering Contradiction:
Improvelocal storage requirementVSAvoidnetwork bandwidth consumption
Core Design Contradiction:
Quantity of substanceVSUse of energy by moving object

Solution Approach 1:

The system applies local quality by storing only a specific portion (initial 10-15 seconds) of each content item at the cloud server, rather than storing complete content or using local device storage. This targeted local storage approach minimizes both cloud storage requirements and network bandwidth consumption during playback, as only the pre-loaded portion needs immediate transmission.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9516081B2Reduced latency electronic content system
Publication Date: 2016.12.06 AMAZON TECH INC
  • US9516081B2 patent drawing
  • US9516081B2 patent drawing
  • US9516081B2 patent drawing

AI summary

An architecture for selecting and providing content items to a device includes cloud-based resources of a device management service and one or more content sources. The device is configured to receive instructions and a portion of the content item from the device management service. The instructions direct the device to obtain and buffer the content item from the content source, while simultaneously outputting the portion of the content item to a user.