Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Learning-based storage reduction in an overlay network

Pending Publication Date: 2022-01-27
AKAMAI TECH INC
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

The patent describes a system that uses a data reduction technique to store high dimension data in a more efficient way. The system uses a learning-based application that processes the data and reduces its size. This reduces the amount of physical data that needs to be stored but does not decrease its informational value. The data is reduced using a technique called Principal Component Analysis (PCA) and stored either in a native data storage or a cloud. The system allows for easy recovery of the original data when requested. Overall, the system provides a way to manage large data sets more efficiently.

Problems solved by technology

Datasets generated by these processes are complex and typically comprise an interrelated set of data items.
Sustaining a large volume of data is costly both in terms of processing (CPU usage) and storage.
Memory and RAM overflow leads to the creation of data backlogs, and the cascading effects of such issues can lead to delays in real-time reporting that is utilized by the provider both for customer billing and internal analytics.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Learning-based storage reduction in an overlay network
  • Learning-based storage reduction in an overlay network
  • Learning-based storage reduction in an overlay network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015]In a known system, such as shown in FIG. 1, a distributed computer system 100 is configured as a content delivery network (CDN) and is assumed to have a set of machines 102a-n distributed around the Internet. Typically, most of the machines are servers located near the edge of the Internet, i.e., at or adjacent end user access networks. A network operations command center (NOCC) 104 manages operations of the various machines in the system. Third party sites, such as web site 106, offload delivery of content (e.g., HTML, embedded page objects, streaming media, software downloads, and the like) to the distributed computer system 100 and, in particular, to “edge” servers. Typically, content providers offload their content delivery by aliasing (e.g., by a DNS CNAME) given content provider domains or sub-domains to domains that are managed by the service provider's authoritative domain name service. End users that desire the content are directed to the distributed computer system t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

An overlay network is augmented to provide more efficient data storage by processing a dataset of high dimension into an equivalent dataset of lower dimension, wherein the data reduction reduces the amount of actual physical data but not necessarily its informational value. Data to be processed (dimensionally-reduced) is received by an ingestion layer and supplied to a learning-based storage reduction application that implements the data reduction technique. The application applies a data reduction algorithm and stores the resulting dimensionally-reduced data sets in the native data storage or third party cloud. To recover the original higher-dimensional data, an associated reverse algorithm is implemented. In general, the application coverts an N dimensional data set to a K dimensional data set, where K<<N. The N dimensional dataset has a high dimension, and the K dimensional dataset has a low dimension. From a data storage perspective, it is cheaper and more efficient to store the low dimensional dataset.

Description

BACKGROUNDTechnical Field[0001]This application relates generally to optimizing data storage in a distributed computing network environment.Brief Description of the Related Art[0002]Distributed computer systems are well-known in the prior art. One such distributed computer system is a “content delivery network” (CDN) or “overlay network” that is operated and managed by a service provider. The service provider typically provides the content delivery service on behalf of third parties (customers) who use the service provider's shared infrastructure. A distributed system of this type typically refers to a collection of autonomous computers linked by a network or networks, together with the software, systems, protocols and techniques designed to facilitate various services, such as content delivery, web application acceleration, or other support of outsourced origin site infrastructure. A CDN service provider typically provides service delivery through digital properties (such as a webs...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/182G06F17/16G06N20/00G06F16/14
CPCG06F16/1827G06F16/148G06N20/00G06F17/16H04L12/2856G06N3/088G06N20/10
Inventor BANERJEE, INDRAJIT
Owner AKAMAI TECH INC
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More