Data uploading and downloading methods and system

A data and data center technology, applied in the field of communications, can solve the problems of wasted traffic, high cross-network traffic, difficult to synchronize in a short time, etc., to reduce data traffic load, improve response efficiency, and save costs.

Inactive Publication Date: 2010-12-22
HUAWEI TECH CO LTD
View PDF2 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Consistency can be guaranteed in a multi-network environment, but cross-network traffic is relatively high, resulting in waste of traffic; cross-network copies are relatively dynamic, and it is difficult to synchronize in a short time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data uploading and downloading methods and system
  • Data uploading and downloading methods and system
  • Data uploading and downloading methods and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0021] This embodiment provides a method for uploading data. Such as figure 1 As shown, the method includes:

[0022] Step 101: receiving a data upload request from a user, and obtaining a content identifier of the uploaded data;

[0023] This step may be performed by an edge server (ES, Edge Server) in the data distribution storage system. The ES node keeps the domain information of the domain where it is located, that is, the data center address (NetID) of the domain where it is located. And the ES only contacts the storage node (CS, Chunk Server) of the data center in the domain. After receiving the request for uploading data or triggering the processing of the uploaded data, the ES obtains the content identifier (OID, Object ID) of the uploaded data through the Hash algorithm, and cascades the NetID of the domain where the ES is located after the OID. For example, "01982736AFED01982736AFED01982736 1", the first 32 bits are the OID obtained from the 128-bit uploaded dat...

Embodiment 2

[0031] This embodiment provides a method for uploading data. Such as figure 2 As shown, the method includes:

[0032] Step 201: The ES receives a data upload request or triggers the processing of the uploaded data, and obtains the content identifier (OID) of the data. The ES obtains the temporary OID of the data and concatenates the NetID1 of the domain where the ES is located. For example, "01982736AFED01982736AFED019827361", the first 32 bits are the OID obtained from the 128-bit uploaded data through the Hash algorithm, and the last bit indicates the NetID1 of the data center where the ES is located.

[0033] Step 202: ES submits to MM a request for uploading legality by the authenticated user. ES sends the user's relevant information and the above-mentioned OID and NetID1 to MM. MM verifies whether the user has the upload permission according to the relevant information of the user. If it is legal, then checks whether the uploaded data has been registered according to ...

Embodiment 3

[0050] This embodiment provides a method for downloading data. Such as image 3 As shown, the method includes:

[0051] Step 301: receiving a download data request from a user, and obtaining a content identifier of the download data;

[0052] This step can be performed by an edge server (ES) in the data distribution storage system. The download request received by the ES carries the content identifier (OID) of the downloaded data, and the content is obtained through a Hash algorithm.

[0053] Step 302: Determine whether the downloaded data is stored in a local data center or a non-local data center according to the content identifier;

[0054] This step can be performed by ES and MM of the data distribution storage system. The MM stores the content identifier of the data and the NetID2 of the data center where the data is stored. The ES submits a query request to the MM, and the MM queries the NetID2 of the data center corresponding to the content identifier storing the d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides data uploading and downloading methods and a data uploading and downloading system. The uploading method comprises the following steps of: receiving a data uploading request of a user, and acquiring a content identifier of the uploaded data; determining whether the uploaded data is stored according to the content identifier; and uploading and storing the uploaded data to a local data center if the uploaded data is not stored. The uploading method has the advantages of lightening data flow load between different networks, improving the response efficiency, performing unified management on content copies of different networks, rapidly querying the content copies, and reducing the distribution number of the same content copies in the system on the network.

Description

technical field [0001] The present invention relates to the field of communication technology, in particular to a data upload method, download method and system. Background technique [0002] The popularization of intelligent access terminals and the diversification of access methods generate a large amount of user-generated content (UGC, User Generated Content), which is stored, shared and distributed on the network. In order to ensure the user experience, sufficient network resources are needed to Support, especially large-scale storage resources in the network. The diversification of businesses based on these resources has prompted the establishment of many data centers, and these data centers will logically form a huge resource pool. In the resource pool, many businesses are reusing the same content, but these content copies are allocated resources according to their respective businesses. In the prior art, a high-speed network such as a dedicated network needs to be l...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08G06F17/30
CPCH04L67/2852H04L67/06H04L67/5682
Inventor 王铁英
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products