System and method for downloading data

A data download and data node technology, applied in the computer field, can solve the problems of non-concentrated access of business users, large number of files, and large amount of stored data, so as to improve data throughput, improve storage capacity, and meet the needs of large storage data. Effect

Inactive Publication Date: 2015-06-10
BEIJING QIHOO TECH CO LTD
View PDF2 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] However, the download service in some occasions (such as large-scale software, game download, etc.) usually has the following characteristics: a large amount of stored data, a large number of files, and some business users access hotspots are not concentrated, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for downloading data
  • System and method for downloading data
  • System and method for downloading data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments of the present invention belong to the protection scope of the present invention.

[0044] The embodiment of the present invention firstly provides a data downloading system, the schematic diagram of which is as follows image 3 shown. In this system, comprise a plurality of download clusters (only show a download cluster in the figure), all comprise LVS (Linux Virtual Server, Linux virtual server), at least two download nodes Nginx and a HDFS (Hadoop) in each download cluster Distributed File System, distributed file system), wherein, the operating system run by Nginx moun...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a system and a method for downloading data. The system comprises a plurality of downloading groups, wherein each downloading group comprises an Linux virtual server LVS, at least two downloading nodes Nginx and a distributed file system HDFS; an Nginx operation system is used for mounting storage service of the HDFS through a user space file system FUSE; the LVS is used for receiving a download request from the user, performing scheduling selection for each Nginx and forwarding the download request to the selected Nginx; the Nginx are used for accessing data stored in the HDFS through the FUSE after receiving the download request forwarded by the LVS, and responding to the download request of the user; the HDFS is used for storing data. According to the method, the demand on download service under large storage data quantity, large file quantity and non-concentrated access hot spots of some service users can be met.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data downloading system and method. Background technique [0002] With the development of information technology, people are increasingly accustomed to obtaining various data through the network. For example, a common way is to download desired content through a data download system. [0003] Currently, there are mainly two download architectures that are widely used, one is the traditional CDN (Content Delivery Network, content distribution network) multi-layer cache architecture, and the other is the download architecture that is commonly used by general video websites. [0004] The schematic diagram of CDN multi-layer cache architecture is as follows: figure 1 As shown, in this architecture, the global data is only stored in the top-level source site device, and each edge service node is reverse-proxyed by Nginx, which forwards the request to the back-end Squid, and Squi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCH04L65/40H04L67/1095
Inventor 王力王锋
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap