System and method for downloading data

A data download and data node technology, applied in the computer field, can solve problems such as large number of files, large amount of stored data, and inconsistency of business users' access to hot spots, so as to improve storage capacity, meet large storage data volumes, and improve data throughput. Effect

Active Publication Date: 2012-07-11
BEIJING QIHOO TECH CO LTD
View PDF4 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] However, the download service in some occasions (such as large-scale software, game download, etc.) usually has the following cha

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for downloading data
  • System and method for downloading data
  • System and method for downloading data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments of the present invention belong to the protection scope of the present invention.

[0044] The embodiment of the present invention firstly provides a data downloading system, the schematic diagram of which is as follows image 3 shown. In this system, comprise a plurality of download clusters (only show a download cluster in the figure), all comprise LVS (Linux Virtual Server, Linux virtual server), at least two download nodes Nginx and a HDFS (Hadoop) in each download cluster Distributed File System, distributed file system), wherein, the operating system run by Nginx moun...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a system and method for downloading data. The system comprises a plurality of downloading clusters. Each downloading cluster comprises a Linux virtual server (LVS), at least two downloading node Nginx servers and a Hadoop distributed file system (HDFS), wherein an operating system of each downloading node Nginx server is used for mounting the storage service of the HDFS through a filesystem in userspace (FUSE); each LVS is used for receiving a downloading request of a user, performing scheduling selection on all Nginx servers and forwarding the downloading request to the selected Nginx server; the Nginx servers are used for accessing the data stored in the HDFS through the FUSE after receiving the downloading request forwarded by each LVS and responding to the downloading request of the user; and each HDFS is used for storing the data. According to the system and the method for downloading the data, the requirements of high stored data volume and great file number can be met, and moreover, the downloading service requirements when the access hotspots of part of service users are not concentrated can also be met.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data downloading system and method. Background technique [0002] With the development of information technology, people are increasingly accustomed to obtaining various data through the network. For example, a common way is to download desired content through a data download system. [0003] Currently, there are mainly two download architectures that are widely used, one is the traditional CDN (Content Delivery Network, content distribution network) multi-layer cache architecture, and the other is the download architecture that is commonly used by general video websites. [0004] The schematic diagram of CDN multi-layer cache architecture is as follows: figure 1 As shown, in this architecture, the global data is only stored in the top-level source site device, and each edge service node is reverse-proxyed by Nginx, which forwards the request to the back-end Squid, and Squi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08
Inventor 王力王锋
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap