Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data acquisition method, system and device, computer equipment and storage medium

A data acquisition and computer program technology, applied in the Internet field, can solve the problems of large read delay of mirror warehouse and inability to meet the needs of high concurrency and high throughput mirror requests.

Active Publication Date: 2021-05-04
中科曙光国际信息产业有限公司
View PDF13 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004]However, the above-mentioned mirror warehouse based on the disk file system is stored or distributed in units of the entire mirror file, resulting in a large reading delay of the mirror warehouse process, which cannot meet the high Concurrent high-throughput mirroring requests require

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data acquisition method, system and device, computer equipment and storage medium
  • Data acquisition method, system and device, computer equipment and storage medium
  • Data acquisition method, system and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

[0057] The data acquisition method provided in this application can be applied to such as figure 1 in the application environment shown. figure 1 A schematic structural diagram of the data acquisition system is given, wherein the first client 101 communicates with the scheduler 102 through the network, the scheduler 102 communicates with the mirror cache node 103 through the network, and the mirror cache node 103 communicates with the distributed storage system 104 through the network. communication. Wherein, the first client 101 can be, but is not limited to, variou...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data acquisition method, system and device, computer equipment and a storage medium. The method comprises the steps that a scheduler receives a data acquisition request sent by a first client side, if idle mirror image cache nodes exist in a distributed mirror image warehouse, at least one mirror image cache node is determined from the idle mirror image cache nodes, and the at least one mirror image cache node is called to acquire at least one data block corresponding to the data packet identifier in the data acquisition request from a distributed storage system in the distributed mirror image warehouse, and the at least one data block forms a data packet, and the data packet is sent to the first client. According to the method, each mirror image data is subjected to block storage based on the distributed storage system, horizontal expansion of service capability and storage capacity is achieved, the problem of single-machine storage capacity is solved, and a plurality of mirror image cache nodes are deployed based on the distributed storage system, so that the bandwidth pressure of the distributed storage system is greatly reduced, and the reading delay of the data packet is shortened.

Description

technical field [0001] The present application relates to the field of Internet technologies, and in particular, to a data acquisition method, system, device, computer equipment and storage medium. Background technique [0002] Linux containers (LXC) is a kernel virtualization technology that can provide lightweight virtualization in order to isolate processes and resources. Now the relatively formed technology is to simplify the deployment and release of software through Docker container technology. The core of container technology is to package the operating environment through images. In the release management of container images, the image repository is responsible for the storage and distribution of images. [0003] The existing technology realizes the storage and distribution of the entire image file based on the Docker Registry open source private image repository and disk file system, and extends and enhances the Docker Registry open source private image repository, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/06
CPCG06F3/0613G06F3/0656G06F3/067
Inventor 原帅张晋锋吕灼恒贾冬冬
Owner 中科曙光国际信息产业有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com