Caching method, system and device for small block input and storable medium

A caching system and caching technology, applied in the field of data processing, can solve the problems of slow update speed, too long IO write process, too many invalid operations, etc., to achieve the effect of improving efficiency, alleviating bottleneck problems, and improving data update speed

Pending Publication Date: 2019-05-24
PING AN TECH (SHENZHEN) CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In view of the above problems, the object of the present invention is to provide a caching method, system, device and storage medium for small block input, so as to solve the problem that the current IO writing process is too long, there are too many invalid operations, and the reading and updating speeds are slow. low efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Caching method, system and device for small block input and storable medium
  • Caching method, system and device for small block input and storable medium
  • Caching method, system and device for small block input and storable medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0034] In order to illustrate the caching method for small block input provided by the present invention, figure 1 The flow of the caching method for small block input according to the embodiment of the present invention is shown. The data writing request involved in the present invention includes some metadata information and data, wherein the metadata includes data such as the name, offset, and length of the object to be written.

[0035] like figure 1 As shown, the caching method for small block input provided by the present invention may include the following steps:

[0036] S110: Integrate multiple write requests belonging to an object into an IO set;

[0037] S120: Send the integrated IO set to the placement strategy group;

[0038] S130: Integrate the IO collections in the placement strategy group;

[0039] S140: Perform cache processing on the metadata of the objects of the IO collection in the integrated placement policy group.

[0040] Due to the improvement of ...

Embodiment 2

[0065] Corresponding to the above method, the present invention also provides a cache system for small block input, Figure 5 The logic structure of the cache system for small block input according to the embodiment of the present invention is shown.

[0066] like Figure 5 As shown, the cache system 500 for small block input provided by the present invention includes an IO integration unit 510 , a PG collection unit 520 , a PG integration unit 530 and a cache unit 540 . in,

[0067] The IO integration unit 510 is configured to integrate multiple small IOs belonging to an object, and integrate multiple small IOs belonging to an object into an IO set belonging to the object;

[0068] The PG collection unit 520 is configured to transmit the integrated IO set to the placement strategy group;

[0069] The PG integration unit 530 is configured to integrate the IO sets in the placement strategy group;

[0070] The caching unit 540 is configured to cache the metadata of the objec...

Embodiment 3

[0076] Image 6 It is a schematic diagram of the logic structure of the electronic device provided by an embodiment of the present invention. like Image 6 As shown, the electronic device 600 of this embodiment includes a processor 610 , a memory 620 and a computer program 621 stored in the memory 620 and operable on the processor 610 . When the processor 610 executes the computer program 621, various steps of the caching method for small block input in Embodiment 1 are implemented, for example figure 1 Steps S110 to S140 are shown. Alternatively, when the processor 610 executes the caching method for small block input, the functions of the modules / units in the above-mentioned device embodiments are implemented, for example Figure 5 The IO integration unit 510 , the PG collection unit 520 , the PG integration unit 530 and the cache unit 540 are shown.

[0077] Exemplarily, the computer program 621 can be divided into one or more modules / units, and one or more modules / unit...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of data processing, and provides a caching method, system and device for small block input and a storage medium, and the method comprises the steps: S110,integrating multiple write requests belonging to an object into an IO set belonging to the object; S120, transmitting the integrated IO set to a placement strategy group; S130, integrating the IO setsin the placement strategy group; and S140, performing caching processing on the metadata of the object of the IO set in the integrated placement strategy group. By utilizing the method and the device, the IO quantity of PG processing can be reduced, CPU resources are released, and the data processing efficiency is improved.

Description

technical field [0001] The present invention relates to the technical field of data processing, and more specifically, to a caching method, system, device and storage medium for small block input. Background technique [0002] With the improvement of informatization, more and more data information needs to be read and written by computers, and the application of massive data information puts forward higher requirements for the way of reading and writing data. [0003] Due to the complexity of application data, in many data read and write applications, it is often necessary to repeatedly perform data IO (I / O, Input / Output, input and output) operations on a certain object, and the repeated IO process consumes a lot of CPU resource. [0004] Among them, the data writing request process is too long, especially for small pieces of data, each IO has to go through lengthy PG (placement group, placement strategy group) logic and object storage logic. Every time object storage writ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F12/0895
Inventor 宋小兵
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap