Unlock instant, AI-driven research and patent intelligence for your innovation.

Hotspot data migration flow control method, device, electronic equipment and storage medium

A hot data and flow control technology, applied in the computer field, can solve problems such as affecting user response time and user experience, so as to reduce the risk of data loss, improve flow control effect, and improve efficiency.

Active Publication Date: 2018-11-06
PING AN TECH (SHENZHEN) CO LTD
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, during the process of storing hotspot data in the cache, a large number of input and output (Input / Output, IO) will be generated. If this happens to be the IO peak period of the user application, it will affect the response time of the user application and bring users a lot of trouble. bad experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hotspot data migration flow control method, device, electronic equipment and storage medium
  • Hotspot data migration flow control method, device, electronic equipment and storage medium
  • Hotspot data migration flow control method, device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0057] figure 1 It is a flow chart of the flow control method for hotspot data migration provided by Embodiment 1 of the present invention. According to different requirements, the execution sequence in the flow chart can be changed, and some steps can be omitted.

[0058] S11. Record the data sets accessed by the user every preset time period.

[0059] The preset time period is a preset time period, for example, one week or 10 days. The present invention does not specifically limit the preset time period, which can be set according to the hardware or data access conditions of the electronic system.

[0060] When the electronic device detects the instruction of the user to access the data, it responds to the instruction of the user to access the data, and feeds back the data accessed by the user to the user. Record the data sets accessed by all users within the preset time period.

[0061] S12. Divide the data set into multiple data blocks.

[0062] Divide the recorded da...

Embodiment 2

[0099] figure 2 It is a flow chart of the method for determining the flow control threshold corresponding to the current statistical period according to the IO load of the user application in the previous statistical period provided by the second embodiment of the present invention.

[0100] S21. Obtain the data block size of each IO applied by the user in the last statistical period, and calculate the average data block size of the IOs in the last statistical period.

[0101] The average data block size of the IOs in the last statistical period may be calculated using an arithmetic mean algorithm, a geometric mean algorithm, or a root mean square mean algorithm.

[0102] For example, suppose it is detected that the user application had ten IOs in the last statistical period, and the data block sizes of the ten IOs are: 2M, 1M, 3M, 0.5M, 10M, 4M, 0.1M, 1.2M, 5M and 8M. Using the arithmetic mean algorithm to calculate the average data block size of the IO in the last statist...

Embodiment 3

[0136] image 3 It is a functional block diagram of a preferred embodiment of the hotspot data migration flow control device of the present invention.

[0137] In some embodiments, the hotspot data migration flow control device 30 runs in an electronic device. The hotspot data migration flow control device 30 may include a plurality of functional modules composed of program code segments. The program codes of each program segment in the hotspot data migration flow control device 30 can be stored in a memory and executed by at least one processor to execute (see for details Figure 1-2 and related descriptions) flow control method for hotspot data migration.

[0138] In this embodiment, the hotspot data migration flow control device 30 can be divided into multiple functional modules according to the functions it performs. The functional modules may include: a recording module 301 , a division module 302 , a judgment module 303 , an acquisition module 304 , a migration module...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A hotspot data migration flow control method comprises: recording a data set accessed by a user every preset time period; dividing the data set into a plurality of data blocks; determining whether there are data blocks as hotspot data in the plurality of data blocks; when determining that there are data blocks as hotspot data, determining whether the data blocks determined as the hotspot data arewritten into the cache; when determining that the data blocks determined as the hotspot data are not written into the cache, obtaining a flow control threshold corresponding to the current statisticalperiod in the migration period; and writing the data blocks determined to be the hotspot data into the cache based on the flow control threshold corresponding to the current statistical period. The invention also provides a hotspot data migration flow control device, electronic equipment and a storage medium. The invention is capable of avoiding the obvious impact on the normal input and output service performance while saving the time of reading the hotspot data by writing the hotspot data into the cache, and has good flow control effect.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a flow control method, device, electronic equipment and storage medium for hotspot data migration. Background technique [0002] The cache is the buffer for data exchange. When a piece of hardware, such as a CPU, wants to read data, it will first look for the required data from the cache. If it finds it, it will execute it directly. The cache runs much faster than the memory, so the job of the cache is to help the hardware run faster. [0003] However, the cache is only a copy of a small part of the data in the memory, so when the hardware goes to the cache to find the data, it will not be found (because the data is not copied from the memory to the cache), at this time the hardware goes to the memory to find the data. data, so that the entire system will slow down. [0004] Hotspot data is data that hardware often needs to use. Storing hotspot data in the cache in ad...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0611G06F3/0619G06F3/064G06F3/0647G06F3/0656
Inventor 陈学伟
Owner PING AN TECH (SHENZHEN) CO LTD