Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method and device

A data processing and data sharding technology, applied in the computer field, can solve problems such as high load, user lag, and too small service node sharding value, so as to avoid too large or too small sharding value and optimize service performance Effect

Active Publication Date: 2022-07-08
SHANGHAI BILIBILI TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The present application also relates to a data processing device, a computing device, and a computer-readable storage medium, so as to solve problems in the prior art that the service node fragmentation value is too large, the disk IO load is high, and the service node fragmentation value is too large. Small problems that cause users to freeze

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. However, the present application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar promotions without violating the connotation of the present application. Therefore, the present application is not limited by the specific implementation disclosed below.

[0025] The terminology used in one or more embodiments of the present application is for the purpose of describing a particular embodiment only, and is not intended to limit the one or more embodiments of the present application. As used in one or more embodiments of this application and the appended claims, the singular forms "a," "the," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that the term "and / or" as used in one...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present application provides a data processing method and device, wherein the data processing method includes: receiving a fragmentation adjustment instruction in the current statistical period; obtaining the egress network bandwidth and read bandwidth of the service node in response to the fragmentation adjustment instruction; A read amplification value is calculated from the egress network bandwidth and the read bandwidth; the target fragmentation value of the service node is determined according to the read amplification value and a preset data fragmentation policy. The data processing method of the present application periodically adjusts the fragment size of the service node based on the read bandwidth of the service node, so that the service node achieves optimal service performance.

Description

technical field [0001] The present application relates to the field of computer technology, and in particular, to a data processing method. The present application also relates to a data processing apparatus, a computing device, and a computer-readable storage medium. Background technique [0002] CDN services usually cache the accessed data, and the normal caching process is to shard the entire file. The sharding logic of CDN includes memory sharding and disk sharding. If the shard size is set too large, the memory utilization will be low and the disk IO load will be high. If the shard size is set too small, it may cause users to freeze and even cause system functions. The call rate is high, and the performance bottleneck is shifted from the IO bottleneck to the CPU utilization bottleneck. SUMMARY OF THE INVENTION [0003] In view of this, the embodiments of the present application provide a data processing method. The present application also relates to a data process...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L67/10H04L67/1074H04L67/568H04L41/0894
CPCH04L67/10H04L67/1074H04L41/0893H04L67/568
Inventor 蔡尚志王盛
Owner SHANGHAI BILIBILI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com