Partition segmentation method and device, server and storage medium

A partitioning and splitting point technology, applied in the field of Internet technology applications, can solve problems such as uneven partitioning, partition fragmentation, unfavorable cluster region management and performance load, etc., to reduce region fragmentation, maintain balanced load, and facilitate region management Effect

Pending Publication Date: 2020-11-20
CHINA MOBILEHANGZHOUINFORMATION TECH CO LTD +1
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the inventors found the following problems in related technologies: Since Hbase row keys are arranged in lexicographical order, the prefix segmentation strategy of related technolog

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Partition segmentation method and device, server and storage medium
  • Partition segmentation method and device, server and storage medium
  • Partition segmentation method and device, server and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0025] In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the various embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, a person of ordinary skill in the art can understand that, in each embodiment of the present invention, many technical details are proposed for the reader to better understand the present application. However, even without these technical details and various changes and modifications based on the following embodiments, the technical solution claimed in this application can be realized. The following division of the various embodiments is for convenience of description, and should not constitute any limitation on the specific implementation of the present invention, and the various embodiments may be combined with each other without contradiction.

[0026] The first embodiment of the present invention relates to a parti...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An embodiment of the invention relates to the field of Internet technology application, and discloses a partition segmentation method and device, a server and a storage medium. The method comprises the steps: acquiring a first critical point set, wherein the row key prefix of a row identified by a critical point is different from the previous row key prefix of the row identified by the critical point; obtaining the distance between the row of the critical point identifier and the partition center; obtaining a second critical point set of which the distance meets a preset distance range from the first critical point set; selecting a segmentation point according to the second critical point set. According to the method and the device, region fragments caused by non-uniform segmentation can be reduced, empty partitions caused by continuous splitting are reduced, meanwhile, the balanced load of the data on the partition level is kept as much as possible, and the region management of the cluster is facilitated.

Description

technical field [0001] The embodiments of the present invention relate to the field of Internet technology applications, and in particular, to a method, device, server, and storage medium for partitioning and dividing. Background technique [0002] Hbase is a distributed, column-oriented open source database. The scalability of the HBase cluster is mainly realized by partitions. The partition automatic segmentation mechanism ensures the scalability of the HBase table in the cluster. The theory of partition segmentation involves the triggering of segmentation. Timing, determination of segmentation point, transactional guarantee and exception handling of segmentation, and optimal selection of segmentation. Currently, HBase provides a variety of optional partition segmentation strategies, which determine the selection of segmentation thresholds and segmentation points. [0003] However, the inventors found the following problems in related technologies: Since Hbase row keys ar...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/22G06F16/27G06F16/21
CPCG06F16/2282G06F16/27G06F16/217
Inventor 温少雄谢韦华杨高明张炜
Owner CHINA MOBILEHANGZHOUINFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products