Elasticsearch cluster expansion method supporting resource leveling

An extension method and clustering technology, applied in the direction of resource allocation, special data processing applications, instruments, etc., can solve the problem that the sharding mechanism cannot meet the requirements, cannot fix the number of main shards of the Hash sharding mechanism, etc., and avoid local hot spots. Effect
CN107566531AActive Publication Date: 2018-01-09XIAMEN MEIYA PICO INFORMATION
4 Cites 19 Cited by

Patent Information

Authority / Receiving Office
CN Β· China
Current Assignee / Owner
XIAMEN MEIYA PICO INFORMATION
Publication Date
2018-01-09

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention relates to an Elasticsearch cluster expansion method supporting resource leveling. The method includes steps of S1, mounting Elasticsearch nodes according to server hardwire resource; S2, setting basic parameters of a dynamic cluster and recording some state values of the dynamic cluster, and performing data persistence on the parameters and the dynamic values in format of database or XML into a magnetic disk; S3, creating a thread, detecting file number and space occupancy regularly, and creating zones and adjusting storage strategy dynamically according to system parameters ifa threshold value is reached. According to the invention, data volume of corresponding proportions can be stored according to performance load leveling of a server in an Elasticsearch cluster and automatic creating of bases and zones are supported according a target data volume and the magnetic disk space threshold value, and the cluster is expanded dynamically. Therefore, problems of excessive data volume of one zone and local hot spots during new data insertion are avoided. At the same time, automatic recognition and load leveling on bases and zones of the Elasticsearch cluster can be realized after a new server is added into the cluster.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to an Elasticsearch cluster expansion method supporting balanced resources. Background technique

[0002] With the development and progress of society, it has entered the era of big data, and the storage and retrieval of massive data has been applied to various fields. Among them, full-text search is one of the commonly used functions, which is similar to the query effect of Baidu and Taobao. Elasticsearch is the most used enterprise-level search application server in full-text search, and has provided solutions for large enterprises such as Acerson, Blizzard Entertainment, Dell, and eBay. It has the characteristics of rich functions, near real-time retrieval, cluster support, etc., and is free and open source.

[0003] For the storage of massive data, Elasticsearch supports cluster mode, and multiple data nodes can be deployed on each server. Each library can be divided into multiple primary shards, and each primary shard is s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More