Unlock instant, AI-driven research and patent intelligence for your innovation.

ElasticSearch data processing method and device

A data processing and data processing technology, applied in the computer field, can solve the problem of low search efficiency of ElasticSearch

Pending Publication Date: 2021-02-05
山东健康医疗大数据有限公司
View PDF8 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, when updating and deleting documents in ElasticSearch, only document mark processing is performed, and the processed data in the document is not actually deleted due to deletion and update, which leads to a large amount of invalid data in the retrieval process, thus ElasticSearch's search efficiency is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work belong to the protection of the present invention. scope.

[0060] Such as figure 1 As shown, the embodiment of the present invention provides a data processing method of ElasticSearch, and the method may include the following steps:

[0061] Step 101: Obtain and load at least one configuration file, wherein the configuration file includes an early warning threshold and a segment size;

[0062] Step 102: trave...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an ElasticSearch data processing method and device. The method comprises the steps of obtaining and loading at least one configuration file which comprises an early warning threshold and a segment size, traversing a data cluster of ElasticSearch, and determining to-be-processed data according to the early warning threshold value, obtaining storage information of the to-be-processed data, the storage information comprising a total data storage amount, a total document amount and a fragment number, determining a data processing strategy of the to-be-processed data according to the storage information and the segment size, and performing data processing on the to-be-processed data according to the data processing strategy. According to the scheme, the search efficiencyof ElasticSearch can be improved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data processing method and device of ElasticSearch. Background technique [0002] ElasticSearch is a real-time distributed search and analysis engine. Due to its horizontal scalability, it can complete data expansion and scaling by adding more instruments and deploying more ElasticSearch instances to carry more data as the business grows or the data scale increases. Therefore, ElasticSearch is widely used in various information search and data analysis application software. [0003] However, with the improvement of economic and social development needs, documents in ElasticSearch need to be deleted and updated frequently. At present, when updating and deleting documents in ElasticSearch, only document mark processing is performed, and the processed data in the document is not actually deleted due to deletion and update, which leads to a large amount of invalid data in the r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/215G06F16/2455
CPCG06F16/215G06F16/2455
Inventor 邵乐鹏李军
Owner 山东健康医疗大数据有限公司