Unlock instant, AI-driven research and patent intelligence for your innovation.

A method and system for data retrieval optimization based on elasticsearch

A technology of data retrieval and optimization method, applied in the field of big data, can solve the problems of inability to retrieve range adjustment, data retrieval delay, etc., to achieve the effect of optimizing storage structure and storage time, reducing storage, and enhancing storage capacity

Active Publication Date: 2022-07-05
浪潮卓数大数据产业发展有限公司
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Among various full-text retrieval systems, the products represented by elasticsearch have been recognized by everyone for their convenience, ease of use, fast efficiency, and are widely used in various business systems by various teams; when the current full-text retrieval system performs retrieval work, It is impossible to effectively adjust the retrieval range according to business needs, and at the same time, the data cache in the retrieval process will cause delays in data retrieval. Therefore, a data retrieval optimization method and system based on elasticsearch is now invented to solve the above problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for data retrieval optimization based on elasticsearch
  • A method and system for data retrieval optimization based on elasticsearch
  • A method and system for data retrieval optimization based on elasticsearch

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] A data retrieval optimization method based on elasticsearch, the specific steps of the method are as follows:

[0042] S1 selects field data to generate an index according to the retrieval purpose:

[0043] S101 forms a series of words Term through grammatical analysis and language processing of the index file;

[0044] S102 forms a dictionary and an inverse index table through index creation;

[0045] S103 writes the index to the hard disk through index storage;

[0046] S2 obtains a series of words Term through grammatical analysis and language analysis of the input query statement;

[0047] S3 obtains a query tree through syntax analysis;

[0048] S4 reads the index into memory through index storage;

[0049] S5 uses the query tree to search the index, obtains the document linked list of each word Term, intersects the document linked list, and obtains the result document:

[0050] S501 searches based on elasticsearch and stores the original file in hbase;

[00...

Embodiment 2

[0060] A data retrieval and optimization system based on elasticsearch, the system specifically includes a word segmentation module, a filtering module, an analysis module, a storage module, a query module, a sorting module and a feedback module:

[0061] Word segmentation module: select field data to generate an index according to the retrieval purpose;

[0062] The word segmentation module specifically includes a processing module, a building module and a saving module:

[0063] Processing module: The index file is parsed and language processed to form a series of words Term;

[0064] Building module: form a dictionary and reverse index table through index creation;

[0065] Save module: write the index to the hard disk through index storage;

[0066] Filtering module: a series of words Term are obtained by grammatical analysis and language analysis of the input query statement;

[0067] Analysis module: get a query tree through syntax analysis;

[0068] Storage module: ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an elasticsearch-based data retrieval optimization method and system, belonging to the field of big data. The specific steps of the method are as follows: S1 selects field data to generate an index according to a retrieval purpose; A series of words Term are obtained by analysis; S3 obtains a query tree through grammatical analysis; S4 reads the index into memory through index storage; S5 uses the query tree to search for the index; S6 sorts the searched result documents for the relevance of the query; S7 Return the query results to the user; when the purpose of using elasticsearch is to provide retrieval functions for other systems, and only the document id needs to be obtained, the present invention can choose not to store the original document, which will reduce disk usage, reduce unnecessary storage, and optimize storage The structure and storage time enhance the storage capacity of the system and improve the efficiency of the system.

Description

technical field [0001] The invention discloses a data retrieval optimization method and system based on elastic search, and relates to the technical field of big data. Background technique [0002] In the era of big data, with the rapid rise and popularization of Internet technology, the amount of data generated by people in different fields has reached an unprecedented level. At the same time, revolutionary changes have taken place in the way data is generated, stored and processed. People's work and life can basically be represented digitally, so it is increasingly important to use an efficient way to retrieve data. [0003] Among various full-text retrieval systems, the products represented by elasticsearch have been recognized by everyone for their convenience, ease of use, speed and efficiency, and are widely used in various business systems by various teams; the current full-text retrieval system, when searching, The retrieval range cannot be effectively adjusted acco...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/9535G06F40/289G06F40/253G06F16/951G06F16/9538
CPCG06F16/9535G06F40/289G06F40/253G06F16/951G06F16/9538Y02D10/00
Inventor 张帆宋设王勇庆
Owner 浪潮卓数大数据产业发展有限公司