Industrial big data search optimization method, system, equipment, medium and terminal

Abstract

The invention belongs to the technical field of industrial data processing, and discloses an industrial big data search optimization method, system, device, medium and terminal. The industrial big data search optimization method comprises the steps of firstly collecting industrial field specialized vocabularies to form a related set, and storing the content into a new document and placing the document in an ik word segmentation device configuration folder; and then configuring an industrial extension dictionary in the XML document to form an industrial word segmentation device, restarting an Elasticsearch search engine, and at the moment, completing the construction of the industrial word segmentation device. The invention provides a word segmentation device specially applied to industry, an industrial word segmentation device is constructed by analyzing the technical principle of the word segmentation device, and the difference between the word segmentation results of the industrial word segmentation device and mainstream general Chinese word segmentation devices jieba and Ansj in the industrial field is compared, and the result shows that based on the industrial word segmentation device, more excellent classification performance and robustness are achieved according to the word segmentation, and the word segmentation effect and the search efficiency are effectively improved by expanding industrial specialized vocabularies.

Description

technical field [0001] The invention belongs to the technical field of industrial data processing, and in particular relates to an industrial big data search optimization method, system, equipment, medium, and terminal. Background technique [0002] At present, in the industrial information service platform, data is the cornerstone of the entire platform, and retrieval and acquisition of data is the core part of the platform. Professional tokenizer design is the key technology to build data search. In the industrial field, due to the large amount of data and many data sources, the efficiency of data retrieval is not high, so it is necessary to study the word segmenter to improve the efficiency of data search. [0003] Analyzer can segment the words in the data text according to specific rules. There is an abstract Analyzer class in each tokenizer. Different Analyzer subclasses determine different word segmentation rules. Therefore, different tokenizers should be used for C...

AI Technical Summary

Problems solved by technology

[0024] Aiming at the problems existing in the prior art, the present invention provides an industrial big data search optimization method, system, equipment, medium, and terminal, and particularly relates to an industrial big data search optimization method, system, equipment, and medium based on an industrial word segmenter , terminal, aiming to solve the problems of low retrieval efficiency and poor retrieval accuracy existing in the current industrial data retrieval methods

Images