Method supporting index creation in various modes

Abstract

The invention discloses a method supporting index creation in various modes. The method comprises the following concrete realization processes of configuring a unified index model, and deploying and installing a search engine server cluster; configuring database and index mapping; configuring HBASE and index mapping; configuring a structured document import script; configuring a non-structured document import script; creating a message queue, and creating indexes through the message queue in real time; searching data transmitted from an engine cluster pair, carrying out word segmentation and filtering treatment, and storing processing results in HDFS; and carrying out relevant retrieval according to input keywords. Compared with the prior art, the method supporting index creation in various modes has the advantages that the problem of unified retrieval of data from different sources and in different formats can be solved, the real-time data indexing capability is improved, the collecting and integrating capability on mass data is enhanced, the retrieval efficiency on the mass data is greatly improved, and the practicability is high.

Description

technical field [0001] The invention relates to the technical field of data indexing, in particular to a method with strong practicability and supporting multiple ways of creating indexes. Background technique [0002] For the information resources in enterprises and institutions, due to the different businesses they belong to, the management systems adopted are also different, which leads to the dispersion of information resources, which is not conducive to the sharing of resources; at the same time, different management systems require different In the process of resource sharing, it will be difficult for non-business personnel to query and understand the situation of other business resources, which also increases the difficulty of resource sharing; in addition, different management systems adopt different technologies and specifications. In the same way, it is difficult to call each other between data materials, and maintenance is also extremely inconvenient, which seriou...

AI Technical Summary

Problems solved by technology

[0002] For the information resources in enterprises and institutions, due to the different businesses they belong to, the management systems adopted are also different, which leads to the dispersion of information resources, which is not conducive to the sharing of resources; at the same time, different management systems require different In the process of resource sharing, it will be difficult for non-business personnel to query and understand the situation of other business resources, which also increases the difficulty of resource sharing; in addition, different management systems adopt different technologies and specifications. In the same way, it is difficult to call each other between data materials, and maintenance is also extremely inconvenient, which seriously hinders the informatization process of enterprises and institutions

[0003] It is difficult to effectively use these data in different systems, and generally only provide retrieval queries in their respective systems

Images