Method and system for analyzing text information law of search engine

Abstract

The present application provides a text information rule analysis method for a search engine, which comprises the following steps: acquiring text of a natural language original document; carrying outfeature extraction on the text of the natural language original document to generate a text feature vector; using a pre-trained vector matching model to match the text with a sample in a sample library according to the text feature vector to obtain a target sample; determining a semantic distribution rule mode of the text by using a pre-trained semantic distribution rule mode according to the consistency of the text features between the original document of the sample of the target sample and the corresponding index set of the target sample, and determining a semantic distribution rule mode ofthe text; According to the semantic distribution pattern of the text, the text of the natural language original document is converted into an index set. A system for analyzing textual information patterns is also provided. The present application realizes the discovery of the word distribution rule of the bearing core semantics of the original document of the natural language, and realizes the search engine index term extraction with high accuracy.

Description

technical field [0001] The present application relates to the technical field of Internet applications, in particular to a method and system for analyzing text information rules used in search engines. Background technique [0002] Search engines are a necessary tool for people to obtain the knowledge and information they need from the massive data on the Internet. Search engines were first produced by the search demand for text information, and currently text information search is still one of the main functions of search engines. [0003] In the search process of text information, the search engine extracts the index items from the original documents in the Internet by the indexer. The index items are generally several words that appear in the original documents, and store the index items and their corresponding original document links in the index table. . Furthermore, through the retriever, the matching index items are queried in the index library according to the user...

AI Technical Summary

Problems solved by technology

[0006] In view of this, the purpose of this application is to propose a text information rule analysis method and system for search engines, to solve the search engine problems caused by the unclear and uncertain existence rules of words carrying the core semantics of documents in the prior art. Difficult and erroneous technical issues with index entry extraction

Images