30 results about "Sentence clustering" patented technology

The invention discloses a multiple-document automatic abstracting method based on a frequent itemset. In the method, a frequent itemset excavating ideal in the association rules is introduced, and an associating method is utilized to excavate the frequent itemsets of effective itemset to serve as child themes; sentences are directly clustered to different child themes without carrying out sentence similarity computing; and multiple-document automatic abstracting is carried out on the basis of an SFI (sub-topics based on frequent item sets) method. In the method, the sentences are directly clustered to different child themes without carrying out sentence similarity computing, thus the method has the characteristics of high simplicity, high legibility, high practicability and the like.

The invention provides a news sentence clustering method based on semantic similarity. The method includes the following steps: preprocessing news sentences of a corpus, and extracting available words; utilizing the available words to train a continuous bag-of-words model to obtain an initial word vector of each available word; utilizing an initial sentence vector of each news sentence and the initial word vectors of the left and right adjoining available words of a certain available word in the news sentence to train the continuous bag-of-words model in an iterative manner to obtain a currentword vector of each available word in the news sentence and a final sentence vector of the news sentence; merging an average value of the word vectors of all the available words, one-hot vectors of high-frequency words and the final sentence vector of each news sentence to obtain a semantic vector of the news sentence; and calculating distances between the semantic vectors to obtain the semanticsimilarity between the different news sentences, and clustering the news sentences of the corpus in accordance therewith. The invention also provides an electronic device and a computer-readable storage medium.

The present invention relates to a method for structured processing of a Chinese pathological text. The method comprises the following steps: extracting template information corresponding to each sample from a hierarchical stricture of a sample of text data of a pathological report text data and indicator; extracting the template information comprising short sentence segmentation and indicator name extraction; classifying the short sentences; with respect to each sample, in combination with a classification result cluster and a short sentence cluster, calculating a TF value, an IDF value and a C-value of each indicator name in an indicator name list in a short sentence language material, and screening out an indicator name whose TF value, IDF value and C-value satisfy a threshold, and using the obtained indicator name as a component of the final template. According to the present invention, a non-structured Chinese pathological text can be structured.

The invention relates to the technical field of text generation in natural language processing. The invention relates to a method, in particular to a multilingual automatic abstract method. INCLUDINGA Whole AUTOMATIC ABNORMATION SYSTEM, the automatic abstract system is divided into a model training module; a single-document abstract module and a multi-document abstract module, the model trainingmodule is divided into a text preprocessing module and a training module; wherein the single-document summary module is divided into a text preprocessing module and a summary generation module, the multi-document summary module is divided into a text preprocessing module, a multi-language sentence clustering module and a summary generation module, a model in the model training module is a seq2seqneural network model, and a training text is obtained through summary-summary generation. According to the invention, a multilingual generative automatic abstract system is designed and realized, a bilingual word embedding technology and a deep learning method are adopted, and a brief abstract is generated for a text or a text set specified by a user, so that the user is helped to browse intentions of an original text and quickly find out the most required information.

The invention discloses an information processing method and system for knowledge servers. The method comprises the following steps: obtaining all or part of the knowledge points as a knowledge point set; determining the semantic information of each knowledge point in the knowledge point set; determining a sentence cluster set corresponding to the knowledge points according to semantic information; determining corresponding chapter information according to the sentence cluster set; and determining corresponding digital resources according to the chapter information. According to the method, the semantic information of the knowledge points is comprehensively considered, and the manner of correlating the corresponding knowledges through the keywords input by the users is not used, so that the method more fits the real demands of the users and is capable of correlating the corresponding knowledges mostly fitting the user demands according to the semantic information of the knowledge points, so that the organization of the knowledges in the field in a knowledge point manner is really realized and the user experience is improved.

A corpus generation device and method, the device comprising: a segmentation module, connected to at least one monolingual parallel corpus for segmenting a sentence into words and processing the segmented words by a knowledge-driven approach; a classification module, for classifying sentences having different tag sequences but the same meaning into the same sentence cluster; a mapping module, for determining the categories of sentence structures of all the sentences in the sentence cluster, recording and storing a mapping mode for transforming tags between sentence structures when different categories of sentence structures in the same sentence cluster are transformed; a sentence structure generation module, for generating sentence structures according to a first mapping mode between a first category of sentence structures in one of the sentence clusters and other categories of sentence structures in the same sentence cluster; and a corpus generation module, for nesting a word corresponding to a sequence tag to generate a new monolingual parallel corpus.

The invention provides an information extraction method based on deep semantic comprehension, which comprises the following steps of: constructing a body and a basic relationship in the field, and manually labeling parts of corpora; processing the manually annotated corpora, identifying an entity type corresponding to a specific relationship, and mining new words and synonyms in the field at the same time; merging synonyms recognized in the sentences, abstracting the original sentences and making syntactic analysis; clustering the abstracted sentences into sentence templates, and performing template learning; making sentence template evaluation; and performing new relationship extraction on manually unlabeled corpora by utilizing the sentence template, and evaluating and filtering a new relationship. According to the method provided by the invention, the syntactic analysis result can be better utilized, so that the automatically mined template has higher-level abstraction and generalization capabilities.

The invention discloses a theme information-based text segmentation method, which comprises the following specific operations of: preprocessing an input text and a training set to obtain a sentence consisting of a series of words; carrying out feature extraction to obtain feature vectors of the features; carrying out clustering operation on the input text according to semantic information contained in the sentence cluster to obtain a series of sentence clusters, and distributing a digital label for each cluster in sequence to obtain a series of simple sentences with the digital labels; distributing existing theme tags in a training set for each sentence, so that the existing theme tags in the training set are distributed to all sentences in the text. According to the invention, the digitallabel labeling result and the theme label labeling result are used for correction to obtain the text fragment with the theme label, and the theme label is distributed to the cut text, so that the theme described by the sentence can be clearly seen, the position for describing the theme in the text can be conveniently positioned according to the theme, and the retrieval is more convenient.

The embodiment of the invention discloses a method and device for clustering sentences. One specific embodiment of the method comprises the steps of determining a set composed of semantic vectors corresponding to all sentences in a to-be-clustered sentence set as a semantic vector set; for each semantic vector in the semantic vector set, executing the following density calculation operation; for each semantic vector in the semantic vector set, executing the following clustering division operation; for each established cluster, determining the semantic vector with the maximum density in the semantic vectors divided into the cluster as the clustering center semantic vector of the cluster; and determining to-be-clustered sentences corresponding to the determined clustering center semantic vectors as a clustering center sentence set. According to the embodiment, the sentence clustering accuracy is improved.

The invention relates to a method for automatically analyzing user comments in an application store and recommending the user comments to developers. The method is technically characterized by comprising the following steps: collecting user comment data and preprocessing the user comment data; carrying out intention classification on the user comments and establishing a classification model; carrying out topic classification on the user comments under each intention classification; performing sentence clustering on the user comments under each topic category, and calculating the clustering center position; establishing a mechanism for evaluating the priority of the user comments, calculating comprehensive scores of the user comments and recommending the comprehensive scores to a software developer. According to the method, intention classification, topic classification and sentence clustering are performed through comment information, and comments are processed in combination with timesequence and sentiment analysis; the hotspot top-k comments recommended and returned by the system are obtained, comment contents with reference values are provided for developers, so that referencesare provided for development and maintenance of applications, intake of redundant information of the developers is effectively reduced, user experience is improved, and the method has the characteristics of accurate and reliable content analysis, convenience in use and the like.

The invention provides an intelligent input method and device for electronic medical records. The intelligent input method comprises the following steps: classifying massive electronic medical record text data according to disease categories; performing similarity calculation on the sentences under each disease category, and clustering the sentences according to the similarity; extracting keywords or words within the first few words of the same kind of sentences as sentence heads, establishing a sentence head library, taking other parts of the same kind of sentences except the sentence heads as sentence tails, establishing a sentence tail library, counting the occurrence frequency of the same kind of sentence tails, and establishing a sentence frequency library; after a specific keyword or word is input and a sentence head library is matched ,determining a sentence clustering category, calling a sentence tail library and a sentence frequency library, carrying out sentence tail completion, and displaying a plurality of sentence tails with frequency ranks from high to low in the sentence frequency library on display equipment for a user to select; and obtaining the sentence tail selected by the user every time and updating the sentence frequency library in real time. The medical record input efficiency of medical staff can be effectively improved, so that more time is reserved for treating a patient, and the medical quality is improved.

The invention discloses a method for constructing and processing a human behavior text data set based on crowdsourcing, which comprises the following steps of: firstly, determining a subject object needing to be collected, generating a task according to a specific requirement, publishing the task to a crowdsourcing platform, and obtaining a text data set of all possible human examples under a set subject; presenting the text of the same behavior or event in a plurality of sentences after being written by different persons, so that different sentences describing the same event need to be clustered together, and different text representations belonging to the same behavior are clustered into one class for the acquired data set by adopting a clustering mode; mining a precedence relation structure existing between behaviors by adopting a correlation analysis technology; adopting the mutual information technology to learn a mutual exclusion relation structure existing between behaviors, creating various relations existing in the human behaviors into a plot. What events can occur under a certain condition is indicated, the occurrence mode of the events is limited, and the analysis accuracy of the human behaviors is improved.

The invention relates to the technical field of airworthiness certification, in particular to natural language-based airworthiness instruction problem feature extraction, which comprises the followingsteps of: extracting problem description chapters behind an airworthiness instruction, and carrying out text data preprocessing; detecting overlapped sentence clusters; selecting a given number of sentence clusters; extracting feature descriptors. The method for extracting the features by detecting the overlapped sentence clusters and directly selecting the phrases from the text description has higher accuracy. Meanwhile, the method has better performance in the aspect of time consumption compared with a comparison method selected in the prior art; key design features, expressed by the airworthiness instruction text, of aircraft products can also be found in feature extraction actually for airworthiness instructions.

In an approach to generating and using a sentence model for answer generation, one or more computer processors ingest a first corpus of a plurality of text sentences. One or more computer processors convert the plurality of text sentences into a plurality of sentence vectors. One or more computer processors group the plurality of sentence vectors into a plurality of sentence clusters, wherein a sentence cluster is composed of sentences that are semantically similar. One or more computer processors receive a second corpus. One or more computer processors determine, for each sentence cluster of the plurality of sentence clusters, a frequency each sentence cluster appears in the second corpus. Based on the determined frequency, one or more computer processors calculate a probability of each sentence cluster of the plurality of sentence clusters. Based on the calculated probabilities, one or more computer processors generate a first sentence model.