5 results about "Sentence clustering" patented technology

The application belongs to the field of natural language processing, and particularly relates to a text key phrase extraction method, a storage medium and a device that integrate inter-sentence correlation, comprising: extracting a nominal phrase in a part-of-speech combination mode; filtering the nominal phrase by combining two Trie trees to obtain a candidate phrase set; calculating a global semantic similarity score of the candidate phrase; clustering each sentence to obtain a sentence cluster containing different semantic information; and sorting the candidate phrases in the sentence cluster according to the global semantic similarity score of the candidate phrase to obtain a key phrase set; the application integrates the inter-sentence relationship in the unsupervised key phrase extraction model based on embedding, improves the accuracy of the model, and constructs different Trie trees to calculate mutual information and left and right information entropy as a candidate phrase extraction method in the key phrase extraction model, thereby reducing the probability of incomplete semantic information appearing in the extracted candidate phrase set.

Embodiments of the present application provide a method for generating a text summary, a text processing method, an apparatus, a device, a medium and a program product. The method for generating a text summary comprises: obtaining a to-be-processed text; performing cluster analysis on all sentences in the to-be-processed text to obtain at least one sentence cluster; determining a first parameter set and a second parameter set of each sentence cluster in the at least one sentence cluster, the first parameter set of a target sentence cluster being a set composed of position weights of each sentence in the target sentence cluster, and the second parameter set of the target sentence cluster being a set composed of semantic distances between each sentence in the target sentence cluster and a cluster centroid of the target sentence cluster; determining a representative sentence of each sentence cluster in the at least one sentence cluster according to the first parameter set and the second parameter set of each sentence cluster; and combining the representative sentences corresponding to the at least one sentence cluster to obtain a summary of the to-be-processed text.

The application relates to the technical field of natural language processing, and provides a contract examination method and device, electronic equipment and a storage medium, the method comprising: performing sentence clustering on a contract text based on semantic vectors of each sentence in the contract text, and lengths and / or structured types of the sentences, to obtain a plurality of semantic clusters; determining a plurality of semantic segments of the contract text based on the plurality of semantic clusters; searching for a target semantic segment associated with an examination item from the plurality of semantic segments; and examining the contract text based on the examination item and the target semantic segment. The method, device, electronic equipment and storage medium provided by the application can effectively guarantee the accuracy and reliability of contract examination while retaining long-distance semantic dependency relationships in the contract text, and can guarantee the traceability and checkability of examination conclusions based on the target semantic segment associated with the examination item.

The application discloses an open domain dialogue method based on dialogue structure graph constraint, which comprises the following steps: after obtaining the dialogue sentence vector representation of an encoder, a new comparative learning loss function is designed by using the features of dialogue sequence and correlation to further train, so that dialogue sentence vectors containing sufficient semantics are obtained; the newly obtained dialogue sentence vectors are clustered to obtain topic-level sentence clustering; finally, the transfer of topics in the dialogue data set is imitated by using imitation learning to construct a topic-level dialogue structure graph, i.e., the transfer between clusters, and the text generation of the autoregressive decoder is constrained by the dialogue structure graph. By using comparative learning to fully extract sentence meaning information and using imitation learning to obtain a dialogue structure graph and predict the next round of dialogue topics, the correlation between generated dialogue and topics is well constrained, and the overall dialogue fluency is improved.

The application relates to the technical field of artificial intelligence, and discloses a text script clustering method and device, computer equipment and a storage medium. The method comprises the following steps: obtaining text data to be clustered, and randomly and evenly dividing the text data to be clustered into K groups; adopting an online greedy algorithm to perform intra-group clustering on the text data in each group respectively, so as to obtain an intra-group clustering result set of the text data to be clustered; adopting the online greedy algorithm to perform cross-group clustering on a center sentence in the intra-group clustering result set, so as to obtain a center sentence clustering result set; obtaining a corresponding clustering cluster of each center sentence in the center sentence clustering result set in the intra-group clustering result set, and merging clustering members of the clustering cluster, so as to obtain a clustering result of the text data to be clustered. The application can effectively improve the clustering accuracy of text scripts, reduce the clustering time of text scripts, and obtain a high-quality clustering result within a reasonable time range.