52 results about "Contextual similarity" patented technology

A method of comparing first and second objects in a context comprises: maximizing or minimizing a quantitative comparison of the first object and a mixture of the second object and the context respective to a weighting parameter that controls the mixture; and outputting a comparison value based on the value of the weighting parameter determined by the maximizing or minimizing.

A similarity measure system selects a first value and a first context related to the first value, divides the first value into a first set of substrings in an order preserving way, and processes each of these substrings through an obfuscation function to produce a first set of obfuscated substrings. The system selects a second value and a second context related to the second value, and processes the second value to produce a second set of obfuscated substrings. The system calculates a context similarity measure for the first context and the second context. The system determines a value similarity measure from the first and second set of order preserved obfuscated substrings. The system determines a closeness degree between the first value and the second value and a closeness degree based on the context similarity measure.

The invention discloses a method and a system for linking entities. The method includes acquiring to-be-linked entities from given texts; acquiring entity names and abbreviation word banks from preset knowledge bases and establishing synonym banks of the entity names on the basis of the preset knowledge bases; carrying out searching in the synonym banks by the aid of entity keywords; linking the entity keywords for searching and the entity names in the preset knowledge bases if a certain entry matched with the synonym banks is found by means of searching; generating candidate entities if the certain entry is not found by means of matching and carrying out disambiguation linking in context similarity evaluation modes. The synonym banks contain the entity names acquired from the preset knowledge bases and information data related to the entity names. The entity keywords are acquired by means of word segmentation and are used as search terms. The entity names in the knowledge bases correspond to the entry. The method and the system in an embodiment of the invention have the advantage that the entity linking accuracy can be improved.

The invention discloses a method and equipment for determining text similarity. The method includes: acquiring first text and second text whose similarity needs to be determined; determining the grammar similarity and theme similarity of the first text, and determining the grammar similarity and theme similarity of the second text; determining the similarity between the first text and the second text according to the determined grammar similarity and theme similarity. By the method and equipment, text similarity can be accurately reflected.

The invention discloses a rearrangement method and a rearrangement system based on document similarity, and relates to the field of calculation and detection on text similarity. The method comprises the following steps of extracting documents to be compared, and generating plain texts; normalizing the plain texts, and generating normalized text unit; encoding the normalized text unit, and generating an irreversible representative code with a fixed length by an encoding algorithm; extracting keywords of the representative codes of the files to be compared, and generating a keyword sequence; calculating the word form similarity and the word sequence similarity of sentences to be compared according to the keyword sequence of the sentences to be compared; calculating the similarity of the sentences to be compared according to the word form similarity and the word sequence similarity of the sentences to be compared; calculating the similarity of the documents to be compared according to the similarity of the sentences. The rearrangement method and the rearrangement system can be suitable for Chinese characters, are convenient for use by users in China, and are also higher in similar document comparison precision.

The invention discloses an information recommendation method of calculating user preference similarity based on a context ontology tree. According to the method, differential influences of various context types and concrete examples thereof on user preferences are analyzed, and a context-based user preference extraction method is designed; then ontology is utilized to carry semantic expression on contexts, an ontology tree expression-based context similarity calculation method is constructed, and the precision of finding similar user sets in collaborative filtering recommendation is improved; and on the basis of the above-mentioned user preference extraction, the extracted contexts are introduced into a collaborative filtering recommendation process, the similarity between the context user preferences is calculated, a collaborative filtering recommendation method based on user context preference analysis is designed, and problems of sparseness, cold starting and the like of existing recommendation methods are solved.

The invention discloses an acquisition method and an acquisition system for similarity of vocabularies between different languages, which are capable of acquiring similarity of the vocabularies between different languages according to context vocabulary similarity and dependence similarity of the vocabularies in the source language and the target language. Since the context vocabulary similarity and the dependence similarity are simultaneously used to evaluate the similarity of the vocabularies between different languages, reliability of the similarity can be effectively enhanced, and translation accuracy can be effectively improved.

A text similarity calculation method is applied to the technical field of computer application and comprises the following steps of respectively performing word segmentation processing on two to-be-processed texts to obtain two first vocabulary sets, and calculating first similarity of the two to-be-processed texts based on the two first vocabulary sets; inputting the two texts into a preset N-gram language model to obtain two second vocabulary sets, and calculating second similarity of the two texts based on the two second vocabulary sets; and calculating the similarity of the two texts basedon the first similarity and the second similarity according to a preset adjustment parameter of the first similarity and a preset adjustment parameter of the second similarity. The invention furtherprovides a text similarity calculation device and a storage medium. In the process, when the text similarity is calculated, the similarity between text semantics is considered, and the similarity of text words is also considered, so that the calculation of the text similarity is more accurate.

The invention discloses a code fragment recommendation method considering code statement sequence information, which comprises the following steps: obtaining a current code context, carrying out formatting, structure information and declarated variable type extraction, and converting a cleaned code fragment into an LC sequence; calculating BWT similarity and variable type similarity of the code segments in the code database and the current code context, and obtaining a plurality of code segments with the highest similarity with the current code context as candidate sets; and reordering the candidate code segments according to the BWT similarity, variable similarity and structural similarity of the code segments in the candidate set and the current code context, and presenting a reordered list to the user. Compared with the prior art, the sequence information between the code statements is used, so that the similarity between the recommended code snippets and the query is higher, and auser can better use the recommended code snippets. And moreover, structural information is introduced in the sorting process, so that a better sorting effect can be achieved.

The invention provides a knowledge base fusion method for encyclopedia websites. The knowledge base fusion method is used for fusing knowledge cards (intebox) of Baidu encyclopedia, interactive encyclopedia and Chinese Wikipedia with the largest influence at present. The method comprises the following steps: step 1, acquiring a query result of an encyclopedia website about the same entity and preprocessing the query result; step 2, establishing a mapping relationship for entities in the encyclopedia website by integrating concept similarity, attribute similarity and context similarity characteristics; step 3, performing attribute alignment on the knowledge cards of the entities with the established mapping relationship by means of an external dictionary; step 4, designing a single truth value discovery scheme and a multi-truth value discovery scheme for attributes with conflict attribute values according to whether the attribute values are single-value type and multi-value type; and step 5, outputting the fused attribute-attribute value pair. And finally redundant high-reliability entity-related attribute-attribute value pairs of the three encyclopedia knowledge cards are obtained.

The present invention discloses an entity linking method based on multi-domain entity indexes. The method comprises two main steps: (1) establishing multi-domain indexes for the entities in the knowledge base; and (2) screening candidate entities based on the multi-domain indexes, reordering candidate entities by using context similarity scores and popularity scores, and linking an entity reference to the entity with the highest score. According to the method disclosed by the present invention, there is no need to search the candidate entities based on the alias dictionary, indexes for the subdomains with different attributes (relations)of entities in the knowledge base are established, and the candidate entities which are matched with the entity reference are obtained by searching the name domain; and for the preliminarily screened candidate entities, the context scores and the popularity scores of the candidate entities are calculated by using the information of other domain indexes, the candidate entities are reordered, and the entity reference is linked to the entity with the highest score.

The invention discloses an entity relation extracting method and device for text processing. The method comprises the steps of inputting a to-be-processed text; identifying entities in the to-be-processed text, wherein the to-be-processed text comprises multiple entities; screening the entities according to preset examples to obtain context features of input instances; calculating context similarity between the input instances and seed examples in a seed example library through the context features; judging whether the context similarity is greater than a first preset threshold value or not; if the similarity is greater than the first preset threshold value, performing statistics on the number of the seed examples with the similarity greater than the preset threshold value; judging whetherthe number of the seed examples with the similarity greater than the preset threshold value is greater than a second preset threshold value or not; and if the number of the seed examples with the similarity greater than the preset threshold value is greater than the second preset threshold value, taking the input instances as entity relation instances obtained by the text processing. According tothe entity relation extracting method and device, the technical problems of high accuracy and low recall of a rule method are solved.

The invention belongs to the technical field of big data and discloses a text similarity ordering method based on ES search. According to the method, the position order of text words is considered inan algorithm to calculate similarity degrees among texts, therefore, the problem that texts with identical words and non-identical serial numbers cannot be ordered through ES search is solved, and theaccuracy of ES text similarity ordering is improved. The method comprises the steps that a, ES preliminary search is performed to obtain a similar text set; b, text word segmentation is performed toobtain a segmented word set; c, on the basis of the segmented word set, vectorized expression is performed on the texts after word segmentation; d, the similarity degrees among text vectors are measured through cosine similarities; and e, similarity reordering is performed on the texts according to cosine similarity values.

The invention discloses an unsupervised industrial image anomaly detection method and system based on knowledge distillation, and belongs to the technical field of industrial image processing. Comprising a training stage and a testing stage, and is composed of multi-scale knowledge distillation and multi-scale anomaly fusion, the multi-scale knowledge distillation comprises a teacher network and a student network, hard case samples are dynamically mined by using adaptive hard case mining, and the student network is optimized by using pixels among the hard case samples and context similarity. In the training stage, knowledge distillation from a teacher network to a student network is carried out only by using a normal industrial image, and iterative optimization is carried out on student network parameters, so that the normal industrial product image depth features extracted by the student network and the teacher network are similar; in a test stage, depth features of a test image are respectively extracted, and regression errors between the features can be used for image anomaly segmentation and detection. According to the method, the performance of unsupervised industrial image anomaly detection is effectively improved, the labor cost is reduced, and the automation and intelligence level of production line quality inspection is improved.

The invention provides a graph model filtering method fusing shallow semantic information, and the method comprises the steps: inputting a Chinese reference into a reference extension method, and obtaining an accurate and complete entity reference; putting the entity reference as a key field of wiki search into a Chinese Wikipedia knowledge base to obtain a candidate entity list of the entity reference; inputting the candidate entity list into a graph model filtering method fusing shallow semantic information to obtain a filtered candidate entity list; and storing the filtered candidate entitylist into a database to prepare for an entity disambiguation module. According to the method, the text similarity is obtained by fusing the shallow semantic information to calculate the context similarity between the candidate entity and the entity reference, and is used as the weight factor of the filtering algorithm; and candidate entity relevancy is calculated based on a graph model in-out degree algorithm to serve as a weight factor of a filtering algorithm, and finally, two weight factors are fused to obtain a comprehensive score to arrange candidate entities, so that entity disambiguation errors are reduced.

The invention discloses a demand entity co-reference detection method and device based on deep learning and context semantics. The method comprises the following steps: 1) context interception: firstly positioning an entity, then intercepting a text according to a window size by taking the entity as a center, and taking a demand text as a context related to the entity; 2) constructing a context similarity network: the network is composed of two parts, one part is a fine tuning BERT model used for learning context representation, and the other part is a Word2Vec-based network used for learningentity representation; respectively inputting the context and the entity into a BERT model and a Word2Vec network, and connecting the two obtained vector representations; and finally, deducing a prediction label by using a multi-layer sensor and a softmax layer, i.e., judging whether the two entities are co-reference entities or not. According to the method, the entity co-reference problem in natural language requirements can be solved, and consensus of entities among stakeholders in multiple different fields is facilitated.