3 results about "Precision and recall" patented technology

This application relates to the field of data processing technology, and in particular to an AI multi-source data processing method and system based on big data. The method includes: calculating the field correlation degree based on the number of times each field co-occurs with all other fields in the field co-occurrence matrix; using the ratio of the number of non-empty records to the total number of records as the data completeness; and using the product of the field correlation degree and the data completeness as the field weight; randomly sampling content samples multiple times for each field to calculate aggregation stability, and calculating the cross-source similarity between any two fields from different data sources; constructing an adaptive similarity threshold for each field; and for each pair of cross-source fields, if the cross-source similarity is not lower than the adaptive similarity threshold, determining that the field pair is semantically matched, and outputting the field mapping relationship. The technical solution of this application can reduce the false matching rate of key fields while maintaining the overall matching recall rate, achieving synergistic optimization of matching precision and recall.

The application discloses a kind of knowledge graph construction methods based on fine-grained retrieval and reverse restoration self-error correction, specifically: first, standard reference case library is constructed, and standard reference vector is calculated.Then, the long text S to be measured is disassembled into sentences to be processed;Each sentence is vectorized, and the similarity score of its standard reference vector is calculated, and the first standard reference case of each sentence is screened;Through large language model, the non-standard logical relationship contained in each sentence is extracted and vectorized, the cosine similarity is calculated, and the candidate mapping is obtained by descending arrangement, after summarizing, double-feature reordering is carried out using multi-round greedy reordering algorithm, and the first standard reference case is screened out, and the single sentence is spliced into large language model, and triple extraction is carried out;Finally, the relationship triple set of all sentences constitutes knowledge graph.The application improves the precision and recall rate of triple extraction under the premise of avoiding redundancy.

The application provides a grammar error correction large model training method and device based on reinforcement learning, equipment and medium, relating to the technical field of data processing. The method comprises the following steps: obtaining an initial grammar correction corpus containing error sentences and corresponding correct sentence pairs, processing the initial grammar correction corpus to generate a reasoning correction training set, adjusting a first preset language model according to the reasoning correction training set to obtain an initial strategy model, performing reinforcement learning training on the initial strategy model based on a preset composite function by using a reinforcement learning algorithm, and finally obtaining a target grammar correction model. The target grammar correction model can fully utilize the reasoning ability, effectively improve the performance of the model in terms of precision and recall, better meet the actual needs of grammar correction, and generate correction results containing reasoning processes, which provides more transparent and interpretable basis for the correction process.