一种基于大语言模型和多路召回的多源数据对齐方法、系统、设备及介质

By constructing keyword and semantic vector indexes using a large language model and multi-way recall strategy, and combining multi-way recall and decision rules, the problem of automated entity alignment of heterogeneous data sources is solved, achieving efficient and accurate data alignment, reducing labor costs and improving data analysis efficiency.

CN122064737BActive Publication Date: 2026-07-17BEIJING LE MA SHI INTELLIGENT TECH CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
BEIJING LE MA SHI INTELLIGENT TECH CO LTD
Filing Date
2026-04-23
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing technologies struggle to automatically and accurately identify and align data records pointing to the same real-world entity from heterogeneous data sources without relying on pre-defined unified identifiers or manual mapping rules. This results in severe data silos, impacting the efficiency of data analysis and intelligent decision-making.

Method used

By employing a large language model and a multi-path recall strategy, and by constructing keyword indexes and semantic vector indexes, combined with multi-path recall and decision rules, we achieve automated multi-source data alignment.

Benefits of technology

It achieves high-precision and high-recall entity alignment, reduces labor costs, improves the automation level of data governance and the credibility of alignment results, and adapts to complex and heterogeneous data scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122064737B_ABST
    Figure CN122064737B_ABST
Patent Text Reader

Abstract

本申请公开了一种基于大语言模型和多路召回的多源数据对齐方法、系统、设备及介质,涉及数据治理领域,该方法包括:基于多个异构的数据源生成多个数据源对;每个数据源对包括一个基础数据源和一个目标数据源;对于每个数据源对,从数据源对中筛选候选字段,并基于候选字段构建双引擎索引;对于每个数据源对,以基础数据源中的每一条实体作为查询记录,基于双引擎索引在目标数据源中进行多路召回,得到多路候选实体列表;对多路候选实体列表中的所有候选实体进行融合和重排序,得到候选实体集;基于决策规则对候选实体集中的候选实体与对应的查询记录进行对齐。本申请可高效、高精度、自动化地解决现实世界中复杂异构数据源的实体对齐问题。
Need to check novelty before this filing date? Find Prior Art