Data lake treatment method and device, electronic equipment and program product

By constructing formal contexts, generating concept lattices and performing semantic embedding, clustering and grouping field names, building a unified data view and knowledge graph, and optimizing storage and access control, the problems of heterogeneous data fusion and security in data lake governance are solved, and efficient and secure data integration and analysis are achieved.

CN121765073APending Publication Date: 2026-03-31CHINA MOBILE (SUZHOU) SOFTWARE TECH CO LTD +1
0 Cites 1 Cited by

Patent Information

Application Number
CN202511894370.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-12-16
Publication Date
2026-03-31

AI Technical Summary

Technical Problem

Existing data lake governance solutions struggle to achieve automated heterogeneous data fusion, metadata semantic enhancement, and adaptive access control, leading to difficulties in cross-domain data discovery, inaccurate data integration, and insufficient security. In particular, they fail to meet the needs of advanced analytics and cross-organizational collaboration in heterogeneous data environments.

Method used

By constructing formal contexts, generating concept lattices and semantically embedding them, clustering and grouping field names, building a unified data view, optimizing storage and generating a knowledge graph, combining B+ tree indexes for semantic queries, dynamically generating access control rules, monitoring access behavior and adjusting permissions, and assessing metadata integrity to achieve adaptive governance.

Benefits of technology

It improves the accuracy and efficiency of data integration, enhances the semantic depth and machine understandability of metadata, ensures data security and compliance, reduces the cost of cross-system data integration and governance, and improves the accuracy of data analysis and machine learning.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention discloses a data lake treatment method and device, electronic equipment and a program product, and relates to the technical field of big data. The method comprises the steps of obtaining original data from a heterogeneous data source, constructing a formal context and generating a concept lattice; semantic embedding and similarity calculation are carried out on the field names, clustering is carried out in combination with the concept lattice, unified field names are generated, and a unified data view is constructed; performing semantic enhanced metadata management on the unified data view, including constructing an attribute graph, mapping into a knowledge graph and expanding an implicit relationship thereof, and constructing an index to support semantic query; and dynamic access control and metadata integrity management are carried out on the unified data view, so that the safety and reliability of the data are ensured. According to the method, the automation degree and accuracy of data integration are effectively improved, and the discoverability, interoperability and safety of the data are enhanced.
Need to check novelty before this filing date? Find Prior Art