基于动态元数据标识与DAG优化的数据编织系统及方法

By using dynamic metadata identification and a DAG-optimized data weaving system, the problem of insufficient flexibility in metadata management and task scheduling is solved, achieving efficient resource allocation and task scheduling, and improving the overall performance and responsiveness of the system.

CN120492137BActive Publication Date: 2026-07-17BEIJING DETA JINGYAO INFORMATION TECH CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
BEIJING DETA JINGYAO INFORMATION TECH CO LTD
Filing Date
2025-04-03
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing technologies lack flexibility in metadata management, DAG task scheduling, and multi-source data federated queries, leading to resource waste and response delays. In particular, they cannot achieve efficient allocation of computing resources and task scheduling under dynamically changing workloads.

Method used

A data weaving system based on dynamic metadata identification and DAG optimization is adopted. By establishing a multi-dimensional scheduling model, using priority weight coefficients, resource elasticity factors and data lineage correlation, and combining genetic algorithms to optimize task scheduling, dynamic task fragmentation and resource allocation are achieved, thereby enhancing the system's flexibility and responsiveness.

Benefits of technology

It improved resource utilization, reduced data processing latency, significantly enhanced multi-source query performance and overall system efficiency, and ensured real-time task scheduling and efficient resource utilization.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120492137B_ABST
    Figure CN120492137B_ABST
Patent Text Reader

Abstract

本发明提出基于动态元数据标识与DAG优化的数据编织系统及方法,涉及数据编织技术领域,包括元数据管理层、数据处理层和执行层,元数据管理层包括动态元数据标识模块和标签化存储引擎模块,数据处理层包括自适应DAG优化引擎模块和动态任务分配器模块,执行层包括数据计算节点集群模块和多源数据连接器模块;方法包括建立DAG任务调度策略,实现动态优化;本发明将业务标签与DAG任务调度深度绑定现“数据‑计算‑业务”闭环,能够根据实时变化的业务标签调整任务的执行顺序和资源分配,由此任务调度不仅考虑了计算资源的使用,还可以根据业务需求对任务进行实时优化,从而提升了整体处理效率。
Need to check novelty before this filing date? Find Prior Art