一种基于神经网络的时序库多线程快速导入导出方法

By optimizing the import and export process of InfluxDB using a neural network-based multithreaded method and a nonlinear fitting model, the problems of resource consumption and performance bottlenecks in time-series databases are solved, achieving efficient data processing and a flexible backup mechanism.

CN118964467BActive Publication Date: 2026-07-17GUODIAN NANJING AUTOMATION

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
GUODIAN NANJING AUTOMATION
Filing Date
2024-08-27
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

The existing InfluxDB time-series database consumes a lot of system resources during backup operations, resulting in performance degradation. Furthermore, the backup granularity is too large, which cannot meet the filtering backup requirements of specific resource tables. At the same time, the processing logic may become a performance bottleneck under high concurrency or large data volume conditions, lacking flexibility and scalability.

Method used

A multi-threaded fast import/export method based on neural networks is adopted. Time-series data is processed by slicing, and multi-threaded parallel processing of slices is used. A non-linear fitting model is built to optimize import/export parameters. Encryption technology and monitoring thread tracking mechanism are combined to ensure data integrity and efficiency.

Benefits of technology

It improves the efficiency of importing and exporting time series libraries, adapts to different operating environments and task requirements, reduces resource contention, and enhances system performance and flexibility.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118964467B_ABST
    Figure CN118964467B_ABST
Patent Text Reader

Abstract

本发明公开了一种基于神经网络的时序库多线程快速导入导出方法,涉及数据导入导出领域,该方法包括:基于预设的定义规则对时序数据进行分片处理,并根据分片处理结果确定线程处理规则执行时序库导入导出操作;获取导入导出操作对应的业务数据,并提取业务数据的统计特征,将统计特征合并为特征数据集反映时序数据管理器的性能与负载情况;以特征数据集为基础利用神经网络构建非线性拟合模型,并利用非线性拟合模型预测导入导出时间效率与资源占用状况。本发明采用多线程自定义分片的方式,通过将时序数据按时间范围等自定义规则划分为多个分片,使用多线程同时进行多个分片的处理,对时序库进行导入导出操作。
Need to check novelty before this filing date? Find Prior Art