3results about How to "Save disk space" patented technology

The present invention discloses a storage and query method and device for monitoring data, and relates to the field of computer technology. A specific implementation of the storage method includes: encoding the monitoring data to be stored, and obtaining the encoded monitoring data to be stored; when the time dimension information of the monitoring data to be stored is at the second level, storing the encoded monitoring data to be stored in a cache and a database; when the time dimension information of the monitoring data to be stored is not at the second level, storing the encoded monitoring data to be stored in a database. This implementation method performs encoding processing on the monitoring data, which can significantly reduce the disk space for data storage, and stores the second-level monitoring data in the cache and the database respectively, which can meet the efficiency of different types of queries and ensure the query speed of recent data in the second-level monitoring data.

This invention discloses a method and system for time-series data persistence based on a data service platform, belonging to the field of time-series database technology. The technical problem this invention aims to solve is how to improve the query performance of total time-series data on a data service platform while simultaneously increasing file utilization. The technical solution adopted is as follows: The method involves writing the collected time-series data into memory, dividing it into multiple blocks of fixed size, and filling them with the data. When a block is full, the data is filed into the file system. Specifically, the following steps are taken: defining the file structure, including a data file (.data) and an index file (.idx); converting row-based data to column-based data; compressing by column, configuring the `compress` parameter to enable or disable compression; using different compression algorithms for each column based on its data type; and persisting the compressed data to the file system.

An embodiment of the present application provides a data lifecycle management method and device, the method comprising: when checking that the data fields and index attributes of a business table, an intermediate table, a local history table, and a history library history table are consistent and it is determined that there is no data in the local history table, obtaining the data to be migrated in the business table; migrating the data to be migrated in the business table to the local history table, and determining the corresponding history library history table according to the time field of the data to be migrated; migrating the data to be migrated in the local history table to the history library history table; the present application can effectively improve the efficiency and accuracy of data cleaning.