Data backup and recovery system and method based on electricity utilization information acquisition system

Abstract

The invention discloses a data backup and recovery system and method based on an electricity utilization information acquisition system. The system comprises a data acquisition module used for performing data acquisition on data acquired by the electricity utilization information acquisition system; the data processing module is used for performing data processing on the acquired data; wherein the data processing comprises preliminary cleaning, conversion and integration processing; the data storage module is used for storing the processed data to obtain a storage data set; the data backup module is used for regularly performing data backup on the storage data set to obtain a backup data set; an automatic recovery mechanism is preset in the data recovery module, and the data recovery module is used for automatically performing data recovery on the storage data set according to the automatic recovery mechanism and the backup data set when the storage data set is abnormal or lost. According to the invention, when the storage data set is abnormal or lost, data recovery can be carried out on the storage data set, and data management and application risks are reduced for power business operation and development.

Description

Technical Field

[0001] The present invention relates to the technical field of software system data management, and in particular to a data backup and recovery system and method based on an electricity consumption information collection system. Background Art

[0002] Software system data efficient backup and recovery technology refers to the technology that saves the status of all or part of the important data of the existing electricity information collection system at a certain point in time in a specific format, so as to quickly and accurately restore the backup data when the data is unavailable due to source system errors, data deletion, malicious data encryption, system hardware failure, etc. On the other hand, when the system cannot operate due to natural disasters and major damage, the system fast backup and recovery technology can help operation and maintenance personnel rebuild and restore the business software and data system in a very short time, and minimize the impact of system abnormalities on electricity business.

[0003] The existing electricity data backup and recovery methods can achieve mechanical backup, but there are large technical gaps and a more complete management mechanism in terms of flexible source data collection and backup, on-demand recovery, optimization and improvement, and comprehensive quality monitoring. It is impossible to effectively achieve the integrity and flexibility of data backup and recovery, which brings considerable data management risks and pressure to the operation and development of power business. Summary of the invention

[0004] In order to solve the technical problems existing in the background technology, the present invention proposes a data backup and recovery system and method based on an electricity consumption information collection system.

[0005] In a first aspect, the present invention proposes a data backup and recovery system based on an electricity consumption information collection system, comprising: a data acquisition module, a data processing module, a data storage module, a data backup module and a data recovery module;

[0006] The data acquisition module is used to acquire data collected by the electricity consumption information acquisition system;

[0007] The data processing module is used to process the acquired data; data processing includes preliminary cleaning, conversion and integration processing;

[0008] A data storage module, used for storing the processed data to obtain a storage data set;

[0009] The data backup module is used to regularly back up the stored data set to obtain a backup data set;

[0010] The data recovery module is preset with an automatic recovery mechanism, and the data recovery module is used to automatically recover the stored data set according to the automatic recovery mechanism and the backup data set when the stored data set is abnormal or lost.

[0011] Preferably, it also includes a data improvement module, which is used to improve the stored data set after data recovery; wherein data improvement includes data cleaning, data verification, and data supplementation and optimization.

[0012] Preferably, data improvement also includes data monitoring and quality feedback.

[0013] Preferably, it also includes a monitoring module, which is used to monitor the process of data acquisition, data processing, data backup, data recovery and data improvement;

[0014] When the monitoring module detects abnormal data or abnormal data operation, the data recovery module is also used to start the automatic recovery mechanism for automatic recovery and complete the recovery and storage of data.

[0015] Preferably, it also includes an early warning module, which is used to issue an early warning when the monitoring module detects abnormal data or abnormal data operation.

[0016] Preferably, the data recovery module also has the function of manually recovering the stored data set.

[0017] Preferably, the backup modes of the data backup module include full backup, incremental backup and differential backup.

[0018] Preferably, the data acquisition module uses acquisition methods including timed acquisition, event-triggered acquisition and real-time acquisition.

[0019] In a second aspect, the present invention further proposes a data backup and recovery method based on an electricity consumption information collection system, comprising:

[0020] Acquire data collected by the electricity consumption information collection system;

[0021] Process the acquired data; data processing includes preliminary cleaning, conversion and integration;

[0022] Storing the processed data to obtain a storage data set;

[0023] Backing up the stored data set regularly to obtain a backup data set;

[0024] When a stored data set is abnormal or lost, the stored data set is automatically restored according to the preset automatic recovery mechanism and the backup data set.

[0025] Preferably, after automatically restoring the stored data set according to the preset automatic recovery mechanism and the backup data set, the method further includes:

[0026] Perform data improvement on the stored data set after data recovery; data improvement includes data cleaning, data verification, and data supplementation and optimization.

[0027] Preferably, data improvement also includes data monitoring and quality feedback.

[0028] Preferably, the process of data acquisition, data processing, data backup, data recovery and data improvement also includes:

[0029] Conduct monitoring;

[0030] When abnormal data or abnormal data operation is detected, the automatic recovery mechanism is activated for automatic recovery.

[0031] Preferably, when abnormal data or abnormal data operation is detected, the method further includes:

[0032] Give early warning.

[0033] Preferably, when an abnormality or loss occurs in the stored data set, the method further includes:

[0034] Manually select the restored storage dataset.

[0035] In the present invention, the proposed data backup and recovery system and method based on the electricity consumption information collection system can acquire data from the electricity consumption information collection system, and process, store and back up the acquired data. When an abnormality occurs in the stored data set or it is lost, the stored data set is automatically restored according to the automatic recovery mechanism and the backup data set, thereby reducing data management and application risks for electricity consumption business operations and development. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 The present invention is a flowchart of a data backup and recovery method based on an electricity consumption information collection system in one embodiment of the present invention. DETAILED DESCRIPTION

[0037] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0038] The present invention proposes a data backup and recovery system based on an electricity consumption information collection system, comprising: a data acquisition module, a data processing module, a data storage module, a data backup module and a data recovery module;

[0039] The data acquisition module is used to acquire data collected by the electricity consumption information acquisition system;

[0040] The data processing module is used to process the acquired data; data processing includes preliminary cleaning, conversion and integration processing;

[0041] A data storage module, used for storing the processed data to obtain a storage data set;

[0042] The data backup module is used to regularly back up the stored data set to obtain a backup data set;

[0043] The data recovery module is preset with an automatic recovery mechanism, and the data recovery module is used to automatically recover the stored data set according to the automatic recovery mechanism and the backup data set when the stored data set is abnormal or lost.

[0044] The present invention can acquire data from an electricity information collection system, and process, store and back up the acquired data. When an abnormality occurs in the stored data set or it is lost, the stored data set is automatically restored according to an automatic recovery mechanism and a backup data set, thereby reducing data management and application risks for electricity business operations and development.

[0045] In this embodiment, the system further includes a data improvement module, which is used to improve the stored data set after data recovery; wherein data improvement includes data cleaning, data verification, and data supplementation and optimization.

[0046] Among them, data cleaning refers to deleting and correcting outliers in the stored data set.

[0047] Data validation refers to the detection and verification of the data values, ranges, and logic within the stored data set.

[0048] Data supplementation refers to obtaining relevant data from external data sources and integrating it with the data in the existing stored data sets to supplement missing information. Specifically, the supplemented missing information is automatically generated by the program, effectively reducing manual intervention.

[0049] Among them, data optimization refers to compressing large amounts of stored data sets.

[0050] This embodiment is configured in such a way that it can supplement, correct and optimize the stored data set after data recovery, process missing values, and correct and optimize unreasonable data ranges and format errors, thereby achieving the integrity of backup data recovery, improving data transmission efficiency and processing efficiency, and further reducing data management and application risks for electricity business operations and development.

[0051] In a further embodiment, data improvement also includes data monitoring and quality feedback.

[0052] Among them, data monitoring and quality feedback refers to comparing and monitoring the quality of the data in the storage data set and the backup data set, and establishing a data quality monitoring and user feedback mechanism in combination with user feedback, and regularly checking and evaluating the data in the storage data set and the backup data set to ensure the data improvement effect.

[0053] This embodiment implements regular inspection and evaluation of electricity consumption-related data by setting up data quality monitoring and user feedback mechanisms in the data improvement module, timely discovers and solves problems in the data, and ensures data storage and application effects.

[0054] In this embodiment, the system further includes a monitoring module, which is used to monitor the processes of data acquisition, data processing, data backup, data recovery and data improvement;

[0055] When the monitoring module detects abnormal data or abnormal data operation, the data recovery module is also used to start the automatic recovery mechanism for automatic recovery and complete the recovery and storage of data.

[0056] This embodiment is configured in this way, so as to closely monitor the changes in data, thereby timely discovering abnormal data or abnormal data operations, and providing a reliable basis for the data operation needs of the entire system.

[0057] Specifically, the data acquisition module is used to extract data within a preset range from the database of the electricity consumption information collection system and convert it into a preset format.

[0058] In this embodiment, the system further includes an early warning module, which is used to issue an early warning when the monitoring module detects abnormal data or abnormal data operation.

[0059] Specifically, the early warning module uses sound and light alarms to give an alarm.

[0060] This embodiment can issue an early warning through the early warning module when the monitoring module detects abnormal data or abnormal data operation, thereby achieving flexibility in process operations such as data backup and data recovery.

[0061] In this embodiment, the data recovery module also has the function of manually recovering the stored data set.

[0062] For example, when data loss occurs due to file system damage, the data recovery module supports the use of file system recovery tools to scan the disk, find lost files and directories, and recover them.

[0063] In this embodiment, the backup modes of the data backup module include full backup, incremental backup and differential backup.

[0064] This embodiment can realize multi-dimensional backup of data, ensure the integrity and effectiveness of source data backup, and improve the backup effect and backup efficiency as a whole.

[0065] Full backup means backing up all data in the storage data set at regular intervals.

[0066] Incremental backup refers to regularly backing up the data in the stored data set that has changed since the previous backup.

[0067] Among them, differential backup means backing up the data that has changed since the last full backup.

[0068] Specifically, based on the existing data storage resources and the actual operation requirements of the system, full backup can be set to back up the entire system database at the end of each month, incremental backup can be set to back up after every Friday, and differential backup can be set to be performed on several non-working days of the month.

[0069] In this embodiment, the collection methods of the data acquisition module include timed acquisition, event-triggered acquisition and real-time acquisition; among them, timed acquisition is used to automatically collect source system data to ensure the timeliness and continuity of source data collection and update; among them, event-triggered acquisition is used to trigger data collection operations when a preset specific event occurs; among them, real-time acquisition is used for source data that needs to be monitored in real time to ensure the timeliness of data management.

[0070] In general, the data of the electricity consumption information collection system is acquired at a scheduled time. When an emergency occurs, the event-triggered acquisition setting automatically samples and collects the data in the source database, and feeds back the collection results to the user terminal. When the operation and maintenance personnel need to detect and apply the source data, the data of the electricity consumption information collection system is acquired in real time. The data of the electricity consumption information collection system is acquired multiple times by combining scheduled acquisition, event-triggered acquisition and real-time acquisition to ensure the integrity and quality of data acquisition.

[0071] Reference Figure 1 The present invention also proposes a data backup and recovery method based on the power consumption information collection system, comprising:

[0072] Acquire data collected by the electricity consumption information collection system;

[0073] Process the acquired data; data processing includes preliminary cleaning, conversion and integration;

[0074] Storing the processed data to obtain a storage data set;

[0075] Backing up the stored data set regularly to obtain a backup data set;

[0076] When a stored data set is abnormal or lost, the stored data set is automatically restored according to the preset automatic recovery mechanism and the backup data set.

[0077] In this embodiment, after automatically restoring the stored data set according to the preset automatic recovery mechanism and the backup data set, it also includes: improving the stored data set after the data recovery; wherein the data improvement includes data cleaning, data verification, and data supplementation and optimization.

[0078] In a further embodiment, data improvement also includes data monitoring and quality feedback.

[0079] In a further embodiment, the process of data acquisition, data processing, data backup, data recovery and data improvement also includes: monitoring; when abnormal data or abnormal data operation is monitored, starting an automatic recovery mechanism for automatic recovery.

[0080] In a further embodiment, when abnormal data or abnormal data operation is monitored, it also includes: issuing an early warning.

[0081] In another embodiment, when the stored data set is abnormal or lost, the method further includes: manually selecting to restore the stored data set.

[0082] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical scheme and inventive concept of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A data backup and recovery system based on an electricity consumption information collection system, characterized in that: include: Data acquisition module, data processing module, data storage module, data backup module and data recovery module; The data acquisition module is used to acquire data collected by the electricity consumption information acquisition system; The data processing module is used to process the acquired data; data processing includes preliminary cleaning, conversion and integration processing; The data storage module is used to store the processed data to obtain a storage data set; The data backup module is used to regularly back up the stored data set to obtain a backup data set; The data recovery module is preset with an automatic recovery mechanism, and the data recovery module is used to automatically recover the stored data set according to the automatic recovery mechanism and the backup data set when the stored data set is abnormal or lost.

2. The data backup and recovery system based on the power consumption information collection system according to claim 1 is characterized in that: It also includes a data improvement module, which is used to improve the stored data set after data recovery; wherein, data improvement includes data cleaning, data verification, and data supplementation and optimization; Preferably, data improvement also includes data monitoring and quality feedback.

3. The data backup and recovery system based on the power consumption information collection system according to claim 2 is characterized in that: It also includes a monitoring module, which is used to monitor the process of data acquisition, data processing, data backup, data recovery and data improvement; When the monitoring module detects abnormal data or abnormal data operation, the data recovery module is also used to start the automatic recovery mechanism for automatic recovery and complete the recovery and storage of data.

4. The data backup and recovery system based on the power consumption information collection system according to claim 3 is characterized in that: It also includes an early warning module, which is used to issue an early warning when the monitoring module detects abnormal data or abnormal data operation.

5. The data backup and recovery system based on the power consumption information collection system according to claim 1 is characterized in that: The data recovery module also has the function of manually recovering stored data sets.

6. The data backup and recovery system based on the power consumption information collection system according to claim 1 is characterized in that: The backup modes of the data backup module include full backup, incremental backup and differential backup.

7. The data backup and recovery system based on the power consumption information collection system according to claim 1 is characterized in that: The data acquisition module's collection methods include timed acquisition, event-triggered acquisition, and real-time acquisition.

8. A data backup and recovery method based on an electricity consumption information collection system, characterized in that: include: Acquire data collected by the electricity consumption information collection system; Process the acquired data; data processing includes preliminary cleaning, conversion and integration; Storing the processed data to obtain a storage data set; Backing up the stored data set regularly to obtain a backup data set; When a stored data set is abnormal or lost, the stored data set is automatically restored according to the preset automatic recovery mechanism and the backup data set.

9. The data backup and recovery method based on the power consumption information collection system according to claim 1 is characterized in that: After automatically restoring the stored data set according to the preset automatic recovery mechanism and the backup data set, it also includes: Performing data improvement on the stored data set after data recovery; wherein data improvement includes data cleaning, data verification, and data supplementation and optimization; preferably, data improvement also includes data monitoring and quality feedback; Preferably, the process of data acquisition, data processing, data backup, data recovery and data improvement also includes: Conduct monitoring; When abnormal data or abnormal data operation is detected, the automatic recovery mechanism is activated for automatic recovery; Preferably, when abnormal data or abnormal data operation is detected, the method further includes: Give early warning.

10. The data backup and recovery method based on the power consumption information collection system according to claim 1 is characterized in that: When a stored data set is abnormal or lost, it also includes: Manually select the restored storage dataset.

Images