Data analysis processing method and system based on water conservancy project

By locating and replenishing the historical data of water conservancy engineering power generation equipment, the problem of blank and garbled data interference in the data is solved, and faster data analysis and more efficient data utilization are achieved.

CN119647783AInactive Publication Date: 2025-03-18SIHONG WATER CONSERVANCY ENG CO LTD

Patent Information

Application Number
CN202411801794.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-09
Publication Date
2025-03-18
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

When the historical data of existing water conservancy power generation equipment is stored, the blank data and garbled data inside the data are not removed, resulting in interference in the subsequent analysis process and extending the analysis time.

Method used

Through the data management terminal, the pending water conservancy project data in the database system is analyzed and processed, the abnormal data location and type are obtained, the location of deleted and supplemented data is determined, and data supplementation and sorting are performed to ensure data integrity and consistency.

Benefits of technology

It effectively avoids the interference of blank data and garbled data on the operation status analysis of water conservancy power generation equipment, shortens the data analysis time, and makes it more convenient and quick when subsequently calling water conservancy project data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119647783A_ABST
    Figure CN119647783A_ABST
Patent Text Reader

Abstract

The invention discloses a data analysis processing method and system based on a water conservancy project, and relates to the technical field of data processing, and the method comprises the steps: carrying out the analysis processing of to-be-processed water conservancy project data in a database system based on a data management terminal, and obtaining a water conservancy project abnormal data position; and based on the data management terminal, analyzing and processing the water conservancy project abnormal data position, and determining a water conservancy project abnormal data type. According to the method, missing data positioning is performed on the to-be-processed water conservancy project data in the database system, then the type of the missing data is analyzed, whether the missing data can be supplemented or not is determined, and if not, the missing data is deleted, so that interference on the water conservancy project power generation equipment during subsequent analysis on the operation state of the water conservancy project power generation equipment is avoided; the data analysis time is shortened, and finally, the supplemented water conservancy project data is sorted through the time continuity, so that the analysis of the water conservancy project data is more convenient and faster when the water conservancy project data is called subsequently.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a data analysis and processing method and system based on water conservancy projects. Background Art

[0002] Water conservancy engineering equipment refers to various types of machinery, instruments and facilities used for the development, utilization, management and protection of water resources. They play an important role in water conservancy projects, involving irrigation, drainage, flood control, hydropower, water supply and other fields. Dams are water-retaining structures that intercept water flows in rivers and channels to raise water levels or regulate flow. They can form reservoirs, raise water levels, regulate runoff, and concentrate water heads for flood control, water supply, irrigation, hydropower generation, improved navigation, etc. River regulation structures that adjust river flow and protect the bank bed are also called dams, such as spur dams, spur dams and submerged dams.

[0003] When storing the historical data of the existing water conservancy project power generation equipment, the blank data and garbled data in the data are not eliminated. When it is necessary to analyze the operating status of the water conservancy project power generation equipment, it is necessary to call the historical data of the water conservancy project power generation equipment for reference, but the blank data and garbled data therein will interfere with the subsequent analysis process and prolong the analysis time. Summary of the invention

[0004] In order to solve the above technical problems, a data analysis and processing method and system based on water conservancy projects are provided. The technical solution solves the problem that when the historical data of the existing water conservancy project power generation equipment proposed in the above background technology is stored, the blank data and garbled data in the data are not eliminated. When the operating status of the water conservancy project power generation equipment needs to be analyzed, the historical data of the water conservancy project power generation equipment needs to be called for reference, but the blank data and garbled data therein will interfere with the subsequent analysis process and prolong the analysis time.

[0005] In order to achieve the above purpose, the technical solution adopted by the present invention is: A data analysis and processing method based on water conservancy projects, comprising: Based on the data management terminal, the water conservancy project data to be processed in the database system are analyzed and processed to obtain the abnormal data position of the water conservancy project, wherein the abnormal data position of the water conservancy project includes the blank data position of the water conservancy project and the garbled data position of the water conservancy project; Based on the data management terminal, the abnormal data location of the water conservancy project is analyzed and processed to determine the abnormal data type of the water conservancy project, wherein the abnormal data type of the water conservancy project is any one of missing water flow rate data, missing power generation duration data, and missing power generation data; Based on the data management terminal, analyze and process the abnormal data types of water conservancy projects, determine the location of water conservancy project data to be deleted and the location of water conservancy project data to be supplemented; Based on the data management terminal, data is supplemented at the location of supplementary water conservancy project data to obtain complete water conservancy project data.

[0006] Preferably, the method of analyzing and processing the water conservancy project data to be processed in the database system based on the data management terminal and obtaining the location of abnormal water conservancy project data specifically includes the following steps: Obtain the name of the water conservancy project data to be processed and the storage partition of the database system; The data management terminal performs data retrieval processing on the storage partitions of the database system according to the names of the water conservancy project data to be processed, and determines the storage partition location information of the water conservancy project data to be processed; The data management terminal performs data extraction processing on the database system according to the storage partition location information of the water conservancy project data to be processed, and obtains the water conservancy project data to be processed; Based on the data management terminal, the water conservancy project data to be processed is analyzed and processed to obtain the location of abnormal data of the water conservancy project.

[0007] Preferably, the step of analyzing and processing the water conservancy project data to be processed based on the data management terminal and obtaining the location of abnormal water conservancy project data specifically includes the following steps: The data management terminal uses blank characters as a feature to retrieve and process the water conservancy project data to be processed, and obtains the location of blank data of the water conservancy project; Based on the data management terminal, the water conservancy project data to be processed are analyzed to obtain the type of the water conservancy project data to be processed; The data management terminal retrieves and processes the water conservancy project data to be processed based on the type of the water conservancy project data to be processed, and obtains the location of the garbled data of the water conservancy project.

[0008] Preferably, the analyzing and processing of the abnormal data location of the water conservancy project based on the data management terminal to determine the abnormal data type of the water conservancy project specifically comprises the following steps: Based on the data management terminal, the previous data or the next data of the blank data position of the water conservancy project and the garbled data position of the water conservancy project are read and processed to obtain the data dimension; Analyze and process data dimensions based on the data management terminal; If the data dimension is power, the data missing type corresponding to the blank data position of the water conservancy project or the garbled data position of the water conservancy project is the missing power generation data; If the data dimension is meter / second, the data missing type corresponding to the blank data position of the water conservancy project or the garbled data position of the water conservancy project is the missing water flow rate data; If the data dimension is seconds, the data missing type corresponding to the blank data position of the water conservancy project or the garbled data position of the water conservancy project is the missing power generation duration data.

[0009] Preferably, the step of analyzing and processing the abnormal data types of water conservancy projects based on the data management terminal to determine the location of deleting water conservancy project data and the location of supplementing water conservancy project data specifically includes the following steps: Based on the data management terminal, analyze and process the abnormal data types of water conservancy projects, and obtain the time information corresponding to the abnormal data types of water conservancy projects; The data management terminal extracts the water conservancy project data to be processed according to the time information corresponding to the water conservancy project abnormal data type, and obtains the number of the water conservancy project abnormal data type; Based on the data management terminal, the number of abnormal data types of the water conservancy project is judged and processed to determine the location of deleting the water conservancy project data and the location of supplementing the water conservancy project data.

[0010] Preferably, the method of judging and processing the number of abnormal data types of water conservancy projects based on the data management terminal and determining the location of deleting water conservancy project data and the location of supplementing water conservancy project data specifically includes the following steps: Based on the data management terminal, the number of abnormal data types of the water conservancy project and the setting of a first threshold are judged and processed; If the number of abnormal water conservancy project data types is greater than the set first threshold, the abnormal water conservancy project data is too much and cannot be supplemented, and the water conservancy project data location is determined to be deleted; If the number of water conservancy project abnormal data types is equal to the set first threshold, the water conservancy project abnormal data can be supplemented, and the location of the supplemented water conservancy project data is determined.

[0011] Preferably, the method of supplementing the location of the supplementary water conservancy project data based on the data management terminal to obtain complete water conservancy project data specifically includes the following steps: The data management terminal deletes all data at the location where the water conservancy project data is deleted, and the next level of data is supplemented upward; Based on the data management terminal, the location of the supplementary water conservancy project data is analyzed and processed to determine the supplementary water conservancy project data type, wherein the supplementary water conservancy project data type is any one of a supplementary water flow rate data type, a supplementary power generation duration data type or a supplementary power generation power data type; Based on the data management terminal, the data type of the supplementary water conservancy project is analyzed and processed to obtain the supplementary water conservancy project data; The data management terminal fills the location of the supplementary water conservancy project data according to the supplementary water conservancy project data to obtain complete water conservancy project data.

[0012] Preferably, the step of analyzing and processing the supplementary water conservancy project data type based on the data management terminal to obtain the supplementary water conservancy project data specifically includes the following steps: Obtain model information of hydropower generation equipment; The data management terminal performs data retrieval processing on the database system through the model information of the water conservancy project power generation equipment to obtain the research and development documents of the water conservancy project power generation equipment; Based on the data management terminal, data extraction and processing are performed on the research and development documents of the water conservancy project power generation equipment to obtain the power conversion law of the water conservancy project power generation equipment; If the supplementary water conservancy project data type is the supplementary water flow rate data type; The data management terminal extracts and processes data based on the location of the replenishment water flow rate data to obtain normal power generation duration data and normal power generation data; The data management terminal performs data analysis based on the normal power generation duration data, normal power generation data, and the power conversion law of the power generation equipment of the water conservancy project to obtain the supplementary water flow rate data; If the supplementary water conservancy project data type is the supplementary power generation duration data type; The data management terminal performs data extraction and processing according to the location of the supplementary power generation duration data to obtain normal water flow rate data and normal power generation data; The data management terminal performs data analysis based on normal water flow rate data, normal power generation data, and the power conversion law of the power generation equipment of the water conservancy project to obtain the supplementary power generation duration data; If the supplementary water conservancy project data type is the supplementary power generation data type; The data management terminal performs data extraction and processing according to the location of the supplementary power generation data to obtain normal water flow rate data and normal power generation duration data; The data management terminal performs data analysis based on normal water flow rate data, normal power generation duration data and the power conversion law of the water conservancy project power generation equipment to obtain supplementary power generation data.

[0013] Preferably, the data management terminal fills the location of the supplementary water conservancy project data with data according to the supplementary water conservancy project data, and obtaining the complete water conservancy project data specifically includes the following steps: The data management terminal fills the location of the supplementary water conservancy project data with data according to the supplementary water conservancy project data, and obtains the disordered water conservancy project data; The data management terminal performs time sorting on the disordered water conservancy project data based on the continuity of time to obtain complete water conservancy project data.

[0014] Furthermore, a data analysis and processing system based on water conservancy projects is proposed, which is used to implement the data analysis and processing method based on water conservancy projects as described above, including: A data management terminal, which is used to control each module to locate missing data, determine missing data, supplement missing data, and sort missing data for the water conservancy project data to be processed, and is used to realize data transmission and information exchange between each module; A database system, the database system is used to store the water conservancy project data to be processed and the research and development documents of the water conservancy project power generation equipment; A data retrieval module, wherein the data retrieval module retrieves and processes the water conservancy project data to be processed based on blank characters or the type of the water conservancy project data to be processed, and determines the location of abnormal water conservancy project data; A data analysis module, wherein the data analysis module analyzes the position of blank data or garbled data of the water conservancy project according to the data dimension to determine the abnormal data type of the water conservancy project; A judgment and analysis module, wherein the judgment and analysis module performs judgment and processing according to the number of abnormal water conservancy project data types, and determines the location of deleting water conservancy project data and the location of supplementing water conservancy project data; A data supplementation module, wherein the data supplementation module performs data analysis on the supplementary water conservancy project data type according to the power conversion law of the water conservancy project power generation equipment to obtain supplementary water conservancy project data; A data sorting module is used to sort the disordered water conservancy project data according to the continuity of time to obtain complete water conservancy project data.

[0015] Compared with the prior art, the present invention provides a data analysis and processing method and system based on water conservancy projects, which has the following beneficial effects: The present invention first locates missing data in the water conservancy project data to be processed in the database system, and then analyzes the type of missing data to determine whether the missing data can be supplemented. If it cannot be supplemented, it is deleted to avoid interference with the subsequent analysis of the operating status of the water conservancy project power generation equipment, thereby shortening the data analysis time. Finally, the supplemented water conservancy project data is sorted according to the continuity of time, so that when the water conservancy project data is subsequently called, the analysis of the water conservancy project data is more convenient and quick. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 This is a flow chart of steps S100-S400 in a data analysis and processing method based on water conservancy projects proposed by the present invention; Figure 2 This is a flow chart of steps S101-S104 in a data analysis and processing method based on water conservancy projects proposed by the present invention; Figure 3This is a flow chart of steps S1041-S1043 in a data analysis and processing method based on water conservancy projects proposed by the present invention; Figure 4 This is a flow chart of steps S201-S205 in a data analysis and processing method based on water conservancy projects proposed by the present invention; Figure 5 This is a flow chart of steps S301-S303 in a data analysis and processing method based on water conservancy projects proposed by the present invention; Figure 6 This is a flow chart of steps S3031-S3033 in a data analysis and processing method based on water conservancy projects proposed by the present invention; Figure 7 This is a flow chart of steps S401-S404 in a data analysis and processing method based on water conservancy projects proposed by the present invention; Figure 8 This is a flow chart of steps S40310-S40312 in a data analysis and processing method based on water conservancy projects proposed by the present invention; Fig. 9 This is a flow chart of steps S40320-S40322 in a data analysis and processing method based on water conservancy projects proposed by the present invention; Fig.10 This is a flow chart of steps S40330-S40332 in a data analysis and processing method based on water conservancy projects proposed by the present invention; Fig.11 It is a flow chart of steps S40340-S40340 in a data analysis and processing method based on water conservancy projects proposed by the present invention; Fig.12 This is a flow chart of steps S4041-S4042 in a data analysis and processing method based on water conservancy projects proposed by the present invention; Fig.13 This is a structural block diagram of a data analysis and processing system based on water conservancy projects proposed by the present invention. DETAILED DESCRIPTION

[0017] The following description is used to disclose the present invention so that those skilled in the art can implement the present invention. The preferred embodiments described below are only examples, and those skilled in the art may think of other obvious variations.

[0018] Reference Figure 1 As shown, a data analysis and processing method based on water conservancy projects includes: S100, based on the data management terminal, analyzing and processing the water conservancy project data to be processed in the database system, and obtaining the abnormal data position of the water conservancy project, wherein the abnormal data position of the water conservancy project includes the blank data position of the water conservancy project and the garbled data position of the water conservancy project; S200, based on the data management terminal, analyzing and processing the location of abnormal data of the water conservancy project to determine the abnormal data type of the water conservancy project, wherein the abnormal data type of the water conservancy project is any one of missing water flow rate data, missing power generation duration data, and missing power generation data; S300, based on the data management terminal, analyzing and processing the abnormal data type of the water conservancy project, determining the location of deleting the water conservancy project data and the location of supplementing the water conservancy project data; S400, based on the data management terminal, supplement the location of the supplementary water conservancy project data to obtain complete water conservancy project data; It can be understood by those skilled in the art that when the water conservancy project power generation equipment is used for too long, the internal electronic components may age, resulting in reduced power generation efficiency, and relying on manual analysis of its operating status may increase the analysis cycle. Therefore, the water conservancy project data is analyzed to determine the operating status of the water conservancy project power generation equipment. The above method can not only shorten the analysis cycle, but also reduce the work intensity of the staff, because the water conservancy project data can indirectly reflect the operating status of the water conservancy project power generation equipment. For example, water conservancy project power generation equipment with different commissioning times has different power generation powers under the same power generation time and water flow rate. Because the commissioning time is too long, the electronic components inside the water conservancy project power generation equipment may be oxidized or damaged to a certain extent due to long-term use at high temperatures. Therefore, the difference in power generation can reflect the aging degree of the water conservancy project power generation equipment. In order to avoid abnormal data in the water conservancy project data interfering with the subsequent analysis process, resulting in an increase in the analysis cycle, the abnormal data of the water conservancy project is analyzed and processed.

[0019] Reference Figure 2 As shown, based on the data management terminal, the water conservancy project data to be processed in the database system is analyzed and processed, and the location of abnormal water conservancy project data is obtained, which specifically includes the following steps: S101, obtaining the name of the water conservancy project data to be processed and the storage partition of the database system; S102, the data management terminal performs data retrieval processing on the storage partitions of the database system according to the names of the water conservancy project data to be processed, and determines the storage partition location information of the water conservancy project data to be processed; S103, the data management terminal performs data extraction processing on the database system according to the storage partition location information of the water conservancy project data to be processed, and obtains the water conservancy project data to be processed; S104, based on the data management terminal, analyzing and processing the water conservancy project data to be processed, and obtaining the location of abnormal data of the water conservancy project; In this embodiment, the database system stores data by partitions. Therefore, different partitions in the database system are searched by the name of the water conservancy project data to be processed to determine the storage location of the water conservancy project data to be processed.

[0020] Reference Figure 3 As shown, based on the data management terminal, the water conservancy project data to be processed is analyzed and processed, and the location of abnormal water conservancy project data is obtained, which specifically includes the following steps: S1041, the data management terminal performs retrieval processing on the water conservancy project data to be processed by taking blank characters as the characteristics, and obtains the location of blank data of the water conservancy project; S1042, based on the data management terminal, performing data analysis on the water conservancy project data to be processed, and obtaining the type of the water conservancy project data to be processed; S1043, the data management terminal retrieves and processes the water conservancy project data to be processed based on the type of the water conservancy project data to be processed, and obtains the location of the garbled data of the water conservancy project; In this embodiment, when data is being collected, if the collection device malfunctions at a certain moment, the collected data will be blank or garbled. When it is necessary to analyze the operating status of the water conservancy project power generation equipment, it is necessary to call the previously collected water conservancy project data as a reference for analysis. Therefore, in order to avoid blank data and garbled data from interfering with subsequent processes, the position of the blank data or garbled data is located.

[0021] Reference Figure 4 As shown, based on the data management terminal, analyzing and processing the location of abnormal data of water conservancy projects and determining the type of abnormal data of water conservancy projects specifically include the following steps: S201, based on the data management terminal, respectively read and process the previous data or the next data of the blank data position of the water conservancy project and the garbled data position of the water conservancy project to obtain the data dimension; S202, analyzing and processing the data dimension based on the data management terminal; S203, if the data dimension is power, then the data missing type corresponding to the blank data position of the water conservancy project or the garbled data position of the water conservancy project is the missing power generation data; S204, if the data dimension is meter / second, the data missing type corresponding to the water conservancy project blank data position or the water conservancy project garbled data position is water flow rate data missing; S205. If the data dimension is seconds, the data missing type corresponding to the blank data position of the water conservancy project or the garbled data position of the water conservancy project is the missing power generation duration data; In this embodiment, the dimension of the data can accurately reflect the type of data. Therefore, in order to determine the type of water conservancy project abnormal data, the dimension of the previous data or the next data of the water conservancy project abnormal data is extracted, and the water conservancy project abnormal data type is determined according to the data dimension.

[0022] Reference Figure 5 As shown, based on the data management terminal, analyzing and processing the abnormal data type of the water conservancy project, determining the location of deleting the water conservancy project data and the location of supplementing the water conservancy project data specifically includes the following steps: S301, based on the data management terminal, analyzing and processing the abnormal data type of the water conservancy project, and obtaining the time information corresponding to the abnormal data type of the water conservancy project; S302, the data management terminal extracts the water conservancy project data to be processed according to the time information corresponding to the water conservancy project abnormal data type, and obtains the number of water conservancy project abnormal data types; S303: Based on the data management terminal, the number of abnormal water conservancy project data types is judged and processed to determine the locations of water conservancy project data to be deleted and the locations of water conservancy project data to be supplemented.

[0023] Reference Figure 6 As shown, based on the data management terminal, judging and processing the number of abnormal data types of water conservancy projects, determining the location of deleting water conservancy project data and the location of supplementing water conservancy project data specifically includes the following steps: S3031, based on the data management terminal, judging and processing the number of abnormal data types of the water conservancy project and setting a first threshold; S3032: If the number of abnormal water conservancy project data types is greater than the set first threshold, there are too many abnormal water conservancy project data and it is impossible to supplement them, and the location of deleting the water conservancy project data is determined; S3033: If the number of abnormal water conservancy project data types is equal to the set first threshold, the abnormal water conservancy project data can be supplemented, and the location of the supplemented water conservancy project data is determined; In this embodiment, at a certain moment, the collected water conservancy project data should include water flow rate, power generation time and power generation power, so the number of missing data of these three data is judged. If the number of missing data is greater than 1, the other two data cannot be obtained based on one data, and one data has no reference value. Therefore, the abnormal data and normal data at this moment are deleted. At the same time, the next data at this moment is supplemented upward to avoid spaces in the water conservancy project data occupying storage space. If the number of missing data is equal to 1, another data can be obtained through two data, making the water conservancy project data larger and making subsequent analysis results more accurate.

[0024] Reference Figure 7As shown, based on the data management terminal, the data location of the supplementary water conservancy project data is supplemented, and the acquisition of complete water conservancy project data specifically includes the following steps: S401, the data management terminal deletes all data at the location where the water conservancy project data is deleted, and the next level of data is supplemented upward; S402, based on the data management terminal, analyzing and processing the location of the supplementary water conservancy project data to determine the supplementary water conservancy project data type, wherein the supplementary water conservancy project data type is any one of a supplementary water flow rate data type, a supplementary power generation duration data type, or a supplementary power generation power data type; S403, based on the data management terminal, analyzing and processing the data type of the supplementary water conservancy project to obtain the supplementary water conservancy project data; S404. The data management terminal fills the location of the supplementary water conservancy project data according to the supplementary water conservancy project data to obtain complete water conservancy project data.

[0025] Reference Figure 8-11 As shown, based on the data management terminal, the supplementary water conservancy project data type is analyzed and processed, and the acquisition of supplementary water conservancy project data specifically includes the following steps: S40310, obtaining model information of power generation equipment of a water conservancy project; S40311. The data management terminal performs data retrieval processing on the database system through the model information of the water conservancy project power generation equipment to obtain the research and development documents of the water conservancy project power generation equipment; S40312. Based on the data management terminal, data extraction and processing are performed on the research and development documents of the water conservancy project power generation equipment to obtain the power conversion law of the water conservancy project power generation equipment; S40320, if the supplementary water conservancy project data type is the supplementary water flow rate data type; S40321. The data management terminal extracts and processes data according to the location of the replenishment water flow rate data to obtain normal power generation duration data and normal power generation power data; S40322. The data management terminal performs data analysis based on the normal power generation duration data, the normal power generation data, and the power conversion law of the power generation equipment of the water conservancy project to obtain the supplementary water flow rate data; S40330, if the supplementary water conservancy project data type is the supplementary power generation duration data type; S40331. The data management terminal extracts and processes data according to the location of the supplementary power generation duration data to obtain normal water flow rate data and normal power generation data; S40332. The data management terminal performs data analysis based on normal water flow rate data, normal power generation data, and power conversion rules of power generation equipment of the water conservancy project to obtain supplementary power generation duration data; S40340, if the supplementary water conservancy project data type is the supplementary power generation data type; S40341. The data management terminal performs data extraction and processing according to the location of the supplementary power generation data to obtain normal water flow rate data and normal power generation duration data; S40340, the data management terminal performs data analysis based on normal water flow rate data, normal power generation duration data, and power conversion rules of water conservancy project power generation equipment to obtain supplementary power generation data; In this embodiment, when the number of abnormal data types of the water conservancy project is equal to 1, it can be supplemented. However, it is necessary to calculate it through the power conversion law of the water conservancy project power generation equipment, and the power conversion law of the water conservancy project power generation equipment is stored in the research and development documents of the water conservancy project power generation equipment. Therefore, data is extracted from the database system to obtain the research and development documents of the water conservancy project power generation equipment, and finally the power conversion law of the water conservancy project power generation equipment can be obtained. Then, the other two data related to the supplemented water conservancy project data type are extracted and combined with the power conversion law of the water conservancy project power generation equipment to perform data calculation to obtain supplemented water conservancy project data, so that the water conservancy project data is more complete, and at the same time, the subsequent analysis of the operating status of the water conservancy project power generation equipment is more accurate.

[0026] Reference Fig.12 As shown, the data management terminal fills the location of the supplementary water conservancy project data with data according to the supplementary water conservancy project data, and obtaining complete water conservancy project data specifically includes the following steps: S4041. The data management terminal fills the location of the supplementary water conservancy project data with data according to the supplementary water conservancy project data to obtain disordered water conservancy project data; S4042, the data management terminal performs time sorting processing on the disordered water conservancy project data based on the continuity of time to obtain complete water conservancy project data; In this embodiment, the storage of water conservancy project data may be disordered. For example, the data in March may be stored after the data in August. In order to make the water conservancy project data more orderly, the water conservancy project data is sorted according to the continuity of time. At the same time, it also makes subsequent calls to the water conservancy project data more convenient without the need to re-sort the water conservancy project data.

[0027] Reference Fig.13 As shown, a data analysis and processing system based on water conservancy projects is used to implement the data analysis and processing method based on water conservancy projects as described above, including: A data management terminal, which is used to control each module to locate missing data, determine missing data, supplement missing data, and sort missing data for the water conservancy project data to be processed, and is used to realize data transmission and information exchange between each module; A database system, the database system is used to store the water conservancy project data to be processed and the research and development documents of the water conservancy project power generation equipment; A data retrieval module, wherein the data retrieval module retrieves and processes the water conservancy project data to be processed based on blank characters or the type of the water conservancy project data to be processed, and determines the location of abnormal water conservancy project data; A data analysis module, wherein the data analysis module analyzes the position of blank data or garbled data of the water conservancy project according to the data dimension to determine the abnormal data type of the water conservancy project; A judgment and analysis module, wherein the judgment and analysis module performs judgment and processing according to the number of abnormal water conservancy project data types, and determines the location of deleting water conservancy project data and the location of supplementing water conservancy project data; A data supplementation module, wherein the data supplementation module performs data analysis on the supplementary water conservancy project data type according to the power conversion law of the water conservancy project power generation equipment to obtain supplementary water conservancy project data; A data sorting module is used to sort the disordered water conservancy project data according to the continuity of time to obtain complete water conservancy project data.

[0028] The above shows and describes the basic principles, main features and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The above embodiments and descriptions only describe the principles of the present invention. The present invention may be subject to various changes and improvements without departing from the spirit and scope of the present invention. These changes and improvements fall within the scope of the present invention. The scope of protection claimed by the present invention is defined by the attached claims and their equivalents.

Claims

1. A data analysis and processing method based on water conservancy projects, characterized in that: include: Based on the data management terminal, the water conservancy project data to be processed in the database system are analyzed and processed to obtain the abnormal data position of the water conservancy project, wherein the abnormal data position of the water conservancy project includes the blank data position of the water conservancy project and the garbled data position of the water conservancy project; Based on the data management terminal, the abnormal data location of the water conservancy project is analyzed and processed to determine the abnormal data type of the water conservancy project, wherein the abnormal data type of the water conservancy project is any one of missing water flow rate data, missing power generation duration data, and missing power generation data; Based on the data management terminal, analyze and process the abnormal data types of water conservancy projects, determine the location of water conservancy project data to be deleted and the location of water conservancy project data to be supplemented; Based on the data management terminal, data is supplemented at the location of supplementary water conservancy project data to obtain complete water conservancy project data.

2. A data analysis and processing method based on water conservancy projects according to claim 1, characterized in that: The method of analyzing and processing the water conservancy project data to be processed in the database system based on the data management terminal and obtaining the location of abnormal water conservancy project data specifically includes the following steps: Obtain the name of the water conservancy project data to be processed and the storage partition of the database system; The data management terminal performs data retrieval processing on the storage partitions of the database system according to the names of the water conservancy project data to be processed, and determines the storage partition location information of the water conservancy project data to be processed; The data management terminal performs data extraction processing on the database system according to the storage partition location information of the water conservancy project data to be processed, and obtains the water conservancy project data to be processed; Based on the data management terminal, the water conservancy project data to be processed is analyzed and processed to obtain the location of abnormal data of the water conservancy project.

3. A data analysis and processing method based on water conservancy projects according to claim 2, characterized in that: The method of analyzing and processing the water conservancy project data to be processed based on the data management terminal and obtaining the location of abnormal water conservancy project data specifically includes the following steps: The data management terminal uses blank characters as a feature to retrieve and process the water conservancy project data to be processed, and obtains the location of blank data of the water conservancy project; Based on the data management terminal, the water conservancy project data to be processed are analyzed to obtain the type of the water conservancy project data to be processed; The data management terminal retrieves and processes the water conservancy project data to be processed based on the type of the water conservancy project data to be processed, and obtains the location of the garbled data of the water conservancy project.

4. The data analysis and processing method based on water conservancy projects according to claim 1 is characterized in that: The method of analyzing and processing the location of abnormal data of the water conservancy project based on the data management terminal and determining the type of abnormal data of the water conservancy project specifically includes the following steps: Based on the data management terminal, the previous data or the next data of the blank data position of the water conservancy project and the garbled data position of the water conservancy project are read and processed to obtain the data dimension; Analyze and process data dimensions based on the data management terminal; If the data dimension is power, the data missing type corresponding to the blank data position of the water conservancy project or the garbled data position of the water conservancy project is the missing power generation data; If the data dimension is meter / second, the data missing type corresponding to the blank data position of the water conservancy project or the garbled data position of the water conservancy project is the missing water flow rate data; If the data dimension is seconds, the data missing type corresponding to the blank data position of the water conservancy project or the garbled data position of the water conservancy project is the missing power generation duration data.

5. The data analysis and processing method based on water conservancy projects according to claim 1 is characterized in that: The method of analyzing and processing the abnormal data type of the water conservancy project based on the data management terminal to determine the location of deleting the water conservancy project data and the location of supplementing the water conservancy project data specifically includes the following steps: Based on the data management terminal, analyze and process the abnormal data types of water conservancy projects, and obtain the time information corresponding to the abnormal data types of water conservancy projects; The data management terminal extracts the water conservancy project data to be processed according to the time information corresponding to the water conservancy project abnormal data type, and obtains the number of the water conservancy project abnormal data type; Based on the data management terminal, the number of abnormal data types of the water conservancy project is judged and processed to determine the location of deleting the water conservancy project data and the location of supplementing the water conservancy project data.

6. The data analysis and processing method based on water conservancy projects according to claim 5 is characterized in that: The method of judging and processing the number of abnormal data types of water conservancy projects based on the data management terminal and determining the location of deleting water conservancy project data and the location of supplementing water conservancy project data specifically includes the following steps: Based on the data management terminal, the number of abnormal data types of the water conservancy project and the setting of a first threshold are judged and processed; If the number of abnormal water conservancy project data types is greater than the set first threshold, the abnormal water conservancy project data is too much and cannot be supplemented, and the water conservancy project data location is determined to be deleted; If the number of water conservancy project abnormal data types is equal to the set first threshold, the water conservancy project abnormal data can be supplemented, and the location of the supplemented water conservancy project data is determined.

7. The data analysis and processing method based on water conservancy projects according to claim 1 is characterized in that: The method of supplementing the location of the supplementary water conservancy project data based on the data management terminal to obtain complete water conservancy project data specifically includes the following steps: The data management terminal deletes all data at the location where the water conservancy project data is deleted, and the next level of data is supplemented upward; Based on the data management terminal, the location of the supplementary water conservancy project data is analyzed and processed to determine the supplementary water conservancy project data type, wherein the supplementary water conservancy project data type is any one of a supplementary water flow rate data type, a supplementary power generation duration data type or a supplementary power generation power data type; Based on the data management terminal, the data type of the supplementary water conservancy project is analyzed and processed to obtain the supplementary water conservancy project data; The data management terminal fills the location of the supplementary water conservancy project data according to the supplementary water conservancy project data to obtain complete water conservancy project data.

8. The data analysis and processing method based on water conservancy projects according to claim 7 is characterized in that: The method of analyzing and processing the supplementary water conservancy project data type based on the data management terminal to obtain the supplementary water conservancy project data specifically includes the following steps: Obtain model information of hydropower generation equipment; The data management terminal performs data retrieval processing on the database system through the model information of the water conservancy project power generation equipment to obtain the research and development documents of the water conservancy project power generation equipment; Based on the data management terminal, data extraction and processing are performed on the research and development documents of the water conservancy project power generation equipment to obtain the power conversion law of the water conservancy project power generation equipment; If the supplementary water conservancy project data type is the supplementary water flow rate data type; The data management terminal extracts and processes data based on the location of the replenishment water flow rate data to obtain normal power generation duration data and normal power generation power data; The data management terminal performs data analysis based on the normal power generation duration data, normal power generation data, and the power conversion law of the power generation equipment of the water conservancy project to obtain the supplementary water flow rate data; If the supplementary water conservancy project data type is the supplementary power generation duration data type; The data management terminal performs data extraction and processing according to the location of the supplementary power generation duration data to obtain normal water flow rate data and normal power generation data; The data management terminal performs data analysis based on normal water flow rate data, normal power generation data, and the power conversion law of the power generation equipment of the water conservancy project to obtain the supplementary power generation duration data; If the supplementary water conservancy project data type is the supplementary power generation data type; The data management terminal performs data extraction and processing according to the location of the supplementary power generation data to obtain normal water flow rate data and normal power generation duration data; The data management terminal performs data analysis based on normal water flow rate data, normal power generation duration data and the power conversion law of the water conservancy project power generation equipment to obtain supplementary power generation data.

9. The data analysis and processing method based on water conservancy projects according to claim 7 is characterized in that: The data management terminal fills the location of the supplementary water conservancy project data with data according to the supplementary water conservancy project data, and obtaining the complete water conservancy project data specifically includes the following steps: The data management terminal fills the location of the supplementary water conservancy project data with data according to the supplementary water conservancy project data, and obtains the disordered water conservancy project data; The data management terminal performs time sorting on the disordered water conservancy project data based on the continuity of time to obtain complete water conservancy project data.

10. A data analysis and processing system based on water conservancy projects, used to implement a data analysis and processing method based on water conservancy projects as claimed in any one of claims 1 to 9, characterized in that: include: A data management terminal, which is used to control each module to locate missing data, determine missing data, supplement missing data, and sort missing data for the water conservancy project data to be processed, and is used to realize data transmission and information exchange between each module; A database system, the database system is used to store the water conservancy project data to be processed and the research and development documents of the water conservancy project power generation equipment; A data retrieval module, wherein the data retrieval module retrieves and processes the water conservancy project data to be processed based on blank characters or the type of the water conservancy project data to be processed, and determines the location of abnormal water conservancy project data; A data analysis module, wherein the data analysis module analyzes the position of blank data or garbled data of the water conservancy project according to the data dimension to determine the abnormal data type of the water conservancy project; A judgment and analysis module, wherein the judgment and analysis module performs judgment and processing according to the number of abnormal water conservancy project data types, and determines the location of deleting water conservancy project data and the location of supplementing water conservancy project data; A data supplementation module, wherein the data supplementation module performs data analysis on the supplementary water conservancy project data type according to the power conversion law of the water conservancy project power generation equipment to obtain supplementary water conservancy project data; A data sorting module is used to sort the disordered water conservancy project data according to the continuity of time to obtain complete water conservancy project data.

Citation Information

Patent Citations

  • A processing method and system for power equipment to monitor abnormal data in online manner

    CN109766334A

  • Big data cleaning and denoising method and system for power grid and computer storage medium

    CN113190542A

  • Characteristic data classification analysis method for operation rules of hydraulic power plant equipment

    CN115689101A

  • Water conservancy project real-time collection data management method and system

    CN116112530A

  • Hydroelectric generating set state monitoring data cleaning method and device and electronic equipment

    CN117574055A

Cited By

  • Water conservancy project monitoring data processing method and system based on cloud computing

    CN120804602B

  • Hydraulic engineering state remote management system

    CN121212827A

  • Hydraulic engineering management data processing method and system based on cloud computing

    CN122090359A

  • Water conservancy project management data processing method and system based on cloud computing

    CN122090359B