Water regimen data scheduling processing method and system
Through the water condition data scheduling and processing method, the water condition data is scheduled using data processing modules and analysis programs, which solves the problems of large existing water conditioning systems and excessive resource occupation, and realizes the efficiency of the water conditioning automation system of the centralized control center Run and low-cost deployment.
Patent Information
- Application Number
- CN202411187793.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-28
- Publication Date
- 2024-12-06
AI Technical Summary
The existing water diversion system needs to be connected with a large number of peripheral components, resulting in too large system and excessive deployment resources, which is difficult to meet the requirements of reliable system, practical functions, reasonable networking, smooth communication, convenient maintenance and simple operation.
提出一种水情数据调度处理方法,包括获取水情数据和气象预测数据,存储至本地数据库,并通过预设调度程序和分析程序进行数据调度操作,根据关联关系识别结果执行调度任务,确保数据处理的自动化和高效性。
The water condition and water regulation automation system of the centralized control center has been realized in power generation and flood control scheduling, reduced the system investment cost, and met the system's reliability, functional practicality, network rationality, communication smoothness and convenience of maintenance. sex.
Smart Images

Figure CN119088520A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing, and in particular to a method and system for scheduling and processing water situation data. Background Art
[0002] The servers of the water regulation system include database servers, communication servers, application servers, synchronization servers, water regulation workstations, etc.
[0003] For example, in the existing technology, the centralized control center can collect, monitor, analyze and manage the water and rainfall conditions of a river basin, and provide support for the centralized control center to carry out reservoir dispatching and decision-making. However, the existing water dispatching system needs to be connected with a large number of peripheral components, including various storage and computing frameworks, which will lead to As a result, the existing scheduling system is too large and its deployment requires additional resources. Summary of the invention
[0004] The embodiment of the present application provides a method and system for dispatching and processing water condition data, ensuring that the water condition and water regulation automation system of the centralized control center plays an important role in power generation and flood control dispatching work, and meets the requirements of system reliability, practical functions, reasonable networking, smooth communication, convenient maintenance and simple operation with a relatively optimal system investment cost.
[0005] The present application embodiment provides a method for scheduling and processing water regime data, including: Obtain water regime data and corresponding meteorological forecast data; The water condition data and the corresponding meteorological forecast data are stored in a local database, the application server includes a data processing module, and when the amount of data stored in the local database or the storage period reaches a preset threshold, the scheduling operation of the water condition data is triggered, the data processing module reads the to-be-scheduled tasks in the local database through a preset scheduling program, and starts to execute the scheduling operation corresponding to the scheduling task; and In the process of executing the scheduling operation, calling a preset analysis program to analyze and identify the association relationship in the to-be-scheduled tasks based on the local database to generate a corresponding relationship identification result; According to the relationship identification result, the scheduling operation corresponding to the task to be scheduled is executed.
[0006] Optionally, the data processing module reads the to-be-scheduled tasks in the local database through a preset scheduling program, and starts to execute the scheduling operation corresponding to the scheduled tasks, including: The local database is read by polling through a preset scheduling program and a preset scheduling period, wherein the preset scheduling period is smaller than the storage period; The tasks to be scheduled are determined based on the preset batch processing log table and the preset job configuration table in the local database.
[0007] Optionally, the data processing module reads the to-be-scheduled tasks in the local database through a preset scheduling program, and before starting to execute the scheduling operation corresponding to the scheduled tasks, it also includes: Acquire the pre-positioned water situation operation obtained by processing the preset data information from the remote database according to the preset data acquisition cycle; The operation log corresponding to the pre-hydraulic operation is sent to the preset batch processing log table of the local database.
[0008] Optionally, the operation of obtaining the pre-processed water condition from the remote database based on preset data information according to the preset data acquisition cycle includes: According to the set data acquisition cycle, the remote database is acquired, and a specified number of pre-hydraulic operations are obtained by processing the preset data information based on the preset operation configuration table in the local database.
[0009] Optionally, before calling a preset analysis program to analyze and identify the association relationship in the to-be-scheduled tasks based on the local database, the method further includes: Based on the preset batch processing log table in the local database, it is determined whether the pre-processing water condition operation corresponding to the task to be scheduled is successfully executed; If yes, the operation log corresponding to the pre-positioned water condition operation is stored in the preset log record table in the local database, and a preset analysis program is called; If not, stop executing the calling operation.
[0010] Optionally, calling a preset analysis program to analyze and identify the association relationship in the to-be-scheduled tasks based on the local database includes: A preset analysis program is called and, based on the preset job configuration table in the local database, the association relationship in the scheduled task is analyzed and identified to generate a corresponding relationship identification result.
[0011] Optionally, executing a scheduling operation corresponding to the task to be scheduled according to the relationship identification result includes: Update the preset log record table in the local database based on the relationship identification result; and, The relationship identification result is written into the local database to complete the scheduling operation corresponding to the task to be scheduled.
[0012] An embodiment of the present application further proposes a water condition data scheduling and processing system, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by the processor, the steps of the water condition data scheduling and processing method as described above are implemented.
[0013] The water condition data scheduling and processing method of the embodiment of the present application can ensure that the water condition and water regulation automation system of the centralized control center plays an important role in power generation and flood control scheduling, and with a relatively optimal system investment cost, meets the requirements of system reliability, practical functions, reasonable networking, smooth communication, convenient maintenance, and simple operation.
[0014] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings: Figure 1 The following is a schematic diagram of the basic process of the water regime data scheduling and processing method of this embodiment. DETAILED DESCRIPTION
[0016] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.
[0017] The present application embodiment proposes a method for dispatching and processing water condition data, such as Figure 1 As shown, the following steps are included: In step S101, water regime data and corresponding meteorological forecast data are obtained. In some examples, an association relationship between the water regime data and the meteorological forecast data may also be established.
[0018] In step S102, the water condition data and the corresponding meteorological forecast data are stored in a local database, and the application server includes a data processing module. When the amount of data stored in the local database or the storage period reaches a preset threshold, the scheduling operation of the water condition data is triggered, and the data processing module reads the tasks to be scheduled in the local database through a preset scheduling program, and starts to execute the scheduling operation corresponding to the scheduling task. For example, when the amount of data stored in the local database reaches 60%-70% of the maximum storage capacity, or the data period reaches 1 month, the scheduling operation of the water condition data is triggered, and the tasks to be scheduled in the local database are read by the data processing module through the preset scheduling program.
[0019] In step S103, during the execution of the scheduling operation, a preset analysis program is called to analyze and identify the association relationship in the to-be-scheduled tasks based on the local database to generate a corresponding relationship identification result.
[0020] In step S104, the scheduling operation corresponding to the task to be scheduled is executed according to the relationship identification result.
[0021] In some embodiments, the data processing module reads the to-be-scheduled tasks in the local database through a preset scheduling program, and starts to execute the scheduling operation corresponding to the scheduled tasks, including: The local database is read by polling through a preset scheduling program and a preset scheduling cycle, wherein the preset scheduling cycle is less than the storage cycle. In this embodiment, the scheduled tasks of the current node in the local database are first read by polling through a preset scheduling program and a preset scheduling cycle, and the corresponding scheduling operations of the scheduled tasks are started. The preset scheduling program can be a scheduling program designed based on the Crontab polling task, which is used to set periodically executed instructions. The preset scheduling cycle can be set based on user needs. For example, if the preset scheduling cycle is 60 minutes, the scheduled tasks of the current time node will be read by polling through the preset scheduling program every 60 minutes.
[0022] The tasks to be scheduled are determined based on the preset batch processing log table and the preset job configuration table in the local database. Specifically, the second preset database is obtained according to the preset data acquisition cycle to process the preset data information based on the preset job configuration table in the first preset database to obtain a number of pre-water condition operations, wherein the preset data acquisition cycle can be set based on user needs, and the water condition operation may include, for example, the gate opening time, the opening time, the generator power generation, the blade opening, etc., and the pre-water condition operation may include the pre-operation of the corresponding operation, such as the adjustment of compliance to the set compliance.
[0023] In some embodiments, the data processing module reads the to-be-scheduled tasks in the local database through a preset scheduling program, and before starting to execute the scheduling operation corresponding to the scheduled tasks, it also includes: According to the preset data acquisition cycle, the front-end water condition operation obtained by processing the preset data information from the remote database is obtained.
[0024] Send the job log corresponding to the pre-conditioning job to the preset batch processing log table of the local database. In the embodiment of the present application, the corresponding dependency relationship is saved in the preset job configuration table, and the job log of the pre-conditioning dependent job is saved in the batch log table. The pre-conditioning job of the task to be scheduled can be determined based on the dependency relationship in the preset job configuration table, and whether the pre-conditioning job is executed can be determined according to the preset batch processing log table to determine the task to be scheduled. That is, the method of the embodiment of the present application can determine the pre-conditioning job of the scheduling task through the preset data table, thereby realizing the pre-conditioning job function.
[0025] In some embodiments, the operation of obtaining the pre-positioned water condition obtained by processing the preset data information from the remote database according to the preset data acquisition cycle includes: According to the set data acquisition cycle, the remote database is acquired, and a specified number of pre-hydraulic operations are obtained by processing the preset data information based on the preset operation configuration table in the local database.
[0026] In some embodiments, before calling a preset analysis program to analyze and identify the association relationship in the to-be-scheduled tasks based on the local database, the method further includes: Based on the preset batch processing log table in the local database, determine whether the pre-water condition operation corresponding to the task to be scheduled is executed successfully; if so, store the corresponding operation log of the pre-water condition operation to the preset log record table in the local database, and call the preset analysis program; if not, stop executing the calling operation.
[0027] In some specific examples, before executing the job to be scheduled, it is necessary to determine whether the pre-water condition job corresponding to the task to be scheduled is successfully executed based on the job log stored in the preset batch processing log table in the local database. If so, the job log corresponding to the pre-water condition job is stored in the preset log record table in the first preset database, and the job status parameter in the job log of the pre-water condition job in the preset log record table is changed to the run state, and then the subsequent scheduling operation is continued.
[0028] In some specific examples, calling a preset analysis program to analyze and identify the association relationship in the to-be-scheduled tasks based on the local database includes: The preset analysis program is called and the association relationship in the scheduled task is analyzed and identified based on the preset job configuration table in the local database to generate a corresponding relationship identification result. In the process of association relationship analysis and identification, different upstream data are connected and the order of processing source tables is different. In the specific example, the corresponding data is processed in order.
[0029] In some specific examples, executing the scheduling operation corresponding to the task to be scheduled according to the relationship identification result includes: Update the preset log record table in the local database based on the relationship identification result; and, The relationship identification result is written into the local database to complete the scheduling operation corresponding to the task to be scheduled. In a specific example, the corresponding relationship identification operation state can be returned to a preset log record table in the local database.
[0030] The water condition data scheduling and processing method of the embodiment of the present application can ensure that the water condition and water regulation automation system of the centralized control center plays an important role in power generation and flood control scheduling, and with a relatively optimal system investment cost, meets the requirements of system reliability, practical functions, reasonable networking, smooth communication, convenient maintenance, and simple operation.
[0031] An embodiment of the present application further proposes a water condition data scheduling and processing system, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by the processor, the steps of the water condition data scheduling and processing method as described above are implemented.
[0032] In addition, although exemplary embodiments have been described herein, the scope includes any and all embodiments based on the present disclosure with equivalent elements, modifications, omissions, combinations (e.g., various embodiments intersecting schemes), adaptations or changes. It is not limited to the examples described in this specification or during the implementation of this application, and its examples will be interpreted as non-exclusive.
[0033] The above description is intended to be illustrative rather than restrictive. For example, the above examples (or one or more of them) can be used in combination with each other. For example, those of ordinary skill in the art may use other embodiments when reading the above description.
[0034] The above embodiments are merely exemplary embodiments of the present disclosure. Those skilled in the art may make various modifications or equivalent substitutions to the present invention within the essence and protection scope of the present disclosure, and such modifications or equivalent substitutions shall also be deemed to fall within the protection scope of the present invention.
Claims
1. A method for dispatching and processing water regime data, characterized in that: include: Obtain water regime data and corresponding meteorological forecast data; The water condition data and the corresponding meteorological forecast data are stored in a local database. The application server includes a data processing module. When the amount of data stored in the local database or the storage period reaches a preset threshold, a scheduling operation of the water condition data is triggered. The data processing module reads the tasks to be scheduled in the local database through a preset scheduling program and starts to execute the scheduling operation corresponding to the scheduling task. as well as, In the process of executing the scheduling operation, calling a preset analysis program to analyze and identify the association relationship in the to-be-scheduled tasks based on the local database to generate a corresponding relationship identification result; According to the relationship identification result, the scheduling operation corresponding to the task to be scheduled is executed.
2. The method for dispatching and processing water regime data according to claim 1, characterized in that: The data processing module reads the to-be-scheduled tasks in the local database through a preset scheduling program, and starts to execute the scheduling operations corresponding to the scheduling tasks, including: The local database is read by polling through a preset scheduling program and a preset scheduling period, wherein the preset scheduling period is smaller than the storage period; The tasks to be scheduled are determined based on the preset batch processing log table and the preset job configuration table in the local database.
3. The method for dispatching and processing water regime data according to claim 2, characterized in that: The data processing module reads the to-be-scheduled tasks in the local database through a preset scheduling program, and before starting to execute the scheduling operation corresponding to the scheduling task, it also includes: Acquire the pre-positioned water situation operation obtained by processing the preset data information from the remote database according to the preset data acquisition cycle; The operation log corresponding to the pre-hydraulic operation is sent to the preset batch processing log table of the local database.
4. The method for dispatching and processing water regime data according to claim 3, characterized in that: The pre-processing water conditions obtained from the remote database based on the preset data information according to the preset data acquisition cycle include: According to the set data acquisition cycle, the remote database is acquired, and a specified number of pre-hydraulic operations are obtained by processing the preset data information based on the preset operation configuration table in the local database.
5. The method for dispatching and processing water regime data according to claim 4, characterized in that: Before calling the preset analysis program to analyze and identify the association relationship in the to-be-scheduled tasks based on the local database, the method further includes: Based on the preset batch processing log table in the local database, it is determined whether the pre-processing water condition operation corresponding to the task to be scheduled is successfully executed; If yes, the operation log corresponding to the pre-positioned water condition operation is stored in the preset log record table in the local database, and a preset analysis program is called; If not, stop executing the calling operation.
6. The method for dispatching and processing water regime data according to claim 4, characterized in that: Calling a preset analysis program to analyze and identify the association relationship in the to-be-scheduled tasks based on the local database includes: A preset analysis program is called and, based on the preset job configuration table in the local database, the association relationship in the scheduled task is analyzed and identified to generate a corresponding relationship identification result.
7. The method for dispatching and processing water regime data according to claim 4, characterized in that: According to the relationship identification result, executing the scheduling operation corresponding to the task to be scheduled includes: Update the preset log record table in the local database based on the relationship identification result; and, The relationship identification result is written into the local database to complete the scheduling operation corresponding to the task to be scheduled.
8. A water regime data dispatching and processing system, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the water regime data scheduling and processing method according to any one of claims 1 to 7 are implemented.
