A method and device for recommending water affairs monitoring data based on distributed

By adopting distributed architecture and message middleware in the water monitoring system, the monitoring data recommendation is optimized, and the problems of over-business and low efficiency of monitoring personnel are solved, achieving more efficient and flexible monitoring operations and system performance.

CN118842822BActive Publication Date: 2024-12-17BEIJING WATER CONSERVANCY AUTOMATION INST
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411316053.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-09-20
Publication Date
2024-12-17
Estimated Expiration
2044-09-20

AI Technical Summary

Technical Problem

The monitoring personnel in the water monitoring system are too busy and lack planning, resulting in low work efficiency and inability to track and respond to emergencies in a timely manner, which puts huge pressure on water maintenance.

Method used

Adopting a distributed water monitoring data recommendation method, the cache middleware, service bearer container and message middleware of the perception server are monitored, and the message service information from the distributed control center is collected and analyzed, and the resource load and monitoring trajectory are optimized. Monitor data to improve the efficiency and flexibility of monitoring actions.

Benefits of technology

Improve the efficiency and security of monitoring actions, enhance the flexibility and functionality of nodes, reduce resource costs, and improve system performance and scalability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118842822B_ABST
    Figure CN118842822B_ABST
Patent Text Reader

Abstract

The present application relates to the field of big data processing technology, and in particular to a method and device for recommending water affairs monitoring data based on distribution. When monitoring that a monitoring perception server and a distributed control center have successfully formed a message queue channel, the message service information from the distributed control center is collected; based on the message service information and the service node of the message middleware, water affairs target monitoring data is obtained, and the water affairs target monitoring data is used to assist the target hydrological protocol message to complete the water affairs monitoring data type. The target hydrological protocol message refers to a function code message that temporarily requisitions and controls the monitoring perception server to complete the water affairs monitoring data type. The message storage message queue contained in the water affairs target monitoring data is proportional to the service node of the message middleware; the control business carrier container deploys the recommended water affairs target monitoring data. The present invention enables application services to be deployed and operated more quickly and flexibly, improves the utilization rate of computing resources, reduces resource costs, and improves system performance.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of big data processing technology, and in particular to a distributed water monitoring data recommendation method and device. Background Art

[0002] Informatization is a major trend in economic and social development. Water affairs informatization is an important symbol of water affairs modernization, the foundation of water affairs scientific and technological progress, and an important means to support the transformation of government functions and improve the industry's basic management and social public service capabilities. Water affairs informatization refers to the use of a visual approach to organically integrate water affairs management departments and water supply and drainage facilities to form an urban water affairs Internet of Things, and to timely analyze and process massive amounts of water affairs information to make corresponding processing results to assist in decision-making. Water affairs informatization is an important means to serve and support the trinity of "water safety, water resources, and water environment" and the mutually coordinated water management concept. After years of informatization construction, the water industry's subordinate water supply, drainage, water conservancy and other industries and various units and institutions have established industry databases, and generally accumulated a large amount of data. At the same time, the data center is also connected to data generated by various different units, sources, systems and models.

[0003] At present, in the monitoring work of the water affairs monitoring system, there are many things to be handled, but few monitoring personnel, and the monitoring department lacks work planning and randomly arranges monitoring tasks, which makes the monitoring personnel exhausted and makes the monitoring personnel's work efficiency low, thus causing huge pressure on water affairs maintenance. As a result, in the actual daily monitoring work, it is impossible to grasp and track the working dynamics of various water affairs monitoring work in a timely and fast manner and respond quickly to emergencies. Summary of the invention

[0004] To achieve the above objectives, this application provides the following technical solutions:

[0005] According to a first aspect of the present invention, the present invention claims a distributed water service monitoring data recommendation method, which is applied to a cache middleware of a monitoring perception server, wherein the monitoring perception server includes the cache middleware, a service bearing container and a message middleware, and the method includes:

[0006] When it is monitored that the monitoring perception server and the distributed control center successfully form a message queue channel, the message service information from the distributed control center is collected, the message service information includes multiple hydrological protocol message information associated with multiple hydrological protocol messages, and the hydrological protocol message information includes the type of water affairs monitoring data consumed by the hydrological protocol message, the database table where the hydrological protocol message is located, and the database table indicated by the water affairs monitoring data type;

[0007] Based on the message service information and the service node of the message middleware, the water affairs target monitoring data is obtained, and the water affairs target monitoring data is used to assist the target hydrological protocol message to complete the water affairs monitoring data type. The target hydrological protocol message refers to a function code message that temporarily requisitions and controls the monitoring perception server to complete the water affairs monitoring data type. The message storage message queue contained in the water affairs target monitoring data is proportional to the service node of the message middleware;

[0008] Control the business bearing container deployment to recommend the water service target monitoring data.

[0009] Furthermore, the message service information includes monitoring location information, and the monitoring location information is used to characterize the distribution of fault nodes in the monitoring range. The service node based on the message service information and the message middleware obtains the water service target monitoring data, including:

[0010] Obtaining target hydrological protocol message information associated with the target hydrological protocol message from the multiple hydrological protocol message information, the target hydrological protocol message information including the target water affairs monitoring data type consumed by the target hydrological protocol message, the preset node where the target hydrological protocol message is located, and the target node indicated by the target water affairs monitoring data type;

[0011] Obtaining a target monitoring trajectory based on the monitoring positioning information, the preset node and the target node;

[0012] Parsing the target resource load consumed by the monitoring perception server to monitor the target node according to the target monitoring trajectory;

[0013] Parsing the selectable resource load of the monitoring perception server based on the service node of the message middleware and the target resource load;

[0014] The water affairs target monitoring data is obtained based on the selectable resource load and the message service information, and the message storage message queue included in the water affairs target monitoring data is proportional to the selectable resource load.

[0015] Further, obtaining a target monitoring trajectory based on the monitoring positioning information, the preset node and the target node includes:

[0016] Based on the monitoring positioning information, the preset node and the target node, a plurality of monitoring trajectories are obtained;

[0017] The following instructions are completed for the multiple monitoring trajectories according to the priority of the trajectory length from low to high, and the target monitoring trajectory is iteratively obtained:

[0018] A database table of other hydrological protocol messages collected from the plurality of hydrological protocol message information;

[0019] The node access frequency associated with the monitoring trajectory analyzed in real time based on the database table analysis of the other hydrological protocol messages;

[0020] If the node access frequency is not higher than a preset threshold, the real-time parsed monitoring trajectory is determined as the target monitoring trajectory;

[0021] If the node access frequency is higher than the preset threshold, continue to parse the next monitoring trajectory.

[0022] Further, the parsing out the target resource load consumed by the monitoring perception server to monitor the target node according to the target monitoring trajectory includes:

[0023] Collecting scene information, where the scene information refers to scene information that affects the monitoring period of the monitoring perception server;

[0024] Input the scene information, the monitoring parameters of the monitoring perception server and the trajectory length of the target monitoring trajectory into a pre-configured recommendation model, and output the monitoring cycle consumed by the monitoring perception server to monitor the target node according to the target monitoring trajectory;

[0025] The target resource load is determined based on the monitoring period.

[0026] Further, obtaining the water service target monitoring data based on the selectable resource load and the message service information includes:

[0027] When the selectable resource load is not lower than a first threshold value, deciding a first monitoring range and a first monitoring message, wherein the first monitoring message refers to other hydrological protocol messages in the first monitoring range;

[0028] Obtaining first monitoring range positioning information based on the first monitoring range and the monitoring positioning information, where the first monitoring range positioning information is used to indicate distribution of fault nodes in the first monitoring range;

[0029] A database table for collecting the first monitoring message from the plurality of hydrological protocol message information;

[0030] The water affairs target monitoring data is obtained based on the first monitoring range positioning information, the database table of the first monitoring message, the target hydrological protocol message information and the target monitoring trajectory.

[0031] Further, obtaining the water service target monitoring data based on the selectable resource load and the message service information includes:

[0032] When the selectable resource load is higher than a second threshold value and lower than the first threshold value, deciding a second monitoring range and a second monitoring message, wherein the second monitoring message refers to other hydrological protocol messages in the second monitoring range;

[0033] Obtaining second monitoring range positioning information based on the second monitoring range and the monitoring positioning information, where the second monitoring range positioning information is used to indicate distribution of fault nodes in the second monitoring range;

[0034] A database table for collecting the second monitoring message from the plurality of hydrological protocol message information;

[0035] The water affairs target monitoring data is obtained based on the second monitoring range positioning information, the database table of the second monitoring message, the target hydrological protocol message information and the target monitoring trajectory.

[0036] Further, obtaining the water service target monitoring data based on the selectable resource load and the message service information includes:

[0037] When the selectable resource load is not higher than a second threshold value, the water affairs target monitoring data is obtained based on the target hydrological protocol message information and the target monitoring trajectory.

[0038] According to a second aspect of the present invention, the present invention claims protection for a distributed water monitoring data recommendation device, which is applied to a cache middleware of a monitoring perception server, wherein the monitoring perception server includes the cache middleware, a service bearing container and a message middleware, and the device includes:

[0039] A collection module, for collecting message service information from the distributed control center when it is monitored that the monitoring perception server and the distributed control center have successfully formed a message queue channel, the message service information including multiple hydrological protocol message information associated with multiple hydrological protocol messages, the hydrological protocol message information including the type of water affairs monitoring data consumed by the hydrological protocol message, the database table where the hydrological protocol message is located, and the database table indicated by the water affairs monitoring data type;

[0040] An output module, used for obtaining water affairs target monitoring data based on the message service information and the service node of the message middleware, wherein the water affairs target monitoring data is used to assist the target hydrological protocol message to complete the water affairs monitoring data type, wherein the target hydrological protocol message refers to a function code message that temporarily requisitions and controls the monitoring perception server to complete the water affairs monitoring data type, and the message storage message queue contained in the water affairs target monitoring data is proportional to the service node of the message middleware;

[0041] A control module, used for controlling the deployment of the service bearing container to recommend the water affairs target monitoring data;

[0042] The distributed water affairs monitoring data recommendation device is used to execute the distributed water affairs monitoring data recommendation method.

[0043] The present application relates to the field of big data processing technology, and in particular to a method and device for recommending water affairs monitoring data based on distribution. When monitoring that a monitoring perception server and a distributed control center have successfully formed a message queue channel, the message service information from the distributed control center is collected; based on the message service information and the service node of the message middleware, water affairs target monitoring data is obtained, and the water affairs target monitoring data is used to assist the target hydrological protocol message to complete the water affairs monitoring data type. The target hydrological protocol message refers to a function code message that temporarily requisitions and controls the monitoring perception server to complete the water affairs monitoring data type. The message storage message queue contained in the water affairs target monitoring data is proportional to the service node of the message middleware; the control business carrier container deploys the recommended water affairs target monitoring data. The present invention enables application services to be deployed and operated more quickly and flexibly, improves the utilization rate of computing resources, reduces resource costs, and improves system performance. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 A workflow diagram of a distributed water affairs monitoring data recommendation method claimed in an embodiment of the present application;

[0045] Figure 2 This is a structural module diagram of a distributed water monitoring data recommendation device claimed in an embodiment of the present application. DETAILED DESCRIPTION

[0046] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0047] The terms "first", "second" and "third" in this application are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first", "second" and "third" can explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "multiple" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined. All directional indications in the embodiments of this application (such as up, down, left, right, front, back...) are only used to explain the relative node relationship, movement, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication also changes accordingly. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or modules is not limited to the listed steps or modules, but optionally also includes steps or modules that are not listed, or optionally also includes other steps or modules inherent to these processes, methods, products or devices.

[0048] Reference to "embodiment" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiment may be included in at least one embodiment of the present application. The appearance of the phrase at various points in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0049] The existing technical solutions do not clearly state the communication protocols used by the terminal devices that can support access. This application proposal supports the data transmission protocols commonly used in the field of hydrology and water resources and issued by the Ministry of Water Resources, including the "Hydrological Monitoring Data Communication Protocol" (SL 651-2014), "Water Resources Monitoring Data Transmission Protocol" (SL / T 427-2021), and the "Pollutant Online Monitoring (Monitoring) System Data Transmission Standard" (HJ212-2017) issued by the Ministry of Environmental Protection.

[0050] The existing technical solutions do not use microservice architecture. This application proposal uses microservice architecture to microservice message reception, message parsing, data storage, data push, and operation monitoring management, splitting them into message reception service, message parsing service, data storage service, and data push service, so that each service can be independently developed, deployed, and expanded, thereby improving development efficiency and system flexibility.

[0051] The existing technical solutions do not use a distributed architecture. This application proposal uses a distributed architecture to deploy the receiving service, parsing service, data storage service, data push service, message middleware service, and Redis storage middleware service in a multi-node distributed manner. When a node fails or the upgrade system needs to be restarted, the service node switching and restarting can be achieved without affecting the business; the distributed architecture can also expand the system's message parsing and processing capabilities by adding parsing nodes. When the system load increases, more nodes can be added to share the load, thereby improving the system's performance and throughput, and providing higher availability, scalability, and fault tolerance.

[0052] The existing technical solutions do not use message middleware services and cache middleware services. This application proposal uses message middleware services to decouple the message receiving, parsing, storage, and push function modules, and realizes asynchronous data communication and collaboration between component services such as message receiving services, message parsing services, data storage services, and data push services to realize the functions of the entire system. This application proposal uses cache middleware services to cache frequently accessed hot data in the system into the cache middleware service to improve the performance of the system.

[0053] Based on the above problems, the present application provides a distributed water monitoring data recommendation method and related devices, in order to improve the intelligence and flexibility of nodes when they are requisitioned for monitoring without affecting the purpose of the nodes themselves.

[0054] The following introduces a distributed water monitoring data recommendation method provided in an embodiment of the present application.

[0055] See also Figure 1 , Figure 1 is a flow chart of a distributed water service monitoring data recommendation method provided in an embodiment of the present application, wherein the method is applied in a cache middleware, such as Figure 1 As shown, the distributed water monitoring data recommendation method includes:

[0056] S101, when it is monitored that the monitoring perception server and the distributed control center successfully form a message queue channel, the message service information from the distributed control center is collected.

[0057] The above message service information is data updated in real time by the distributed control center based on actual conditions. For example, when the distributed control center collects new task targets, it will transmit the new task targets to the terminal equipment of the command center, which will centrally dispatch and deploy them and assign the new task targets to a hydrological protocol message. At this time, the data is transmitted back to the distributed control center, and the distributed control center will update the hydrological protocol message information associated with the hydrological protocol message to the message service information.

[0058] Furthermore, the monitoring that the monitoring perception server and the distributed control center successfully form a message queue channel includes: responding to the data entry instruction of the target hydrological protocol message, sending a target request message to the distributed control center, the target request message carries the team code of the target hydrological protocol message, and the team code is used to verify the monitoring authority of the target hydrological protocol message; collecting target response messages from the distributed control center, and the target response messages are used to confirm that the monitoring perception server has communication authority; and deciding that the monitoring perception server and the distributed control center successfully form a message queue channel.

[0059] Specifically, the data entry instruction can be an instruction completed by a team member of the target hydrological protocol message on the central console of the monitoring perception server. Exemplarily, when other terminals request to access the distributed control center, the distributed control center has access rights. Only when the request message carrying specific authorization information sent by the terminal is collected, a message queue channel will be formed with the terminal to implement the authentication process and improve data security. In this example, the specific authorization information is the team code of each hydrological protocol message, that is, the data entered into the hydrological protocol message can specifically be the team code of the hydrological protocol message. At this time, the distributed control center verifies it, returns the target response message to the monitoring perception server, and forms a message queue channel.

[0060] S102, obtaining water service target monitoring data based on the message service information and the service node of the message middleware.

[0061] Among them, the water affairs target monitoring data is used to assist the target hydrological protocol message to complete the water affairs monitoring data type, the target hydrological protocol message refers to the function code message that temporarily requisitions and controls the monitoring perception server to complete the water affairs monitoring data type, and the message storage message queue contained in the water affairs target monitoring data is proportional to the service node of the message middleware. In other words, when the message middleware has more service nodes, the obtained water affairs target monitoring data contains more message storage message queues, which can provide more information to the hydrological protocol message on the basis of supporting the monitoring perception server to complete the monitoring; and when the message middleware has fewer service nodes, the obtained water affairs target monitoring data contains fewer message storage message queues, so as to avoid accelerating resource load consumption due to too many message storage message queues presented, thereby causing the service node to be unable to support the monitoring perception server to complete the monitoring.

[0062] S103: Control the service carrying container to deploy and recommend the water service target monitoring data.

[0063] It can be seen that in the embodiment of the present application, when the cache middleware monitors that the monitoring perception server and the distributed control center have successfully formed a message queue channel, it collects message service information from the distributed control center, and the message service information includes multiple hydrological protocol message information associated with multiple hydrological protocol messages, and the hydrological protocol message information includes the water monitoring data type consumed by the hydrological protocol message, the database table where the hydrological protocol message is located, and the database table indicated by the water monitoring data type; based on the message service information and the service node of the message middleware, water target monitoring data is obtained, and the water target monitoring data is used to assist the target hydrological protocol message to complete the water monitoring data type. The target hydrological protocol message refers to a function code message that temporarily requisitions and controls the monitoring perception server to complete the water monitoring data type. The message storage message queue contained in the water target monitoring data is proportional to the service node of the message middleware; the control business carrier container deploys recommended water target monitoring data. In this way, the monitoring perception server can provide monitoring guidance for function code messages in the form of views, and reasonably control the presented message storage message queue based on the service node of the message middleware, thereby improving the efficiency and security of monitoring actions and enhancing the flexibility and functionality of the nodes.

[0064] In a possible example, the message service information includes monitoring location information, and the monitoring location information is used to characterize the distribution of faulty nodes in the monitoring range. The water affairs target monitoring data is obtained based on the message service information and the service node of the message middleware, including: obtaining the target hydrological protocol message information associated with the target hydrological protocol message from the multiple hydrological protocol message information, the target hydrological protocol message information including the target water affairs monitoring data type consumed by the target hydrological protocol message, the preset node where the target hydrological protocol message is located, and the target node indicated by the target water affairs monitoring data type; obtaining the target monitoring trajectory based on the monitoring location information, the preset node and the target node; parsing the target resource load consumed by the monitoring perception server to monitor the target node according to the target monitoring trajectory; parsing the optional resource load of the monitoring perception server based on the service node of the message middleware and the target resource load; obtaining the water affairs target monitoring data based on the optional resource load and the message service information, and the message storage message queue contained in the water affairs target monitoring data is proportional to the optional resource load.

[0065] The monitoring and positioning information may be data collected by a terminal in communication with a distributed control center within the monitoring range, and the terminal may be a drone or a monitoring node. Optionally, the terminal determines its own node and the faulty node through the positioning function, thereby determining the distribution of the faulty node within the monitoring range, obtaining the monitoring and positioning information, and transmitting it to the distributed control center. In particular, during the monitoring of the monitoring node, if unrecorded faulty node information is detected, the unrecorded faulty node information is sent to the distributed control center to update the monitoring and positioning information.

[0066] Among them, when the distributed control center allocates water affairs monitoring data types based on instructions, it will bind the hydrological protocol message information with the hydrological protocol message that completes the water affairs monitoring data type. Specifically, it can be a mapping relationship between the hydrological protocol message information and the team code of the associated hydrological protocol message. At this time, the cache middleware can obtain the target hydrological protocol message information associated with the target hydrological protocol message from the multiple hydrological protocol message information based on the team code of the target hydrological protocol message.

[0067] Among them, the optional resource load refers to the resource load that is allowed to be allocated to the business carrying container under the premise that the monitoring perception server can complete the driving task. Consumption is explained as follows: because under normal circumstances, the sensor module, positioning module, boost module and other devices are turned on by default during the monitoring process, in this example, the resource load consumed by the sensor module, positioning module, boost module and other devices during the monitoring process is also part of the target resource load, that is, the target resource load represents the overall resource load consumed by the monitoring perception server to monitor the target node based on the target monitoring trajectory. In a possible example, the preset node of the monitoring perception server is a safe starting point, and the resource load consumed to complete the driving task is twice the target resource load. At this time, the optional resource load is the service node of the message middleware minus twice the target resource load minus the spare resource load. The spare resource load can be the resource load value preset by the hydrological protocol message through the central console. The purpose is to reserve a part of the resource load to deal with emergencies and improve the safety of the monitoring action.

[0068] It can be seen that in this example, the cache middleware first obtains the target hydrological protocol message information associated with the target hydrological protocol message, and then further combines the monitoring location information to obtain the target monitoring trajectory, so that it can parse the target resource load consumed by the monitoring perception server to monitor the target node according to the target monitoring trajectory, and then can combine the service node of the message middleware to parse the optional resource load of the monitoring perception server, and finally obtain the water affairs target monitoring data in which the message storage message queue contained is proportional to the optional resource load. In this way, the monitoring perception server is given the highest priority to successfully complete the monitoring, and on this basis, the optional resource load is parsed to reasonably control the message storage message queue in the water affairs target monitoring data, avoid excessive resource consumption, and improve intelligence and flexibility.

[0069] In a possible example, the target monitoring trajectory is obtained based on the monitoring positioning information, the preset node and the target node, including: obtaining multiple monitoring trajectories based on the monitoring positioning information, the preset node and the target node; completing the following instructions for the multiple monitoring trajectories according to the priority of trajectory length from low to high, and iteratively obtaining the target monitoring trajectory: collecting a database table of other hydrological protocol messages from the multiple hydrological protocol message information; parsing the node access frequency associated with the real-time parsed monitoring trajectory based on the database table of other hydrological protocol messages; if the node access frequency is not higher than a preset threshold, deciding the real-time parsed monitoring trajectory as the target monitoring trajectory; if the node access frequency is higher than the preset threshold, continuing to parse the next monitoring trajectory.

[0070] The node access frequency is used to characterize the congestion level of the monitoring trajectory. In this example, in order to complete the water monitoring data type more efficiently, the cache middleware uses the trajectory length as the primary screening condition and the node access frequency as the secondary screening condition, and sequentially screens the obtained multiple monitoring trajectories, thereby screening out target monitoring trajectories with short trajectory length and low node access frequency.

[0071] It can be seen that in this example, the cache middleware obtains multiple monitoring trajectories and selects target monitoring trajectories with short trajectory length and low node access frequency from the multiple monitoring trajectories, thereby improving monitoring efficiency and security.

[0072] In a possible example, the parsing of the target resource load consumed by the monitoring perception server to monitor the target node based on the target monitoring trajectory includes: collecting scene information, the scene information refers to scene information that affects the monitoring period of the monitoring perception server; inputting the scene information, the monitoring parameters of the monitoring perception server and the trajectory length of the target monitoring trajectory into a pre-configured recommendation model, and outputting the monitoring period consumed by the monitoring perception server to monitor the target node based on the target monitoring trajectory; and deciding the target resource load based on the monitoring period.

[0073] Wherein, the scene information includes water speed, wind speed and wind direction, which can be measured by the sensor module set on the monitoring perception server, or collected from the distributed control center; the monitoring parameters of the monitoring perception server include the weight, length, width, draft and other parameters of the monitoring perception server in the monitoring state, which can be measured by the sensor module set on the monitoring perception server; the recommendation model specifically collects a large amount of sample data through simulation experiments in different scenarios, and the sample data includes the above-mentioned scene information, monitoring parameters, monitoring trajectory length and monitoring period, and then inputs the sample data into the model for configuration, and obtains the optimal recommendation model through continuous parameter adjustment and verification. Wherein, the decision of the target resource load based on the monitoring period includes: retrieving the historical monitoring records of the target ship, the historical monitoring records include the monitoring period and resource load associated with each monitoring; estimating the resource load consumption interval associated with the monitoring period based on the historical monitoring records; taking the median resource load value of the resource load consumption interval as the target resource load.

[0074] It can be seen that in this example, the cache middleware obtains the monitoring cycle consumed by the monitoring perception server to monitor the target node according to the target monitoring trajectory through the recommendation model, and then decides the target resource load based on the monitoring cycle. In this way, the accuracy of the analysis results can be improved, so that the message storage message queue in the water target monitoring data can be adjusted more accurately and the flexibility can be improved.

[0075] In a possible example, the water target monitoring data is obtained based on the selectable resource load and the message service information, including: when the selectable resource load is not lower than the first threshold value, deciding a first monitoring range and a first monitoring message, the first monitoring range is a circular range with the midpoint of the straight line trajectory of the preset node and the target node as the center and the monitoring edge node as the edge, the monitoring edge node is the sum of the straight line trajectory length of the preset node and the target node and the preset length, the first monitoring message refers to other hydrological protocol messages in the first monitoring range; obtaining first monitoring range positioning information based on the first monitoring range and the monitoring positioning information, the first monitoring range positioning information is used to indicate the distribution of faulty nodes in the first monitoring range; collecting a database table of the first monitoring message from the multiple hydrological protocol message information; obtaining the water target monitoring data based on the first monitoring range positioning information, the database table of the first monitoring message, the target hydrological protocol message information and the target monitoring trajectory.

[0076] Among them, the first threshold value can be an empirical value at the critical point of sufficient resource load based on statistical analysis of historical data, such as 20% of the total resource load, that is, when the service nodes of the monitoring perception server exceed 20%, it can be considered that the monitoring perception server is in a state of sufficient resource load. At this time, water target monitoring data containing more message storage queues can be obtained to better assist in completing the water monitoring data type.

[0077] Based on the distributed architecture, message middleware service node 1 and cache middleware service node 1 are deployed on middleware server 1, and message middleware service node 2 and cache middleware service node 2 are deployed on middleware server 2. Message middleware service node 1 and message middleware service node 2 form a master-slave cluster, and cache middleware service node 1 and cache middleware service node 2 form a master-slave cluster.

[0078] The message middleware service is used for asynchronous communication and distributed collaboration of data between the message receiving service, message parsing service, data storage service, and data push service modules, thereby decoupling the receiving, parsing, storage, and push functions by establishing a microservice architecture.

[0079] In this example, when the selectable resource load is not less than the first threshold value, the cache middleware obtains the first monitoring range and the first monitoring message, and then obtains the first monitoring range positioning information and the database table of the first monitoring message, and then obtains the water affairs target monitoring data including the first monitoring range positioning information, the database table of the first monitoring message, the target hydrological protocol message information and the target monitoring trajectory. In this way, the monitoring perception server can present the message service information to the target hydrological protocol message in the form of a view, and when the resource load is relatively abundant, expand the scope of the monitoring range presented in the water affairs target monitoring data, and at the same time present the fault node information within the monitoring range and the database table of other hydrological protocol messages, which can bring more information to the target hydrological protocol message, for example, it can observe the moving direction of other hydrological protocol messages to make adjustments to the monitoring cycle in advance, improve the safety and efficiency of the monitoring action, and also improve the intelligence and flexibility of the equipment.

[0080] In a possible example, the water target monitoring data is obtained based on the selectable resource load and the message service information, including: when the selectable resource load is higher than a second threshold value and lower than the first threshold value, deciding a second monitoring range and a second monitoring message, the second monitoring range is a circular range with the midpoint of the straight line trajectory of the preset node and the target node as the center and the length of the straight line trajectory as the diameter, and the second monitoring message refers to other hydrological protocol messages in the second monitoring range; obtaining second monitoring range positioning information based on the second monitoring range and the monitoring positioning information, the second monitoring range positioning information is used to indicate the distribution of faulty nodes in the second monitoring range; collecting a database table of the second monitoring message from the multiple hydrological protocol message information; obtaining the water target monitoring data based on the second monitoring range positioning information, the database table of the second monitoring message, the target hydrological protocol message information and the target monitoring trajectory.

[0081] Among them, the second threshold value can be an empirical value at the critical point of insufficient resource load obtained based on statistical analysis of historical data, for example, 30% of the total resource load, that is, when the service nodes of the monitoring perception server are less than 30%, it can be considered that the monitoring perception server is in a state of insufficient resource load, and when the service nodes of the monitoring perception server exceed 30% and are less than 20%, it can be considered that the monitoring perception server is in a state of moderate resource load. At this time, water affairs target monitoring data containing a certain message storage message queue can be obtained to assist in completing the water affairs monitoring data type.

[0082] Use the cache middleware service to cache frequently accessed hot data in the system into the storage middleware service to improve system performance.

[0083] Based on the distributed architecture, load balancing service 1 and load balancing service 2 are deployed on communication server 1 and communication server 2 respectively. At the same time, the sensing terminal device is configured to preferentially establish a connection request to load balancing service 1 and send an uplink message. If the connection fails, a connection request is established with load balancing service 2 and an uplink message is sent.

[0084] Load balancing service: used to establish a connection with the sensing terminal device installed at the front end and distribute the connection request and the sent uplink message to the four message receiving service nodes according to a certain weight. The load balancing service distributes the request and uplink message to each message receiving service node according to the configured weight. If one of the message receiving service nodes fails to connect, it distributes to other message receiving service nodes.

[0085] Based on the distributed architecture, message receiving service node 1, message receiving service node 2, message receiving service node 3, and message receiving service node 4 are deployed on receiving server 1, receiving server 2, receiving server 3, and receiving server 4 respectively.

[0086] Message receiving service: used to receive the original uplink message of water affairs perception monitoring data sent by the perception terminal device, match the message parsing service to be used according to the message header content, and store it in the corresponding message receiving message queue in the message middleware service. If it is judged to be a message sent according to the SL651 hydrological protocol, the uplink message is stored in the SL651 hydrological protocol message receiving message queue, and the downlink message is replied to the perception terminal unit; if it is judged to be a message sent according to the HJ212 water environment protocol, the uplink message is stored in the HJ212 water environment protocol message receiving message queue, and the downlink message is replied to the perception terminal unit; if it is judged to be a message sent according to the SL427 water resources protocol, the uplink message is stored in the SL427 water resources protocol message receiving message queue, and the downlink message is replied to the perception terminal unit.

[0087] In this example, when the selectable resource load is higher than the second threshold value and lower than the first threshold value, the cache middleware obtains the second monitoring range and the second monitoring message, and then obtains the second monitoring range positioning information and the database table of the second monitoring message, and then obtains the water affairs target monitoring data containing the second monitoring range positioning information, the database table of the second monitoring message, the target hydrological protocol message information and the target monitoring trajectory. In this way, the monitoring perception server can present the message service information to the target hydrological protocol message in the form of a view, and when the resource load is moderate, the message service information presented in the water affairs target monitoring data is limited to the data associated with the second monitoring range, and the message storage message queue presented in the water affairs target monitoring data is reasonably controlled, so that on the one hand, a certain amount of data information can be presented to assist in completing the water affairs monitoring data type, and on the other hand, the presented message storage message queue is reasonably controlled to avoid excessive resource consumption and improve intelligence and flexibility.

[0088] In a possible example, obtaining the water target monitoring data based on the selectable resource load and the message service information includes: when the selectable resource load is not higher than a second threshold value, obtaining the water target monitoring data based on the target hydrological protocol message information and the target monitoring trajectory.

[0089] Among them, when the selectable resource load is not higher than the second threshold value, it indicates that the monitoring perception server is in a state of insufficient resource load. At this time, the water target monitoring data obtained should contain fewer message storage message queues, and the presented message service information should be data that can directly guide the target hydrological protocol message to complete the water monitoring data type, so as to provide the target hydrological protocol message monitoring guidance information in the form of a view while reducing the resource consumption speed of the monitoring perception server to the greatest extent.

[0090] On business service hosting server 1, container technology is applied to create container 1 and container 2 respectively, and message parsing service node 1 is deployed in container 1, and message parsing service node 2 is deployed in container 2; on business service hosting server 2, container technology is applied to create container 3 and container 4 respectively, and message parsing service node 3 is deployed in container 3, and message parsing service node 4 is deployed in container 4. The number of created containers and the number of containerized message parsing services can be reasonably expanded according to the needs of access devices to improve platform stability and carrying capacity.

[0091] Message parsing service: Build a message parsing service based on a variety of message communication protocols commonly used in the water industry. It is used to parse the uplink original messages in the message middleware service and parse out water perception monitoring data with business significance.

[0092] The message parsing service stores the parsed monitoring data in the water affairs awareness monitoring data storage message queue and the water affairs awareness monitoring data push message queue in the message middleware service.

[0093] On the business service hosting server 3, container technology is applied to create containers 5 and 6 respectively, data storage service node 1 is deployed in container 5, and data push service node 1 is deployed in container 6. On the business service hosting server 4, container technology is applied to create containers 7 and 8 respectively, data storage service node 2 is deployed in container 7, and data push service node 2 is deployed in container 8.

[0094] In this example, when the selectable resource load is not higher than the second threshold value, the cache middleware obtains water service target monitoring data that only contains target hydrological protocol message information and target monitoring trajectory. In this way, when the resource load is insufficient, the monitoring perception server can directly guide the target hydrological protocol message to complete the water service monitoring data type in the form of a view to the target hydrological protocol message, thereby reducing the resource consumption rate of the monitoring perception server to the greatest extent, avoiding the inability of the monitoring perception server to complete the monitoring task due to excessive consumption, and improving intelligence and flexibility.

[0095] In a possible example, the method also includes: when it is monitored that the service nodes of the message middleware are insufficient to support the monitoring perception server to complete the monitoring task, outputting a low resource load warning message to remind the target hydrological protocol message that the service nodes of the monitoring perception server are insufficient; and sending the low resource load warning message to the distributed control center so that the distributed control center can dispatch other hydrological protocol messages as soon as possible to assist or take over to complete the target water monitoring data type.

[0096] In accordance with the above-mentioned embodiments, please refer to Figure 2 , Figure 2 is a functional module block diagram of a distributed water monitoring data recommendation device provided in an embodiment of the present application, such as Figure 2As shown, the distributed water affairs monitoring data recommendation device includes: a collection module 201, which is used to collect message service information from the distributed control center when it is monitored that the monitoring perception server and the distributed control center successfully form a message queue channel, the message service information includes multiple hydrological protocol message information associated with multiple hydrological protocol messages, and the hydrological protocol message information includes the water affairs monitoring data type consumed by the hydrological protocol message, the database table where the hydrological protocol message is located, and the database table indicated by the water affairs monitoring data type; an output module 202, which is used to obtain water affairs target monitoring data based on the message service information and the service node of the message middleware, the water affairs target monitoring data is used to assist the target hydrological protocol message to complete the water affairs monitoring data type, the target hydrological protocol message refers to a function code message that temporarily requisitions and controls the monitoring perception server to complete the water affairs monitoring data type, and the message storage message queue contained in the water affairs target monitoring data is proportional to the service node of the message middleware; a control module 203, which is used to control the deployment of the business carrying container to recommend the water affairs target monitoring data.

[0097] In one possible example, the message service information includes monitoring location information, and the monitoring location information is used to characterize the distribution of faulty nodes in the monitoring range. In terms of obtaining water service target monitoring data based on the message service information and the service node of the message middleware, the output module 202 is specifically used to: obtain the target hydrological protocol message information associated with the target hydrological protocol message from the multiple hydrological protocol message information, and the target hydrological protocol message information includes the target water service monitoring data type consumed by the target hydrological protocol message, the preset node where the target hydrological protocol message is located, and the The target node indicated by the target water affairs monitoring data type; obtaining the target monitoring trajectory based on the monitoring positioning information, the preset node and the target node; parsing the target resource load consumed by the monitoring perception server to monitor the target node according to the target monitoring trajectory; parsing the optional resource load of the monitoring perception server based on the service node of the message middleware and the target resource load; obtaining the water affairs target monitoring data based on the optional resource load and the message service information, and the message storage message queue contained in the water affairs target monitoring data is proportional to the optional resource load.

[0098] In one possible example, in terms of obtaining the target monitoring trajectory based on the monitoring positioning information, the preset node and the target node, the output module 202 is specifically used to: obtain multiple monitoring trajectories based on the monitoring positioning information, the preset node and the target node; complete the following instructions for the multiple monitoring trajectories according to the priority of trajectory length from low to high, and iteratively obtain the target monitoring trajectory: collect a database table of other hydrological protocol messages from the multiple hydrological protocol message information; parse the node access frequency associated with the real-time parsed monitoring trajectory based on the database table of other hydrological protocol messages; if the node access frequency is not higher than the preset threshold, decide the real-time parsed monitoring trajectory as the target monitoring trajectory; if the node access frequency is higher than the preset threshold, continue to parse the next monitoring trajectory.

[0099] In one possible example, in terms of parsing the target resource load consumed by the monitoring perception server to monitor the target node based on the target monitoring trajectory, the output module 202 is specifically used to: collect scene information, where the scene information refers to scene information that affects the monitoring period of the monitoring perception server; input the scene information, the monitoring parameters of the monitoring perception server and the trajectory length of the target monitoring trajectory into a pre-configured recommendation model, and output the monitoring period consumed by the monitoring perception server to monitor the target node based on the target monitoring trajectory; and decide the target resource load based on the monitoring period.

[0100] In one possible example, in terms of obtaining the water affairs target monitoring data based on the selectable resource load and the message service information, the output module 202 is specifically used for: when the selectable resource load is not lower than a first threshold value, deciding a first monitoring range and a first monitoring message, the first monitoring range being a circular range with the midpoint of the straight line trajectory of the preset node and the target node as the center and the monitoring edge node as the edge, the monitoring edge node being the sum of the straight line trajectory length of the preset node and the target node and the preset length, the first monitoring message refers to other hydrological protocol messages in the first monitoring range; obtaining first monitoring range positioning information based on the first monitoring range and the monitoring positioning information, the first monitoring range positioning information being used to indicate the distribution of faulty nodes in the first monitoring range; collecting a database table of the first monitoring message from the multiple hydrological protocol message information; obtaining the water affairs target monitoring data based on the first monitoring range positioning information, the database table of the first monitoring message, the target hydrological protocol message information and the target monitoring trajectory.

[0101] In one possible example, in terms of obtaining the water target monitoring data based on the selectable resource load and the message service information, the output module 202 is specifically used for: when the selectable resource load is higher than a second threshold value and lower than the first threshold value, deciding a second monitoring range and a second monitoring message, the second monitoring range being a circular range with the midpoint of the straight line trajectory of the preset node and the target node as the center and the length of the straight line trajectory as the diameter, and the second monitoring message refers to other hydrological protocol messages in the second monitoring range; obtaining second monitoring range positioning information based on the second monitoring range and the monitoring positioning information, the second monitoring range positioning information being used to indicate the distribution of faulty nodes in the second monitoring range; collecting a database table of the second monitoring message from the multiple hydrological protocol message information; and obtaining the water target monitoring data based on the second monitoring range positioning information, the database table of the second monitoring message, the target hydrological protocol message information and the target monitoring trajectory.

[0102] In a possible example, in obtaining the water target monitoring data based on the selectable resource load and the message service information, the output module 202 is specifically used to: when the selectable resource load is not higher than a second threshold value, obtain the water target monitoring data based on the target hydrological protocol message information and the target monitoring trajectory.

[0103] It can be understood that since the method embodiment and the device embodiment are different presentation forms of the same technical concept, the content of the method embodiment part in this application should be synchronously adapted to the device embodiment part and will not be repeated here.

[0104] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of modules is only a logical function division. There may be other division methods in actual implementation. For example, multiple modules or components can be combined or integrated into another system, or some features can be ignored or not completed. Another point is that the mutual coupling or direct coupling or message queue channel deployed, recommended or discussed can be through some interfaces, indirect coupling or message queue channels of devices or modules, which can be electrical, mechanical or other forms.

[0105] In addition, each functional module in each embodiment of the present application can be integrated into one parsing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. The above is only an implementation method of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the specification and drawings of this application, or directly or indirectly used in other related technical fields, are similarly included in the patent protection scope of the present application.

[0106] The specific implementation methods of the invention are described in detail above, but they are only examples, and the present application is not limited to the specific implementation methods described above. For those skilled in the art, any equivalent modification or substitution of the invention is also within the scope of the present application, and therefore, the equalization, modification, and improvement made without departing from the spirit and principle of the present application should be included in the scope of the present application.

Claims

1. A distributed water monitoring data recommendation method, characterized in that: A cache middleware applied to a monitoring perception server, wherein the monitoring perception server includes the cache middleware, a service bearing container and a message middleware, and the method includes: When it is monitored that the monitoring perception server and the distributed control center successfully form a message queue channel, the message service information from the distributed control center is collected, the message service information includes multiple hydrological protocol message information associated with multiple hydrological protocol messages, and the hydrological protocol message information includes the type of water affairs monitoring data consumed by the hydrological protocol message, the database table where the hydrological protocol message is located, and the database table indicated by the water affairs monitoring data type; Based on the message service information and the service node of the message middleware, the water affairs target monitoring data is obtained, and the water affairs target monitoring data is used to assist the target hydrological protocol message to complete the water affairs monitoring data type. The target hydrological protocol message refers to a function code message that temporarily requisitions and controls the monitoring perception server to complete the water affairs monitoring data type. The message storage message queue contained in the water affairs target monitoring data is proportional to the service node of the message middleware; Controlling the deployment of the service bearing container to recommend the water affairs target monitoring data; The message service information includes monitoring location information, and the monitoring location information is used to characterize the distribution of fault nodes in the monitoring range. The service node based on the message service information and the message middleware obtains the water service target monitoring data, including: Obtaining target hydrological protocol message information associated with the target hydrological protocol message from the multiple hydrological protocol message information, the target hydrological protocol message information including the target water affairs monitoring data type consumed by the target hydrological protocol message, the preset node where the target hydrological protocol message is located, and the target node indicated by the target water affairs monitoring data type; Obtaining a target monitoring trajectory based on the monitoring positioning information, the preset node and the target node; Parsing the target resource load consumed by the monitoring perception server to monitor the target node according to the target monitoring trajectory; Parsing the selectable resource load of the monitoring perception server based on the service node of the message middleware and the target resource load; The water affairs target monitoring data is obtained based on the selectable resource load and the message service information, wherein the message storage message queue included in the water affairs target monitoring data is proportional to the selectable resource load; The obtaining of a target monitoring trajectory based on the monitoring positioning information, the preset node and the target node includes: Based on the monitoring positioning information, the preset node and the target node, a plurality of monitoring trajectories are obtained; The following instructions are completed for the multiple monitoring trajectories according to the priority of the trajectory length from low to high, and the target monitoring trajectory is iteratively obtained: A database table of other hydrological protocol messages collected from the plurality of hydrological protocol message information; The node access frequency associated with the monitoring trajectory analyzed in real time based on the database table analysis of the other hydrological protocol messages; If the node access frequency is not higher than a preset threshold, the real-time parsed monitoring trajectory is determined as the target monitoring trajectory; If the node access frequency is higher than the preset threshold, continue to parse the next monitoring trajectory.

2. The method according to claim 1, characterized in that: The parsing out the target resource load consumed by the monitoring perception server to monitor the target node according to the target monitoring trajectory includes: Collecting scene information, where the scene information refers to scene information that affects the monitoring period of the monitoring perception server; Input the scene information, the monitoring parameters of the monitoring perception server and the trajectory length of the target monitoring trajectory into a pre-configured recommendation model, and output the monitoring cycle consumed by the monitoring perception server to monitor the target node according to the target monitoring trajectory; The target resource load is determined based on the monitoring period.

3. The method according to claim 2, characterized in that: The obtaining the water affairs target monitoring data based on the selectable resource load and the message service information includes: When the selectable resource load is not lower than a first threshold value, deciding a first monitoring range and a first monitoring message, wherein the first monitoring message refers to other hydrological protocol messages in the first monitoring range; Obtaining first monitoring range positioning information based on the first monitoring range and the monitoring positioning information, where the first monitoring range positioning information is used to indicate distribution of fault nodes in the first monitoring range; A database table for collecting the first monitoring message from the plurality of hydrological protocol message information; The water affairs target monitoring data is obtained based on the first monitoring range positioning information, the database table of the first monitoring message, the target hydrological protocol message information and the target monitoring trajectory.

4. The method according to claim 3, characterized in that: The obtaining the water affairs target monitoring data based on the selectable resource load and the message service information includes: When the selectable resource load is higher than a second threshold value and lower than the first threshold value, deciding a second monitoring range and a second monitoring message, wherein the second monitoring message refers to other hydrological protocol messages in the second monitoring range; Obtaining second monitoring range positioning information based on the second monitoring range and the monitoring positioning information, where the second monitoring range positioning information is used to indicate distribution of fault nodes in the second monitoring range; A database table for collecting the second monitoring message from the plurality of hydrological protocol message information; The water affairs target monitoring data is obtained based on the second monitoring range positioning information, the database table of the second monitoring message, the target hydrological protocol message information and the target monitoring trajectory.

5. The method according to claim 4, characterized in that: The obtaining the water affairs target monitoring data based on the selectable resource load and the message service information includes: When the selectable resource load is not higher than a second threshold value, the water affairs target monitoring data is obtained based on the target hydrological protocol message information and the target monitoring trajectory.

6. A distributed water monitoring data recommendation device, characterized in that: A cache middleware applied to a monitoring perception server, wherein the monitoring perception server includes the cache middleware, a service bearing container and a message middleware, and the device includes: A collection module, for collecting message service information from the distributed control center when it is monitored that the monitoring perception server and the distributed control center have successfully formed a message queue channel, the message service information including multiple hydrological protocol message information associated with multiple hydrological protocol messages, the hydrological protocol message information including the type of water affairs monitoring data consumed by the hydrological protocol message, the database table where the hydrological protocol message is located, and the database table indicated by the water affairs monitoring data type; An output module, used for obtaining water affairs target monitoring data based on the message service information and the service node of the message middleware, wherein the water affairs target monitoring data is used to assist the target hydrological protocol message to complete the water affairs monitoring data type, wherein the target hydrological protocol message refers to a function code message that temporarily requisitions and controls the monitoring perception server to complete the water affairs monitoring data type, and the message storage message queue contained in the water affairs target monitoring data is proportional to the service node of the message middleware; A control module, used for controlling the deployment of the service bearing container to recommend the water affairs target monitoring data; The distributed water affairs monitoring data recommendation device is used to execute the distributed water affairs monitoring data recommendation method as described in any one of claims 1-5.

Citation Information

Patent Citations

  • Water conservancy data acquisition method based on water conservancy Internet of Things

    CN115550444A

  • Method and system for realizing multi-protocol hydrological monitoring data conversion

    CN118075360A

  • Data management method and corresponding apparatus

    WO2023125380A1

  • Database fault processing method and apparatus based on monitor service, and distributed cluster

    WO2024148854A1