Water conservancy monitoring terminal access system and method based on virtual gateway

Abstract

The invention relates to a water conservancy monitoring terminal access system and method based on a virtual gateway, and belongs to the technical field of Internet of Things. According to the system, virtual gateways and a service platform are designed in a split mode, the virtual gateways are independently deployed on the side, close to a water conservancy monitoring terminal, of the edge of a network, data transmission between the virtual gateways and the service platform is achieved through message middleware, and each virtual gateway is composed of a gateway definition part and a gateway instance part; each group of virtual gateways comprises one or more gateway instances, and each gateway instance comprises a virtual gateway server, a load balancer, a data receiving module, a configuration management module, a data processing module, an identity verification module and a data caching module. Through split type design, online data analysis logic synchronization and elastic expansion of the virtual gateway, an efficient, flexible and extensible solution is provided for access and management of the water conservancy monitoring terminal.

Description

Technical Field

[0001] The present invention relates to a distributed Internet of Things (IoT) efficient and secure access system, and in particular to a water conservancy monitoring terminal access system and method based on a virtual gateway, belonging to the technical field of the IoT. Background Art

[0002] With the rapid development of water conservancy information technology, water conservancy monitoring terminals are increasingly used. They are used for key tasks such as real-time monitoring of hydrological data, control of water conservancy facility operation, and prediction of water regime changes. However, there are still some problems and challenges in the access and management of water conservancy monitoring terminals.

[0003] First, the traditional access methods of water conservancy monitoring terminals are diverse and complex. Different monitoring terminals may use different communication protocols and interface standards, which brings great difficulties to unified access and management. At the same time, with the continuous increase in the number of water conservancy monitoring terminals, the traditional access method cannot meet the access needs of large-scale terminals, resulting in low access efficiency and waste of resources.

[0004] Secondly, the security issues of water conservancy monitoring terminals are becoming increasingly prominent. Since the water conservancy system involves important water resources and public safety, once the terminal is illegally accessed or attacked, it may lead to serious consequences such as data leakage and system paralysis. Therefore, how to ensure the access security of water conservancy monitoring terminals has become an urgent problem to be solved.

[0005] In addition, data management and analysis of water conservancy monitoring terminals is also an important issue. Traditional data management methods often only focus on data storage and query, but lack in-depth data mining and analysis. With the continuous development of big data and artificial intelligence technologies, how to use these technologies to efficiently process and analyze data from water conservancy monitoring terminals to support the optimized operation and decision support of water conservancy systems has become a hot topic in current research. Summary of the invention

[0006] The purpose of the present invention is to provide a water conservancy monitoring terminal access system and method based on a virtual gateway to address the above-mentioned deficiencies. The system realizes unified access, centralized management and secure communication of water conservancy monitoring terminals and improves terminal access efficiency by introducing a virtual gateway.

[0007] The technical solution adopted by the present invention is: A water conservancy monitoring terminal access system based on a virtual gateway includes a water conservancy monitoring terminal, a virtual gateway, a service platform, a message middleware and a data center. The virtual gateway and the service platform are designed separately. The virtual gateway is independently deployed at the edge of the network close to the water conservancy monitoring terminal, and the data transmission between the virtual gateway and the service platform is realized through the message middleware. There are multiple groups of virtual gateways, which are composed of two parts: gateway definition and gateway instance. Each group of virtual gateways contains one or more gateway instances. The gateway instance includes a virtual gateway server, a load balancer, a data receiving module, a configuration management module, a data processing module, an identity authentication module and a data cache module. The virtual gateway server is the environment carrier for the gateway instance program to run, and works with the load balancer to provide virtual gateway services to the outside world. The load balancer allocates data processing capacity according to a predetermined strategy and monitors the working status of each gateway instance to dynamically adjust the load distribution strategy; The data receiving module receives data from various water conservancy monitoring terminals and connects with terminal devices through multiple communication protocols (such as MQTT, CoAP, HTTP, TCP, UDP, etc.); The configuration management module is responsible for communicating with the service platform to obtain gateway registration protocol information, dynamic code parsing logic, register terminal information, and implement the dynamic loading code execution data processing logic of the gateway instance; The data processing module is mainly responsible for processing and forwarding the received data, mainly realizing data parsing and verification, data format conversion, and forwarding data to the service platform; The identity authentication module ensures that only authorized water conservancy monitoring terminals can access the virtual gateway. The identity authentication module will verify the terminal identification and terminal transmission data protocol characteristics, confirm that the terminal protocol is legal and complies with the terminal registration protocol. For illegal terminals, the virtual gateway will refuse to communicate with them. The data cache module caches frequently used data locally on the virtual gateway server.

[0008] Each group of virtual gateways has multiple gateway instances with the same data processing capability.

[0009] The gateway definition is used to define the name, type, parsing capability (parsing capability includes editing dynamic parsing code, configuring protocol indicator parameters, configuring instruction templates, etc.), and data receiving address of the gateway. The gateway instance realizes specific parsing capability by loading the dynamic parsing code and parameters in the gateway definition of the corresponding virtual gateway.

[0010] The service platform is provided with a functional module for online writing of data analysis calculation logic, allowing users to write and modify data analysis rules and task configurations in real time on the platform, and synchronize these logics and configurations to the gateway instance under the virtual gateway through the message middleware.

[0011] The water conservancy monitoring terminal is an Internet of Things device such as various sensors and controllers installed in water conservancy engineering facilities. These devices are equipped with various sensors for collecting various hydrological parameters.

[0012] The service platform is a cloud service platform, which is the core service layer of the Internet of Things platform and provides data processing, analysis and application services, including user interface, configuration management, data processing and analysis, application services, API interface and security management functions.

[0013] The message middleware is used to transmit and process messages between system modules, including message queue management, message routing, message persistence, load balancing and high availability functions.

[0014] The data center is responsible for storing and managing all equipment and system data, providing data management functions and security guarantees, and supporting large-scale data analysis and mining.

[0015] The water conservancy monitoring terminal access method based on a virtual gateway comprises the following steps: (1) Configure the water conservancy monitoring terminal protocol parsing: Log in to the service platform and define the data transmission specifications and parsing logic according to the data transmission protocol and specifications used by the water conservancy monitoring terminal; (2) Define a virtual gateway: Log in to the service platform to create a virtual gateway, associate protocol parsing, terminal parameters, and add a gateway instance to this virtual gateway. The service platform sends the data transmission protocol and specifications, data processing code, and terminal parameter information configured by the virtual gateway to the gateway instance. The gateway instance authenticates the terminal based on the terminal parameter information and processes the terminal uploaded information based on the data processing logic. (3) Register terminal information: When a new terminal is connected, it is necessary to log in to the service platform to register the terminal information, including terminal identification, terminal name, terminal type, and configure the data receiving address of the virtual gateway for the terminal; (4) Terminal discovery and access request: After startup, the water conservancy monitoring terminal will actively send an access request to the virtual gateway; (5) Request verification and resource allocation: After the virtual gateway receives the access request, it establishes a connection with the water conservancy monitoring terminal; (6) Terminal authentication and data interaction: After receiving the uplink data from the terminal, the virtual gateway parses and verifies the information in the request. First, the gateway is configured according to the data specifications issued by the service platform to verify the legitimacy of the data uploaded by the terminal. If it does not meet the data specifications issued by the service platform, the data is discarded and the number of abnormalities for this connection channel is counted. If the count exceeds the set threshold, the connection is actively disconnected. If it meets the information specifications, the data is parsed according to the data processing logic issued by the service platform and the legitimacy of the terminal's identification information is verified. If it is an illegal terminal, the data uploaded by the terminal is ignored. If it is legal, the parsed information is transmitted to the service platform through the message middleware. The service platform receives and processes it and then transmits it to the data center. (7) Data processing and analysis: The data center receives the water conservancy monitoring terminal data forwarded by the virtual gateway in real time, and processes and analyzes it. The data center visualizes the data and generates reports as needed to facilitate user viewing and management.

[0016] In traditional water conservancy monitoring systems, the platform and the gateway are usually tightly coupled. Although this design can meet the needs of data processing and management to a certain extent, it also brings many problems, such as high system complexity, poor scalability, and low terminal access efficiency. In order to overcome these problems, the present invention introduces a split design of the platform and the gateway. The split design of the platform and the gateway realizes data transmission and processing through the message middleware, decouples the functions of data protocol parsing and data calculation from the platform part and transfers them to the gateway part, so that the gateway can be independently deployed at the edge of the network and perform data processing close to the terminal side. The main advantage of this design is to utilize the ability of edge computing to reduce the delay in the data transmission process and improve the efficiency of terminal access. Specifically, after the gateway receives the data from the terminal, it first performs protocol parsing and preprocessing of the data, and then transmits the processed data to the platform through the message middleware, and the platform performs further analysis and processing according to the needs. This split design not only reduces the load of the platform, but also improves the response speed and processing capacity of the entire system. This split design has significant advantages in practical applications. For example, when water conservancy monitoring terminals are deployed in remote areas, by deploying the gateway close to the terminals, the delay of data transmission can be reduced, avoiding data loss or delay caused by network congestion or long transmission distance. This design is particularly suitable for water conservancy monitoring application scenarios that require high real-time performance and high reliability, such as flood warning and real-time water quality monitoring.

[0017] Traditional water conservancy monitoring systems usually rely on fixed rules and logics for data parsing and calculation. This static processing method is difficult to adapt to the changing terminal types and data formats, and when it is necessary to adjust the parsing rules or update the data processing logic, manual intervention and system downtime maintenance are often required, which greatly affects the flexibility and availability of the system. In order to solve this problem, the present invention designs a function of online writing data parsing and calculation logic on a platform, allowing users to write and modify data parsing rules and task configurations on the platform in real time, and synchronize these logics and configurations to the virtual gateway through the message middleware. After receiving these updates, the gateway can immediately load new parsing and calculation logic to quickly respond to new data processing requirements. This online synchronization mechanism not only enhances the flexibility of the system, but also improves the accuracy and timeliness of data processing. Through this design, when a new water conservancy monitoring terminal is added to the system, there is no need to reconstruct or shut down the entire system on a large scale for maintenance. It is only necessary to configure the parsing rules for the new data format on the platform to achieve the processing and analysis of the new terminal data. At the same time, this design also supports the dynamic allocation and adjustment of tasks, such as sending specific data processing logic to the corresponding gateway instance according to different monitoring tasks to ensure the efficient execution of tasks.

[0018] The present invention realizes elastic scaling and horizontal expansion of virtual gateway performance by editing multiple gateway instances with the same data processing capabilities into a virtual gateway group. The design concept of the virtual gateway group stems from the demand for resource optimization and performance expansion. Each gateway instance is an independent entity, and its data parsing and computing capabilities can be dynamically adjusted according to actual needs. When the load of a virtual gateway is too high, the system can schedule other gateway instances to share the workload, thereby achieving dynamic load balancing. This design enables the virtual gateway to have extremely high elastic expansion capabilities, and can flexibly adjust the number and capability configuration of gateway instances according to real-time load conditions, thereby optimizing resource utilization efficiency and reducing unnecessary resource waste.

[0019] In addition, the elastic scaling capability of the virtual gateway is also reflected in the horizontal expansion of system performance. When the number of terminal devices in the system increases or the data processing demand increases dramatically, the overall performance of the virtual gateway can be expanded by adding gateway instances. This horizontal expansion method can not only quickly respond to new business needs, but also avoid the high cost and complex operations caused by hardware upgrades in traditional systems. The dynamic management capability of gateway instances further enhances the availability and reliability of the system. When a gateway instance fails or requires maintenance, other instances can automatically take over its tasks to ensure the continuous operation of the system. Through grouping design, gateway instances can share configuration information and processing logic, improving the overall stability of the system.

[0020] The present invention provides an efficient, flexible and scalable solution for the access and management of water conservancy monitoring terminals through split design, online data analysis logic synchronization and elastic expansion of virtual gateways. This solution solves many bottlenecks in traditional water conservancy monitoring systems. By sinking data processing capabilities to the edge of the network and using message middleware to achieve efficient communication between the platform and the gateway, the present invention can significantly improve the access efficiency of water conservancy monitoring terminals. At the same time, through the elastic scaling design of the virtual gateway, it ensures that the system can still maintain efficient and stable operation when facing large-scale data processing needs. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 It is a schematic diagram of the structure of the system of the present invention; Figure 2 This is a schematic diagram of access authentication of a water conservancy monitoring terminal of the present invention; Figure 3 This is a structural block diagram of the data center of the present invention; Figure 4 This is the network access request process of the water conservancy monitoring terminal of the present invention; Figure 5 This is the water conservancy monitoring terminal authentication process of the present invention; Figure 6 This is a schematic diagram of the data access processing flow. DETAILED DESCRIPTION

[0022] The present invention is further described below with reference to specific embodiments.

[0023] Embodiment: A water conservancy monitoring terminal access system based on a virtual gateway includes a water conservancy monitoring terminal, a virtual gateway, a service platform, a message middleware and a data center. The virtual gateway and the service platform are designed separately. The virtual gateway is independently deployed at the edge of the network close to the water conservancy monitoring terminal, and data transmission with the service platform is realized through the message middleware.

[0024] As the access and management center of the water conservancy monitoring terminal, the virtual gateway is responsible for receiving and processing the access requests of the terminal, allocating access channels and communication resources to the terminal, establishing connections with the terminal and interacting with the data. The virtual gateway uses a general server as a hardware platform and can be deployed under common operating systems such as Linux / Unix / Windows. In addition, the virtual gateway has certain security protection functions and can verify and filter the access requests of the terminal to ensure the security of the system. The virtual gateway communicates with various terminal devices through the network, manages data flows, and provides secure and reliable data transmission and processing services.

[0025] There are multiple groups of virtual gateways, which consist of two parts: gateway definition (which defines the name, type, resolution capability, dynamic resolution code, data receiving address, etc. of the gateway) and gateway instance (specific deployed application, which implements the capabilities of the virtual gateway by loading the gateway definition of the corresponding virtual gateway). Each group of virtual gateways contains one or more gateway instances. The instances under the same virtual gateway load-balance the terminal data interaction and processing connected to the virtual gateway.

[0026] The gateway instance mainly consists of the following parts: 1. Virtual gateway server; 2. Load balancer; 3. Data receiving module; 4. Configuration management module; 5. Data processing module; 6. Identity authentication module; 7. Data cache module.

[0027] The virtual gateway server is the environment carrier for the operation of the gateway instance program. It works with the load balancer and is responsible for providing virtual gateway services to the outside world. Its main functions include: providing an operating environment for the gateway instance, managing the operating status of the gateway instance, and providing access channels for terminal data.

[0028] The load balancer is designed to evenly distribute the workload of each virtual gateway instance to ensure efficient operation of the system. The load balancer allocates data processing capacity according to a predetermined strategy and monitors the working status of each gateway instance to dynamically adjust the load distribution strategy.

[0029] The data receiving module receives data from various IoT terminals and connects to terminal devices through multiple communication protocols (such as MQTT, CoAP, HTTP, TCP, UDP, etc.).

[0030] Configuration management module: The gateway instance is designed to dynamically load code to execute data processing logic. The configuration management module is responsible for communicating with the cloud service to obtain gateway registration protocol information, dynamic code parsing logic, and registration terminal information.

[0031] The data processing module is mainly responsible for processing and forwarding the received data, mainly realizing data parsing and verification, data format conversion, and forwarding data to the Internet of Things platform or other business systems.

[0032] The identity authentication module ensures that only authorized water conservancy monitoring terminals can access the virtual gateway. The identity authentication module will verify the terminal identification and terminal transmission data protocol characteristics, confirm that the terminal protocol is legal and complies with the terminal registration protocol, and the virtual gateway will refuse to communicate with illegal terminals.

[0033] In order to improve the operation efficiency of the gateway program, the data cache module caches frequently used data locally on the gateway server, such as gateway configuration data, terminal legal verification and other information.

[0034] Water conservancy monitoring terminal: Water conservancy monitoring terminal is a variety of sensors, controllers and other IoT devices installed in water conservancy engineering facilities. These devices are equipped with various sensors for collecting various hydrological parameters and have remote control functions. Water conservancy monitoring terminals are equipped with various sensors for collecting various hydrological parameters, including water level (monitoring the water level height of rivers, lakes, reservoirs and other water bodies), flow (measuring the water flow in rivers, channels, etc.), water quality (detecting pH value, dissolved oxygen, turbidity, pollutant concentration, etc. in water bodies), meteorological data (collecting meteorological information such as rainfall, temperature, humidity, wind speed, etc.), responsible for real-time monitoring of the operation status of water conservancy projects, controlling the operation of water conservancy facilities, etc. Some terminals have remote control functions, which can remotely operate water conservancy facilities (such as gates, pumping stations, etc.) as needed to optimize water resource scheduling and management. Water conservancy monitoring terminals are usually composed of the following parts: sensor modules (water level sensors, flow meters, water quality sensors, meteorological sensors, etc., used to collect various hydrological parameters), data processing modules (built-in microprocessors or embedded systems, responsible for preliminary data processing, storage and transmission control), communication modules (supporting multiple communication methods, such as GPRS, NB-IoT, LoRa, Wi-Fi, Ethernet, etc., to ensure stable data transmission), power modules (usually solar power combined with batteries to ensure long-term stable operation in the field environment). Water conservancy monitoring terminals are used in the following scenarios: river and lake monitoring (monitoring water level changes, flow, water quality, and timely warning of floods, droughts and pollution events), reservoir and hydropower station management (real-time monitoring of reservoir water level, flow and water quality, optimizing water resources management, and ensuring the safe operation of hydropower stations), urban drainage systems (monitoring the water level and flow of urban rivers and drainage networks to prevent urban waterlogging), farmland irrigation management (monitoring the water volume and water quality of irrigation water sources, optimizing irrigation scheduling, and improving water use efficiency). More advanced terminals have local data storage functions, which can temporarily save data when the network is abnormal. After the data is transmitted to the virtual gateway and stored in the data center, detailed hydrological information and forecasts are provided through the integration, processing and analysis of these water conservancy data. The water conservancy monitoring terminal transmits the collected data to the virtual gateway through wireless networks (such as GPRS, NB-IoT, LoRa, etc.), and the virtual gateway parses the data and forwards it to the service platform for further processing.

[0035] Service platform: It is a cloud service platform and the core service layer of the IoT platform. It provides data processing, analysis and application services, including user interface, configuration management, data processing and analysis, application services, API interface, and security management functions. It mainly includes the following functions: User UI: Provide users with an intuitive business operation interface; Configuration management: Manage registered terminals, protocol configuration (including protocol data parsing and calculation logic code, parameter configuration, instruction configuration, etc.), virtual gateway resources, project information, data push and other resources in the platform; Terminal management: Terminal management includes configuring basic terminal information (such as terminal identification, name, type, location, ownership, etc.), terminal debugging, terminal data query, etc. Specification management: Specification management includes configuring basic specification information (such as specification name, specification specification, indicator escape, etc.), online editing of data analysis and calculation logic function code, configuration parameter templates, etc. Gateway management: Gateway management includes configuring basic information of virtual gateways (such as virtual gateway names), mounting or uninstalling association protocols, gateway instances, IoT terminals, configuring scheduled tasks, and historical data query. Project management: configure the basic information of the IoT project (such as project name, project manager, construction / contracting unit, operation and maintenance manager, etc.), configure the terminals under the project, and count the terminal status under the project; Data sharing: configure the information of sharing data with third-party systems (such as the name of the third-party system, data push interface, etc.); Data processing and analysis: process and analyze the data collected from the terminal devices to extract valuable information; Application services: provide various application services, such as monitoring, early warning, report generation, etc.; API interface: Provide standardized API interface to facilitate third-party applications to access and use platform data and services; Security management: Ensure data security and privacy to prevent unauthorized access and data leakage.

[0036] Message middleware: Message middleware is used to transmit and process messages between various system modules, including terminal control messages, terminal service messages, virtual gateway configuration messages, protocol-based data analysis and calculation logic codes, etc. It mainly includes the following functions: Message queue management: manage message queues to ensure reliable delivery and sequential processing of messages; Message routing: Distribute messages to corresponding services or applications according to predetermined routing rules; Message persistence: Store messages persistently to ensure that they are not lost in the event of a system failure. Load balancing and high availability: Through distributed deployment, load balancing and high availability of the system are achieved.

[0037] The virtual gateway is used to process the original data of the monitoring terminal, generate processing results, and send the processing results to the cloud service platform. The gateway includes an edge container service module and several independent containers. The edge container service module is used to deploy the target application in each of the containers according to the application deployment request.

[0038] The data center is the entire data storage and management center, responsible for storing and managing all device and system data, including structured data and unstructured data; and provides data management functions, including data indexing, querying and backup, etc.; at the same time, it ensures data security and prevents data loss and leakage through access control, encryption and backup measures. It supports large-scale data analysis and mining to help discover hidden patterns and trends.

[0039] The water conservancy monitoring terminal access processing flow is as follows: (1) Configure the water conservancy monitoring terminal protocol parsing: Before accessing the terminal, configure the data transmission protocol and specifications used by the terminal. If the service platform has defined a water conservancy terminal that accesses the protocol, this step can be ignored. If the service platform has not defined it, log in to the cloud service platform and first define the data transmission specifications and parsing logic.

[0040] (2) Define the virtual gateway: Before accessing the water conservancy monitoring terminal, you need to define the virtual gateway first. If the service platform already has a virtual gateway for accessing this type of terminal, you can ignore this step. Otherwise, you need to log in to the cloud service platform to create a virtual gateway, associate protocol parsing, terminal parameters, and add a gateway instance to this virtual gateway. The platform will send the data transmission protocol and specifications, data processing code, and terminal parameter information of the virtual gateway configuration to the gateway instance. The gateway instance authenticates the terminal based on the terminal parameter information and processes the terminal uploaded information based on the data processing logic.

[0041] Initialize the gateway instance: When the gateway instance is started, the initialization execution steps are as follows a. The gateway program establishes a connection with the message middleware and logs in for authentication; b. The gateway program sends a message to request gateway configuration parameters, including requesting a list of legal terminals, associated protocol information, gateway parameter information, scheduled task information, protocol parsing and calculation logic code, etc.; c. The cloud service platform sends messages to the gateway based on the gateway's legal terminal list, associated protocol information, gateway parameter information, scheduled task information, protocol parsing and calculation logic code, etc.; d. After the gateway obtains the gateway configuration information, the legal terminal list is written into the local cache, the gateway parameter information is loaded into the local parameter configuration memory, a gateway task running instance is created according to the scheduled task information, and the gateway message processing module loads the protocol parsing calculation logic code and prepares to start processing the terminal upload message; e. After the gateway program obtains the above configuration, it starts to listen to the port and receive the terminal upload message according to the terminal data receiving port number in the configuration.

[0042] (3) Register terminal information: When a new terminal is connected, you need to log in to the platform to register the terminal information, such as terminal identification, terminal name, terminal type, etc.

[0043] (4) Terminal configuration: When the water conservancy monitoring terminal is shipped or installed and configured, the data receiving address of the virtual gateway is configured in the data push address list of the terminal. If the data push address is not configured when the terminal is installed, the virtual gateway data receiving address can be configured in the terminal data push list through remote instructions or on-site configuration by construction and maintenance personnel.

[0044] (5) Terminal discovery and access request: After startup, the water conservancy monitoring terminal will actively send an access request to the virtual gateway. The request contains key information such as the terminal's identification information, device type, and communication protocol.

[0045] (6) Request verification and resource allocation: After receiving the access request, the virtual gateway establishes a connection with the water conservancy monitoring terminal. This connection can be a network connection based on the TCP / IP protocol or other protocol connections suitable for IoT communication. Once the connection is successfully established, the virtual gateway can interact with the terminal in real time, including receiving data sent by the terminal and sending control instructions to the terminal.

[0046] (7) Terminal authentication and data interaction: After the gateway receives the uplink data from the terminal, it parses and verifies the information in the request. First, the gateway is configured according to the data specifications issued by the platform to verify the legitimacy of the data uploaded by the terminal. If it does not meet the data specifications issued by the platform, the data is discarded and the number of abnormalities for this connection channel is counted. If the count exceeds the set threshold, the connection is actively disconnected. If it meets the information specifications, the data is parsed according to the data processing logic issued by the platform and the legality of the terminal's identification information is verified (by comparing the pre-stored terminal list or access control list). If it is an illegal terminal, the data uploaded by this terminal is ignored. If it is legal, the parsed information is transmitted to the service platform through the message middleware. The service platform receives and processes it and then transmits it to the data center. (8) Data processing and analysis: The data center receives the water conservancy monitoring terminal data forwarded by the virtual gateway in real time, and processes and analyzes it. This data can be used to monitor the operating status of the water conservancy system in real time, predict potential risks and failures, and optimize the operation of water conservancy facilities. The data center visualizes the data and generates reports as needed to facilitate user viewing and management.

[0047] The data processing flow is as follows: a. The terminal sends a message to the gateway data receiving port through the network; b. After receiving the data, the gateway authenticates the terminal and obtains the terminal's unique identification serial number based on the network channel mapping cache or the message itself. If the terminal serial number fails to be obtained, the message is discarded; c. After startup, the gateway obtains a list of legal terminal serial numbers from the server, and verifies whether the terminal serial number uploaded by the terminal is legal. If it is illegal, the message is discarded; d. After confirming that the message comes from a legitimate terminal, the gateway calls the protocol parsing script loaded from the cloud service platform to parse the message content; e. After parsing the message content, generate a response message according to the protocol specification; f. The gateway checks the network connection with the message middleware and prepares to send the parsed message content; g. The gateway forwards the parsed message content to the topic specified by the message center, and the cloud service platform obtains the message according to the pre-agreed topic and further processes it; h. The gateway checks the network connection with the terminal and prepares to forward the response message to the terminal; i. The gateway sends a response message to the terminal, notifying the terminal that the message has been processed.

[0048] Security protection measures are an essential design for IoT gateways, which mainly include two parts: access control and data encryption.

[0049] Access control: The virtual gateway will strictly control the access requests of the water conservancy monitoring terminal to ensure that only legitimate terminals can access the system. This can be achieved by comparing the terminal's identification information, using passwords or key authentication, etc.

[0050] Data encryption: During data transmission, if the terminal supports encrypted data transmission, the virtual gateway will encrypt the data to ensure the security and confidentiality of the data during transmission. This can be done using common encryption algorithms such as AES, RSA, etc.

[0051] The water conservancy monitoring terminal access system based on virtual gateway requires the entire system to have good scalability and maintainability. The design and implementation plan for system scalability and maintainability is as follows: System expansion: When a new water conservancy monitoring terminal needs to be connected, it is only necessary to add the corresponding device information and configuration in the virtual gateway. This makes the system highly scalable and able to adapt to the continuous development and changes of the water conservancy system.

[0052] System maintenance: In order to maintain the stability and reliability of the system, the system needs to be maintained regularly. This includes updating software versions, checking the status of hardware devices, backing up and restoring data, etc. In addition, the system can also be optimized for performance and upgraded for functions as needed.

[0053] The above is a further description of the present invention in combination with the embodiments, and the protection scope of the present invention is not limited thereto.

Claims

1. A water conservancy monitoring terminal access system based on a virtual gateway includes a water conservancy monitoring terminal, a virtual gateway, a service platform, a message middleware and a data center, and is characterized in that: The virtual gateway and service platform are designed separately. The virtual gateway is independently deployed at the edge of the network close to the water conservancy monitoring terminal, and realizes data transmission with the service platform through the message middleware. There are multiple groups of virtual gateways, which are composed of two parts: gateway definition and gateway instance. Each group of virtual gateways contains one or more gateway instances. The gateway instance includes a virtual gateway server, a load balancer, a data receiving module, a configuration management module, a data processing module, an identity authentication module, and a data cache module. The virtual gateway server is the environment carrier for the gateway instance program to run, and works with the load balancer to provide virtual gateway services to the outside world. The load balancer allocates data processing capacity according to a predetermined strategy and monitors the working status of each gateway instance to dynamically adjust the load distribution strategy; The data receiving module receives data from various water conservancy monitoring terminals and connects with the terminal equipment through a variety of communication protocols; The configuration management module is responsible for communicating with the service platform to obtain gateway registration protocol information, dynamic code parsing logic, register terminal information, and implement the dynamic loading code execution data processing logic of the gateway instance; The data processing module is responsible for processing and forwarding the received data, mainly realizing data parsing and verification, data format conversion, and forwarding data to the service platform; The identity authentication module ensures that only authorized water conservancy monitoring terminals can access the virtual gateway. The identity authentication module will verify the terminal identification and terminal transmission data protocol characteristics, confirm that the terminal protocol is legal and complies with the terminal registration protocol. For illegal terminals, the virtual gateway will refuse to communicate with them. The data cache module caches frequently used data locally on the virtual gateway server.

2. According to the virtual gateway-based water conservancy monitoring terminal access system of claim 1, it is characterized in that: Each group of virtual gateways has multiple gateway instances with the same data processing capability.

3. The water conservancy monitoring terminal access system based on virtual gateway according to claim 1 is characterized in that: The gateway definition is used to define the name, type, resolution capability, and data receiving address of the gateway. The gateway instance implements the specific resolution capability by loading the dynamic resolution code and parameters in the gateway definition of the corresponding virtual gateway.

4. The water conservancy monitoring terminal access system based on virtual gateway according to claim 1 is characterized in that: The service platform is provided with a functional module for online writing of data analysis calculation logic, allowing users to write and modify data analysis rules and task configurations in real time on the platform, and synchronize these logics and configurations to the gateway instance under the virtual gateway through the message middleware.

5. The water conservancy monitoring terminal access system based on virtual gateway according to claim 1 is characterized in that: The service platform is a cloud service platform, which is the core service layer of the Internet of Things platform and provides data processing, analysis and application services, including user interface, configuration management, data processing and analysis, application services, API interface and security management functions.

6. The water conservancy monitoring terminal access system based on virtual gateway according to claim 1 is characterized in that: The message middleware is used to transmit and process messages between system modules, including message queue management, message routing, message persistence, load balancing and high availability functions.

7. The water conservancy monitoring terminal access system based on virtual gateway according to claim 1 is characterized in that: The data center is responsible for storing and managing all equipment and system data, providing data management functions and security guarantees, and supporting large-scale data analysis and mining.

8. A water conservancy monitoring terminal access method based on a virtual gateway, characterized in that: The steps include: (1) Configure the water conservancy monitoring terminal protocol parsing: Log in to the service platform and define the data transmission specifications and parsing logic according to the data transmission protocol and specifications used by the water conservancy monitoring terminal; (2) Define a virtual gateway: Log in to the service platform to create a virtual gateway, associate protocol parsing, terminal parameters, and add a gateway instance to this virtual gateway. The service platform sends the data transmission protocol and specifications, data processing code, and terminal parameter information configured by the virtual gateway to the gateway instance. The gateway instance authenticates the terminal based on the terminal parameter information and processes the terminal uploaded information based on the data processing logic. (3) Register terminal information: When a new terminal is connected, it is necessary to log in to the service platform to register the terminal information, including terminal identification, terminal name, terminal type, and configure the data receiving address of the virtual gateway for the terminal; (4) Terminal discovery and access request: After startup, the water conservancy monitoring terminal will actively send an access request to the virtual gateway; (5) Request verification and resource allocation: After the virtual gateway receives the access request, it establishes a connection with the water conservancy monitoring terminal; (6) Terminal authentication and data interaction: After receiving the uplink data from the terminal, the virtual gateway parses and verifies the information in the request; First, the gateway is configured according to the data specifications issued by the service platform to verify the legitimacy of the data uploaded by the terminal. If it does not meet the data specifications issued by the service platform, the data will be discarded and the number of abnormalities for this connection channel will be counted. If the count exceeds the set threshold, the connection will be actively disconnected. If it meets the information specifications, the data will be parsed according to the data processing logic issued by the service platform and the terminal's identification information will be verified to be legal. If it is an illegal terminal, the data uploaded by this terminal will be ignored. If it is legal, the parsed information will be transmitted to the service platform through the message middleware, and the service platform will receive and process it and then transmit it to the data center. (7) Data processing and analysis: The data center receives the water conservancy monitoring terminal data forwarded by the virtual gateway in real time, and processes and analyzes it. The data center visualizes the data and generates reports as needed to facilitate user viewing and management.

Images