A Control System and Method for Intelligent Water Conservancy Terminal Equipment
By setting up container service modules and independent containers in the gateway at the edge, decoupling the target application and the underlying hardware, solving the deployment and upgrading problems of existing terminal devices, achieving rapid deployment, upgrade and failure recovery, and improving the performance and availability of smart water conservancy terminal devices.
Patent Information
- Application Number
- CN202210997841.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-08-19
- Publication Date
- 2025-07-29
- Estimated Expiration
- 2042-08-19
AI Technical Summary
In the existing terminal device solutions, RTU lacks edge computing capabilities, cannot implement complex business logic, and has weak concurrent processing capabilities. Moreover, when the edge computing gateway is large, it is difficult to manage, deploy and upgrade. It needs to be adapted to the underlying hardware one by one, and it is impossible to quickly deploy, upgrade, expand and migrate.
Set up edge container service modules and several independent containers in the gateway at the edge, generate application deployment requests through the cloud, and achieve the operation environment and resource isolation of the target application based on the container, decouple from the underlying hardware, and realize rapid deployment, upgrade, expansion and abnormal recovery.
It reduces the difficulty of controlling and upgrading the nodes at the edge, improves the production capacity and equipment utilization rate of smart water conservancy terminal equipment, and achieves rapid deployment, upgrade and failure recovery.
Smart Images

Figure CN115473899B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of Internet of Things control, and in particular to a control system and method for intelligent water conservancy terminal devices. Background Art
[0002] The modern water conservancy industry requires terminal devices to summarize, upload, and monitor the video, images, and hydrological data collected by various instruments, in order to achieve purposes such as hydrological telemetry, water regime monitoring, reservoir automation monitoring, and water resource monitoring. Therefore, terminal devices need to have the characteristics of stable high availability and intelligent capabilities.
[0003] Currently, the common terminal device solutions mainly include Remote Terminal Unit (RTU) and edge computing gateways. Among them, RTU usually consists of signal input / output modules, microprocessors, wired / wireless communication devices, power supplies, and enclosures, is controlled by a microprocessor, and supports network systems. RTU realizes functions such as remote measurement, remote control, remote signaling, and remote adjustment of production site instruments by its own software or intelligent software system. However, RTU lacks the ability of edge computing, cannot implement complex business logics, and has weak concurrent processing capabilities; RTU also has problems of high dependence on the network, inability to be online for a long time, and lack of scalability. Compared with RTU, an edge computing gateway is an industrial Internet data remote transmission terminal, connects field devices and instruments through serial ports or Ethernet, and transmits data to a remote server through methods such as Ethernet, 5G, 4G, 3G, WIFI, ZigBee, etc. based on protocols such as MQTT and HTTP, to complete functions such as data monitoring, local logic control, remote upgrade, and fault alarm, and does not have the above-mentioned disadvantages of RTU. However, the current edge computing gateways are non-containerized deployments, and the management, deployment, and upgrade of edge nodes are difficult when the scale is large, and it is necessary to adapt to the underlying hardware one by one. In addition, the edge computing gateway is tightly coupled with the hardware, and it is impossible to achieve rapid deployment, upgrade, scale-out / scale-in, migration, and exception recovery in the case of heterogeneous edge devices. Summary of the Invention
[0004] An object of the present invention is to solve at least to some extent one of the technical problems existing in the prior art.
[0005] To this end, embodiments of the present invention provide a control system and method for intelligent water conservancy terminal devices, which improve the production capacity and equipment utilization rate of the control of intelligent water conservancy terminal devices.
[0006] In order to achieve the above technical purpose, the technical solutions adopted by the embodiments of the present invention include:
[0007] On the one hand, embodiments of the present invention provide a control system for intelligent water conservancy terminal devices, including an edge side and a cloud side;
[0008] The edge device includes a data acquisition module and a gateway. The data acquisition module is used to acquire raw data. The gateway is used to process the raw data, generate a processing result, and send the processing result to the cloud. The gateway includes an edge container service module and a number of independent containers. The edge container service module is used to deploy a target application in each of the containers according to an application deployment request;
[0009] The cloud is used to generate the application deployment request according to an application deployment operation and send the application deployment request to the gateway.
[0010] In addition, for a smart water conservancy terminal device management and control system according to the above embodiments of the present invention, the following additional technical features may also be provided:
[0011] Further, in a smart water conservancy terminal device management and control system according to an embodiment of the present invention, the edge container service module includes a first startup module, a device mounting module, a second startup module, and a first return module;
[0012] The first startup module starts the container according to the application deployment request; in response to the completion of the startup of the container, the device mounting module mounts and initializes the terminal device; in response to the completion of the mounting and initialization of the terminal device, the second startup module starts the target application; the first return module feeds back the startup status of the target application to the cloud.
[0013] Further, in an embodiment of the present invention, the cloud includes a management and control module and a display module;
[0014] The management and control module generates the application deployment request according to the application deployment operation and sends the application deployment request to the gateway. The management and control module is also used to receive and store the processing result, and the display platform displays the processing result.
[0015] Further, in an embodiment of the present invention, the management and control module is also used to generate an application exit request according to an application exit operation and send the application exit request to the gateway. The edge container service module also includes an application exit module, a device unloading module, a container release module, and a second return module;
[0016] The application exit module exits the target application according to the application exit request; in response to the successful exit of the target application, the device unloading module unloads the corresponding terminal device; in response to the completion of the unloading of the terminal device, the container release module releases the container; in response to the completion of the release of the container, the second return module feeds back the exit status of the target application to the cloud.
[0017] Further, in an embodiment of the present invention, the cloud also includes a cloud database;
[0018] The management and control module stores the processing result in the cloud database.
[0019] On the other hand, an embodiment of the present invention proposes a method for managing and controlling intelligent water conservancy terminal devices. The method is applied to an intelligent water conservancy terminal device management and control system, which includes an edge side and a cloud side. The edge side includes a data acquisition module and a gateway, and the gateway includes an edge container service module and a number of independent containers. The method includes:
[0020] According to the application deployment operation, generate an application deployment request through the cloud side and send the application deployment request to the gateway;
[0021] According to the application deployment request, deploy the target application in each of the containers through the edge container service module;
[0022] Collect raw data through the data acquisition module;
[0023] Process the raw data through the gateway to generate a processing result, and send the processing result to the cloud side.
[0024] Further, in an embodiment of the present invention, the edge container service module includes a first startup module, a device mounting module, a second startup module, and a first return module;
[0025] The step of deploying the target application in each of the containers through the edge container service module according to the application deployment request includes:
[0026] According to the application deployment request, start the container through the first startup module;
[0027] In response to the completion of the container startup, perform the mounting and initialization of the terminal device through the device mounting module;
[0028] In response to the completion of the mounting and initialization of the terminal device, start the target application through the second startup module;
[0029] Feed back the startup status of the target application to the cloud side through the first return module.
[0030] Further, in an embodiment of the present invention, the cloud side includes a management and control module and a display module;
[0031] The step of generating an application deployment request through the cloud side according to the application deployment operation and sending the application deployment request to the gateway includes:
[0032] According to the application deployment operation, generate an application deployment request through the control module and send the application deployment request to the gateway;
[0033] After the original data is processed by the gateway to generate a processing result and the processing result is sent to the cloud, the method further includes:
[0034] Receive the processing result through the control module and store it;
[0035] Display the processing result through the display platform.
[0036] Furthermore, in an embodiment of the present invention, the edge container service module further includes an application exit module, a device uninstallation module, a container release module, and a second return module;
[0037] The method further includes an exit process for the target application, and the exit process for the target application includes the following steps:
[0038] According to the application exit operation, generate an application exit request through the control module and send the application exit request to the gateway;
[0039] Exit the target application through the application exit module according to the application exit request;
[0040] In response to the successful exit of the target application, unload the corresponding terminal device through the device uninstallation module;
[0041] In response to the completion of the unloading of the terminal device, release the container through the container release module;
[0042] In response to the completion of the container release, feedback the exit status of the target application to the cloud through the second return module.
[0043] Furthermore, in an embodiment of the present invention, the cloud further includes a cloud database;
[0044] The receiving and storing the processing result through the control module includes:
[0045] Store the processing result into the cloud database through the control module.
[0046] Advantages and beneficial effects of the present invention:
[0047] In the embodiment of the present invention, a control system and method for intelligent water conservancy terminal equipment are provided. An edge container service module and a number of independent containers are set in the gateway at the edge end. An application deployment request is generated by the cloud and sent to the gateway, and the edge container service module deploys the target application in each of the containers according to the application deployment request. Based on the containers, isolation of the operating environment and resources of the services corresponding to the target application is achieved, so that the services corresponding to the target application are decoupled from the underlying hardware architecture. As a result, the gateway does not need to be individually adapted to the underlying hardware, realizing rapid deployment, upgrade, scaling, migration, and exception recovery, and reducing the control, deployment, and upgrade difficulties of each node at the edge end; the gateway processes the raw data collected by the data collection module and sends the processing result to the cloud. BRIEF DESCRIPTION OF THE DRAWINGS
[0048] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following introduces the drawings of the related technical solutions in the embodiments of the present application or the prior art. It should be understood that the drawings introduced below only conveniently and clearly illustrate some embodiments of the technical solutions in the present application. For those skilled in the art, without creative efforts, other drawings can also be obtained based on these drawings.
[0049] Figure 1 It is a schematic diagram of the architecture of a specific embodiment of an intelligent water conservancy terminal equipment control system of the present invention;
[0050] Figure 2 It is a timing diagram of the data processing flow of a specific embodiment of an intelligent water conservancy terminal equipment control system of the present invention;
[0051] Figure 3 It is a timing diagram of the application deployment process and the application exit process of a specific embodiment of an intelligent water conservancy terminal equipment control system of the present invention;
[0052] Figure 4 It is a timing diagram of the upgrade process of a specific embodiment of an intelligent water conservancy terminal equipment control system of the present invention;
[0053] Figure 5 It is a timing diagram of the fault recovery process of a specific embodiment of an intelligent water conservancy terminal equipment control system of the present invention;
[0054] Figure 6 It is a schematic flowchart of a specific embodiment of an intelligent water conservancy terminal equipment control method of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0055] Embodiments of the present invention will be described in detail below. Examples of the embodiments are shown in the accompanying drawings, where like or similar reference numerals denote like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are exemplary and are only for explaining the present application, and should not be construed as limiting the present application. For the step numbers in the following embodiments, they are only set for the convenience of description and illustration, and no limitation is imposed on the order between the steps. The execution order of each step in the embodiments can be adaptively adjusted according to the understanding of those skilled in the art.
[0056] The terms "first", "second", "third", "fourth", etc. in the description and claims of the present invention and the accompanying drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that comprises a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products, or devices.
[0057] Referring to "embodiments" in the present invention means that specific features, structures, or characteristics described in connection with the embodiments can be included in at least one embodiment of the present invention. The phrase appears in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.
[0058] Currently, the common terminal device solutions mainly include RTUs and edge computing gateways. Among them, an RTU usually consists of signal input / output modules, a microprocessor, wired / wireless communication devices, a power supply, and a housing. It is controlled by a microprocessor and supports a network system. The RTU realizes functions such as telemetry, telecontrol, teleindication, and teleadjustment of production site instruments by the central monitoring and dispatching system through its own software or intelligent software system. However, the RTU lacks the ability of edge computing, cannot implement complex business logics, and has weak concurrent processing ability. The RTU also has problems such as high dependence on the network, inability to be online for a long time, and lack of scalability. Compared with the RTU, an edge computing gateway is an industrial Internet data remote transmission terminal that connects field devices and instruments through a serial port or Ethernet and transmits data to a remote server through Ethernet, 5G, 4G, 3G, WIFI, ZigBee, etc. based on protocols such as MQTT and HTTP, completing functions such as data monitoring, local logic control, remote upgrade, and fault alarm, without the above-mentioned disadvantages of the RTU. However, the current edge computing gateways are non-containerized deployments, and the management, deployment, and upgrade of edge nodes are difficult when the scale is large, and it is necessary to adapt to the underlying hardware one by one. In addition, the edge computing gateway is tightly coupled with the hardware and cannot achieve rapid deployment, upgrade, scale-out / scale-in, migration, and exception recovery in the case of heterogeneous edge devices. For this reason, the present invention proposes a control system and method for intelligent water conservancy terminal devices. An edge container service module and a number of independent containers are provided in the gateway at the edge end. An application deployment request is generated by the cloud and sent to the gateway, and the edge container service module deploys the target application in each of the containers according to the application deployment request. Based on the container, isolation of the operating environment and resources of the service corresponding to the target application is achieved, so that the service corresponding to the target application is decoupled from the underlying hardware architecture, thereby enabling the gateway to avoid adapting to the underlying hardware one by one, achieving rapid deployment, upgrade, scale-out / scale-in, migration, and exception recovery, and reducing the management, deployment, and upgrade difficulty of each node at the edge end; the gateway processes the raw data collected by the data acquisition module and sends the processing result to the cloud.
[0059] Next, a control system and method for intelligent water conservancy terminal devices according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings. First, a control system for intelligent water conservancy terminal devices according to an embodiment of the present invention will be described.
[0060] A control system for intelligent water conservancy terminal devices in an embodiment of the present invention includes an edge end and a cloud end;
[0061] Among them, the edge side includes a data acquisition module and a gateway. The data acquisition module is used to acquire raw data, and the gateway is used to process the raw data, generate a processing result, and send the processing result to the cloud. The gateway includes an edge container service module and several independent containers. The edge container service module is used to deploy a target application in each container according to an application deployment request;
[0062] The cloud is used to generate an application deployment request according to an application deployment operation and send the application deployment request to the gateway.
[0063] Specifically, in the embodiment of the present invention, the terminal device is virtualized into multiple independent containers through edge containers, realizing fine-grained isolation of the node resources on the edge side and improving the application performance and the accuracy of the processing result deployed in the container.
[0064] Optionally, in an embodiment of the present invention, the data acquisition module includes a camera, a water level gauge, and various other sensors.
[0065] Optionally, in an embodiment of the present invention, the applications deployed in the containers include an AI computing framework, an image recognition application, data acquisition and reporting, and remote control.
[0066] In the embodiment of the present invention, the cluster components on the edge side provide consistency and high availability capabilities, and the security components provide capabilities of permission management and access control.
[0067] Optionally, referring to Figure 2 , taking the raw data as video / image data as an example, the process of the gateway on the edge side of the embodiment of the present invention processing the raw data specifically includes:
[0068] 1) Acquire video / image data through the data acquisition module;
[0069] 2) Preprocessing of video / image data: Decode the video stream in the video / image data, extract key frames, and encode the key frames and the image data in the video / image data into a picture format specified by the target application. Perform noise reduction, matting, and scaling processing on the encoded pictures to obtain target images;
[0070] 3) Load the target image, input the target image into a pre-trained model file, call the deep learning computing framework for model inference, and output an inference result;
[0071] 4) Perform data type conversion on the inference result, release memory resources, output a class flag with a specified confidence level, generate a processing result, and send the processing result to the cloud.
[0072] As an alternative implementation, the edge container service module includes a first startup module, a device mounting module, a second startup module, and a first return module;
[0073] Referring to Figure 3 , after the cloud issues an application deployment request to the gateway, the first startup module starts a container according to the application deployment request; in response to the completion of the container startup, the device mounting module mounts and initializes the terminal device; in response to the completion of the mounting and initialization of the terminal device, the second startup module starts the target application; the first return module feeds back the startup status of the target application to the cloud, such as feeding back that the target application has been successfully started.
[0074] As an alternative implementation, the cloud includes a management and control module and a display module;
[0075] Among them, the management and control module generates an application deployment request according to the application deployment operation, and issues the application deployment request to the gateway. The management and control module is also used to receive and store the processing result, and the display platform displays the processing result.
[0076] As an alternative implementation, the management and control module is also used to generate an application exit request according to the application exit operation, and issue the application exit request to the gateway. The edge container service module also includes an application exit module, a device unmounting module, a container release module, and a second return module;
[0077] Continuing to refer to Figure 3 , the application exit module exits the target application according to the application exit request; in response to the successful exit of the target application, the device unmounting module unmounts the corresponding terminal device; in response to the completion of the unmounting of the terminal device, the container release module releases the container; in response to the completion of the container release, the second return module feeds back the exit status of the target application to the cloud, such as feeding back that the target application has been successfully exited.
[0078] As an alternative implementation, the cloud also includes a cloud database;
[0079] The management and control module stores the processing result in the cloud database.
[0080] It can be understood that the intelligent water conservancy terminal device management and control system in the embodiments of the present invention reduces the management, deployment, and upgrade difficulties of each node at the edge by performing containerized deployment on the gateway at the edge. Referring to Figure 4 , the upgrade process of the gateway specifically includes:
[0081] 1) The cloud generates an upgrade command according to the upgrade operation, and issues the upgrade command to the gateway;
[0082] 2) The gateway exits the process of the application to be upgraded according to the upgrade command, modifies the configuration file, and pulls a new installation package for application upgrade;
[0083] 3) After the application upgrade is completed, restart the application process and report the completion of the application upgrade to the management and control platform in the cloud.
[0084] In the embodiments of the present invention, the gateway monitors the operating status of the data acquisition module and the applications in the container in real time to achieve fault recovery. Refer to Figure 5 , the fault recovery process of the gateway specifically includes:
[0085] 1) When the data acquisition module fails or the operating status of the application in the container is abnormal (such as the application exits abnormally), the gateway reports the container where the faulty service / abnormal service is located to the management and control platform in the cloud;
[0086] 2) The management and control platform controls the container where the faulty service / abnormal service is located to exit, restarts the container where the faulty service / abnormal service is located through the gateway, and starts the application in the container where the faulty service / abnormal service is located;
[0087] 3) If the application in the container where the faulty service / abnormal service is located starts successfully, report the successful start of the application to the management and control module in the cloud through the gateway; if the application in the container where the faulty service / abnormal service is located fails to start, report the failure of the application start to the management and control module in the cloud through the gateway, and generate a fault warning message through the management and control platform.
[0088] In summary, in the embodiments of the present invention, an edge container service module and a number of independent containers are provided in the gateway at the edge of the intelligent water conservancy terminal device management and control system. An application deployment request is generated by the cloud and sent to the gateway, and the edge container service module deploys the target application in each of the containers according to the application deployment request. Based on the container, the operating environment and resources of the service corresponding to the target application are isolated, so that the service corresponding to the target application is decoupled from the underlying hardware architecture, so that the gateway does not need to be adapted to the underlying hardware one by one, realizing rapid deployment, upgrade, scaling, migration and exception recovery, reducing the management, deployment and upgrade difficulties of each node at the edge; the gateway processes the raw data collected by the data acquisition module and sends the processing result to the cloud.
[0089] Secondly, refer to Figure 6 , the embodiments of the present invention propose an intelligent water conservancy terminal device management and control method, which is applied to an intelligent water conservancy terminal device management and control system. The intelligent water conservancy terminal device management and control system includes an edge side and a cloud side. The edge side includes a data acquisition module and a gateway. The gateway includes an edge container service module and a number of independent containers. The intelligent water conservancy terminal device management and control method includes:
[0090] S601. According to the application deployment operation, generate an application deployment request through the cloud and send the application deployment request to the gateway;
[0091] Among them, the cloud includes a management and control module and a display module.
[0092] Specifically, in the embodiment of the present invention, according to the application deployment operation, an application deployment request is generated by the management and control module and sent to the gateway.
[0093] S602. Deploy the target application in each container through the edge container service module according to the application deployment request;
[0094] Among them, the edge container service module includes a first startup module, a device mounting module, a second startup module, and a first return module.
[0095] Step S602 can be further divided into the following steps S6021 - S6024:
[0096] Step S6021. Start the container through the first startup module according to the application deployment request;
[0097] Step S6022. In response to the completion of container startup, perform the mounting and initialization of the terminal device through the device mounting module;
[0098] Step S6023. In response to the completion of the mounting and initialization of the terminal device, start the target application through the second startup module;
[0099] Step S6024. Feed back the startup status of the target application to the cloud through the first return module.
[0100] In the embodiment of the present invention, the edge container service module further includes an application exit module, a device unloading module, a container release module, and a second return module. The intelligent water conservancy terminal device management and control method of the embodiment of the present invention further includes an application exit process, which specifically includes the following steps:
[0101] 1) According to the application exit operation, generate an application exit request through the management and control module and send the application exit request to the gateway;
[0102] 2) Exit the target application through the application exit module according to the application exit request;
[0103] 3) In response to the successful exit of the target application, unload the corresponding terminal device through the device unloading module;
[0104] 4) In response to the completion of terminal device unloading, release the container through the container release module;
[0105] 5) In response to the completion of container release, feed back the exit status of the target application to the cloud through the second return module.
[0106] S603. Collect raw data through the data collection module;
[0107] Optionally, in an embodiment of the present invention, the data acquisition module includes a camera, a water level gauge, and various other sensors.
[0108] S604. Process the original data through the gateway to generate a processing result, and send the processing result to the cloud.
[0109] Specifically, taking the original data as video / image data as an example, step S604 includes:
[0110] 1) Collect video / image data through the data acquisition module;
[0111] 2) Preprocessing of video / image data: Decode the video stream in the video / image data, extract key frames, and encode the key frames and the image data in the video / image data into the picture format specified by the target application. Perform noise reduction, matte extraction, and scaling processing on the encoded pictures to obtain target images;
[0112] 3) Load the target image, input the target image into a pre-trained model file, call the deep learning computing framework for model inference, and output the inference result;
[0113] 4) Perform data type conversion on the inference result, release memory resources, output the class flag with a specified confidence level, generate a processing result, and send the processing result to the cloud.
[0114] In an embodiment of the present invention, after receiving the processing result sent by the gateway, the cloud stores the processing result through the management and control module and displays the processing result through the display platform.
[0115] Specifically, in an embodiment of the present invention, the cloud further includes a cloud database, and the management and control module stores the processing result in the cloud database.
[0116] The content in the above method embodiments is applicable to the system embodiments of the present invention. The functions specifically implemented by the system embodiments of the present invention are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those of the above method embodiments.
[0117] In some alternative embodiments, the functions / operations recited in the block diagrams may not occur in the order presented in the operational illustrations. For example, depending on the functions / operations involved, two blocks shown in succession may actually be executed substantially concurrently or the blocks may sometimes be executed in reverse order. Further, the embodiments presented and described in the flowcharts of the present application are provided by way of example for the purpose of providing a more thorough understanding of the technology. The disclosed methods are not limited to the operations and logic flows presented herein. Alternative embodiments are contemplated in which the order of various operations is altered and in which sub-operations described as part of a larger operation are performed independently.
[0118] In addition, while the present application has been described in the context of functional modules, it should be understood that, unless otherwise stated to the contrary, one or more of the functions and / or features may be integrated in a single physical device and / or software module or one or more functions and / or features may be implemented in separate physical devices or software modules. It should also be understood that a detailed discussion of the actual implementation of each module is not necessary for an understanding of the present application. Rather, given the attributes, functions, and internal relationships of the various functional modules in the devices disclosed herein, the actual implementation of such modules will be understood within the ordinary skill of an engineer. Accordingly, those of ordinary skill in the art will be able to implement the present application as set forth in the claims without undue experimentation. It should also be understood that the particular concepts disclosed are illustrative only and are not intended to limit the scope of the present application, which is determined by the full scope of the appended claims and their equivalents.
[0119] It should be understood that the various parts of the present application may be implemented by hardware, software, firmware, or a combination thereof. In the above-described embodiments, multiple steps or methods may be implemented by software or firmware stored in a memory and executed by a suitable program execution system. For example, if implemented in hardware, as in another embodiment, any one of the following techniques well known in the art or combinations thereof may be used: discrete logic circuits having logic gates for implementing logical functions on data signals, application specific integrated circuits having appropriate combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.
[0120] In the foregoing description of this specification, the descriptions referring to the terms "one embodiment / example", "another embodiment / example", or "certain embodiments / examples", etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.
[0121] Although the embodiments of the present application have been shown and described, those of ordinary skill in the art can understand that various changes, modifications, substitutions, and variations can be made to these embodiments without departing from the principles and spirit of the present application, and the scope of the present application is defined by the claims and their equivalents.
[0122] The above is a specific description of the preferred embodiments of the present application, but the present application is not limited to the described embodiments. Those skilled in the art can also make various equivalent deformations or substitutions without departing from the spirit of the present application, and these equivalent deformations or substitutions are all included within the scope defined by the claims of the present application.
Claims
1. A control system for intelligent water conservancy terminal equipment, characterized in that, It includes an edge side and a cloud side; The edge side includes a data acquisition module and a gateway. The data acquisition module is used to acquire raw data. The gateway is used to process the raw data, generate a processing result, and send the processing result to the cloud side. The gateway includes an edge container service module and several independent containers. The edge container service module is used to deploy a target application in each of the containers according to an application deployment request, and is also used to virtualize a terminal device into multiple independent containers through edge containers. The target applications deployed in the containers include an AI computing framework, an image recognition application, data acquisition and reporting, and remote control; The cloud side is used to generate the application deployment request according to an application deployment operation and send the application deployment request to the gateway; The edge container service module includes a first startup module, a device mounting module, a second startup module, and a first return module; The first startup module starts the container according to the application deployment request; in response to the completion of the startup of the container, the device mounting module mounts and initializes the terminal device; in response to the completion of the mounting and initialization of the terminal device, the second startup module starts the target application; The first return module feeds back the startup status of the target application to the cloud side; The process of processing the raw data by the gateway on the edge side specifically includes: Acquiring video / image data through the data acquisition module; Decoding the video stream in the video / image data, extracting key frames, encoding the key frames and the image data in the video / image data into a picture format specified by the target application, and performing noise reduction, matting, and scaling processing on the encoded pictures to obtain target images; Loading the target images, inputting the target images into a pre-trained model file, calling a deep learning computing framework for model inference, and outputting an inference result; Performing data type conversion on the inference result, releasing memory resources, outputting a class flag with a specified confidence level, generating a processing result, and sending the processing result to the cloud side.
2. The intelligent water conservancy terminal device control system according to claim 1, characterized in that, The cloud side includes a management and control module and a display module; The management and control module generates the application deployment request according to the application deployment operation and sends the application deployment request to the gateway. The management and control module is also used to receive and store the processing result, and the display platform displays the processing result.
3. The intelligent water conservancy terminal device control system according to claim 2, characterized in that, The management and control module is also used to generate an application exit request according to an application exit operation and send the application exit request to the gateway. The edge container service module also includes an application exit module, a device unloading module, a container release module, and a second return module; The application exit module exits the target application according to the application exit request; in response to the successful exit of the target application, the device unloading module unloads the corresponding terminal device; in response to the completion of the unloading of the terminal device, the container release module releases the container; in response to the completion of the release of the container, the second return module feeds back the exit status of the target application to the cloud side.
4. The intelligent water conservancy terminal device control system according to claim 2, wherein The cloud side also includes a cloud database; The management and control module stores the processing result in the cloud database.
5. A control method for intelligent water conservancy terminal equipment, characterized in that, The method is applied to a smart water conservancy terminal device management and control system, which includes an edge side and a cloud side. The edge side includes a data acquisition module and a gateway. The gateway includes an edge container service module and a number of independent containers. The method includes: According to the application deployment operation, generate an application deployment request through the cloud side and send the application deployment request to the gateway; According to the application deployment request, deploy the target application in each of the containers through the edge container service module. Virtualize the terminal device into multiple independent containers through the edge container. The target applications deployed in the containers include an AI computing framework, an image recognition application, data acquisition and reporting, and remote control; Collect raw data through the data acquisition module; Process the raw data through the gateway to generate a processing result and send the processing result to the cloud side; The edge container service module includes a first startup module, a device mounting module, a second startup module, and a first return module; The step of deploying the target application in each of the containers through the edge container service module according to the application deployment request includes: Start the container through the first startup module according to the application deployment request; In response to the completion of the container startup, perform the mounting and initialization of the terminal device through the device mounting module; In response to the completion of the mounting and initialization of the terminal device, start the target application through the second startup module; Feedback the startup status of the target application to the cloud side through the first return module; The process of processing the raw data through the gateway specifically includes: Collect video / image data through the data acquisition module; Decode the video stream in the video / image data, extract key frames, and encode the key frames and the image data in the video / image data into the picture format specified by the target application. Perform noise reduction, matte extraction, and scaling processing on the encoded pictures to obtain target images; Load the target images and input the target images into a pre-trained model file, call the deep learning computing framework for model inference, and output the inference result; Perform data type conversion on the inference result, release the memory resources, output the class flag with a specified confidence level, generate a processing result, and send the processing result to the cloud side.
6. A control method for an intelligent water conservancy terminal device according to claim 5, characterized in that The cloud side includes a management and control module and a display module; The step of generating an application deployment request through the cloud side according to the application deployment operation and sending the application deployment request to the gateway includes: Generate an application deployment request through the management and control module according to the application deployment operation and send the application deployment request to the gateway; After processing the raw data through the gateway to generate a processing result and sending the processing result to the cloud side, the method further includes: Receive and store the processing result through the management and control module; Display the processing result through the display platform.
7. A control method for an intelligent water conservancy terminal device according to claim 6, characterized in that, The edge container service module further includes an application exit module, a device unloading module, a container release module, and a second return module; The method further includes an exit process for the target application, and the exit process of the target application includes the following steps: According to the application exit operation, generate an application exit request through the management and control module, and send the application exit request to the gateway; Exit the target application through the application exit module according to the application exit request; In response to the successful exit of the target application, uninstall the corresponding terminal device through the device uninstallation module; In response to the completion of the terminal device uninstallation, release the container through the container release module; In response to the completion of the container release, feedback the exit status of the target application to the cloud through the second return module.
8. The control method of an intelligent water conservancy terminal device according to claim 6, characterized in that, The cloud further includes a cloud database; The receiving and storing the processing result through the management and control module includes: Store the processing result into the cloud database through the management and control module.
Citation Information
Patent Citations
Edge computing gateway management system and method based on LXC container technology
CN111061491A