A real-time monitoring system for port locks based on Internet of Things technology
Through a real-time port lock monitoring system based on IoT technology, combined with cameras and deep neural networks, real-time monitoring and fault detection of port locks are realized, solving the problems of untimely monitoring and insufficient security caused by manual operations in traditional systems. Improves the reliability and security of port locks.
Patent Information
- Application Number
- CN202410620284.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-20
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2044-05-20
AI Technical Summary
Traditional port lock monitoring systems require manual operation, which have problems such as human negligence and inaccurate operation. They cannot monitor the port lock status in real time and cannot actively detect and alarm abnormal situations, resulting in untimely and effective monitoring and management.
A real-time monitoring system for port locks based on IoT technology is designed, including unlocking signal module, unlocking request detection and information sending module, physical port unlocking module and unlocking record storage module, remote control and real-time monitoring are realized through the Internet of Things platform, and Use cameras and deep neural networks to detect and alarm faults.
It improves the reliability and security of port locks, realizes real-time monitoring of port locks and timely discovers and handles abnormal situations, and improves operation and maintenance efficiency and security.
Smart Images

Figure CN118250108B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of intelligent monitoring, and more specifically, to a port lock real-time monitoring system based on Internet of Things technology. Background Art
[0002] The Internet of Things (IoT) is a technology that connects the physical world with the cyber world, and realizes the perception, control and management of the physical world through various sensors, controllers, smart terminals and other devices. The IoT technology has been widely used in various fields, such as smart home, smart transportation, smart medical care, etc.
[0003] IoT technology also plays an important role in the real-time monitoring of port locks. A port lock is a device that controls access rights to physical ports. It can prevent unauthorized personnel from accessing network devices and protect the security of network device ports. It is commonly found in computer rooms, data centers and other places. A port lock usually consists of two parts: hardware and software. The hardware part is responsible for locking and unlocking the physical port, and the software part is responsible for the management and control of the port lock. In order to improve the security and reliability of the port lock, it is necessary to monitor the port lock in real time so that abnormal situations can be discovered and handled in a timely manner.
[0004] However, traditional port lock monitoring systems usually require manual operation, such as manual unlocking and recording unlocking information. This method has problems such as human negligence and inaccurate operation, which can easily lead to errors or omissions in unlocking records. In addition, traditional port lock monitoring systems can only record unlocking events, but cannot monitor the status of the port lock in real time, nor can they actively detect and alarm abnormal situations. In other words, the manual operation of the operation and maintenance personnel cannot obtain the unlocking records and abnormal situations of the port lock in time, resulting in insufficient and ineffective monitoring and management of the port lock.
[0005] Therefore, a port lock real-time monitoring system based on Internet of Things technology is desired. Summary of the invention
[0006] In order to solve the above technical problems, the present application is proposed. The present application provides a port lock real-time monitoring system based on the Internet of Things technology, which can improve the reliability and security of the port lock.
[0007] According to one aspect of the present application, a port lock real-time monitoring system based on Internet of Things technology is provided, which includes:
[0008] The unlocking signal module is used to send an unlocking request to the port lock through the authorization module of the IoT platform when the operation and maintenance personnel need to unlock the lock;
[0009] An unlock request detection and information sending module, configured to send unlock information to the Internet of Things platform in response to the port lock application receiving the unlock request;
[0010] A physical port unlocking module, used to forward the unlocking information to the hardware of the port lock through the Internet of Things platform to unlock the physical port;
[0011] The unlocking record saving module is used to automatically save the unlocking record to the log recording application through the port lock application.
[0012] Compared with the prior art, the real-time monitoring system for port locks based on the Internet of Things technology provided by the present application includes: an unlocking signal module, an unlocking request detection and information sending module, a physical port unlocking module, and an unlocking record storage module. When the operation and maintenance personnel need to unlock, the unlocking request is first sent to the port lock through the authorization module of the Internet of Things platform. Then, in response to the application of the port lock receiving the unlocking request, the unlocking information is sent to the Internet of Things platform. Then, the unlocking information is forwarded to the hardware of the port lock through the Internet of Things platform to realize the unlocking of the physical port. Finally, the unlocking record is automatically saved to the log recording application through the application of the port lock. In this way, the reliability and security of the port lock can be improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. The following drawings are not intentionally scaled to the actual size, and the focus is on illustrating the main purpose of the present application.
[0014] Figure 1 It is a block diagram of a port lock real-time monitoring system based on Internet of Things technology according to an embodiment of the present application.
[0015] Figure 2 It is a block diagram of an abnormal situation monitoring module also included in the port lock real-time monitoring system based on Internet of Things technology according to an embodiment of the present application.
[0016] Figure 3 The present invention is a flowchart of a method for real-time monitoring of a port lock based on Internet of Things technology according to an embodiment of the present application.
[0017] Figure 4 This is an application scenario diagram of a port lock real-time monitoring system based on Internet of Things technology according to an embodiment of the present application. DETAILED DESCRIPTION
[0018] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, not all embodiments. Based on the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field without creative work also fall within the scope of protection of the present application.
[0019] As shown in this application and claims, unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural. Generally speaking, the terms "include" and "comprise" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.
[0020] Although the present application makes various references to certain modules in the system according to the embodiments of the present application, any number of different modules can be used and run on the user terminal and / or server. The modules are only illustrative, and different aspects of the system and method can use different modules.
[0021] Flowcharts are used in the present application to illustrate the operations performed by the system according to the embodiments of the present application. It should be understood that the preceding or following operations are not necessarily performed accurately in order. On the contrary, various steps may be processed in reverse order or simultaneously as required. Meanwhile, other operations may also be added to these processes, or a certain step or several steps of operations may be removed from these processes.
[0022] Below, the exemplary embodiments according to the present application will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited to the exemplary embodiments described here.
[0023] In response to the above technical problems, in the technical solution of the present application, a port lock real-time monitoring system based on Internet of Things technology is proposed, which can connect the port lock with the Internet of Things platform to achieve remote control and real-time monitoring, thereby improving the monitoring security and convenience of the port lock. Figure 1 FIG. 1 is a block diagram of a port lock real-time monitoring system based on Internet of Things technology according to an embodiment of the present application. Figure 1As shown, according to the embodiment of the present application, the port lock real-time monitoring system 100 based on the Internet of Things technology includes: an unlocking signal module 110, which is used to send an unlocking request to the port lock through the authorization module of the Internet of Things platform when the operation and maintenance personnel need to unlock the port lock; an unlocking request detection and information sending module 120, which is used to send the unlocking information to the Internet of Things platform in response to the port lock application receiving the unlocking request; a physical port unlocking module 130, which is used to forward the unlocking information to the hardware of the port lock through the Internet of Things platform to realize the unlocking of the physical port; and an unlocking record saving module 140, which is used to automatically save the unlocking record to the log recording application through the port lock application.
[0024] In particular, in the above-mentioned port lock real-time monitoring system based on the Internet of Things technology, an abnormal situation monitoring module 150 is also included, which is used to detect the state of the port lock to determine whether the port lock is faulty. Accordingly, if an abnormal situation is detected in the port lock, such as a port lock failure, the abnormal situation monitoring module will issue an alarm to the operation and maintenance personnel, so that the operation and maintenance personnel can take corresponding measures to deal with it in time.
[0025] Specifically, the technical concept of the present application is to collect port lock monitoring images through a camera, and introduce image processing and analysis algorithms at the back end to analyze the port lock monitoring images, so as to determine whether the port lock has a fault. In this way, it is possible to achieve real-time detection and remote control of port lock faults and abnormal states based on the Internet of Things technology, so as to timely discover and handle abnormal conditions of the port lock, improve the intelligence level of the port lock, and also improve the reliability and safety of the port lock.
[0026] Accordingly, if Figure 2 As shown, the abnormal situation monitoring module 150 includes: a port lock monitoring image acquisition unit 151, which is used to receive the port lock monitoring image collected by the camera; a port lock area feature extraction unit 152, which is used to extract features from the port lock monitoring image through a port lock area feature extractor based on a deep neural network model to obtain a port lock monitoring feature map; a port lock monitoring feature denoising unit 153, which is used to pass the port lock monitoring feature map through a denoising sparsifier based on a position mask module to obtain a denoised port lock monitoring feature map; a port lock monitoring feature local manifestation unit 154, which is used to pass the denoised port lock monitoring feature map through a local information efficient modeling module to obtain a locally significant port lock monitoring feature map as the locally significant port lock monitoring feature; and a port lock fault detection unit 155, which is used to determine whether the port lock has a fault based on the locally significant port lock monitoring feature.
[0027] More specifically, in the technical solution of the present application, first, a port lock monitoring image captured by a camera is received. Then, a port lock region feature extractor based on a convolutional neural network model with excellent performance in extracting implicit features of an image is used to perform feature mining on the port lock monitoring image, so as to extract feature information about the state of the port lock in the port lock monitoring image, thereby obtaining a port lock monitoring feature map.
[0028] Correspondingly, in the port lock area feature extraction unit 152, the deep neural network model is a convolutional neural network model, that is, the port lock area feature extractor based on the deep neural network model is a port lock area feature extractor based on the convolutional neural network model. It is worth mentioning that the convolutional neural network (CNN) is a deep learning model, which is particularly suitable for processing data with a grid structure, such as images and voices. It extracts the features of input data through multi-layer convolution and pooling operations, and performs classification or regression through a fully connected layer. Convolutional neural network models are widely used in the field of computer vision and can be used for tasks such as image classification, target detection, and image generation. It can automatically extract high-level semantic features in images by learning local features and spatial structures of images. In the abnormal situation monitoring module, the convolutional neural network model is used as a port lock area feature extractor to extract feature information in the port lock monitoring image. By training the model, it can have a good feature extraction capability, thereby realizing accurate detection of the port lock state and fault judgment.
[0029] In the actual process of port lock fault detection, the port lock monitoring image may be interfered by various factors, such as light changes, image blur, camera shaking, etc., which will cause noise and redundant information to appear in the feature map. If the port lock monitoring feature map is not processed, these noises and redundant information may affect the subsequent feature analysis and classification results of the port lock, reducing the accuracy and reliability of the system for port lock monitoring. In addition, it is also considered that when the state of the port lock is actually detected, the focus should be on the feature information of the relevant area of the port lock in the image, and the remaining useless noise and background interference features should be filtered out, so as to highlight the key features of the port lock and improve the accuracy of the judgment of the port lock state. Based on this, in the technical solution of the present application, the port lock monitoring feature map is further passed through a denoising sparser based on a position mask module to obtain a denoised port lock monitoring feature map. In particular, the denoising sparser based on a position mask module can identify and remove noise and background interference in the feature map according to the pixel position information in the image. By sparsely representing and reconstructing the feature map, the denoising sparsifier can remove the noise part to retain the feature information related to the port lock state, thereby obtaining a denoised feature map. In other words, the denoised port lock monitoring feature map has clearer edges and more accurate feature representation, which is conducive to subsequent feature analysis and classification. For example, in the abnormal situation monitoring module, the denoised feature map can provide more reliable feature input, so that the classifier based on the deep learning model can more accurately determine whether the port lock is faulty.
[0030] Correspondingly, the port lock monitoring feature denoising unit 153 is used to: process the port lock monitoring feature graph through a denoising sparsifier based on a position mask module according to the denoising formula to obtain the denoised port lock monitoring feature graph; wherein the denoising formula is:
[0031] ;
[0032] ;
[0033] in, is the port lock monitoring characteristic diagram, is the threshold feature map, is the port lock monitoring characteristic diagram after noise reduction, is the characteristic value of each position in the port lock monitoring characteristic graph, is the feature value of each position in the threshold feature map, It means point multiplication by position. and is a hyperparameter, Represents the condition set of the threshold function.
[0034] Furthermore, considering that there are local port lock detail features in the port lock monitoring image, these details are very important for the status and fault detection of the port lock. However, since the structure of the convolutional neural network model in the traditional sense is a convolution plus pooling layer, neurons with local receptive fields (such as 3×3 convolution kernels) can be used to extract features and reduce the dimension by pooling, and significant information on each channel can be obtained at the same time. However, this method has a large receptive field, which will cause the distribution characteristics of the state features of the port lock in the extracted port lock monitoring image to be blurred, and it is easy to ignore the quality detail feature information with resolution in the feature map. Therefore, in the technical solution of the present application, the denoised port lock monitoring feature map is further passed through a local information efficient modeling module to obtain a locally significant port lock monitoring feature map. It should be understandable that the local information efficient modeling module can add a 1×1 convolution kernel and a ReLU activation function after the traditional convolution. From the perspective of cross-channel pooling, this is equivalent to implementing cascaded cross-channel weighted pooling on a normal convolution layer, so that the model can learn the relationship between channels, and more efficiently model and characterize the local detail feature information about the port lock in the port lock monitoring image, so that the local detail features of the port lock in the image are more prominent and prominent, highlighting important local information of the port lock, reducing the impact of irrelevant details and noise, thereby improving the accuracy of port lock status and fault detection.
[0035] Accordingly, the port lock monitoring feature local manifestation unit 154 is used to: process the denoised port lock monitoring feature map through the local information efficient modeling module using the following significant formula to obtain the local significant port lock monitoring feature map; wherein the significant formula is:
[0036] ;
[0037] in, represents the port lock monitoring characteristic diagram after noise reduction, represents the local significant port lock monitoring feature map, express function, Indicates that a 3×3 convolution kernel is used for convolution processing. Indicates that a 1×1 convolution kernel is used for convolution processing.
[0038] Then, the local significant port lock monitoring feature map is passed through a classifier to obtain a classification result, and the classification result is used to indicate whether the port lock has a fault. In other words, the significant feature information of the important local area of the port lock is used for classification processing to determine whether the port lock has a fault. In this way, real-time detection and remote control of the fault and abnormal state of the port lock can be achieved based on the Internet of Things technology, so as to timely discover and handle the abnormal situation of the port lock.
[0039] Correspondingly, the port lock fault detection unit 155 includes: a fault detection subunit, which is used to pass the local salient port lock monitoring feature map through a classifier to obtain a classification result, and the classification result is used to indicate whether the port lock has a fault.
[0040] Furthermore, the fault detection subunit includes: an expansion secondary unit, used to expand the local significant port lock monitoring feature map into an optimized classification feature vector according to a row vector or a column vector; a fully connected encoding secondary unit, used to use the fully connected layer of the classifier to fully connect encode the optimized classification feature vector to obtain an encoded classification feature vector; and a classification secondary unit, used to input the encoded classification feature vector into the Softmax classification function of the classifier to obtain the classification result.
[0041] That is, in the technical solution of the present application, the labels of the classifier include whether the port lock is faulty (first label), and whether the port lock is not faulty (second label), wherein the classifier determines to which classification label the local salient port lock monitoring feature map belongs through a soft maximum function. It is worth noting that the first label p1 and the second label p2 here do not contain artificially set concepts. In fact, during the training process, the computer model does not have the concept of "whether the port lock is faulty". It only has two classification labels and the probability of the output feature under these two classification labels, that is, the sum of p1 and p2 is one. Therefore, the classification result of whether the port lock is faulty is actually converted into a binary class probability distribution that conforms to natural laws through the classification label. In essence, the physical meaning of the natural probability distribution of the label is used, rather than the linguistic text meaning of "whether the port lock is faulty".
[0042] It should be understood that the role of the classifier is to use the given categories and known training data to learn classification rules and classifiers, and then classify (or predict) unknown data. Logistic regression, SVM, etc. are often used to solve binary classification problems. For multi-class classification problems, logistic regression or SVM can also be used, but multiple binary classifications are required to form a multi-classification, but this is prone to errors and inefficient. Commonly used multi-classification methods include the Softmax classification function.
[0043] In particular, in the technical solution of the present application, after the port lock monitoring image passes through the port lock area feature extractor based on the convolutional neural network model, each feature matrix of the port lock monitoring feature map is used to express the image semantic features of the port lock monitoring image, and each feature matrix has a channel association of the convolutional neural network model. In addition, after the port lock monitoring feature map passes through the denoising sparsifier based on the position mask module to obtain the denoised port lock monitoring feature map, and the denoised port lock monitoring feature map passes through the local information efficient modeling module to obtain the local significant port lock monitoring feature map, the image semantic feature spatial distribution of each feature matrix of the local significant port lock monitoring feature map will be further enhanced, but at the same time, it will also cause the channel distribution correlation between the feature matrices of the local significant port lock monitoring feature map to deteriorate, so that when the local significant port lock monitoring feature map is subjected to classification regression training by the classifier, the local significant port lock monitoring feature map has poor regression constraints relative to the overall distribution of the classifier, affecting the accuracy of the classification result.
[0044] In a preferred example, the fault detection subunit includes: flattening the local significant port lock monitoring feature map to obtain a local significant port lock monitoring feature vector; calculating the point sum of the local significant port lock monitoring feature vector and the square root of the length of the local significant port lock monitoring feature vector and the inverse of the square root of the two norm of the local significant port lock monitoring feature vector to obtain a local significant port lock monitoring semantic offset feature vector; calculating the exponential function of the local significant port lock monitoring semantic offset feature vector with a natural constant as the base to obtain a local significant port lock monitoring semantic offset prediction feature vector; calculating the point product of the local significant port lock monitoring feature vector and the one norm of the local significant port lock monitoring feature vector and a weight hyperparameter to obtain a local significant port lock monitoring semantic constraint feature vector; calculating the point sum of the local significant port lock monitoring semantic offset prediction feature vector and the local significant port lock monitoring semantic constraint feature vector to obtain an optimized local significant port lock monitoring feature vector; and passing the optimized local significant port lock monitoring feature vector through the classifier to obtain the classification result.
[0045] In the above preferred example, the structured norm representation of the local significant port lock monitoring feature vector is used as the local canonical coordinate for each eigenvalue of the local significant port lock monitoring feature vector to determine the class rotation offset prediction direction of the vector overall distribution representation of the local significant port lock monitoring feature vector relative to the eigenvalue for each eigenvalue of the local significant port lock monitoring feature vector as the center, and the bounding box of the vector eigenvalue distribution of the local significant port lock monitoring feature vector is used for eigenvalue constraint to improve the constraint of the local significant port lock monitoring feature vector under the overall regression distribution, thereby improving the training speed of the model and the accuracy of the classification result obtained by the local significant port lock monitoring feature vector through the classifier. In this way, real-time detection and remote control of the fault and abnormal state of the port lock can be realized based on the Internet of Things technology, so as to timely discover and handle the abnormal situation of the port lock, improve the intelligence level of the port lock, and also improve the reliability and safety of the port lock.
[0046] In summary, the port lock real-time monitoring system 100 based on the Internet of Things technology according to the embodiment of the present application is explained, which can improve the reliability and security of the port lock.
[0047] As described above, the port lock real-time monitoring system 100 based on the Internet of Things technology according to the embodiment of the present application can be implemented in various terminal devices, such as a server with a port lock real-time monitoring algorithm based on the Internet of Things technology according to the embodiment of the present application. In an example, the port lock real-time monitoring system 100 based on the Internet of Things technology according to the embodiment of the present application can be integrated into the terminal device as a software module and / or a hardware module. For example, the port lock real-time monitoring system 100 based on the Internet of Things technology according to the embodiment of the present application can be a software module in the operating system of the terminal device, or can be an application developed for the terminal device; of course, the port lock real-time monitoring system 100 based on the Internet of Things technology according to the embodiment of the present application can also be one of the many hardware modules of the terminal device.
[0048] Alternatively, in another example, the port lock real-time monitoring system 100 based on the Internet of Things technology according to the embodiment of the present application and the terminal device may also be separate devices, and the port lock real-time monitoring system 100 based on the Internet of Things technology may be connected to the terminal device via a wired and / or wireless network, and transmit interactive information in accordance with an agreed data format.
[0049] Figure 3 Flow chart of the real-time monitoring method of port lock based on Internet of Things technology according to an embodiment of the present application. Figure 3As shown, according to the real-time monitoring method of the port lock based on the Internet of Things technology according to the embodiment of the present application, it includes: S110, when the operation and maintenance personnel need to unlock the port lock, send an unlock request to the port lock through the authorization module of the Internet of Things platform; S120, in response to the application of the port lock receiving the unlock request, send the unlock information to the Internet of Things platform; S130, forward the unlock information to the hardware of the port lock through the Internet of Things platform to realize the unlocking of the physical port; and, S140, automatically save the unlock record to the log recording application through the application of the port lock.
[0050] In a specific example, the real-time monitoring method for a port lock based on the Internet of Things technology also includes an abnormal situation monitoring step, which includes: receiving a port lock monitoring image captured by a camera; performing feature extraction on the port lock monitoring image through a port lock area feature extractor based on a deep neural network model to obtain a port lock monitoring feature map; passing the port lock monitoring feature map through a denoising sparsifier based on a position mask module to obtain a denoised port lock monitoring feature map; passing the denoised port lock monitoring feature map through a local information efficient modeling module to obtain a locally significant port lock monitoring feature map as the locally significant port lock monitoring feature; and, based on the locally significant port lock monitoring feature, determining whether the port lock has a fault.
[0051] Here, those skilled in the art can understand that the specific operations of each step in the above-mentioned port lock real-time monitoring method based on the Internet of Things technology have been referred to above. Figure 1 to Figure 2 The description of the port lock real-time monitoring system 100 based on the Internet of Things technology has been introduced in detail, and therefore, its repeated description will be omitted.
[0052] Figure 4 FIG. 1 is an application scenario diagram of a port lock real-time monitoring system based on Internet of Things technology according to an embodiment of the present application. Figure 4 As shown, in this application scenario, first, a port lock monitoring image (for example, Figure 4 D), then, the port lock monitoring image is input to a server (for example, Figure 4 In S) as shown in , the server can use the port lock real-time monitoring algorithm based on the Internet of Things technology to process the port lock monitoring image to obtain a classification result for indicating whether the port lock is faulty.
[0053] It should be understood that physical port security is a very important part of network security strategy. Its main task is to protect the physical connections of network devices, including the ports, cables and connection devices of network devices.
[0054] Common device ports include the following categories: 1. USB port: Universal Serial Bus (Universal Serial Bus) is a communication interface between a computer and external devices. USB ports include USB Type-A, USB Type-B, USB Type-C, USB Micro-B and other interface types, which are suitable for various types of devices. 2. HDMI port: HDMI (High Definition Multimedia Interface) is a digital interface for video and audio signal transmission. HDMI port is mainly used to connect monitors, TVs, projectors, audio and other devices. 3. VGA port: VGA (Video Graphics Array) is an analog signal interface, mainly used to connect VGA monitors, projectors and other devices. 4. DVI port: DVI (Digital Video Interface) is a digital interface for transmitting video signals. DVI interface includes two types: DVI-D (digital signal) and DVI-A (analog signal). 5. RJ-45 port: RJ-45 (twisted pair Ethernet port) is an interface for connecting Ethernet devices. RJ-45 port is mainly used to connect routers, switches, hubs, network cards and other devices. 6. Thunderbolt port: Thunderbolt is a high-speed interface that supports data transmission, video transmission and charging functions. Thunderbolt port is mainly used to connect Mac computers, docking stations, hard drives and other devices. 7. DisplayPort port: DisplayPort is a digital video interface, mainly used to connect monitors, TVs and other devices. 8. Fiber optic port: Fiber optic ports are mainly used for high-speed data transmission, such as fiber optic Ethernet, fiber optic SDH, etc. 9. Ethernet port: Network card ports are used to connect network devices such as routers, switches, hubs, etc. 10. Audio interface: Audio interfaces include headphone jacks, microphone jacks, audio line input / output and other types, which are used to connect audio devices. In short, physical port security is a very important aspect of network security, and comprehensive security measures need to be taken to ensure the security of device and network connections.
[0055] The importance of IoT device port locks includes: 1. Effectively protect the inside of the device: Physical ports are the main channels for devices to connect to other systems or devices. If these ports are not effectively blocked, they may become the entrance for malicious attackers to enter the inside of the device. By blocking physical ports, the hardware and software inside the device can be effectively protected. 2. Enhance system security: Blocking physical ports helps prevent unauthorized access and malicious attacks. By preventing attackers from entering the inside of the device, the risk of device attacks can be reduced and the security of device data can be protected. 3. Prevent external attacks: Blocking physical ports can prevent unauthorized external access. This helps to ensure that the enterprise network is protected from external attackers and protect the security of enterprise data and systems. 4. Reduce security risks: Physical port blocking helps reduce device security risks. By placing physical ports within a safe range, attackers can be effectively prevented from using the device's ports to attack. 5. Simplify maintenance and management: Blocking physical ports helps simplify the maintenance and management of devices. This allows enterprises to focus more on other aspects of network security, such as application security, authentication, and access control. 6. Improve device availability: Blocking physical ports prevents devices from failing to work properly due to attacks. This helps to improve device availability and reduce business interruptions due to device failures. 7. Adapt to the changing threat environment: As the network threat environment continues to change, enterprises need to take corresponding security measures to deal with new threats. Blocking physical ports helps enterprises maintain security and stability in the face of the changing threat environment. In short, blocking physical ports is of great significance in terms of device security. Enterprises should attach importance to blocking physical ports of equipment and formulate corresponding security policies and measures to ensure the security of equipment and networks.
[0056] The IoT port lock uses a combination of hardware and software to monitor the physical port of the device in real time, allowing operation and maintenance personnel to authorize unlocking, automatically save records, automatically record work orders, and remind alarm events. The IoT port lock uses a combination of hardware and software to monitor the physical port of the device in real time, authorize unlocking, automatically save records, automatically record work orders, and remind alarm events.
[0057] Specifically, the hardware part includes: IoT devices: such as smart gateways or routers, used to connect all port locks and receive and forward data; port lock hardware: such as physical port locks, used to control the switch of physical ports; IoT keys: with IoT management functions, which detect the corresponding authorization when unlocking, and issue an alarm if there is a mismatch with the port lock to remind the management personnel.
[0058] Regarding the software part, it includes: Internet of Things platform: used to manage Internet of Things devices, port locks and other related equipment; port lock application: used to monitor the status of the physical port in real time, including whether it is authorized to unlock; logging application: used to store all unlocking events that are automatically recorded for easy traceability; work order system: used to record and manage unlocking requests, including requester, request time, unlocking status, etc.; alarm system: used to send alarm reminders to relevant personnel when abnormal situations occur (such as illegal unlocking, port lock failure, etc.).
[0059] When the operation and maintenance personnel need to unlock the port, they can use the authorization function on the IoT platform to send an unlock request to the port lock. After receiving the unlock request, the port lock application sends the unlock information to the IoT platform. The IoT platform forwards the unlock information to the port lock hardware to unlock the physical port. At the same time, the port lock application automatically saves the unlock record to the logging application.
[0060] During the operation and maintenance process, the work order system can be used to record and manage unlocking requests. The work order system can classify and query work orders according to time, personnel, equipment and other dimensions. At the same time, operation and maintenance personnel can view unlocking records and logs in the work order system for traceability and analysis. If an abnormal situation occurs, such as illegal unlocking, port lock failure, etc., the alarm system will issue an alarm reminder to the relevant personnel. Operation and maintenance personnel can view alarm events in the alarm system and take appropriate measures to deal with them. By combining hardware and software, real-time monitoring of IoT port locks, authorized unlocking, automatic record saving, automatic record of work orders and alarm event reminders can be achieved, thereby improving operation and maintenance efficiency and safety.
[0061] According to another aspect of the present application, a non-volatile computer-readable storage medium is provided, on which computer-readable instructions are stored. When the instructions are executed by a computer, the above-mentioned method can be executed.
[0062] The program part of the technology can be considered as a "product" or "manufactured product" in the form of executable code and / or related data, which is participated in or realized by computer-readable media. Tangible and permanent storage media can include any memory or storage used by any computer, processor, or similar device or related module. For example, various semiconductor memories, tape drives, disk drives or any similar devices that can provide storage functions for software.
[0063] The present application uses specific words to describe the embodiments of the present application. For example, "first / second embodiment", "one embodiment", and / or "some embodiments" refer to a certain feature, structure or characteristic related to at least one embodiment of the present application. Therefore, it should be emphasized and noted that "one embodiment" or "an embodiment" or "an alternative embodiment" mentioned twice or multiple times in different positions in this specification does not necessarily refer to the same embodiment. In addition, some features, structures or characteristics in one or more embodiments of the present application can be appropriately combined.
[0064] In addition, it will be appreciated by those skilled in the art that various aspects of the present application may be illustrated and described by a number of patentable categories or situations, including any new and useful process, machine, product or combination of substances, or any new and useful improvements thereto. Accordingly, various aspects of the present application may be performed entirely by hardware, entirely by software (including firmware, resident software, microcode, etc.), or by a combination of hardware and software. The above hardware or software may all be referred to as "data blocks", "modules", "engines", "units", "components" or "systems". In addition, various aspects of the present application may be represented as a computer product located in one or more computer-readable media, which includes computer-readable program code.
[0065] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by those of ordinary skill in the art to which this application belongs. It should also be understood that terms such as those defined in common dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an idealized or extremely formal sense, unless explicitly defined as such herein.
[0066] The above is an explanation of the present application and should not be considered as a limitation thereof. Although several exemplary embodiments of the present application are described, it will be readily understood by those skilled in the art that many modifications may be made to the exemplary embodiments without departing from the novel teachings and advantages of the present application. Therefore, all of these modifications are intended to be included within the scope of the present application as defined by the claims. It should be understood that the above is an explanation of the present application and should not be considered to be limited to the specific embodiments disclosed, and modifications to the disclosed embodiments and other embodiments are intended to be included within the scope of the appended claims. The present application is defined by the claims and their equivalents.
Claims
1. A port lock real-time monitoring system based on Internet of Things technology, characterized in that: include: The unlocking signal module is used to send an unlocking request to the port lock through the authorization module of the IoT platform when the operation and maintenance personnel need to unlock the lock; An unlock request detection and information sending module, configured to send unlock information to the Internet of Things platform in response to the port lock application receiving the unlock request; A physical port unlocking module, used to forward the unlocking information to the hardware of the port lock through the Internet of Things platform to unlock the physical port; An unlocking record saving module, used to automatically save the unlocking record to a log recording application via the port lock application; The system further includes an abnormal situation monitoring module, the abnormal situation monitoring module including: A port lock monitoring image acquisition unit, used for receiving a port lock monitoring image acquired by a camera; A port lock area feature extraction unit, configured to extract features from the port lock monitoring image by using a port lock area feature extractor based on a deep neural network model to obtain a port lock monitoring feature map; A port lock monitoring feature denoising unit, configured to pass the port lock monitoring feature graph through a denoising sparsifier based on a position mask module to obtain a denoised port lock monitoring feature graph; A port lock monitoring feature local manifestation unit, used for passing the denoised port lock monitoring feature graph through a local information efficient modeling module to obtain a local salient port lock monitoring feature graph as the local salient port lock monitoring feature; A port lock fault detection unit, configured to determine whether the port lock has a fault based on the locally significant port lock monitoring feature; The deep neural network model is a convolutional neural network model; The port lock monitoring feature noise reduction unit is used to: Processing the port lock monitoring feature map through a denoising sparsifier based on a position mask module using the denoising formula to obtain the denoised port lock monitoring feature map; Wherein, the noise reduction formula is: ; ; in, is the port lock monitoring characteristic diagram, is the threshold feature map, is the port lock monitoring characteristic diagram after noise reduction, is the characteristic value of each position in the port lock monitoring characteristic graph, is the feature value of each position in the threshold feature map, It means point multiplication by position. and is a hyperparameter, represents the condition set of the threshold function; The port lock monitoring feature local manifestation unit is used to: The noise-reduced port lock monitoring feature map is processed by a local information efficient modeling module using the following saliency formula to obtain the local saliency port lock monitoring feature map; The significant formula is: ; in, represents the port lock monitoring characteristic diagram after noise reduction, represents the local significant port lock monitoring feature map, express function, Indicates that a 3×3 convolution kernel is used for convolution processing. Indicates that a 1×1 convolution kernel is used for convolution processing; The port lock failure detection unit comprises: A fault detection subunit, used for passing the local significant port lock monitoring feature map through a classifier to obtain a classification result, wherein the classification result is used to indicate whether the port lock has a fault; The fault detection subunit comprises: An expansion secondary unit is used to expand the local salient port lock monitoring feature map into an optimized classification feature vector according to a row vector or a column vector; A fully connected encoding secondary unit, used for performing fully connected encoding on the optimized classification feature vector using the fully connected layer of the classifier to obtain an encoded classification feature vector; A classification secondary unit, used for inputting the encoded classification feature vector into the Softmax classification function of the classifier to obtain the classification result; The fault detection subunit is further used to: flatten the local significant port lock monitoring feature map to obtain a local significant port lock monitoring feature vector; calculate the point sum of the local significant port lock monitoring feature vector and the square root of the length of the local significant port lock monitoring feature vector and the inverse of the square root of the two norm of the local significant port lock monitoring feature vector to obtain a local significant port lock monitoring semantic offset feature vector; calculate the exponential function of the local significant port lock monitoring semantic offset feature vector with a natural constant as the base to obtain a local significant port lock monitoring semantic offset prediction feature vector; calculate the point product of the local significant port lock monitoring feature vector and the one norm of the local significant port lock monitoring feature vector and a weight hyperparameter to obtain a local significant port lock monitoring semantic constraint feature vector; calculate the point sum of the local significant port lock monitoring semantic offset prediction feature vector and the local significant port lock monitoring semantic constraint feature vector to obtain an optimized local significant port lock monitoring feature vector; pass the optimized local significant port lock monitoring feature vector through the classifier to obtain the classification result; The structured norm representation of the locally significant port lock monitoring feature vector is used as the local canonical coordinate for each eigenvalue of the locally significant port lock monitoring feature vector, the class rotation offset of the vector overall distribution representation of the locally significant port lock monitoring feature vector relative to the eigenvalue is determined, and the class offset prediction direction of each eigenvalue of the locally significant port lock monitoring feature vector as the center is determined, and the bounding box of the vector eigenvalue distribution of the locally significant port lock monitoring feature vector is used to constrain the eigenvalue, so as to improve the constraint of the locally significant port lock monitoring feature vector under the overall regression distribution.
