Dual-mode carrier communication system and method based on security encryption ad hoc network

By adopting a dual-mode carrier communication system based on secure encryption ad hoc network in field applications, the problem of carrier network and frequency band interference, traditional serial communication not being IP-based and plug-and-play, and insufficient security transmission guarantee between terminal devices is solved, and the device plug-and-play, network deployment and management is simplified, data transmission efficiency is improved, and communication security and reliability are achieved.

CN119653362APending Publication Date: 2025-03-18NARI INFORMATION & COMM TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411777953.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-05
Publication Date
2025-03-18

AI Technical Summary

Technical Problem

In field applications, the increase in smart terminal devices leads to mutual interference between carrier networks and frequency bands. Traditional serial communication has not achieved IPization and plug-and-play, and secure transmission between terminal devices is insufficient.

Method used

It adopts a dual-mode carrier communication system based on secure encryption ad hoc network, combining ad hoc network technology, carrier communication technology, secure encryption technology and standardized protocols to provide a secure and reliable wireless communication solution. The system includes a main station unit, a communication channel unit and a collection unit. It uses GPRS/CDMA wireless public network channel, fiber optic channel and Ethernet channel for remote communication. It has a built-in security chip to realize bidirectional identity authentication and data encryption.

Benefits of technology

It realizes plug-and-play equipment, simplifies network deployment and management, improves data transmission efficiency and supports large-scale terminal devices, ensures the security and reliability of communications, and optimizes network performance through deep learning routing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119653362A_ABST
    Figure CN119653362A_ABST
Patent Text Reader

Abstract

The invention discloses a dual-mode carrier communication system and method based on a security encryption ad hoc network, and provides a solution capable of automatically constructing and maintaining network connection by combining an ad hoc network technology, a carrier communication technology, a security encryption technology and a standardized protocol. The system not only supports the plug and play of equipment and simplifies the network deployment and management, but also improves the data transmission efficiency and the capability of supporting large-scale terminal equipment by adopting the orthogonal frequency division multiplexing modulation technology and the IPv6 protocol; a built-in security chip and a domestic cryptographic algorithm are used for realizing strong and effective bidirectional identity authentication and data encryption, so that the security and the reliability of communication are ensured; the application of deep learning routing further optimizes the network performance, dynamically adjusts the optimal path according to the real-time network condition, and enhances the flexibility and robustness of the system. Generally speaking, the system significantly improves the stability and safety of broadband power line carrier communication, and provides solid technical support for smart power grid application scenarios.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of carrier communication technology, and in particular to a dual-mode carrier communication system and method based on a secure encrypted ad hoc network. Background Art

[0002] Ad hoc network refers to a network formed by nodes in the network without central control. The network topology can be star, mesh or hybrid. Nodes communicate through wireless connections. Ad hoc network technology enables the network to dynamically adapt to environmental changes without prior information and has strong flexibility and robustness. Carrier communication is a technology that uses carriers in the radio spectrum to transmit information. Common carrier communication technologies include frequency modulation (FM), amplitude modulation (AM) and orthogonal frequency division multiplexing (OFDM). These technologies can be selected according to the needs of the application scenario to improve the efficiency and reliability of data transmission. Data security is crucial in wireless communication, especially in ad hoc network environments. Due to the dynamic nature of the network topology, security risks are more prominent. Therefore, it is essential to use secure encryption technology to encrypt and authenticate data. Common secure encryption technologies include symmetric encryption algorithms (such as AES), asymmetric encryption algorithms (such as RSA) and digital signatures. Broadband power line carrier communication can play an important role in sensing connection communication and can realize various applications such as high-frequency data collection, remote monitoring, energy management, power analysis, and fault repair.

[0003] However, in on-site applications, there are still some difficult problems that have not been completely solved: with the increasing number of on-site intelligent terminal devices, there will be problems such as carrier networking and frequency band interference when coordinating multiple master nodes, which brings troubles to on-site construction and debugging; the carrier equipment as a whole is still based on traditional serial communication, and has failed to achieve true IP and plug-and-play, and is still quite far from intelligence; the secure transmission between a large number of terminal devices is not guaranteed. Summary of the invention

[0004] In view of the above existing problems, the present invention is proposed.

[0005] Therefore, the present invention provides a dual-mode carrier communication system and method based on secure encrypted ad hoc networking. By combining ad hoc networking technology, carrier communication technology, secure encryption technology and standardized protocols, it can provide a safe and reliable wireless communication solution that is suitable for various application scenarios, such as the Internet of Things, smart cities, etc.

[0006] In order to achieve the above object, the present invention provides the following technical solutions:

[0007] In the first aspect, the present invention provides a dual-mode carrier communication system based on a secure encrypted self-organizing network, including: a master station unit, including a local area network that is securely isolated from other systems and public network channels by a firewall, and is used to realize data transmission and reception between the master station unit and the collection unit through a wireless communication network; a communication channel unit, including a GPRS / CDMA wireless public network channel, a fiber optic channel and an Ethernet channel, and is used to realize remote communication channel selection between the master station unit and the collection unit by using a combination of HPLC and HRF as alternative modes; a collection unit, including a concentrator, a collector, a multi-function meter and related equipment of a user's electric energy meter, and is used to collect relevant data and communicate data with the master station unit.

[0008] As a preferred solution of the dual-mode carrier communication system based on secure encrypted ad hoc network described in the present invention, the device access process of the dual-mode carrier communication system includes:

[0009] When a new device needs to access the dual-mode carrier communication system network, it sends a specific request discovery signal to find an available network address. After receiving the request from the terminal node device, the proxy node in the network replies with an available IP address and a network configuration message;

[0010] After receiving the reply from the proxy node, the terminal node device selects the IP address provided therein and sends a confirmation message, wherein the confirmation message is to confirm the intention to use the address. After receiving the confirmation message, the proxy node node marks the selected IP address as batched;

[0011] When the terminal node leaves the network, it sends a message requesting release, and the proxy node releases the allocated IP address after receiving the message.

[0012] As a preferred solution of the dual-mode carrier communication system based on secure encrypted ad hoc network described in the present invention, wherein: the dual-mode carrier communication system adopts the IPV6 neighbor discovery protocol, and the IPV6 neighbor discovery protocol process includes:

[0013] The terminal node periodically sends neighbor requests and waits for neighbor message replies, wherein the terminal node sends messages containing IPv6 addresses through a special multicast address, and all nodes on the same link receive the multicast messages;

[0014] After receiving the multicast message, the target node generates a neighbor advertisement message and unicasts it to the terminal node, wherein the neighbor advertisement message includes its own link layer address;

[0015] After receiving the reply message from the target node, the terminal node extracts the link layer address of the target device from the reply message and stores the message in its neighbor cache.

[0016] As a preferred solution of the dual-mode carrier communication system based on secure encrypted self-organizing network described in the present invention, the dual-mode carrier communication system realizes two-way identity authentication and data encryption through an embedded security chip, the application layer message between the module and the main station unit adopts two-way identity authentication based on an asymmetric cryptographic algorithm, and security authentication and data integrity verification measures are taken for remote parameter settings and remote upgrade instructions from the main station, wherein domestic cryptographic algorithms SM1, SM2, and SM3 are adopted, and a security chip is used to realize the storage, management, and cryptographic operations of terminal keys.

[0017] In a second aspect, the present invention provides a dual-mode carrier communication method based on a secure encrypted self-organizing network, comprising: in HPLC dual-mode communication, each node perceives the surrounding environment based on the current state space, each node evaluates possible actions according to a neural network model, and selects an optimal action; after selecting the optimal action, the node forwards the data packet to the selected next-hop node, and calculates a reward based on the actual result after forwarding; the neural network parameters of the node are updated according to the reward, and the neural network parameters of the node reach a convergence state as the number of training times increases, thereby determining the optimal path of the data packet in the network.

[0018] As a preferred solution of the dual-mode carrier communication method based on secure encrypted ad hoc network described in the present invention, wherein: the determining the best path for a data packet in the network includes:

[0019] The network environment is represented by a directed graph G = (N, L), where N represents a set of finite nodes, and L represents a set of physical transmissions in the node set N. The routing process of the data packet is abstracted as a process starting from the source node, forwarded through multiple intermediate aggregation nodes, and finally reaching the destination router;

[0020] The average transmission of a data packet set is used as a mathematical quantitative indicator to measure the algorithm, and the transmission path with the minimum comprehensive metric value between the source nodes of the data packet is found according to the routing metric;

[0021] Reinforcement learning is designed as a framework based on partially observable Markov decision processes, and each routing node is equipped with a neural network model with the same construction;

[0022] For each routing node n, its state space consists of the destination address of the data packet to be forwarded at the head of the team, the size of the data packet, the observable local state information of the current node, and the information interacting with the neighboring nodes. Its action space is defined as the set of neighboring nodes of the current node n, which means that at the moment of routing decision, the node will select the most appropriate action based on its state space, that is, select a next-hop node to forward the data packet, and design a reward function to guide the iteration direction of the routing strategy.

[0023] As a preferred solution of the dual-mode carrier communication method based on secure encrypted ad hoc network described in the present invention, wherein: the determining the best path for a data packet in the network further includes:

[0024] Before the size information of the current data packet to be forwarded, the final destination address information of the current data packet to be forwarded, the historical forwarding decision information of k data of the current data packet to be forwarded, the final destination address information of m data packets in the cache queue following the current data packet to be forwarded, and the information of the neighbor node with the longest cache queue storing data packets to be forwarded among all neighbor nodes of the current routing node are input into the neural network, encoding processing is performed based on the total delay of the routing path.

[0025] As a preferred solution of the dual-mode carrier communication method based on secure encrypted ad hoc network described in the present invention, wherein: the determining the best path for a data packet in the network further includes:

[0026] Each node i in the encoding process has a similar neural network Q i and unique neural network parameters θ i , used as the Q function to estimate the value of the state-action correspondence, when the local state on node i is s, the hidden state is h and the decision of the agent is θ i When α action is taken on the data packet, the node i estimates the minimum cumulative delay required for the data packet to reach the final destination;

[0027] In each strategy round, the agent on each node n of the network will take out the data packet p to be forwarded from its cache queue and observe the network layout state information d p and E n , and obtain the shared information C of the node at the same time n , thereby combining the current state S on node n i :{d p ,p size ,E n ,C n} and hidden state h i , a forwarding action is performed based on the greedy algorithm strategy, so that the data packet p is forwarded to the corresponding neighbor node v i The current data packet p is forwarded to the corresponding node v i After that, the corresponding reward r i will be calculated and returned to node n;

[0028] The function Q on each node i It is used to estimate the cumulative delay of the current data packet being transmitted from node i to the destination node. After training, the parameters of the neural network of each node reach a convergence state as the number of training rounds increases.

[0029] In a third aspect, the present invention provides an electronic device, comprising:

[0030] Memory and processor;

[0031] The memory is used to store computer executable instructions, and the processor is used to execute the computer executable instructions. When the computer executable instructions are executed by the processor, the steps of the dual-mode carrier communication method based on a secure encrypted ad hoc network are implemented.

[0032] In a fourth aspect, the present invention provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the steps of the dual-mode carrier communication method based on a secure encrypted ad hoc network.

[0033] Compared with the prior art, the beneficial effects of the present invention are as follows: the present invention provides a dual-mode carrier communication system and method based on a secure encrypted ad hoc network, and provides a solution that can automatically build and maintain network connections by combining ad hoc network technology, carrier communication technology, secure encryption technology and standardized protocols. The system not only supports plug-and-play of devices, simplifies network deployment and management, but also improves data transmission efficiency and the ability to support large-scale terminal devices by adopting orthogonal frequency division multiplexing modulation technology and IPv6 protocol; moreover, the built-in security chip and the use of domestic cryptographic algorithms realize strong and effective two-way identity authentication and data encryption, ensuring the security and reliability of communication; in addition, the application of deep learning routing selection further optimizes network performance, dynamically adjusts the best path according to real-time network conditions, and enhances the flexibility and robustness of the system. In general, the system significantly improves the stability and security of broadband power line carrier communications, and provides solid technical support for application scenarios such as smart grids and the Internet of Things. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0035] Figure 1 A system architecture diagram of a dual-mode carrier communication system and method based on a secure encrypted ad hoc network according to an embodiment of the present invention;

[0036] Figure 2 A software architecture diagram of a dual-mode carrier communication system and method based on a secure encrypted ad hoc network according to an embodiment of the present invention;

[0037] Figure 3A schematic diagram of a node networking method of a dual-mode carrier communication system and method based on a secure encrypted ad hoc network according to an embodiment of the present invention;

[0038] Figure 4 A network topology diagram consisting of 6 nodes and 12 pairs of bidirectional links for a dual-mode carrier communication system and method based on a secure encrypted ad hoc network described in an embodiment of the present invention. DETAILED DESCRIPTION

[0039] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the drawings of the specification. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in the art without creative work should fall within the scope of protection of the present invention.

[0040] Example 1

[0041] Reference Figure 1-Figure 4 As an embodiment of the present invention, a dual-mode carrier communication system based on a secure encrypted ad hoc network is provided. By combining ad hoc network technology, carrier communication technology, secure encryption technology and standardized protocols, a solution capable of automatically building and maintaining network connections is provided, specifically including:

[0042] The master station unit includes a local area network that is securely isolated from other systems and public network channels by a firewall, and is used to send and receive data with the acquisition unit through a wireless communication network;

[0043] The communication channel unit includes a GPRS / CDMA wireless public network channel, an optical fiber channel and an Ethernet channel, and is used to realize the remote communication channel selection between the master station unit and the acquisition unit by adopting a mode in which HPLC and HRF are combined as alternatives to each other;

[0044] The collection unit, including the concentrator, collector, multi-function meter and related equipment of the user's electric energy meter, is used to collect relevant data and communicate data with the main station unit.

[0045] Specifically, Figure 1The main station unit of the system shown is generally a separate local area network, which is safely isolated from other systems and public network channels by firewalls to ensure the information security of the system; the communication channel refers to the remote communication channel between the system main station and the acquisition equipment, mainly including GPRS / CDMA wireless public network channels, optical fiber channels and Ethernet channels; the acquisition equipment generally refers to the related equipment for on-site acquisition, including concentrators, collectors, multi-function meters and user electric energy meters and other related equipment. Local communication is mainly power carrier, micro-power wireless and 485 bus, etc. The carrier signal also has a certain attenuation and signal distortion when propagating in the power line. During long-term transmission, the signal attenuation is more serious. When the radius of the station area is large or there are more meters, the collection rate will be greatly limited. However, by using the HPLC and HRF combination mode, the two channels can be alternative paths for each other, making full use of the characteristics of different channels to ensure communication and business reliability. Compared with HPLC single-mode and dual-mode communication, the concurrency capacity of dual-mode communication is increased from 5 to 20, and the dual-mode business bandwidth is increased by more than 40%, which can meet the needs of high-frequency acquisition business. Through broadcasting, aggregation and other strategies, HPLC and wireless communication can complement each other in power outage reporting services, and the missed reporting rate will be reduced to less than 1%.

[0046] Further, such as Figure 2 The following is a software architecture diagram of a dual-mode carrier communication system based on a secure encrypted ad hoc network, which specifically includes:

[0047] (1) APP layer: The APP layer includes meter reading business functions, supports 376.2 / 645 / 698 protocols, and supports products including concentrators, electric meters, and supports type I and type II collectors. At the same time, the APP layer also supports customers to develop other applications based on the interfaces provided by the SDK.

[0048] (2) Debugging tools: Debugging tools are a set of tools used for R&D debugging, field diagnosis, and operation and maintenance in PLC communication systems. They include R&D debugging tools, field maintenance tools, and meter reading business simulation software.

[0049] (3) MDM subsystem: MDM (Modem) is the abbreviation of the HP PLC communication module software basic platform, including chip driver, peripheral device driver, PLC communication, and operating system functions. It provides basic functions such as protocol stack, system, and driver for use by the APP layer. It mainly includes serial port, GPIO (General Purpose Input / Output), I2C (Inter-Integrated Circuit), CIPHER, SPI Flash, PLC channel transceiver, and operating system interface.

[0050] (4) TCP / IP layer: The TCP / IP protocol stack provides basic TCP / IP functions. The interface it provides to the upper layer is a simplified standard Socket-like interface and a standard Socket interface.

[0051] (5) MAC layer: The MAC protocol stack layer includes functional modules such as data transmission and reception, routing, and network management. The MAC protocol stack provides upper-layer application software with basic functions such as data transmission and reception, and network routing information query.

[0052] (6) Upgrade management: Upgrade management is responsible for the software upgrade function of the PLC network. It upgrades the STA modules added to the network through CCO and supports full network upgrades and single-point upgrades.

[0053] (7) System basic library (including OS, SAL, and DRV modules): The system basic library provides OS, DRV interfaces, NV management, DIAG channel, system resource management, software maintenance, and diagnostic functions.

[0054] ①OS provides basic operating system functions, including multi-task management, message management, etc. ②SAL provides MDM system adaptation and management functions, including software initialization, OS resource allocation and management, APP startup management, service channel management, diagnostic debugging channels and interfaces. ③DRV implements the underlying hardware driver, including PHY driver, IO driver, Flash, LED and other interface drivers.

[0055] (8) Peripheral driver layer: The peripheral driver layer provides customizable driver functions, including BOOT startup customization, IO application driver, etc. Users can customize the corresponding driver according to the needs of peripheral devices.

[0056] (9) Physical layer: The physical layer consists of the main chip plus necessary peripheral devices. Peripheral devices include PLC PHY, SPI Flash, MII (Media Independent Interface), JTAG (Joint Test Action Group), SPI (Serial Peripheral Interface), I2C (Inter-Integrated Circuit), GPIO module, etc.

[0057] Further, such as Figure 3 The device access process of the dual-mode carrier communication system shown includes:

[0058] When a new device needs to access the dual-mode carrier communication system network, it sends a specific request discovery signal to find an available network address. After receiving the request from the terminal node device, the proxy node in the network replies with an available IP address and network configuration message.

[0059] After receiving the reply from the proxy node, the terminal node device selects the IP address provided therein and sends a confirmation message, which confirms the intention to use the address. After receiving the confirmation message, the proxy node node marks the selected IP address as batched;

[0060] When the terminal node leaves the network, it sends a message requesting release. After receiving the message, the proxy node releases the allocated IP address.

[0061] It should be noted that through the above process, the device can dynamically obtain IP addresses and other network configuration messages without the need for manual settings by the user, thereby achieving flexible and efficient management of network node devices.

[0062] Furthermore, the dual-mode carrier communication system adopts the IPv6 neighbor discovery protocol, wherein the IPv6 neighbor discovery protocol process includes:

[0063] The terminal node periodically sends neighbor requests and waits for the neighbor's message reply. The terminal node sends the message containing the IPv6 address through a special multicast address. All nodes on the same link will receive the multicast message, but only the target node will respond to the message.

[0064] After receiving the multicast message, the target node generates a neighbor advertisement message and unicasts it to the terminal node, where the neighbor advertisement message contains its own link layer address;

[0065] After receiving the reply message from the target node, the terminal node extracts the link layer address of the target device from the reply message and stores this message in its neighbor cache.

[0066] Furthermore, the dual-mode carrier communication system realizes two-way identity authentication and data encryption through an embedded security chip. The application layer messages between the module and the main station unit adopt two-way identity authentication based on an asymmetric cryptographic algorithm. Security authentication and data integrity verification measures are taken for remote parameter settings and remote upgrade instructions from the main station. Domestic cryptographic algorithms SM1, SM2, and SM3 are used, and a security chip is used to realize the storage, management, and cryptographic operations of terminal keys.

[0067] It should be noted that the present invention provides a dual-mode carrier communication system and method based on a secure encrypted ad hoc network. By combining ad hoc network technology, carrier communication technology, secure encryption technology and standardized protocols, a solution that can automatically build and maintain network connections is provided. The system not only supports plug-and-play of devices, simplifies network deployment and management, but also improves data transmission efficiency and the ability to support large-scale terminal devices by adopting orthogonal frequency division multiplexing modulation technology and IPv6 protocol; moreover, the built-in security chip and the use of domestic cryptographic algorithms realize strong and effective two-way identity authentication and data encryption, ensuring the security and reliability of communication; in addition, the application of deep learning routing selection further optimizes network performance, dynamically adjusts the best path according to real-time network conditions, and enhances the flexibility and robustness of the system. In general, the system significantly improves the stability and security of broadband power line carrier communication, and provides solid technical support for application scenarios such as smart grids and the Internet of Things.

[0068] This embodiment also provides a dual-mode carrier communication method based on a secure encrypted ad hoc network, including:

[0069] In HPLC dual-mode communication, each node perceives the surrounding environment based on the current state space, and each node evaluates possible actions according to the neural network model and selects an optimal action;

[0070] After selecting the optimal action, the node forwards the data packet to the selected next-hop node and calculates the reward based on the actual result after forwarding;

[0071] The neural network parameters of the node are updated according to the reward. The neural network parameters of the node reach a convergence state as the number of training increases, thereby determining the optimal path for the data packet in the network.

[0072] It should be noted that a routing algorithm that integrates multiple network environment factors such as node load, link bandwidth, data packet size, routing path and historical decision-making is proposed using deep learning routing selection. According to the coexistence of wide and narrowband links in wireless networks, data packets of different sizes are transmitted with different link bandwidths at different times, and are sensitive to broadband resource consumption, a dual-mode communication routing algorithm is designed. The data transmission network is divided into two parts: nodes and physical links connecting adjacent nodes. The data packet routing problem in the network is the process in which the data packet is transmitted from the source node, then forwarded through the aggregation node in the network, and finally reaches the destination base station. The following is the mathematical modeling process of the routing problem:

[0073] Network environment: Use a directed graph G = (N, L) to represent the network environment, where N represents a set of finite nodes, and L represents a set of physical transmissions in the node set N, such as Figure 4The figure shows a network topology consisting of 6 nodes and 12 pairs of bidirectional links. Since the data routing is carried out in a wireless environment, and the relationship between the forwarding of data packets and the bandwidth of the link is considered, each link has a bandwidth identifier of a certain value. The bandwidth of the bidirectional link between node i and node j in the network is given by In the network topology, each data packet needs to be forwarded from its source node s to the destination node d, where s, d∈N, and s≠d. Finally, the number of data packets generated in the network follows a Poisson distribution.

[0074] Routing problem: The routing process of a data packet is abstracted as starting from the source node, being relayed through multiple intermediate aggregation nodes and finally reaching the destination router;

[0075] Optimization goal: Find the transmission path with the minimum comprehensive metric between the source nodes of the data packet based on some routing metrics, such as bandwidth, delay, and interference. This embodiment uses the average transmission T of the data packet set P as the mathematical quantitative indicator to measure the algorithm, where the average delay is Where p∈P represents a data packet in the data packet set, t p represents the total transmission delay of data packet p, and K represents the number of data packets in the data packet set P.

[0076] Reinforcement learning design: The model is based on the partially observable Markov decision process as the underlying mathematical principle. In the algorithm of this embodiment, the neural network of each node is constructed in the same way, but the weight parameters and routing strategies of the neural network model are indeed independent of each other.

[0077] State space of reinforcement learning: For each routing node n, its state space consists of the destination address of the data packet to be forwarded at the head of the team, the size of the data packet, the observable local state information of the current node, and the information interacting with neighboring nodes, denoted as S n :{d p ,p size ,E n ,C n}, where d p Indicates the destination address of the head packet p, p size Indicates the size of the packet at the head of the team, E n Represents the local state information of the system observable at the current node, C n Indicates the information obtained by the current node through interaction with neighboring nodes;

[0078] Action space of reinforcement learning: For each routing node n, define the action space of the current node as A n :V n , where V nRepresents the set of neighbor nodes on the current routing node n. At the routing decision time t, for the data packet p to be forwarded on the current node, it is only necessary to first obtain the state s of the current node from the node's state space t ∈S n , and then select a suitable action a from the action space of this node according to the current state t ∈A n implement.

[0079] Reward function of reinforcement learning: Since the reward function in reinforcement learning determines the iteration direction of the routing strategy, the optimization goal of this embodiment is to minimize the average delay T of the data packet set P. Therefore, the reward function of this embodiment is as follows: At the decision time t, for the data packet p to be forwarded on the current node, after executing action a t Afterwards, the rewards are:

[0080] r = log 10 q+l+1

[0081] Among them, q represents the queuing time of data packet p in the cache queue of the current node, l represents the transmission time of data packet p from the current node to the node with action a. t The corresponding transmission delay on the next hop node m is generally l = p size / B nm , where p size Indicates the size of the data packet p, B nm Indicates the bandwidth of the link between routing node n and routing node m.

[0082] Furthermore, before the size information of the current data packet to be forwarded, the final destination address information of the current data packet to be forwarded, the historical forwarding decision information of k data of the current data packet to be forwarded, the final destination address information of m data packets in the cache queue following the current data packet to be forwarded, and the information of the neighbor node with the longest cache queue storing the data packets to be forwarded among all neighbor nodes of the current routing node are input into the neural network, encoding processing is performed using the total delay of the routing path as a measure.

[0083] Furthermore, each node i in the encoding process has a similar neural network Q i and unique neural network parameters θ i , used as the Q function to estimate the value of the state-action correspondence, when the local state on node i is s, the hidden state is h and the decision of the agent is θ i When α action is taken on the data packet, the node i estimates the minimum cumulative delay required for the data packet to reach the final destination;

[0084] Furthermore, in each strategy round, the agent on each node n of the network will take out the data packet p to be forwarded from its cache queue and observe the network layout state information d p and E n , and obtain the shared information C of the node at the same time n , thereby combining the current state S on node n i :{d p ,p size ,E n ,C n} and hidden state h i , a forwarding action is performed based on the greedy algorithm strategy, so that the data packet p is forwarded to the corresponding neighbor node v i The current data packet p is forwarded to the corresponding node v i After that, the corresponding reward r i will be calculated and returned to node n, for transmitting the data packet to neighbor node v i After that, the estimated time formula of the total delay τ is as follows:

[0085]

[0086] Furthermore, the function Q on each node i It is used to estimate the cumulative delay of the current data packet being transmitted from node i to the destination node. After training, the parameters of the neural network of each node reach a convergence state as the number of training rounds increases.

[0087] This embodiment also provides an electronic device, which includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, an operator network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a dual-mode carrier communication method based on a secure encrypted self-organizing network is implemented. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covered on the display screen, or a button, trackball or touchpad set on the housing of the computer device, or an external keyboard, touchpad or mouse.

[0088] This embodiment also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the method proposed in the above embodiment is implemented.

[0089] The storage medium proposed in this embodiment and the method proposed in the above embodiment belong to the same inventive concept. The technical details not fully described in this embodiment can be referred to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0090] Through the above description of the implementation methods, the technicians in the relevant field can clearly understand that the present invention can be implemented by means of software and necessary general hardware, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, read-only memory (ReadOnly, Memory, ROM), random access memory (RandomAccess Memory, RAM), flash memory (FLASH), hard disk or optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform the methods of various embodiments of the present invention.

[0091] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

[0092] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of complete hardware embodiments, complete software embodiments, or embodiments in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code. The scheme in the embodiments of the present application can be implemented in various computer languages, for example, object-oriented programming language Java and literal scripting language JavaScript, etc.

[0093] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0094] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0095] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0096] Although the preferred embodiments of the present application have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0097] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A dual-mode carrier communication system based on a secure encrypted ad hoc network, characterized in that: include: The master station unit includes a local area network that is securely isolated from other systems and public network channels by a firewall, and is used to send and receive data with the acquisition unit through a wireless communication network; The communication channel unit includes a GPRS / CDMA wireless public network channel, an optical fiber channel and an Ethernet channel, and is used to realize the remote communication channel selection between the master station unit and the acquisition unit by adopting a mode in which HPLC and HRF are combined as alternatives to each other; The collection unit includes a concentrator, a collector, a multifunctional electric meter and related equipment of a user's electric energy meter, and is used to collect relevant data and communicate data with the master station unit.

2. The dual-mode carrier communication system based on secure encryption ad hoc network according to claim 1, characterized in that: The device access process of the dual-mode carrier communication system includes: When a new device needs to access the dual-mode carrier communication system network, it sends a specific request discovery signal to find an available network address. After receiving the request from the terminal node device, the proxy node in the network replies with an available IP address and a network configuration message; After receiving the reply from the proxy node, the terminal node device selects the IP address provided therein and sends a confirmation message, wherein the confirmation message is to confirm the intention to use the address. After receiving the confirmation message, the proxy node node marks the selected IP address as batched; When the terminal node leaves the network, it sends a message requesting release, and the proxy node releases the allocated IP address after receiving the message.

3. The dual-mode carrier communication system based on secure encryption ad hoc network according to claim 2, characterized in that: The dual-mode carrier communication system adopts the IPV6 neighbor discovery protocol, and the IPV6 neighbor discovery protocol process includes: The terminal node periodically sends neighbor requests and waits for neighbor message replies, wherein the terminal node sends messages containing IPv6 addresses through a special multicast address, and all nodes on the same link receive the multicast messages; After receiving the multicast message, the target node generates a neighbor advertisement message and unicasts it to the terminal node, wherein the neighbor advertisement message includes its own link layer address; After receiving the reply message from the target node, the terminal node extracts the link layer address of the target device from the reply message and stores the message in its neighbor cache.

4. The dual-mode carrier communication system based on secure encryption ad hoc network according to claim 3, characterized in that: The dual-mode carrier communication system realizes two-way identity authentication and data encryption through an embedded security chip. The application layer messages between the module and the main station unit adopt two-way identity authentication based on an asymmetric cryptographic algorithm. Security authentication and data integrity verification measures are taken for remote parameter settings and remote upgrade instructions from the main station. Domestic cryptographic algorithms SM1, SM2, and SM3 are adopted, and a security chip is used to realize the storage, management, and cryptographic operations of terminal keys.

5. A method for applying the dual-mode carrier communication system based on a secure encrypted ad hoc network as claimed in any one of claims 1 to 4, characterized in that: include: In HPLC dual-mode communication, each node perceives the surrounding environment based on the current state space, and each node evaluates possible actions according to the neural network model and selects an optimal action; After selecting the optimal action, the node forwards the data packet to the selected next-hop node, and calculates the reward based on the actual result after forwarding; The neural network parameters of the node are updated according to the reward, and the neural network parameters of the node reach a convergence state as the number of training times increases, thereby determining the optimal path of the data packet in the network.

6. The dual-mode carrier communication method based on a secure encrypted ad hoc network according to claim 5, characterized in that: Determining the best path for a data packet in a network includes: The network environment is represented by a directed graph G = (N, L), where N represents a set of finite nodes, and L represents a set of physical transmissions in the node set N. The routing process of the data packet is abstracted as a process starting from the source node, forwarded through multiple intermediate aggregation nodes, and finally reaching the destination router; The average transmission of a data packet set is used as a mathematical quantitative indicator to measure the algorithm, and the transmission path with the minimum comprehensive metric value between the source nodes of the data packet is found according to the routing metric; Reinforcement learning is designed as a framework based on partially observable Markov decision processes, and each routing node is equipped with a neural network model with the same construction; For each routing node n, its state space consists of the destination address of the data packet to be forwarded at the head of the team, the size of the data packet, the observable local state information of the current node, and the information interacting with the neighboring nodes. Its action space is defined as the set of neighboring nodes of the current node n, which means that at the moment of routing decision, the node will select the most appropriate action based on its state space, that is, select a next-hop node to forward the data packet, and design a reward function to guide the iteration direction of the routing strategy.

7. The dual-mode carrier communication method based on a secure encrypted ad hoc network according to claim 6, characterized in that: Determining the best path for a data packet in the network also includes: Before the size information of the current data packet to be forwarded, the final destination address information of the current data packet to be forwarded, the historical forwarding decision information of k data of the current data packet to be forwarded, the final destination address information of m data packets in the cache queue following the current data packet to be forwarded, and the information of the neighbor node with the longest cache queue storing data packets to be forwarded among all neighbor nodes of the current routing node are input into the neural network, encoding processing is performed based on the total delay of the routing path.

8. The dual-mode carrier communication method based on secure encrypted ad hoc network according to claim 7, characterized in that: Determining the best path for a data packet in the network also includes: Each node i in the encoding process has a similar neural network Q i and unique neural network parameters θ i , used as the Q function to estimate the value of the state-action correspondence, when the local state on node i is s, the hidden state is h and the decision of the agent is θ i When α action is taken on the data packet, the node i estimates the minimum cumulative delay required for the data packet to reach the final destination; In each strategy round, the agent on each node n of the network will take out the data packet p to be forwarded from its cache queue and observe the network layout state information d p and E n , and obtain the shared information C of the node at the same time n , thereby combining the current state S on node n i :{d p ,p size ,E n ,C n } and hidden state h i , based on the greedy algorithm strategy, a forwarding action is performed so that the data packet p is forwarded to the corresponding neighbor node v i The current data packet p is forwarded to the corresponding node v i After that, the corresponding reward r i will be calculated and returned to node n; The function Q on each node i It is used to estimate the cumulative delay of the current data packet being transmitted from node i to the destination node. After training, the parameters of the neural network of each node reach a convergence state as the number of training rounds increases.

9. An electronic device, comprising: Memory and processor; The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions. When the computer-executable instructions are executed by the processor, the steps of the dual-mode carrier communication method based on a secure encrypted ad hoc network as described in any one of claims 5 to 8 are implemented.

10. A computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the steps of the dual-mode carrier communication method based on a secure encrypted ad hoc network as claimed in any one of claims 5 to 8.