Network connection method, system and device, storage medium and computer program product
By receiving network resource parameters and applying reinforcement learning algorithms to calculate beacon frame scheduling strategy, dynamically adjusting the transmission frequency and power of beacon frames, solving the problems of waste of network resources and low distribution network efficiency caused by fixed configuration, and improving network connection efficiency and user experience.
Patent Information
- Application Number
- CN202411210002.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-30
- Publication Date
- 2024-11-19
AI Technical Summary
The existing beacon frame issuing frequency and power based on fixed configurations, and fails to consider changes in the network environment, resulting in waste of network resources and reduced distribution efficiency.
By receiving network resource parameters, a pre-trained reinforcement learning algorithm is used to calculate the beacon frame scheduling strategy, and dynamically adjust the transmission frequency, power and channel of the beacon frame to adapt to changes in the network environment.
It improves network connection efficiency, reduces resource waste, improves user experience, and optimizes the transmission strategy of beacon frames through dynamic adjustments to adapt to different time periods and network conditions.
Smart Images

Figure CN118984493A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of wireless Internet of Things, and in particular to a network connection method, system, device, storage medium and computer program product. Background Art
[0002] Since smart devices such as smart bulbs and network cameras have special hardware forms and do not have a human-computer interaction interface, users cannot directly enter the SSID (service set identifier) and password of the target network into the smart device, so it is necessary to configure the smart device. During the network configuration process, the access point (AP, such as a router) sends out beacon frames at a preset frequency. The beacon frame is used to broadcast the network information of the target network. After the smart device discovers the target network through the beacon frame, it initiates a request to query the AP information (SSID and password) of the target network, thereby realizing the configuration and access of the smart device.
[0003] However, the frequency and power of existing beacon frames are usually based on fixed configurations, which fail to take into account the impact of changes in the network environment. If beacon frames are always transmitted at a fixed frequency, it will cause a waste of network resources and reduce the efficiency of network distribution. Summary of the invention
[0004] The present application is proposed in view of the above problems, and provides a network connection method, system, device, storage medium and computer program product.
[0005] According to one aspect of the present application, a network connection method is provided, which is applied to a server, and the method includes:
[0006] Receiving a network resource parameter from an access point device, wherein the network resource parameter is used to characterize a resource congestion degree of a current network;
[0007] Based on the network resource parameters and the pre-trained reinforcement learning algorithm, obtaining a beacon frame scheduling strategy;
[0008] The beacon frame scheduling policy is sent to the access point device.
[0009] In addition, the network connection method according to one aspect of the present application further includes: after sending the beacon frame scheduling strategy to the access point device, further including:
[0010] Receiving a verification request from the access point device, and acquiring device information of the terminal carried in the verification request;
[0011] Verify whether there is target device information matching the device information in the information repository, and obtain a verification result in response to the verification request;
[0012] The verification result is returned to the access point device.
[0013] In addition, the network connection method according to one aspect of the present application further includes: verifying whether there is target device information matching the device information in the information library, including:
[0014] Extracting feature data from the device information, and generating a device identification code based on the feature data;
[0015] Verify whether there is a target device identification code that is consistent with the device identification code in the information library.
[0016] In addition, the network connection method according to one aspect of the present application further includes: after obtaining the beacon frame scheduling strategy, it also includes:
[0017] At the beginning of the next scheduling period, obtaining multiple groups of network performance parameters from the access point device in the current scheduling period, where the collection time of any two groups of the network performance parameters is different;
[0018] When the change trend of the network performance represented by the multiple groups of network performance parameters is decreasing, a current beacon frame scheduling strategy is obtained based on the reinforcement learning algorithm and the current network resource parameters from the access point device, and the current beacon frame scheduling strategy is sent to the access point device.
[0019] According to another aspect of the present application, a network connection method is provided, which is applied to an access point device, and the method includes:
[0020] Receiving the beacon frame scheduling policy from the server;
[0021] The beacon frame is transmitted outwardly according to the beacon frame scheduling strategy, so that the terminal establishes a network connection with the access point device based on the beacon frame.
[0022] In addition, the network connection method according to another aspect of the present application further includes: after transmitting the beacon frame outward according to the beacon frame scheduling strategy, it also includes:
[0023] In a case where a point-to-point transmission link is established with the terminal, acquiring device information of the terminal based on the point-to-point transmission link;
[0024] receiving a query request from a terminal, and sending a verification request to the server when confirming that the query request carries an identification protocol field, wherein the verification request carries the device information, and the identification protocol field is used to indicate whether the terminal is consistent with a user account to which the access point device belongs;
[0025] receiving a verification result returned by the server in response to the verification request;
[0026] In a case where the verification result indicates that the terminal has passed the verification, configuration information is returned to the terminal in response to the query request, where the configuration information includes the name and password of the access point device.
[0027] According to another aspect of the present application, there is provided a network connection system, comprising:
[0028] The server is configured to receive network resource parameters from an access point device, wherein the network resource parameters are used to characterize the resource congestion level of the current network; obtain a beacon frame scheduling strategy based on the network resource parameters and a pre-trained reinforcement learning algorithm; and send the beacon frame scheduling strategy to the access point device;
[0029] The access point device is used to receive the beacon frame scheduling policy from the server; and transmit beacon frames outwardly according to the beacon frame scheduling policy, so that the terminal establishes a network connection with the access point device based on the beacon frame.
[0030] The terminal is used to receive the beacon frame transmitted by the access point device.
[0031] In addition, the network connection system according to another aspect of the present application further includes: extracting an identification field in the beacon frame when the beacon frame is received;
[0032] When the identification field indicates that the access point device supports a point-to-point transmission protocol, establishing a point-to-point transmission link between the terminal and the access point device;
[0033] A query request is sent to the access point device based on the point-to-point transmission link, and upon receiving configuration information returned by the access point device in response to the query request, a network connection is established with the access point device using the configuration information.
[0034] According to another aspect of the present application, a network connection device is provided, comprising:
[0035] A first receiving module, configured to receive a network resource parameter from an access point device, wherein the network resource parameter is used to characterize a resource congestion degree of a current network;
[0036] A calculation module, used to obtain a beacon frame scheduling strategy based on the network resource parameters and a pre-trained reinforcement learning algorithm;
[0037] A sending module, used to send the beacon frame scheduling policy to the access point device;
[0038] A second receiving module, used for receiving the beacon frame scheduling strategy from the sending module;
[0039] A policy execution module is used to transmit beacon frames according to the beacon frame scheduling policy, so that the terminal establishes a network connection with the access point device based on the beacon frame.
[0040] According to another aspect of the present application, a computer device is provided, including a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the method of the above aspect.
[0041] According to another aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method of the above aspect is implemented.
[0042] According to another aspect of the present application, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the method of the above aspect is implemented.
[0043] As described in detail below, according to a network connection method, system, device, storage medium and computer program product of an embodiment of the present application, the server receives network resource parameters representing the resource congestion level of the current network, applies the network resource parameters to a pre-trained reinforcement learning algorithm, and calculates a beacon frame scheduling strategy. The access point device can transmit beacon frames outward according to the beacon frame scheduling strategy, so that the terminal establishes a network connection with the access point device. The beacon frame scheduling strategy is calculated according to the resource congestion level of the current network, and the transmission frequency and power of the beacon frame can be adaptively adjusted to reduce the waste of resources caused by transmitting at a fixed frequency, which is conducive to improving network connection efficiency and user experience.
[0044] It is to be understood that both the foregoing general description and the following detailed description are exemplary, and are intended to provide further explanation of the technology as claimed. BRIEF DESCRIPTION OF THE DRAWINGS
[0045] By describing the embodiments of the present application in more detail in conjunction with the accompanying drawings, the above and other purposes, features and advantages of the present application will become more apparent. The accompanying drawings are used to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. In the accompanying drawings, the same reference numerals generally represent the same components or steps.
[0046] Figure 1 It is a flowchart illustrating a network connection method applied to a server according to an embodiment of the present application.
[0047] Figure 2It is a flowchart illustrating a network connection method applied to an access point device according to an embodiment of the present application.
[0048] Figure 3 It is a framework diagram illustrating the generation process of the beacon frame scheduling strategy according to the embodiment of the present application.
[0049] Figure 4 It is a framework diagram illustrating a P2P connection process according to an embodiment of the present application.
[0050] Figure 5 It is a framework diagram of the security verification process applied according to an embodiment of the present application.
[0051] Figure 6 It is a schematic diagram illustrating the structure of a network connection device according to an embodiment of the present application.
[0052] Figure 7 It is a schematic diagram illustrating the structure of a computer device according to an embodiment of the present application.
[0053] Figure 8 is a schematic diagram illustrating a computer program product according to an embodiment of the present application. DETAILED DESCRIPTION
[0054] In order to make the purpose, technical solution and advantages of the present application more obvious, the exemplary embodiments according to the present application will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited to the exemplary embodiments described here.
[0055] Since smart devices such as smart bulbs and network cameras have special hardware forms and do not have a human-computer interaction interface, users cannot directly enter the SSID (service set identifier) and password of the target network into the smart device, so it is necessary to configure the smart device. During the configuration process, the access point (AP, such as a router) sends out beacon frames at a preset frequency. The beacon frame is used to broadcast the network information of the target network. After the terminal discovers the target network through the beacon frame, it initiates a request to query the AP information (SSID and password) of the target network, thereby realizing the configuration and access of the smart device terminal.
[0056] However, the frequency and power of existing beacon frames are usually based on fixed configurations, which fail to take into account the impact of changes in the network environment. If beacon frames are always transmitted at a fixed frequency, it will cause a waste of network resources and reduce the efficiency of network distribution.
[0057] On the other hand, in the existing network configuration process, the smart device is triggered to start the network configuration mode through physical buttons, and a third-party device (such as a mobile phone or router) is also required to ensure that the third-party device sends the SSID and password of the target network to the terminal when connected to the target network. This is not only cumbersome but also inefficient.
[0058] In the above, a network connection method, system, device, storage medium and computer program product according to an embodiment of the present application are described with reference to the accompanying drawings. The server receives network resource parameters representing the resource congestion level of the current network, applies the network resource parameters to a pre-trained reinforcement learning algorithm, and calculates a beacon frame scheduling strategy. The access point device can transmit beacon frames outward according to the beacon frame scheduling strategy, so that the terminal establishes a network connection with the access point device. The beacon frame scheduling strategy is calculated according to the resource congestion level of the current network, and the transmission frequency and power of the beacon frame can be adaptively adjusted to reduce the waste of resources caused by transmitting at a fixed frequency, which is conducive to improving network connection efficiency and user experience.
[0059] By obtaining multiple groups of network performance parameters from access point devices in the current scheduling period, the impact of the beacon frame scheduling strategy on the network environment at this time can be determined. When the change trend of the network performance represented by the multiple groups of network performance parameters is decreasing, it indicates that the beacon frame scheduling strategy at this time cannot adapt to the current network environment. The beacon frame scheduling strategy needs to be updated so that the beacon frame is in a dynamic adjustment state to adapt to different time periods and network conditions, thereby improving the utilization efficiency of network resources and reducing unnecessary energy consumption.
[0060] To facilitate understanding of this embodiment, a network connection method disclosed in the embodiment of the present application is first introduced in detail. The execution subject of the network connection method provided in the embodiment of the present application is generally a computer device with certain computing capabilities, and the computer device includes, for example: a terminal device or a server or other processing device, and the terminal device can be a user equipment (User Equipment, UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (Personal DiTital Assistant, PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. In some possible implementations, the network connection method can be implemented by a processor calling a computer-readable instruction stored in a memory.
[0061] like Figure 1 As shown, it is a flowchart of a network connection method applied to a server provided in an embodiment of the present application, and the method includes S1-S3:
[0062] S1: Receive network resource parameters from an access point device.
[0063] Among them, access point devices such as smart gateways or routers, network resource parameters are used to characterize the resource congestion level of the current network. Specifically, network resource parameters include the terminal density, channel utilization rate and conflict rate of the current network environment. The channel congestion level can be judged based on the channel utilization rate and conflict rate.
[0064] S2: Obtain the beacon frame scheduling strategy based on network resource parameters and the pre-trained reinforcement learning algorithm.
[0065] The reinforcement learning algorithm may be any one of Q-Learning, SARSA, DQN, etc. Specifically, the beacon frame scheduling strategy includes the transmission frequency, transmission power, and transmission channel of the beacon frame. In this embodiment, the beacon frame scheduling strategy may also include transmission content.
[0066] For example, according to the resource congestion level of the current network, the beacon frame scheduling strategy includes the following scheduling contents:
[0067] (1) Adjust the transmission frequency of beacon frames: reduce the frequency to reduce channel congestion, or increase the frequency to enhance the terminal's recognition speed.
[0068] (2) Adjust the signal transmission power of the beacon frame: reduce the power to reduce interference, or increase the power to expand the coverage.
[0069] (3) Adjust the optimal transmission channel for beacon frames: Based on the congestion level of the channel, select the current channel to send the beacon frame, or select a more idle channel to send the beacon frame.
[0070] S3: Send a beacon frame scheduling policy to the access point device.
[0071] The server sends the beacon frame scheduling strategy to the access point device, and the access point device executes the beacon frame scheduling strategy.
[0072] Preferably, in this embodiment, after S2 obtains the beacon frame scheduling strategy, the step further includes:
[0073] S2.1: At the beginning of the next scheduling period, multiple groups of network performance parameters from access point devices in the current scheduling period are obtained, and the collection time of any two groups of network performance parameters is different.
[0074] After obtaining the beacon frame scheduling strategy, the current scheduling cycle is started. The cycle length of the scheduling cycle, such as 12 hours, 24 hours, etc., can be selected according to actual needs. Taking the cycle length of 24 hours as an example, it can be set to obtain network performance parameters once every hour. Specifically, the network performance parameters include throughput, jitter rate, response time, energy efficiency and other parameters that reflect network performance.
[0075] S2.2: When the change trend of the network performance represented by multiple groups of network performance parameters is decreasing, the current beacon frame scheduling strategy is obtained based on the reinforcement learning algorithm and the current network resource parameters from the access point device, and the current beacon frame scheduling strategy is sent to the access point device in S3.
[0076] If the change trend of the network performance represented by multiple groups of network performance parameters is decreasing, it means that the beacon frame scheduling strategy at this time can no longer adapt to the network environment and needs to be updated, that is, repeat S1-S2 to obtain the current beacon frame scheduling strategy.
[0077] When the change trend of the network performance represented by multiple groups of network performance parameters is upward, the server does not update the beacon frame scheduling strategy, which significantly improves the network resource utilization efficiency and user experience.
[0078] Preferably, in this embodiment, after S3 sends the beacon frame scheduling strategy to the access point device, the following steps are further included:
[0079] S4: Receive a verification request from the access point device, and obtain device information carried in the verification request.
[0080] The verification request is used to verify the legitimacy of the terminal, and the device information includes the terminal's MAC, SN, software version, hardware information, etc.
[0081] S5: Verify whether there is target device information matching the device information in the information database, and obtain a verification result in response to the verification request.
[0082] Specifically, the device information in the information database can be imported or uploaded by the manufacturer of the terminal device. For smart device terminals that require network configuration, the manufacturer will upload the device information to the information database for maintaining the device information and subsequent identity security verification processes.
[0083] The device information carried in the verification request is matched with the device information in the information database to determine whether the match is successful. Specifically, this embodiment provides a preferred solution:
[0084] Extract feature data from the device information carried in the verification request, generate a device identification code based on the feature data, and verify whether there is a target device identification code consistent with the device identification code in the information library. If so, the verification result is passed; if not, the verification result is failed.
[0085] After the manufacturer uploads the device information to the information database, the database can use deep learning algorithms to process the device information and generate a unique device identification code (or fingerprint code) as the basis for identity authentication, thereby improving the security of network access. After entering the verification process, it is only necessary to verify whether the device identification code matches, thereby enhancing the security of the system and its ability to prevent malicious devices.
[0086] S6: Return the verification result to the access point device.
[0087] like Figure 2 As shown, it is a flowchart of a network connection method applied to an access point device provided in an embodiment of the present application, and the method includes S1-S2:
[0088] S1: Receive the beacon frame scheduling strategy from the server.
[0089] S2: transmitting beacon frames according to the beacon frame scheduling strategy, so that the terminal establishes a network connection with the access point device based on the beacon frame.
[0090] Among them, the transmission content included in the beacon frame scheduling strategy may specifically include the following fields:
[0091] (1) OUI, used to identify the manufacturer ID of the access point device (such as a router);
[0092] (2) OUI Type, used to identify whether the access point device supports P2P (point-to-point transmission) connection, for example, OUI Type = 1, indicating support; OUI Type = 0, indicating not support;
[0093] (3) Capability: used to identify whether the access point device acts as a GC (Group Client) or a GO (P2P Group Owner).
[0094] This embodiment expands the beacon frame structure, adds the above three fields to the beacon frame, realizes richer network information broadcasting, and enhances the identification capability and discovery efficiency of terminals in the wireless network.
[0095] Preferably, in this embodiment, after S2, the following steps are further included:
[0096] S3: When a point-to-point transmission link is established with the terminal, device information of the terminal is acquired based on the point-to-point transmission link.
[0097] After receiving the beacon frame transmitted by the access point device, if the terminal confirms that the access point device supports P2P connection, a P2P connection (ie, a point-to-point transmission link) may be established with the access point device.
[0098] S4: receiving a query request from the terminal, and sending a verification request to the server when confirming that the query request carries an identification protocol field, wherein the verification request carries device information.
[0099] The terminal sends a query request to the access point device through a P2P connection, and the query request is used to query the configuration information of the access point device (such as SSID and password). Among them, the identification protocol field is used to characterize whether the terminal is consistent with the user account to which the access point device belongs. For example, the user account to which the access point device belongs is Company A. At this time, Company A needs to configure the network for a certain smart terminal (such as a printer). Then manual operation (such as using third-party devices such as mobile phones and computers) is required to add the printer information to Company A's account. After adding, a customized identification protocol field will be assigned to the printer's device information to characterize the printer as a terminal device under Company A's account. At this time, the query request sent by the printer carries the identification protocol field. Compared with the existing manual operation network configuration method, this embodiment only requires manual addition of the printer's information to Company A's account, and manual operation can be done remotely, without connecting to Company A's network, which is safer and more efficient.
[0100] S5: Receive the verification result returned by the server in response to the verification request.
[0101] S6: When the verification result indicates that the terminal has passed the verification, in response to the query request, configuration information is returned to the terminal, where the configuration information includes the name (SSID) and password of the access point device.
[0102] If the verification result indicates that the terminal has not passed the verification, no response is given to the query request, that is, no configuration information is returned to the terminal.
[0103] According to another aspect of an embodiment of the present application, a network connection system is provided, including:
[0104] The server is used to receive network resource parameters from an access point device, where the network resource parameters are used to characterize the resource congestion level of the current network; obtain a beacon frame scheduling strategy based on the network resource parameters and a pre-trained reinforcement learning algorithm; and send the beacon frame scheduling strategy to the access point device.
[0105] The access point device is used to receive the beacon frame scheduling strategy from the server; and transmit the beacon frame outward according to the beacon frame scheduling strategy, so that the terminal establishes a network connection with the access point device based on the beacon frame.
[0106] The terminal is used to receive the beacon frame transmitted by the access point device.
[0107] The terminal is also used for the following steps:
[0108] 1) When a beacon frame is received, extract the identification field in the beacon frame.
[0109] In combination with the above embodiment, the identification field may be OUI Type.
[0110] 2) When the identification field indicates that the access point device supports P2P (point-to-point transmission protocol) connection, a P2P connection (point-to-point transmission link) is established between the terminal and the access point device.
[0111] Specifically, the P2P connection is used to exchange data information before establishing a network connection.
[0112] 3) Sending a query request to the access point device based on the point-to-point transmission link, and upon receiving configuration information returned by the access point device in response to the query request, establishing a network connection with the access point device using the configuration information.
[0113] The terminal of this embodiment operates in P2P GC and STA (station) concurrent modes. In the network configuration stage, the terminal operates in P2P GC mode. After establishing a P2P connection, the terminal sends a query request to the access point device. The query request is used to query the configuration information (i.e., SSID and password) of the access point device. After receiving the configuration information returned by the access point device, the terminal switches to STA mode, establishes a network connection with the access point device through the SSID and password, and enters a normal working mode.
[0114] The embodiment of the present application provides a network connection method, which involves a server (cloud platform), an access point device (AP, such as a router) and a terminal. The network connection method provided in the embodiment of the present application specifically includes the following steps:
[0115] Step 1: The cloud platform generates a beacon frame scheduling policy, and the router transmits beacon frames based on the beacon frame scheduling policy issued by the cloud platform.
[0116] Combination Figure 3 The generation process framework diagram of the beacon frame scheduling strategy shown in the figure, step 1 includes the following steps:
[0117] Step 1.1: Environmental perception and data collection module: Collect network resource parameters that characterize the resource congestion level of the current network, and upload the network resource parameters to the cloud platform.
[0118] The network resource parameters include terminal density (or quantity) and channel utilization rate and conflict rate, wherein the channel utilization rate and conflict rate are used to characterize the degree of congestion of the channel.
[0119] Step 1.2: Strategy calculation module: Calculate the beacon frame scheduling strategy based on network resource parameters and pre-trained reinforcement learning algorithm.
[0120] Among them, the reinforcement learning algorithm can be any one of the algorithms such as Q-Learning, SARSA, DQN, etc. According to the resource congestion level of the current network, the beacon frame scheduling strategy includes the following scheduling contents:
[0121] (1) Adjust the transmission frequency of beacon frames: reduce the frequency to reduce channel congestion, or increase the frequency to enhance the terminal's recognition speed.
[0122] (2) Adjust the signal transmission power of the beacon frame: reduce the power to reduce interference, or increase the power to expand the coverage.
[0123] (3) Adjust the optimal transmission channel for beacon frames: Based on the congestion level of the channel, select the current channel to send the beacon frame, or select a more idle channel to send the beacon frame.
[0124] Dynamically adjust the transmission frequency and content of beacon frames to adapt to different time periods and network conditions, thereby improving the utilization efficiency of network resources and reducing unnecessary energy consumption.
[0125] Step 1.3: Policy delivery module: delivers the beacon frame scheduling policy to the router.
[0126] Step 1.4: Strategy execution module: Based on the beacon frame scheduling strategy, adjust the transmission configuration of the beacon frame, such as transmission frequency, transmission power, transmission channel, etc.
[0127] Step 1.5: Enhanced beacon frame module: Generates a specific enhanced beacon frame according to the policy execution module and transmits it to the outside.
[0128] Among them, the enhanced beacon frame of the embodiment of the present application includes the following fields:
[0129] (1) Tag Number: This is a common field in existing beacon frames and will not be described in detail in this embodiment.
[0130] (2) Tag Length: This is a common field in existing beacon frames and will not be described in detail in this embodiment.
[0131] (3) OUI, used to identify the router's manufacturer ID.
[0132] (4) OUI Type: used to identify whether the router supports P2P connection. For example, OUI Type = 1 indicates support; OUI Type = 0 indicates no support.
[0133] (5) Capability: used to identify whether the router acts as a GC (Group client) or a GO (P2P Group Owner).
[0134] This embodiment expands the beacon frame structure and adds fields (3) to (5) to the beacon frame, thereby achieving richer network information broadcasting and enhancing the identification capability and discovery efficiency of terminals in the wireless network.
[0135] Step 1.6: Network status monitoring module: The router collects multiple sets of network performance parameters and sends the multiple sets of network performance parameters to the cloud platform.
[0136] Specifically, the network performance parameters include parameters reflecting network performance indicators such as throughput, latency, energy consumption rate, etc. It should be noted that after obtaining the beacon frame scheduling strategy, the current scheduling cycle is started. The cycle length of the scheduling cycle is, for example, 12 hours, 24 hours, etc. Taking the cycle length of 12 hours as an example, it can be set to obtain network performance parameters once every 1 hour. The specific time interval and cycle length can be selected according to actual needs.
[0137] Step 1.7: At the beginning of the next scheduling period, when the change trend of the network performance represented by the multiple groups of network performance parameters is decreasing, the beacon frame scheduling strategy is updated to obtain the current beacon frame scheduling strategy.
[0138] If the change trend of the network performance represented by the multiple groups of network performance parameters is decreasing, it means that the beacon frame scheduling strategy at this time can no longer adapt to the current network environment and needs to be updated.
[0139] Step 1.8: Send the current beacon frame scheduling policy to the policy execution module of the router, and repeat steps 1.4 to 1.8.
[0140] The introduction of reinforcement learning algorithm enables the access point devices (AP) in the network to autonomously learn and optimize the beacon frame scheduling strategy, dynamically adjust the broadcast frequency and content of the beacon frame to adapt to different time periods and network conditions, thereby improving the utilization efficiency of network resources and reducing unnecessary energy consumption.
[0141] Step 2: Add the terminal information to the target user account.
[0142] Among them, the target user account is the user account of the router. The terminal information can be added to the target user account through manual operation with the help of a third-party device (such as a mobile phone). This process can be operated remotely, and the mobile phone can be successfully added without being connected to the wireless network of the router, which reduces the user operation threshold and is safer and more efficient. After the terminal information is added to the target user account, an identification protocol field can be allocated or configured for the terminal. The query request sent by the terminal will carry this identification protocol field to indicate that the user account to which the terminal belongs is consistent with that to the access point device, simplifying the user configuration process and realizing an automated process and secure private data transmission.
[0143] Step 3: Based on the beacon frame, the terminal establishes a P2P connection with the router.
[0144] Combination Figure 4 In the P2P connection process framework diagram shown, step 3 includes the following steps:
[0145] Step 3.1: Monitoring module: detect the network configuration status of the terminal. If it is not configured, enable WiFi P2P; and receive the beacon frame transmitted by the P2P GO (router). Based on the identification field OUI Type in the beacon frame, confirm whether the router supports P2P connection.
[0146] Step 3.2: P2P Client module: establishes a P2P connection with the P2P GO module of the router.
[0147] Among them, the P2P GO module is responsible for implementing the Group Owner function in P2P, establishing a P2P connection with the terminal, and supporting the DHCP function to allocate IP to the terminal. The P2P protocol stipulates that the P2P Role negotiation must go through the scanning, monitoring, discovery, and negotiation stages. This process requires several cycles to negotiate the Owner and Client, which is time-consuming. This embodiment optimizes the P2P Group Owner negotiation process, sets the router as the P2P Group Owner, and shortens the negotiation process.
[0148] Step 4: After establishing the P2P connection, perform security verification on the terminal. Figure 5 In the security verification process framework diagram shown in FIG. 1 , step 4 includes the following steps:
[0149] Step 4.1: P2P Client module: Send the device information of the terminal to the router through the P2P connection; and send a query request to the router through the P2P connection.
[0150] The query request is encapsulated in a private protocol, that is, the query request carries an identification protocol field, which is used to indicate whether the terminal is consistent with the user account to which the access point device belongs. The device information includes MAC, SN, software version, hardware information, etc. The query request is used to query the configuration information of the router, such as SSID and password.
[0151] Step 4.2: Device information management module: collects the device information of the terminal through P2P connection; and, after receiving the query request from the terminal, parses the query request and sends a verification request to the cloud platform.
[0152] The verification request carries device information, which is used to verify whether the device information is legitimate.
[0153] Step 4.3: Device information management and authentication module: compare the device information with the device information in the information database and send the verification result to the router.
[0154] Specifically, the device information in the information database can be imported or uploaded by the manufacturer of the terminal device. For smart device terminals that require network configuration, the manufacturer will upload the device information to the information database for maintaining the device information and subsequent identity security verification processes.
[0155] The device information carried in the verification request is matched with the device information in the information database to determine whether the match is successful. Specifically, this embodiment provides a preferred solution:
[0156] Feature data is extracted from the device information carried in the verification request. Based on the feature data, a deep learning algorithm is used to generate a device identification code. The verification information library is verified to see whether there is a target device identification code that is consistent with the device identification code. If so, the verification result is passed. If not, the verification result is failed.
[0157] After the manufacturer uploads the device information to the information database, the information database can use deep learning algorithms to process the device information and generate a unique device identification code (or fingerprint code) as the basis for identity authentication, which improves the security of network access. After entering the verification process, it only needs to verify whether the device identification code matches, which improves the response efficiency. The cloud platform maintains the device fingerprint database to achieve unified management and identification across devices.
[0158] Step 4.3: Verification request execution module: Receive the verification result in response to the verification request, and if the verification result indicates that the verification is passed, send the router's configuration information (SSID and password) to the terminal; if the verification result indicates that the verification is not passed, do not respond to the query request sent by the terminal.
[0159] Step 4.4: The terminal switches to STA working mode, establishes a network connection with the router based on the SSID and password, and enters normal working mode.
[0160] According to another aspect of the embodiment of the present application, a network connection device is provided, such as Figure 6 As shown, the device comprises:
[0161] A first receiving module 101 is used to receive a network resource parameter from an access point device, where the network resource parameter is used to characterize the resource congestion level of the current network;
[0162] A calculation module 102, configured to obtain a beacon frame scheduling strategy based on the network resource parameters and a pre-trained reinforcement learning algorithm;
[0163] The sending module 103 is used to send the beacon frame scheduling policy to the access point device;
[0164] A second receiving module 104, configured to receive the beacon frame scheduling strategy from the sending module;
[0165] The policy execution module 105 is configured to transmit a beacon frame according to the beacon frame scheduling policy, so that the terminal establishes a network connection with the access point device based on the beacon frame.
[0166] The network connection device is further used to: after sending the beacon frame scheduling strategy to the access point device, receive a verification request from the access point device, and obtain device information carried in the verification request;
[0167] Verify whether there is target device information matching the device information in the information repository, and obtain a verification result in response to the verification request;
[0168] The verification result is returned to the access point device.
[0169] In one or more embodiments, verifying whether there is target device information matching the device information in the information library includes:
[0170] Extracting feature data from the device information, and generating a device identification code based on the feature data;
[0171] Verify whether there is a target device identification code that is consistent with the device identification code in the information library.
[0172] The network connection device is further used to: after obtaining the beacon frame scheduling strategy, at the beginning of the next scheduling period, obtain multiple groups of network performance parameters from the access point device in the current scheduling period, and the collection time of any two groups of the network performance parameters is different;
[0173] When the change trend of the network performance represented by the multiple groups of network performance parameters is decreasing, a current beacon frame scheduling strategy is obtained based on the reinforcement learning algorithm and the current network resource parameters from the access point device, and the current beacon frame scheduling strategy is sent to the access point device.
[0174] The network connection device is further configured to: after transmitting the beacon frame outward according to the beacon frame scheduling strategy, in the case of establishing a point-to-point transmission link with the terminal, acquire the device information of the terminal based on the point-to-point transmission link;
[0175] receiving a query request from a terminal, and sending a verification request to the server when confirming that the query request carries an identification protocol field, wherein the verification request carries the device information, and the identification protocol field is used to indicate whether the terminal is consistent with a user account to which the access point device belongs;
[0176] receiving a verification result returned by the server in response to the verification request;
[0177] In a case where the verification result indicates that the terminal has passed the verification, configuration information is returned to the terminal in response to the query request, where the configuration information includes the name and password of the access point device.
[0178] The network connection device provided in the embodiment of the present application and the network connection method provided in the embodiment of the present application are based on the same inventive concept and have the same beneficial effects as the methods adopted, operated or implemented therein.
[0179] The present application also provides a computer device to execute the above network connection method. Figure 7 It shows a schematic diagram of a computer device provided by some embodiments of the present application. Figure 7 As shown, the computer device 8 includes: a processor 800, a memory 801, a bus 802 and a communication interface 803, wherein the processor 800, the communication interface 803 and the memory 801 are connected via the bus 802; the memory 801 stores a computer program that can be run on the processor 800, and when the processor 800 runs the computer program, the network connection method provided in any of the aforementioned embodiments of the present application is executed.
[0180] The memory 801 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk storage. The communication connection between the device network element and at least one other network element is realized through at least one communication interface 803 (which may be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. may be used.
[0181] The bus 802 may be an ISA bus, a PCI bus, or an EISA bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. The memory 801 is used to store programs, and the processor 800 executes the programs after receiving the execution instruction. The network connection method disclosed in any implementation of the embodiment of the present application may be applied to the processor 800, or implemented by the processor 800.
[0182] The processor 800 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 800. The above processor 800 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a ready-made programmable gate array (FPTA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in the embodiments of the present application can be directly embodied as a hardware decoding processor to be executed, or the hardware and software modules in the decoding processor can be executed. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 801, and the processor 800 reads the information in the memory 801 and completes the steps of the above method in combination with its hardware.
[0183] The computer device provided in the embodiment of the present application and the network connection method provided in the embodiment of the present application are based on the same inventive concept and have the same beneficial effects as the methods adopted, run or implemented therein.
[0184] An embodiment of the present application also provides a computer-readable storage medium corresponding to the network connection method provided in the aforementioned embodiment. The computer-readable storage medium is a CD on which a computer program (i.e., a computer program product) is stored. When the computer program is run by a processor, it will execute the network connection method provided in any of the aforementioned embodiments.
[0185] It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical or magnetic storage media, which are not listed here one by one.
[0186] The computer-readable storage medium provided in the above-mentioned embodiments of the present application and the network connection method provided in the embodiments of the present application are based on the same inventive concept and have the same beneficial effects as the methods adopted, run or implemented by the application programs stored therein.
[0187] The present application also provides a computer program product. Figure 8 The computer program product 600 carries a program code, namely a computer program 601. The instructions included in the computer program 601 can be used to execute the steps of the network connection method described in the above method embodiment. For details, please refer to the above method embodiment, which will not be repeated here.
[0188] The computer program product may be implemented in hardware, software or a combination thereof. In one optional embodiment, the computer program product is implemented as a computer storage medium. In another optional embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).
[0189] The basic principles of the present application are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present application are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present application. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, not for limitation, and the above details do not limit the present application to being implemented by adopting the above specific details.
[0190] The block diagrams of the devices, apparatuses, equipment, and systems involved in this application are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagram. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including", "comprising", "having", etc. are open words, referring to "including but not limited to", and can be used interchangeably with them. The words "or" and "and" used here refer to the words "and / or" and can be used interchangeably with them, unless the context clearly indicates otherwise. The words "such as" used here refer to the phrase "such as but not limited to", and can be used interchangeably with them.
[0191] Additionally, as used herein, "or" used in a list of items beginning with "at least one" indicates a separate list, so that, for example, a list of "at least one of A, B, or C" means A or B or C, or AB or AC or BC, or ABC (i.e., A and B and C). Furthermore, the word "exemplary" does not mean that the example described is preferred or better than other examples.
[0192] It should also be noted that in the system and method of the present application, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present application.
[0193] Various changes, substitutions, and modifications of the techniques described herein may be made without departing from the techniques of the teachings defined by the appended claims. Furthermore, the scope of the claims of this application is not limited to the specific aspects of the processes, machines, manufactures, compositions, means, methods, and actions described above. Currently existing or later to be developed processes, machines, manufactures, compositions, means, methods, or actions that perform substantially the same functions or achieve substantially the same results as the corresponding aspects described herein may be utilized. Thus, the appended claims include such processes, machines, manufactures, compositions, means, methods, or actions within their scope.
[0194] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present application. Therefore, the present application is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.
[0195] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present application to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.
Claims
1. A network connection method, characterized in that: Applied to a server, the method comprises: Receiving a network resource parameter from an access point device, wherein the network resource parameter is used to characterize a resource congestion degree of a current network; Based on the network resource parameters and a pre-trained reinforcement learning algorithm, obtaining a beacon frame scheduling strategy; The beacon frame scheduling policy is sent to the access point device.
2. The network connection method according to claim 1, characterized in that: After sending the beacon frame scheduling strategy to the access point device, the method further includes: Receiving a verification request from the access point device, and acquiring device information of the terminal carried in the verification request; Verify whether there is target device information matching the device information in the information repository, and obtain a verification result in response to the verification request; The verification result is returned to the access point device.
3. The network connection method according to claim 2, characterized in that: Verify whether there is target device information matching the device information in the information database, including: Extracting feature data from the device information, and generating a device identification code based on the feature data; Verify whether there is a target device identification code that is consistent with the device identification code in the information library.
4. The network connection method according to claim 1, characterized in that: After obtaining the beacon frame scheduling strategy, it also includes: At the beginning of the next scheduling period, obtaining multiple groups of network performance parameters from the access point device in the current scheduling period, where the collection time of any two groups of the network performance parameters is different; When the change trend of the network performance represented by the multiple groups of network performance parameters is decreasing, a current beacon frame scheduling strategy is obtained based on the reinforcement learning algorithm and the current network resource parameters from the access point device, and the current beacon frame scheduling strategy is sent to the access point device.
5. A network connection method, characterized in that: Applied to an access point device, the method comprises: Receiving the beacon frame scheduling policy from the server; The beacon frame is transmitted outwardly according to the beacon frame scheduling strategy, so that the terminal establishes a network connection with the access point device based on the beacon frame.
6. The network connection method according to claim 5, characterized in that: After transmitting the beacon frame outward according to the beacon frame scheduling strategy, the method further includes: In a case where a point-to-point transmission link is established with the terminal, acquiring device information of the terminal based on the point-to-point transmission link; receiving a query request from a terminal, and sending a verification request to the server when confirming that the query request carries an identification protocol field, wherein the verification request carries the device information, and the identification protocol field is used to indicate whether the terminal is consistent with a user account to which the access point device belongs; receiving a verification result returned by the server in response to the verification request; In a case where the verification result indicates that the terminal has passed the verification, configuration information is returned to the terminal in response to the query request, where the configuration information includes the name and password of the access point device.
7. A network connection system, characterized in that: include: The server is used to receive network resource parameters from the access point device, where the network resource parameters are used to characterize the resource congestion level of the current network; Based on the network resource parameters and a pre-trained reinforcement learning algorithm, obtaining a beacon frame scheduling strategy; Sending the beacon frame scheduling policy to the access point device; An access point device, configured to receive the beacon frame scheduling policy from the server; Transmitting a beacon frame outwardly according to the beacon frame scheduling strategy, so that the terminal establishes a network connection with the access point device based on the beacon frame; The terminal is used to receive the beacon frame transmitted by the access point device.
8. The network connection system according to claim 7, characterized in that: The terminal is also used for: Upon receiving the beacon frame, extracting an identification field in the beacon frame; When the identification field indicates that the access point device supports a point-to-point transmission protocol, establishing a point-to-point transmission link between the terminal and the access point device; A query request is sent to the access point device based on the point-to-point transmission link, and upon receiving configuration information returned by the access point device in response to the query request, a network connection is established with the access point device using the configuration information.
9. A computer device comprising a memory, a processor and a computer program stored in the memory, characterized in that: The processor executes the computer program to implement the method according to any one of claims 1 to 6.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.
11. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.
