Information data security transmission method based on AI large model training
By using a method based on large AI models for training, information data transmission requests are filtered and allocated in real time, solving the problem of traffic surges on a single gateway caused by multiple requests and achieving efficient response of the information data transmission system.
Patent Information
- Application Number
- CN202411519994.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-29
- Publication Date
- 2025-12-12
- Estimated Expiration
- 2044-10-29
AI Technical Summary
When multiple similar data transmission requests arrive simultaneously, existing data transmission systems can cause a surge in traffic load on a single data transmission gateway, affecting request response speed.
The system employs a method based on large AI models for training, which receives and filters information data transmission requests in real time. Based on business attributes and correlation identification algorithms, the requests are distributed to multiple data transmission gateways, and traffic distribution is optimized by combining load balancing algorithms.
This effectively avoids a surge in traffic load on a single data transmission gateway, ensuring the request response speed and business performance of the information data transmission system.
Smart Images

Figure CN119402255B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The application relates to the technical field of data transmission, in particular to an information data safe transmission method based on AI large model training. BACKGROUND
[0002] When the existing information data transmission system performs information data transmission configuration of the subsystem access data transmission gateway, the adopted mode is to configure similar information data transmission to the same data transmission gateway. Although this mode is convenient for increasing and decreasing management of information data transmission, the simultaneous request problem of multiple information data transmission is not considered, which may cause the single data transmission gateway flow load to surge when the gateway system simultaneously receives multiple similar information data transmission requests, and the request response speed of the entire information data transmission system to the access equipment is affected. SUMMARY
[0003] To solve the above technical problems, the application provides an information data safe transmission method and system based on AI large model training, which solves the problem that when the gateway system simultaneously receives multiple similar information data transmission requests, the single data transmission gateway flow load surges, and the request response speed of the entire information data transmission system to the access equipment is affected.
[0004] To achieve the above purpose, the technical scheme adopted by the application is as follows:
[0005] An information data safe transmission method based on AI large model training, comprising:
[0006] Real-time receiving of information data transmission requests of all single devices, and elimination of illegal requests and invalid requests in the information data transmission requests to obtain valid requests;
[0007] The data transmission gateway receives the valid requests sent by the flow gateway, and routes the valid requests to the correct position;
[0008] Obtaining at least one single device accessing the information data transmission system, and based on the business attribute of the single device, the single device is split into a plurality of information data transmission businesses, and based on an information data transmission distribution algorithm, the data transmission gateway corresponding to each information data transmission business is determined, and the information data transmission registration is performed on the corresponding data transmission gateway;
[0009] If any valid requests pose a security risk, the system will authenticate the individual device corresponding to that valid request. If authentication is successful, the valid request will be sent to the data transmission gateway for execution. If authentication fails, the individual device corresponding to that valid request will be isolated from the network. Otherwise, each valid request will be sent to its respective data transmission gateway for execution.
[0010] Preferably, the information data transmission and allocation algorithm specifically includes:
[0011] Determine the packet restriction conditions based on the current number of data transmission gateways;
[0012] Based on the grouping constraints, several candidate business group allocation schemes are determined.
[0013] Based on the correlation identification algorithm, the business correlation index is determined for each candidate business group allocation scheme, and the candidate business group allocation scheme with the smallest business correlation index is determined as the optimal business group allocation scheme.
[0014] Based on the optimal business group allocation scheme, a load balancing algorithm is used to determine the information data transmission service corresponding to each data transmission gateway, and information data transmission registration is performed with the corresponding data transmission gateway.
[0015] Preferably, determining the packet restriction conditions based on the current number of data transmission gateways specifically includes:
[0016] Determine the current number of data transmission gateways n and the total number of information data transmission services m;
[0017] Generate n random numbers whose sum is m and greater than 1, and form an n-dimensional random array A, where A = {a1…a2}. i …a n}, a i This is the i-th random number generated;
[0018] Iterate through and generate all n-dimensional random arrays that meet the conditions, forming the grouping constraints.
[0019] Preferably, determining several candidate business group allocation schemes based on grouping constraints specifically includes:
[0020] Following the order i from 1 to n, randomly select a from all information data transmission services. i An information data transmission service, as a i The corresponding information data transmission service group is determined, and the information data transmission service group corresponding to all elements in the n-dimensional random array is obtained, thus completing a grouping action corresponding to the n-dimensional random array.
[0021] Repeat the grouping action corresponding to the n-dimensional random number set for several times until a new grouping scheme cannot be generated, complete the complete grouping action of the n-dimensional random number set;
[0022] Traverse all complete grouping actions of the n-dimensional random number set in the grouping restriction condition, and record all the obtained grouping schemes as candidate service group allocation schemes.
[0023] Preferably, the correlation identification algorithm specifically comprises:
[0024] Determine the information data transmission correlation index between each two of all information data transmission services;
[0025] Pair each information data transmission service in each information data transmission service group in the candidate service group allocation scheme, to obtain a plurality of information data transmission service pairs corresponding to the information data transmission service group;
[0026] Calculate the information data transmission service pairing correlation index of each information data transmission service group in the candidate service group allocation scheme based on the correlation calculation formula;
[0027] Average all information data transmission service pairing correlation indexes of the information data transmission service groups in the candidate service group allocation scheme, to obtain the service correlation index under the candidate service group allocation scheme;
[0028] The correlation calculation formula is:
[0029]
[0030] Wherein, G is the information data transmission service pairing correlation index, R j is the information data transmission correlation index of the jth pair of information data transmission services of the information data transmission service group, and J is the total number of information data transmission service pairs of the information data transmission service group.
[0031] Preferably, the specific steps of determining the information data transmission correlation index between each two of all information data transmission services are:
[0032] Let the information data transmission services to be calculated for the information data transmission correlation index be B x and B y
[0033] Determine the number of information data transmission requests in which B x appears, the number of information data transmission requests in which B y appears, and the number of information data transmission requests in which B x and B y appear simultaneously in the historical information data transmission request;
[0034] Then Bx and B y The information data transmission correlation index between B
[0035]
[0036] wherein, N x and B y The information data transmission correlation index between B x N x The number of information data transmission requests in which B xy N y The number of information data transmission requests in which B xy The number of information data transmission requests in which B x and B y The number of information data transmission requests in which B
[0037] Preferably, the load balancing algorithm is specifically:
[0038] determining the traffic load capacity of each data transmission gateway;
[0039] obtaining the frequency of occurrence of each information data transmission service in historical information data transmission requests;
[0040] determining the load demand of each information data transmission service;
[0041] randomly pairing each information data transmission service group in the optimal service group allocation scheme with each data transmission gateway to obtain a plurality of service pairing schemes;
[0042] calculating the load balancing index of each service pairing scheme based on the load balancing algorithm;
[0043] selecting the service pairing scheme with the smallest load balancing index as the optimal service pairing scheme;
[0044] determining the information data transmission service group corresponding to each data transmission gateway in the optimal service pairing scheme, and registering the information data transmission service group corresponding to the data transmission gateway to the data transmission gateway;
[0045] The load balancing algorithm is specifically:
[0046]
[0047] wherein, H is the load balancing index of the service pairing scheme, T i is the traffic load capacity of the i-th data transmission gateway, and f ka load demand of the kth information data transmission service in the information data transmission service group paired with the ith data transmission gateway in the service pairing scheme, p k a frequency of the kth information data transmission service in the information data transmission service group paired with the ith data transmission gateway in the service pairing scheme, b i a total number of information data transmission services in the information data transmission service group paired with the ith data transmission gateway in the service pairing scheme.
[0048] Further, an information data security transmission system based on AI large model training is proposed, which is used to implement the information data security transmission method based on AI large model training as described above, and includes:
[0049] The traffic gateway is used to receive information data transmission requests of all single devices in real time, and eliminate illegal requests and invalid requests, to obtain valid requests.
[0050] The data transmission gateway is connected with the traffic gateway at the input end, and connected with the information data transmission device application layer at the output end. The data transmission gateway is used to receive valid requests sent by the traffic gateway, and route the valid requests to the correct position.
[0051] The service registration module is electrically connected with the data transmission gateway. The service registration module is used to obtain at least one single device accessing the information data transmission system, and split each single device into a plurality of information data transmission services based on the service attributes of the single device. The information data transmission distribution algorithm is used to determine the corresponding data transmission gateway of each information data transmission service, and register the information data transmission with the corresponding data transmission gateway.
[0052] The security protection module is electrically connected with the traffic gateway. The security protection module is used to identify whether there is a valid request that causes a security risk in the valid request. If yes, the single device corresponding to the valid request is authenticated. If the authentication is passed, the valid request is sent to the data transmission gateway for execution. If the authentication is not passed, the single device corresponding to the valid request is network isolated. If no, each valid request is sent to each data transmission gateway for execution.
[0053] Optionally, the service registration module includes:
[0054] The limit setting unit is used to determine the grouping limit condition based on the current number of data transmission gateways.
[0055] A scheme allocation unit is configured to determine a plurality of candidate service group allocation schemes based on a grouping restriction condition;
[0056] A correlation calculation unit is configured to determine a service correlation index for each candidate service group allocation scheme based on a correlation identification algorithm, and determine a candidate service group allocation scheme with the minimum service correlation index as the optimal service group allocation scheme;
[0057] A load balancing unit is configured to determine an information data transmission service corresponding to each data transmission gateway based on the optimal service group allocation scheme using a load balancing algorithm, and register the information data transmission with the corresponding data transmission gateway.
[0058] Optionally, the security protection module comprises:
[0059] A risk identification unit is configured to identify whether there is an effective request that causes a security risk in the effective request;
[0060] An authentication unit is configured to authenticate a single device corresponding to the effective request that causes a security risk, and determine whether the single device corresponding to the effective request that causes a security risk has the permission corresponding to the effective request.
[0061] Compared with the prior art, the present application has the following advantages:
[0062] The present application provides an information data security transmission scheme based on AI large model training. Based on the probability of simultaneous request of various information data transmission services in the historical operation process of the information data transmission system, the information data transmission correlation index between each other in the information data transmission services is calculated, and the information data transmission services that are simultaneously requested are dispersed to multiple different data transmission gateways as much as possible based on the information data transmission correlation index between each other in the information data transmission services, so that when multiple similar information data transmissions are simultaneously requested, the simultaneous request response of multiple information data transmission services can be maintained, the situation of explosive increase of traffic load of a single data transmission gateway is avoided, the request response speed of the information data transmission system to the access device is ensured, and the service information data transmission level of the device cluster of the information data transmission system is improved. BRIEF DESCRIPTION OF DRAWINGS
[0063] Figure 1 The present application provides an information data security transmission method flow chart based on AI large model training.
[0064] Figure 2 The present application provides an information data transmission allocation algorithm method flow chart.
[0065] Figure 3 Method flow chart for determining packet restriction condition based on current number of data transmission gateway in the present application;
[0066] Figure 4 Method flow chart for determining several candidate service group allocation schemes based on packet restriction condition in the present application;
[0067] Figure 5 Method flow chart for correlation recognition algorithm in the present application;
[0068] Figure 6 Method flow chart for load balancing algorithm in the present application. DETAILED DESCRIPTION
[0069] The following description is provided to enable those skilled in the art to carry out the present application. The preferred embodiments in the following description are only examples and other obvious modifications can be made by those skilled in the art.
[0070] Referring to Figure 1 The informationization data security transmission method based on AI large model training comprises the following steps:
[0071] Real-time receive informationization data transmission request of all single devices, and eliminate illegal request and invalid request in it to obtain valid request;
[0072] The data transmission gateway receives the valid request sent by the traffic gateway, and routes the valid request to the correct position;
[0073] Obtain at least one single device accessing the informationization data transmission system, and based on the service attribute of the single device, split each single device into several informationization data transmission services, and determine the data transmission gateway corresponding to each informationization data transmission service based on the informationization data transmission allocation algorithm, and register the informationization data transmission with the corresponding data transmission gateway;
[0074] Identify whether there is an effective request that causes security risk in the valid request, if yes, then authenticate the single device corresponding to the effective request, if the authentication is passed, then send the effective request to the data transmission gateway for execution, if the authentication is not passed, then network isolate the single device corresponding to the effective request, if no, then send each valid request to each data transmission gateway for execution.
[0075] The scheme is based on the gateway system historical operation process, the probability of simultaneous request of various information data transmission services is calculated, the information data transmission correlation index between each other in the information data transmission service is calculated, and the information data transmission services that are simultaneously requested are dispersed to multiple different data transmission gateways as much as possible based on the information data transmission correlation index between each other in the information data transmission service, so that when multiple similar information data transmissions are simultaneously requested, the simultaneous request response of multiple information data transmission services can be maintained.
[0076] Referring to Figure 2 The information data transmission allocation algorithm specifically includes:
[0077] Based on the current number of data transmission gateways, a grouping limit condition is determined;
[0078] Based on the grouping limit condition, a plurality of candidate service group allocation schemes are determined;
[0079] Based on the correlation identification algorithm, the service correlation index under each candidate service group allocation scheme is determined, and the candidate service group allocation scheme with the minimum service correlation index is determined as the best service group allocation scheme;
[0080] Based on the best service group allocation scheme, a load balancing algorithm is used to determine the information data transmission services corresponding to each data transmission gateway, and the information data transmission is registered with the corresponding data transmission gateway.
[0081] The plurality of information data transmission services of the Internet of Things distributed access equipment are dynamically allocated and registered, the information data transmission services are divided into a corresponding number of groups based on the number of data transmission gateways, and the correlation identification algorithm is used to screen out the candidate service group allocation scheme with the minimum correlation index, so that the plurality of information data transmission services that are easily simultaneously requested are dispersed to multiple different data transmission gateways, and the load balancing method is used to configure multiple information data transmission services corresponding to the performance of the multiple data transmission gateways with different performances, so as to ensure the adaptation degree between the performance of the data transmission gateway and its load, and further realize the request response speed of the Internet of Things distributed multiple access equipment, and improve the information data transmission level of the Internet of Things cluster of the distributed access equipment.
[0082] Referring to Figure 3 Based on the current number of data transmission gateways, the grouping limit condition specifically includes:
[0083] The current number of data transmission gateways n and the total number of information data transmission services m are determined;
[0084] n random numbers with a total sum of m and greater than 1 are randomly generated to form an n-dimensional random array A, A={a1…an}, and the grouping limit condition is determined based on A. ia n},a i for generating the i-th random number;
[0085] All n-dimensional random arrays that meet the conditions are traversed to generate a group limit condition.
[0086] It can be understood that when performing informatization data transmission service division, in order to ensure full utilization of the data transmission gateway, it is necessary to allocate informatization data transmission services to each data transmission gateway, thereby ensuring the uniform dispersion of informatization data transmission services. Set n random numbers generated randomly with a total sum of m and greater than 1 to form an n-dimensional random array A. At the same time, in order to cover all possibilities when generating the scheme, set all n-dimensional random arrays that meet the conditions to be traversed to generate a group limit condition.
[0087] Referring to Figure 4 , based on the group limit condition, determining a plurality of candidate service group allocation schemes specifically includes:
[0088] According to the order of i from 1 to n, randomly extract a i number of informatization data transmission services from all informatization data transmission services as a i corresponding informatization data transmission service group, determine the informatization data transmission service group corresponding to all elements in the n-dimensional random array, and obtain a grouping scheme of the n-dimensional random array. Thus, the grouping action corresponding to the n-dimensional random array is completed once;
[0089] Repeat the grouping action corresponding to the n-dimensional random array several times until a new grouping scheme cannot be generated, and complete the complete grouping action of the n-dimensional random array;
[0090] Traverse all complete grouping actions of the n-dimensional random array in the group limit condition, and record all the obtained grouping schemes as candidate service group allocation schemes.
[0091] It can be understood that each n-dimensional random array corresponds to a plurality of different grouping schemes, and the best service group allocation scheme selected by traversing all n-dimensional random arrays and all grouping schemes is the best scheme under all grouping schemes.
[0092] Referring to Figure 5 , the correlation identification algorithm specifically includes:
[0093] Determine the informatization data transmission correlation index between each pair of informatization data transmission services in all informatization data transmission services;
[0094] Pair each pair of informatization data transmission services in each informatization data transmission service group in the candidate service group allocation scheme to obtain a plurality of informatization data transmission service pairs corresponding to the informatization data transmission service group;
[0095] Based on the correlation calculation formula, the informationization data transmission service group allocation scheme in each group of informationization data transmission service group allocation scheme is calculated.
[0096] The average value of all groups of informationization data transmission service group allocation scheme in the candidate service group allocation scheme is obtained.
[0097] The correlation calculation formula is:
[0098]
[0099] Wherein, G is the informationization data transmission service group allocation scheme, R j is the informationization data transmission correlation index of the jth pair of informationization data transmission service pair in the informationization data transmission service group, and J is the total number of informationization data transmission service pairs in the informationization data transmission service group.
[0100] The specific steps of determining the informationization data transmission correlation index between all informationization data transmission services are as follows:
[0101] The informationization data transmission service to be calculated is respectively recorded as B x and B y
[0102] The number of informationization data transmission requests of B x , the number of informationization data transmission requests of B y and the number of informationization data transmission requests of B x and B y in the historical informationization data transmission request are determined.
[0103] The informationization data transmission correlation index between B x and B y is:
[0104]
[0105] In the formula, is the informationization data transmission correlation index between B x and B y , N x is the number of informationization data transmission requests of B x in the historical informationization data transmission request, N xy is the number of informationization data transmission requests of B y in the historical informationization data transmission request, and N xy is the number of informationization data transmission requests of B x and B yThe number of times information data transmission requests are made.
[0106] It is understandable that in information data transmission services, the correlation index between two information data transmission services is the probability index of two information data transmission services being requested simultaneously. In this embodiment, the larger the information data transmission correlation index is, the greater the probability of two information data transmission services being requested simultaneously. Based on this, this solution uses the average value of the information data transmission correlation index of any two candidate service pairs in the candidate service group as the inter-group correlation of the information data transmission service group. By selecting the candidate service group with the smallest overall inter-group correlation, the optimal service group allocation scheme is selected, thereby ensuring that the information data transmission services requested simultaneously are distributed as much as possible to multiple different data transmission gateways, and ensuring that when multiple similar information data transmission services are requested simultaneously, the simultaneous request response of multiple information data transmission services can be maintained.
[0107] Reference Figure 6 As shown, the load balancing algorithm is as follows:
[0108] Determine the traffic load capacity of each data transmission gateway;
[0109] Obtain the frequency of occurrence of each type of information data transmission service in historical information data transmission requests;
[0110] Determine the load requirements for each type of information data transmission service;
[0111] Each information data transmission business group in the optimal business group allocation scheme is randomly paired with each data transmission gateway to obtain several business pairing schemes.
[0112] Based on the load balancing algorithm, calculate the load balancing metrics for each service pairing scheme.
[0113] Select the business pairing scheme with the lowest load balancing index as the best business pairing scheme;
[0114] In determining the optimal service pairing scheme, each data transmission gateway corresponds to an information data transmission service group, and the information data transmission service group corresponding to the data transmission gateway is registered to the data transmission gateway;
[0115] The load balancing algorithm is as follows:
[0116]
[0117] In the formula, H is the load balancing metric of the service pairing scheme, and T... i f represents the traffic load capacity of the i-th data transmission gateway. kLoad demand of the kth information data transmission service in the information data transmission service group paired with the ith data transmission gateway in the service pairing scheme, p k Occurrence frequency of the kth information data transmission service in the information data transmission service group paired with the ith data transmission gateway in the service pairing scheme, b i Total number of information data transmission services in the information data transmission service group paired with the ith data transmission gateway in the service pairing scheme.
[0118] In the present scheme, a load balancing algorithm is adopted to allocate information data transmission services in combination with the load demand and occurrence frequency of each information data transmission service and the traffic load capacity of the data transmission gateway, and the load balancing algorithm adopts As the nominal value of the load demand of the information data transmission service group at a single information data transmission request, the closer the value is to the traffic load capacity of the data transmission gateway, the more suitable the information data transmission service group is to the data transmission gateway, and the allocation of the information data transmission service group to the data transmission gateway can ensure the efficient and stable operation of the information data transmission service.
[0119] Further, based on the same inventive concept as the above information data security transmission method trained based on an AI large model, the present scheme further proposes an information data security transmission system based on an AI large model training, comprising:
[0120] Traffic gateway: the traffic gateway is used to receive information data transmission requests of all single devices in real time, and to eliminate illegal requests and invalid requests therein to obtain valid requests;
[0121] Data transmission gateway: the data transmission gateway input end is connected with the traffic gateway, the data transmission gateway output end is connected with the information data transmission device application layer, and the data transmission gateway is used to receive valid requests sent by the traffic gateway and route the valid requests to the correct position;
[0122] Service registration module: the service registration module is electrically connected with the data transmission gateway, and the service registration module is used to obtain at least one single device accessing the information data transmission system, to split each single device into a plurality of information data transmission services based on the service attributes of the single device, to determine the corresponding data transmission gateway of each information data transmission service based on an information data transmission allocation algorithm, and to register the information data transmission with the corresponding data transmission gateway;
[0123] The security protection module is electrically connected with the traffic gateway, and is used for identifying whether there is an effective request causing a security risk in the effective request, if yes, authenticating the single device corresponding to the effective request, if the authentication is passed, sending the effective request to the data transmission gateway for execution, if the authentication is not passed, performing network isolation on the single device corresponding to the effective request, if no, sending each effective request to each data transmission gateway for execution.
[0124] The business registration module comprises:
[0125] The restriction setting unit is used for determining a grouping restriction condition based on the current number of data transmission gateways;
[0126] The scheme allocation unit is used for determining a plurality of candidate business group allocation schemes based on the grouping restriction condition;
[0127] The correlation calculation unit is used for determining a business correlation index under each candidate business group allocation scheme based on a correlation identification algorithm, and determining a candidate business group allocation scheme with the minimum business correlation index as the best business group allocation scheme;
[0128] The load balancing unit is used for determining an informatization data transmission business corresponding to each data transmission gateway based on the best business group allocation scheme by using a load balancing algorithm, and performing informatization data transmission registration on the corresponding data transmission gateway.
[0129] Optionally, the security protection module comprises:
[0130] The risk identification unit is used for identifying whether there is an effective request causing a security risk in the effective request;
[0131] The authentication unit is used for authenticating the single device corresponding to the effective request causing the security risk, and judging whether the single device corresponding to the effective request causing the security risk exists the permission corresponding to the effective request.
[0132] The use process of the system is as follows:
[0133] Step one: the business registration module calls the restriction setting unit to determine a grouping restriction condition based on the current number of data transmission gateways;
[0134] Step two: the business registration module calls the scheme allocation unit to determine a plurality of candidate business group allocation schemes based on the grouping restriction condition;
[0135] Step three: the business registration module calls the correlation calculation unit to determine the business correlation index under each candidate business group allocation scheme based on the correlation identification algorithm, and determines the candidate business group allocation scheme with the minimum business correlation index as the optimal business group allocation scheme;
[0136] Step four: the business registration module calls the load balancing unit to determine the information data transmission business corresponding to each data transmission gateway based on the optimal business group allocation scheme using the load balancing algorithm, and performs information data transmission registration on the corresponding data transmission gateway to construct a gateway system as shown in Figure 6
[0137] Step five: the traffic gateway receives real-time information data transmission requests from all single devices, and eliminates illegal requests and invalid requests to obtain valid requests.
[0138] Step six: the security protection module calls the risk identification unit to identify whether there is a valid request that causes a security risk in the valid request, if yes, the authentication unit is called to authenticate the single device corresponding to the valid request that causes a security risk, to determine whether the single device corresponding to the valid request that causes a security risk has the permission corresponding to the valid request, if the authentication is passed, the valid request is sent to the data transmission gateway for execution, if the authentication is not passed, the single device corresponding to the valid request is network isolated, if not, each valid request is sent to each data transmission gateway for execution.
[0139] In summary, the advantages of the present application are that the information data transmission business requested at the same time is dispersed to multiple different data transmission gateways as much as possible, the request response speed of the information data transmission system to the access device is ensured, and the business information data transmission level of the device cluster of the information data transmission system is improved.
[0140] The basic principles, main features and advantages of the present application are shown and described above. It should be understood by those skilled in the art that the present application is not limited by the above examples, the above examples and descriptions in the specification are only the principles of the present application, various changes and improvements can be made without departing from the spirit and scope of the present application, and these changes and improvements all fall within the scope of the claimed present application. The scope of protection claimed by the present application is defined by the appended claims and their equivalents.
Claims
1. A method for secure transmission of information data based on AI large-scale model training, characterized in that, include: It receives information data transmission requests from all individual devices in real time, and removes illegal and invalid requests to obtain valid requests; The data transmission gateway receives valid requests sent by the traffic gateway and routes the valid requests to the correct location. Obtain at least one individual device connected to the information data transmission system, and based on the service attributes of the individual device, split each individual device into several information data transmission services, determine the data transmission gateway corresponding to each information data transmission service based on the information data transmission allocation algorithm, and register information data transmission with the corresponding data transmission gateway. If any valid requests pose a security risk, the system will authenticate the individual device corresponding to that valid request. If authentication is successful, the valid request will be sent to the data transmission gateway for execution. If authentication fails, the individual device corresponding to that valid request will be isolated from the network. Otherwise, each valid request will be sent to its respective data transmission gateway for execution.
2. The method for secure transmission of information data based on AI large model training according to claim 1, characterized in that, The information data transmission and allocation algorithm specifically includes: Determine the packet restriction conditions based on the current number of data transmission gateways; Based on the grouping constraints, several candidate business group allocation schemes are determined. Based on the correlation identification algorithm, the business correlation index is determined for each candidate business group allocation scheme, and the candidate business group allocation scheme with the smallest business correlation index is determined as the optimal business group allocation scheme. Based on the optimal business group allocation scheme, a load balancing algorithm is used to determine the information data transmission service corresponding to each data transmission gateway, and information data transmission registration is performed with the corresponding data transmission gateway.
3. The method for secure transmission of information data based on AI large model training according to claim 2, characterized in that, The specific details of determining the packet restriction conditions based on the current number of data transmission gateways include: Determine the current number of data transmission gateways n and the total number of information data transmission services m; Generate n random numbers whose sum is m and greater than 1, and form an n-dimensional random array A, where A = {a1…a2}. i …a n }, a i This is the i-th random number generated; Iterate through and generate all n-dimensional random arrays that meet the conditions, forming the grouping constraints.
4. The method for secure transmission of information data based on AI large model training according to claim 3, characterized in that, The determination of several candidate business group allocation schemes based on grouping constraints specifically includes: Following the order i from 1 to n, randomly select a from all information data transmission services. i An information data transmission service, as a i The corresponding information data transmission service group is determined, and the information data transmission service group corresponding to all elements in the n-dimensional random array is obtained, thus completing a grouping action corresponding to the n-dimensional random array. Repeat the grouping action corresponding to the n-dimensional random array several times until no new grouping scheme can be generated, thus completing the complete grouping action of the n-dimensional random array. Complete the grouping action of all n-dimensional random arrays in the grouping constraints, and record all the resulting grouping schemes as candidate business group allocation schemes.
5. The method for secure transmission of information data based on AI large model training according to claim 4, characterized in that, The correlation identification algorithm specifically includes: Identify the correlation indicators between all pairs of information data transmission services; In the candidate business group allocation scheme, the information data transmission services in each information data transmission business group are paired up to obtain several information data transmission service pairs corresponding to the information data transmission business group. Based on the correlation calculation formula, the pairing correlation index of each group of information data transmission business groups in the candidate business group allocation scheme is calculated; The average value of the pairing and correlation indicators of all groups of information data transmission business groups in the candidate business group allocation scheme is used to obtain the business relevance indicators under the candidate business group allocation scheme. The formula for calculating the correlation is: Where G is the pairing and association indicator for information data transmission service groups, and R... j Let J be the information data transmission correlation index of the j-th information data transmission service pair in the information data transmission service group, and J be the total number of information data transmission service pairs in the information data transmission service group.
6. The method for secure transmission of information data based on AI large model training according to claim 5, characterized in that, The specific steps for determining the correlation indicators between any two data transmission services are as follows: Let B be the information data transmission service for which the information data transmission correlation indicators are to be calculated. x and B y In the determination of historical information data transmission requests, B appears. x The number of times information data transmission requests occur, and the occurrence of B y The number of information data transmission requests and the simultaneous occurrence of B x and B y The number of times information data transmission requests are made; Then B x and B y The correlation indicators for information data transmission between them are: In the formula, B is... x and B y Information data transmission correlation indicators between them, N x B appears in the historical information data transmission request x The number of information data transmission requests, N xy B appears in the historical information data transmission request y The number of information data transmission requests, N xy B appears simultaneously in the historical information data transmission request. x and B y The number of times information data transmission requests are made.
7. The method for secure transmission of information data based on AI large model training according to claim 6, characterized in that, The load balancing algorithm is as follows: Determine the traffic load capacity of each data transmission gateway; Obtain the frequency of occurrence of each type of information data transmission service in historical information data transmission requests; Determine the load requirements for each type of information data transmission service; Each information data transmission business group in the optimal business group allocation scheme is randomly paired with each data transmission gateway to obtain several business pairing schemes. Based on the load balancing algorithm, calculate the load balancing metrics for each service pairing scheme. Select the business pairing scheme with the lowest load balancing index as the best business pairing scheme; In determining the optimal service pairing scheme, each data transmission gateway corresponds to an information data transmission service group, and the information data transmission service group corresponding to the data transmission gateway is registered to the data transmission gateway; The load balancing algorithm is as follows: In the formula, H is the load balancing metric of the service pairing scheme, and T... i f represents the traffic load capacity of the i-th data transmission gateway. k For the load requirement of the k-th information data transmission service in the information data transmission service group paired with the i-th data transmission gateway in the service pairing scheme, p k Let b be the frequency of occurrence of the k-th information data transmission service in the information data transmission service group paired with the i-th data transmission gateway in the service pairing scheme. i This represents the total number of information data transmission services in the information data transmission service group paired with the i-th data transmission gateway in the service pairing scheme.
8. An information data security transmission system based on AI large model training, characterized in that, The method for secure transmission of information-based large-scale AI model training as described in any one of claims 1-7 includes: Traffic gateway: The traffic gateway is used to receive information data transmission requests from all individual devices in real time, and to remove illegal and invalid requests and obtain valid requests; Data transmission gateway: The input end of the data transmission gateway is connected to the traffic gateway, and the output end of the data transmission gateway is connected to the application layer of the information data transmission device. The data transmission gateway is used to receive valid requests sent by the traffic gateway and route the valid requests to the correct location. The service registration module is electrically connected to the data transmission gateway. The service registration module is used to obtain at least one single device that accesses the information data transmission system, and based on the service attributes of the single device, split each single device into several information data transmission services, and determine the data transmission gateway corresponding to each information data transmission service based on the information data transmission allocation algorithm, and perform information data transmission registration with the corresponding data transmission gateway. The security protection module is electrically connected to the traffic gateway. The security protection module is used to identify whether there are any valid requests that pose a security risk among the valid requests. If so, it will authenticate the individual device corresponding to the valid request. If the authentication is successful, the valid request will be sent to the data transmission gateway for execution. If the authentication fails, the individual device corresponding to the valid request will be isolated from the network. Otherwise, each valid request will be sent to its respective data transmission gateway for execution.
9. The information data security transmission system based on AI large model training according to claim 8, characterized in that, The business registration module includes: A restriction setting unit is used to determine packet restriction conditions based on the current number of data transmission gateways; A scheme allocation unit is used to determine several candidate business group allocation schemes based on grouping constraints. The correlation calculation unit is used to determine the business correlation index under each candidate business group allocation scheme based on the correlation identification algorithm, and to determine the candidate business group allocation scheme with the smallest business correlation index as the best business group allocation scheme. The load balancing unit is used to determine the information data transmission service corresponding to each data transmission gateway based on the optimal service group allocation scheme and the load balancing algorithm, and to register the information data transmission with the corresponding data transmission gateway.
10. The information data security transmission system based on AI large model training according to claim 9, characterized in that, The security protection module includes: A risk identification unit is used to identify whether there are any valid requests that pose a security risk among valid requests. The authentication unit is used to authenticate the individual device corresponding to a valid request that poses a security risk, and to determine whether the individual device corresponding to the valid request has the corresponding permission.
Citation Information
Patent Citations
Resource allocation method and system for uplink communication service in electric power Internet of Things
CN110248417A
Data security transmission method and device
CN116074845A