A method of data transmission between servers

Abstract

The application discloses a data transmission method between servers, and belongs to the technical field of communication and computers. The method can analyze response data of stored data in a subserver in a storage process and parameters of the data itself, so that the participation coefficient of each split data group is judged to represent the interaction degree of each split data group with a user in the storage process. The application also analyzes operation data of each subserver and stored split data groups, so that the aging coefficient and the re-capturing value of each subserver are obtained. In a subsequent data transmission and storage process, the split data group with a larger participation coefficient is transmitted to the subserver with a smaller re-capturing value, so that the split data group with a lower overall importance is stored in the server with a higher fault risk, thereby reducing the risk caused by data loss, loss and the like due to damage, fault and the like of the subserver.

Description

Technical Field

[0001] This invention belongs to the field of communication and computer technology, specifically relating to a method for data transmission between servers. Background Technology

[0002] During the product manufacturing process, a large amount of information generated during production needs to be collected by sensors and transmitted to the server for analysis and processing. On the one hand, the data packets generated during the production process are large, often tens or hundreds of gigabytes. In order to ensure the efficiency of data processing and the security of data storage, distributed storage is a commonly used method. That is, by dividing the data packets and distributing them in a distributed server cluster, data loss can be reduced when the server fails.

[0003] In existing technologies, data is stored in a random distribution manner when it is distributed, without taking into account the different states of the server or the distribution of existing stored data within the server. When the server fails, a large amount of important data may be damaged, resulting in serious losses. In order to solve the above problems and reduce the losses caused by server failures and damages, the present invention provides the following technical solutions. Summary of the Invention

[0004] The purpose of this invention is to provide a data transmission method between servers, which solves the problem that the existing technology does not consider the different states of servers and the distribution of existing stored data when performing distributed data storage. When a server fails, a large amount of important data may be damaged, resulting in serious losses.

[0005] The objective of this invention can be achieved through the following technical solutions:

[0006] A method for data transmission between servers includes the following steps:

[0007] The first step is to acquire relevant data about the same object within a period using the data acquisition unit, and then mark all relevant data about the same object within a period as a data packet. The data packets corresponding to the same object are then sequentially labeled B1, B2, ..., B... n ;

[0008] Related data within the same data packet are divided into several split data groups according to a certain rule, and each split data group within the same data packet is sequentially labeled as z. i1 z i2 ... z im ;

[0009] Where 1≤i≤n, and n is the number of data packets corresponding to the same object;

[0010] m is the number of split data groups corresponding to the same data packet;

[0011] The second step is to distribute and store the split data groups within the same data packet in each sub-server.

[0012] For each data packet corresponding to the same object, its corresponding split data group is sequentially marked as z. 1j z 2j ... z nj , will z 1j To z nj The corresponding split data set is labeled as a control group, where 1≤j≤m;

[0013] Calculate and obtain the reference coefficient X corresponding to the n split data groups within the same control group;

[0014] The third step is for the controller to calculate the aging coefficient L, which represents the aging level of each sub-server, based on the operation records of each sub-server.

[0015] The fourth step is to obtain the split data groups stored in each sub-server and label these split data groups sequentially as h1, h2, ..., h k , get h r The corresponding reference coefficient X of the control group r ;

[0016] Where 1≤r≤k;

[0017] The controller is based on formula X p =(X1+X2+、…、+X k The average parameter coefficient X of the corresponding sub-server is calculated by ) / k. p ;

[0018] According to the formula The recapacity value G for each sub-server is calculated;

[0019] Where λ1 and λ2 are both preset coefficients;

[0020] The fifth step is to obtain the corresponding updated re-capacity value G of each sub-server when the data acquisition unit needs to transmit the split data groups in the new data packet.

[0021] Obtain the parameter coefficient X corresponding to each split data group s ;

[0022] Each split data group is assigned a reference coefficient X. s Sort the numbers in descending order to get a1, a2, ..., a m ;

[0023] Sort each sub-server in ascending order according to its updated corresponding recapacity value G to obtain b1, b2, ..., b m ;

[0024] b j With a j Correspondingly, a j The corresponding split data group is transmitted to the corresponding sub-server b. j middle.

[0025] As a further aspect of the present invention, the method for calculating and obtaining the reference coefficient X corresponding to n split data groups within the same control group includes the following steps:

[0026] The controller acquires the split data set z within a control group. ij Within time T starting from the moment z enters the corresponding sub-server, ij The number of times c and z are read ij The browsing time t, the corresponding weighting coefficient q, and z ij Size d;

[0027] Then according to the formula z was calculated ij Corresponding parameter ratio V ij ;

[0028] Where β1 and β2 are both preset values;

[0029] Calculate and obtain the corresponding n V values ​​within a control group. ij The values ​​are labeled as V in sequence. 1j V 2j V nj ;

[0030] According to the formula V was calculated 1j To V nj The discrete value S of this set of parameter proportion data;

[0031] Where V ijp =(V 1j +V 2j +、…、+V nj ) / n;

[0032] According to the formula The reference coefficient X corresponding to the n split data groups within the same control group was calculated;

[0033] Where T is a preset value and α is a preset coefficient;

[0034] The weighting coefficient q is based on z ij The coefficients are preset for the type of split data group corresponding to the control group.

[0035] As a further aspect of the present invention, the size of β2 varies depending on the data display type corresponding to the split data group; the data display type includes video, audio, text, and images.

[0036] As a further aspect of the present invention, the aging coefficient L of the sub-server is calculated as follows:

[0037] For a sub-server, obtain its usage time t1 after it is put into operation;

[0038] Get the number of times the sub-server was repaired during its usage period, w1;

[0039] Obtain the maintenance cost w2 of the sub-server during its use;

[0040] Get the sub-server's own price w3;

[0041] According to the formula The aging coefficient L corresponding to each sub-server is calculated;

[0042] θ1, θ2, and θ3 are all preset coefficients.

[0043] The beneficial effects of this invention are:

[0044] 1. This invention can analyze the response data and data parameters of the data stored in the sub-server during the storage process to determine the reference coefficient of each split data group, which represents the degree of interaction between each split data group and the user during the storage process. This invention also analyzes the operation data of each sub-server and the stored split data groups to obtain the aging coefficient and recapacity value of each sub-server. In the subsequent data transmission and storage process, split data groups with larger reference coefficients are transmitted to sub-servers with smaller recapacity values. This ensures that servers with higher failure risk store split data groups with lower overall importance, thereby reducing the risk of data loss or damage caused by sub-server damage or failure.

[0045] 2. This invention effectively reduces data loss caused by server failures or damage by distributing data packets. Detailed Implementation

[0046] The technical solutions in the embodiments of the present invention will be clearly and completely described below. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0047] A method for data transmission between servers includes the following steps:

[0048] The first step is to acquire relevant data about the same object within a period using the data acquisition unit, and then mark all relevant data about the same object within a period as a data packet. The data packets corresponding to the same object are then sequentially labeled B1, B2, ..., B... n ;

[0049] Related data within the same data packet are divided into several split data groups according to a certain rule, and each split data group within the same data packet is sequentially labeled as z. i1 z i2 ... z im ;

[0050] Where 1≤i≤n, and n is the number of data packets corresponding to the same object;

[0051] m is the number of split data groups corresponding to the same data packet;

[0052] The cycle is a preset time period;

[0053] In one embodiment of the present invention, the same object is a production workshop, and the cycle is one day;

[0054] In another embodiment of the present invention, the same object is a test component, and the cycle is the test cycle of the corresponding test component;

[0055] One method for dividing related data within the same data packet into several split data groups according to a certain rule is: dividing according to the type of data acquisition unit;

[0056] The second step is to distribute and store the split data groups within the same data packet in each sub-server, and then package the storage addresses of the split data groups corresponding to the same data packet and store them in the central server.

[0057] For each data packet corresponding to the same object, its corresponding split data group is sequentially marked as z. 1j z 2j ... z nj , will z 1j To z nj The corresponding split data set is labeled as a control group, where 1≤j≤m;

[0058] The controller acquires the split data group zij within a control group, within a time T calculated from the time it enters the corresponding sub-server. ij The number of times c and z are read ij The browsing time t, the corresponding weighting coefficient q, and z ij Size d;

[0059] Then according to the formula z was calculated ij Corresponding parameter ratio V ij ;

[0060] β1 and β2 are both preset values, and the size of β2 varies depending on the data display type corresponding to the split data group;

[0061] The data display types include video, audio, text, and images;

[0062] Calculate and obtain the corresponding n V values ​​within a control group. ij The values ​​are labeled as V in sequence. 1j V 2j V nj ;

[0063] According to the formula V was calculated 1j To V nj The discrete value S of this set of parameter proportion data;

[0064] Where V ijp =(V 1j +V 2j +、…、+V nj ) / n;

[0065] According to the formula The reference coefficient X corresponding to the n split data groups within the same control group was calculated;

[0066] Where T is a preset value and α is a preset coefficient;

[0067] The weighting coefficient q is based on z ij The coefficients are preset for the type of split data group corresponding to the control group;

[0068] The third step is for the controller to calculate the aging coefficient L, which represents the aging level of each sub-server, based on the operation records of each sub-server.

[0069] Specifically, the aging factor L of the sub-server is calculated as follows:

[0070] For a sub-server, obtain its usage time t1 after it is put into operation;

[0071] Get the number of times the sub-server was repaired during its usage period, w1;

[0072] Obtain the maintenance cost w2 of the sub-server during its use;

[0073] Get the sub-server's own price w3;

[0074] According to the formula The aging coefficient L corresponding to each sub-server is calculated;

[0075] Where θ1, θ2, and θ3 are all preset coefficients;

[0076] The fourth step is to obtain the split data groups stored in each sub-server and label these split data groups sequentially as h1, h2, ..., h k , get h r The corresponding reference coefficient X of the control group r ;

[0077] Where 1≤r≤k;

[0078] The controller is based on formula X p =(X1+X2+、…、+X k The average parameter coefficient X of the corresponding sub-server is calculated by ) / k. p ;

[0079] Then according to the formula The recapacity value G for each sub-server is calculated;

[0080] Where λ1 and λ2 are both preset coefficients;

[0081] The fifth step is to obtain the corresponding updated re-capacity value G of each sub-server when the data acquisition unit needs to transmit the split data groups in the new data packet.

[0082] Obtain the parameter coefficient X corresponding to each split data group s ;

[0083] Each split data group is assigned a reference coefficient X. s Sort the numbers in descending order to get a1, a2, ..., a m ;

[0084] Sort each sub-server in ascending order according to its updated corresponding recapacity value G to obtain b1, b2, ..., b m ;

[0085] b j With a j Correspondingly, a j The corresponding split data group is transmitted to the corresponding sub-server b. j middle;

[0086] This invention effectively reduces losses caused by server failures and damage by distributing data packets.

[0087] This invention can analyze the response data and data parameters of the data stored in the sub-server during the storage process to determine the parameter coefficient of each split data group, which represents the degree of interaction between each split data group and the user during the storage process. This invention also analyzes the operational data of each sub-server and the stored split data groups to obtain the aging coefficient and recapacity value of each sub-server. In the subsequent data transmission and storage process, split data groups with larger parameter coefficients are transmitted to sub-servers with smaller recapacity values, thereby reducing the risk of data loss or damage caused by sub-server damage or failure.

[0088] The aforementioned method for data transmission between servers is implemented through a data transmission management system for servers, which includes:

[0089] The data acquisition unit is used to collect relevant data of each object in each period to obtain each data packet, and after dividing the relevant data in the same data packet into several split data groups according to a certain rule, the split data groups are numbered.

[0090] It should be noted that the pattern of dividing data packets corresponding to the same object into several split data groups is the same;

[0091] The server unit includes a central server and several sub-servers. Each sub-server is used to store and analyze the data groups collected by the data acquisition unit. When analyzing the data groups, the sub-servers retrieve the corresponding data analysis and processing scheme from the central server according to the number of the data groups, process the corresponding data groups according to the corresponding analysis and processing scheme, and finally import the obtained data analysis and processing results into the central server for aggregation.

[0092] The controller is used to obtain the strategy for the split data groups acquired by the data acquisition unit to enter the sub-server;

[0093] When a user needs to read a split data group in a server unit, the storage address of the corresponding split data group stored in the central server is read first, and then the corresponding split data group is read according to the storage address.

[0094] In the description of this specification, the references to terms such as "an embodiment," "example," "specific example," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the present invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0095] The above description is merely an example and illustration of the present invention. Those skilled in the art can make various modifications or additions to the specific embodiments described, or use similar methods to replace them, as long as they do not deviate from the invention or exceed the scope defined in the claims, all of which should fall within the protection scope of the present invention.

Claims

1. A method for data transmission between servers, characterized in that, Includes the following steps: The first step is to acquire relevant data about the same object within a period using the data acquisition unit, and then mark all relevant data about the same object within a period as a data packet. The data packets corresponding to the same object are then sequentially labeled B1, B2, ..., B... n ; Related data within the same data packet are divided into several split data groups according to a certain rule, and each split data group within the same data packet is sequentially labeled as z. i1 z i2 ..., z im ; The pattern of dividing data packets corresponding to the same object into several split data groups is the same; Where 1≤i≤n, and n is the number of data packets corresponding to the same object; m is the number of split data groups corresponding to the same data packet; The second step is to distribute and store the split data groups within the same data packet in each sub-server. For each data packet corresponding to the same object, its corresponding split data group is sequentially marked as z. 1j z 2j ..., z nj , will z 1j To z nj The corresponding split data set is labeled as a control group, where 1≤j≤m; Calculate and obtain the reference coefficient X corresponding to the n split data groups within the same control group; The third step is for the controller to calculate the aging coefficient L, which represents the aging level of each sub-server, based on the operation records of each sub-server. The fourth step is to obtain the split data groups stored in each sub-server and label these split data groups sequentially as h1, h2, ..., h k , get h r The corresponding reference coefficient X of the control group r ; Where 1≤r≤k; The controller is based on formula X p =(X1+X2+…+X k The average parameter coefficient X of the corresponding sub-server is calculated by ) / k. p ; According to the formula The recapacity value G for each sub-server is calculated; Where λ1 and λ2 are both preset coefficients; The fifth step is to obtain the corresponding updated re-capacity value G of each sub-server when the data acquisition unit needs to transmit the split data groups in the new data packet. Obtain the parameter coefficient X corresponding to each split data group s ; Each split data group is assigned a reference coefficient X. s Sort the numbers in descending order to get a1, a2, ..., a m ; Sort each sub-server in ascending order according to its updated corresponding recapacity value G to obtain b1, b2, ..., b m ; b j With a j Correspondingly, a j The corresponding split data group is transmitted to the corresponding sub-server b. j middle; The method for calculating the reference coefficient X corresponding to n split data groups within the same control group includes the following steps: The controller acquires the split data set z within a control group. ij Within time T starting from the moment z enters the corresponding sub-server, ij The number of times c and z are read ij The browsing time t, the corresponding weighting coefficient q, and z ij Size d; Then according to the formula z was calculated ij Corresponding parameter ratio V ij ; Where β1 and β2 are both preset values; Calculate and obtain the corresponding n V values ​​within a control group. ij The values ​​are labeled as V in sequence. 1j V 2j V nj ; According to the formula V was calculated 1j To V nj The discrete value S of this set of parameter proportion data; Where V ijp =(V 1j +V 2j +…+V nj ) / n; According to the formula The reference coefficient X corresponding to the n split data groups within the same control group was calculated; Where T is a preset value and α is a preset coefficient; The weighting coefficient q is based on z ij The coefficients are preset for the type of split data group corresponding to the control group.

2. The data transmission method between servers according to claim 1, characterized in that, The size of β2 varies depending on the data display type corresponding to the split data group; the data display types include video, audio, text, and images.

3. The data transmission method between servers according to claim 1, characterized in that, The aging factor L of the sub-server is calculated as follows: For a sub-server, obtain its usage time t1 after it is put into operation; Get the number of times the sub-server was repaired during its usage period, w1; Obtain the maintenance cost w2 of the sub-server during its use; Get the sub-server's own price w3; According to the formula The aging coefficient L corresponding to each sub-server is calculated; θ1, θ2, and θ3 are all preset coefficients.

Images