Data transmission method and device based on transmission machine, equipment and storage medium
A data transmission method and transmission machine technology, applied in the field of big data in computer technology, can solve the problems of waste of resources, idle resources, and transmission delay of data transmission tasks.
Active Publication Date: 2020-09-25
APOLLO INTELLIGENT DRIVING (BEIJING) TECHNOLOGY CO LTD
8 Cites 0 Cited by
AI-Extracted Technical Summary
Problems solved by technology
[0004]However, in the prior art, since the transmission machine allocates the same resource for each task, some tasks may have insufficient res...
Method used
202, according to the file size of each data file of each task, determine the ideal concurrency degree of each task, wherein, the minimum resource number that the ideal concurrency degree characterizes task can use, and task is under ideal concurrency degree The transmission time is minimum.
[0222] In order to uniformly allocate bandwidth to each transmission machine in the same computer room, it is guaranteed that the transmission machine with the task to be transmitted (high-quality task) with the first priority level can be allocated more bandwidth, and each transmission machine can be dynamically adjusted in real time. The total concurrency threshold of a transport machine. This embodiment provides a "bandwidth allocation strategy between transmission machines in the same computer room", dynamically adjusts the total concurrency threshold of each transmission machine in real time, and improves the tasks to be transmitted with the first priority level (high priority tasks) The "total concurrency threshold" of the transmission machine reduces the "total concurrency threshold" of tasks to be transmitted that do not have the first priority level (high-quality tasks); thus ensuring that the tasks to be transmitted with the first priority level (high-quality tasks) The transmission machine obtains more bandwidth resources, that is, guarantees that the tasks to be transmitted of the first priority level (high-priority tasks) obtain more bandwidth resources and are transmitted quickly.
[0233] Through the process of steps 301-303, different speed limit network configurations are configured for transmission machines in different states, and then different concurrency total thresholds are configured for transmission machines in different states to improve tasks with the first priority level (high The total threshold of the concurrency degree of the optimal task) is reduced, and the total threshold of the concurrency degree of the task (ordinary task) that does not have the first priority level is reduced; and then the total concurrency threshold of each transmission machine can be dynamically adjusted in real time. Furthermore, it is ensured that the transmitter with the task to be transmitted of the first priority level (high-quality task) gets more bandwidth resources, that is, it is ensured that the task to be transmitted of the first priority level (high-quality task) gets more bandwidth resources, and the fast is transmitted.
[0235] In this embodiment, the current limited network speed of the current transmission machine is determined according to the state identification of each transmission machine in the same computer room by the current transmission machine, and then the current network speed is determined according to the current actual network speed and the limited network speed of the current transmission machine. The total threshold of the concurrency degree of the transmission machine; the total threshold of the concurrency degree of the transmission machine can be allocated according to the task status and task situation in the current transmission machine, so as to ensure that more bandwidth resources are allocated for the high-quality transmission machine, and the high-quality state is guaranteed. The tasks in the transmission machine are prioritized and transmitted quickly; and the bandwidth resources are still allocated for the normal transmission machine to ensure that the tasks in the normal transmission machine are also transmitted. The total concurrency threshold of each transmission machine can be dynamically adjusted in real time, the total concurrency threshold of the transmission machine with the first priority level tasks (high-quality tasks) can be increased, and the task without the first priority level (ordinary tasks) can be lowered. ) the total threshold of the concurrency of the transmission machine; and then ensure that the transmission machine with the first priority level of tasks to be transmitted (high-quality tasks) gets more bandwidth resources, that is, to ensure that the first priority level of tasks to be transmitted (high-quality tasks) ) to obtain more bandwidth resources, and to be transmitted quickly; that is, to ensure that concurrency resources are allocated to the first-priority tasks to be transmitted (high-quality tasks), and then to ensure that high-quality tasks occupy more bandwidth resources, so that high-quality tasks Priority tasks are transferred quickly. Allocate bandwidth for each transmission machine in the same computer room to ensure that all tasks in the same computer room maintain high-speed transmission, and make full use of bandwidth resources, do not idle or waste bandwidth, and maximize the transmission throughput in the same computer room.
[0302] Through the process of steps 404-405, different speed limit network configurations are configured for the transmission machines in different states, and then different concurrency total thresholds are configured for the transmission machines in different states, so as to improve tasks with the first priority level (high The total threshold of the concurrency degree of the optimal task) is reduced, and the total threshold of the concurrency degree of the task (ordinary task) that does not have the first priority level is reduced; and then the total concurrency threshold of each transmission machine can be dynamically adjusted in real time. Furthermore, it is ensured that the transmitter with the task to be transmitted of the first priority level (high-quality task) gets more bandwidth resources, that is, it is ensured that the task to be transmitted of the first priority level (high-quality task) gets more bandwidth resources, and the fast is transmitted.
[0305] In this embodiment, on the basis of the above-mentioned embodiments, by analyzing the status identifiers of all the transmission machines in the computer room to which the current transmission machine belongs, the limited network speed of the current transmission machine is determined. Make the transmission machines that meet the requirements of free competition compete to determine the limited network speed through free competition, and the transmission machines that do not meet the requirements of free c...
Abstract
The invention discloses a data transmission method and device based on a transmission machine, equipment and a storage medium, relates to the field of big data, and can be used for mass data transmission in automatic driving. According to the specific implementation scheme, a total concurrency threshold of a current transmission machine and the actual concurrency of each task in the current transmission machine are obtained, the tasks have priorities, and the total concurrency threshold is an upper limit value of the sum of the actual concurrency; according to the total concurrency threshold and the actual concurrency of each task, expected concurrency of to-be-transmitted tasks with different priorities is determined, the expected concurrency being characterized by the number of resourcesallocated to the to-be-transmitted tasks, and the expected concurrency of the to-be-transmitted tasks with different priorities being different; and resources corresponding to the number of resourcesrepresented by the expected concurrency of each to-be-transmitted task are started, and each to-be-transmitted task is transmitted separately; different numbers of resources to different tasks are allocated. Tasks can be successfully and quickly transmitted, and the resources are ensured not to be idle and not to be wasted.
Application Domain
Program initiation/switchingResource allocation +1
Technology Topic
Embedded systemData transmission +4
Image
Examples
- Experimental program(1)
Example Embodiment
[0371] In addition, in an example, the network speed limitation in step 602 specifically includes the following embodiments, which are "the first implementation of network speed limitation in step 602" and "the second implementation of network speed limitation in step 602". the way":
[0372] In the first implementation manner of limiting the network speed in step 602, when the server determines that the current transmission machine meets the requirements of free competition according to the status identification of each transmission machine, the limiting network speed of the current transmission machine is determined by the server according to the free competition method of.
[0373] In an example, the first implementation method specifically includes: when the server determines that the current transmission machine meets the requirements of free competition according to the status identification of each transmission machine, the current transmission machine meets the first preset condition, and the network card of the current transmission machine The bandwidth is the limited network speed of the current transmitter; among them, the first preset condition is that the current actual total bandwidth of the computer room to which the current transmitter belongs is less than the preset bandwidth threshold, or the status of the current transmitter is identified as high-optimal state, or the current The number of high-optimized transmitters in the computer room to which the transmitter belongs is zero; wherein the bandwidth threshold is the product of the total bandwidth of the outlet of the computer room to which the current transmitter belongs and the preset ratio value.
[0374] Exemplarily, when determining the limit network speed of the current transmission machine, the server analyzes the status identification of each transmission machine in the computer room to which the current transmission machine belongs, or analyzes the status identification of the current transmission machine to determine whether the current transmission machine complies with free competition Claim. Among them, it meets the "free competition requirements", for example, all the transmission machines in the computer room to which the current transmission machine belongs are in the high-quality state, or all the transmission machines in the computer room to which the current transmission machine belongs are in the normal state, or the current transmission machine It is a high state.
[0375] When the server determines that the current transmission machine meets the requirements of free competition, it informs the current transmission machine to compete in a free competition way to determine the restriction on the network speed. Among them, "using free competition to determine and limit network speed" means that the transmission machine is not restricted, and the transmission machine freely competes for the total export bandwidth of the computer room. Therefore, when all the transmitters in the computer room to which the current transmitter belongs are in the high-optimum state, or when the current transmitter is in the high-optimum state, the current transmitter has priority to compete for the total bandwidth of the computer room’s outlet, that is, to ensure the high-quality transmission machine Prioritizing the total export bandwidth of the computer room can ensure that sufficient bandwidth is allocated to high-quality transmitters. Moreover, when all the transmitters in the computer room to which the current transmitter belongs are in the normal state, the transmitters in the normal state can also compete for the total export bandwidth of the computer room to ensure that all the transmitters in the normal state can be allocated bandwidth.
[0376] In one example, when the server judges that the current transmission machine meets the free competition requirement according to the status identification of each transmission machine, the server can analyze the status identification or bandwidth of the transmission machine to determine that the current transmission machine meets the free competition requirement. If the server determines that the current transmitter meets the first preset condition, it informs the current transmitter to compete in free competition to determine the limit of the network speed; at this time, the server can directly use the current transmitter’s network card bandwidth as the current transmitter’s bandwidth. Limit internet speed.
[0377] For example, for the i-th transmission machine in the machine room, i is a positive integer greater than or equal to 1, and the i-th transmission machine limit_speed(i)=bandwith_machine(i), where bandwith_machine(i) is the network card of the i-th transmission machine Bandwidth, the network card bandwidth is a fixed value.
[0378] Among them, the first preset condition includes the following implementation methods.
[0379] The first implementation mode: if the server determines that the current transmission machine is a high-optimum state transmission machine, that is, the previous transmission machine state is identified as a high-optimization state, the server determines that the current transmission machine meets the first preset condition. At this time, the server informs the current transmitter to determine the limit of the network speed through free competition; the server directly uses the network card bandwidth of the current transmitter as the current limit of the network speed. In turn, it is ensured that sufficient bandwidth is allocated to high-optimized transmitters first.
[0380] The second implementation method: If the server determines that the number of high-optimized transmissions in the computer room to which the current transmission machine belongs is zero, that is, the transmissions in the current transmission machine room are in the normal state or idle state (there is no high-quality transmission in the computer room). Optimal transmission machine), the server determines that the current transmission machine meets the first preset condition. At this time, the server informs the current transmitter to determine the limit of the network speed through free competition; the server directly uses the network card bandwidth of the current transmitter as the current limit of the network speed.
[0381] A third implementation manner: if the server determines that the current actual total bandwidth of the computer room to which the current transmitter belongs is less than the preset bandwidth threshold, where the bandwidth threshold is related to the total outlet bandwidth of the computer room, the server determines that the current transmitter meets the first preset condition. At this time, the server informs the current transmitter to determine the limit of the network speed through free competition; the server directly uses the network card bandwidth of the current transmitter as the current limit of the network speed. In an example, the preset bandwidth threshold is the product of the total outlet bandwidth of the computer room to which the current transmitter belongs and the preset ratio value; the preset ratio value is, for example, 0.5.
[0382] The fourth implementation manner: if the server determines that the current transmission machines in the machine room to which the current transmission machine belongs are all high-quality transmission machines, the server determines that the current transmission machine meets the first preset condition. At this time, the server informs the current transmitter to determine the limit of the network speed through free competition; the server directly uses the network card bandwidth of the current transmitter as the current limit of the network speed. Furthermore, the server does not impose restrictions on the bandwidth of each high-optimized transmitter, so that each high-optimized transmitter freely competes for bandwidth.
[0383] In the second implementation manner of limiting the network speed in step 602, when the server determines that the current transmission machine does not meet the requirements of free competition according to the status identification of each transmission machine, the current transmission machine’s restricted network speed is the server according to the current transmission machine’s network card Determined by bandwidth.
[0384] In an example, the second implementation manner specifically includes: when the server determines that the current transmission machine does not meet the requirements of free competition according to the status identification of each transmission machine, the current transmission machine meets the second preset condition, and the current transmission machine Limit the network speed and the bandwidth of the network card of the current transmission machine, the total export bandwidth of the computer room to which the current transmission machine belongs, the current actual network speed of the high-quality transmission machine in the computer room to which the current transmission machine belongs, and the general state of the transmission machine in the computer room to which the current transmission machine belongs. The total number is related. Among them, the second preset condition is that the current actual total bandwidth of the computer room to which the current transmitter belongs is greater than or equal to the preset bandwidth threshold, or the status of the current transmitter is not in the high-optimal state, or the computer room to which the current transmitter is in the high-optimal state The number of transmitters is not zero; where the bandwidth threshold is the product of the total bandwidth of the outlet of the computer room to which the current transmitter belongs and the preset ratio value.
[0385] Exemplarily, if the current transmission machine does not meet the requirements of free competition, the server informs the current transmission machine that it does not use free competition to determine the speed limit, and the server determines the current transmission machine according to the network card bandwidth of the current transmission machine Limit Internet speed. The bandwidth of the network card of the current transmitter can be used to limit (ie, reduce) the limited network speed of the current transmitter. Due to the limitation of the network speed of the transmission machine, the bandwidth of the ordinary transmission machine can be restricted, and priority is given to ensuring that the high-quality transmission machine occupies the outlet bandwidth of the machine room.
[0386] In one example, when the server determines that the current transmitter meets the free competition requirement based on the status identifier of each transmitter, the server can analyze the status identifier or bandwidth of the transmitter to determine that the current transmitter meets the free competition requirement. If the server determines that the current transmitter meets the second preset condition, it informs the current transmitter that it cannot compete in a freely competitive manner to determine the speed limit, and the server limits the speed limit of the current transmitter according to the network card bandwidth of the current transmitter.
[0387] The server can obtain the current actual network speed of the high-quality transmission machine in the computer room to which the current transmission machine belongs, and the total number of normal transmission machines in the computer room to which the current transmission machine belongs; the server can obtain the current transmission machine’s network card bandwidth and current transmission machine. The total exit bandwidth of the computer room to which the current transmission machine belongs, the current actual network speed of the high-quality transmission machine in the computer room to which the current transmission machine belongs, and the total number of normal transmission machines in the computer room to which the current transmission machine belongs, calculate the current limit network speed of the transmission machine.
[0388] In an example, the server sets the machine room outlet with bandwith_idc (unit MB/s), and establishes three machine information lists, namely the machine flag list {flag(i)="idle machine"|i in machine_all}, machine network card Bandwith_machine(i)=0|i in machine-all}, bandwidth list {real_speed(i)=0|i in machine_all}. Among them, machine_all represents all the conveyors in a machine room, i inmachine_all represents the i-th conveyor among all the conveyors in a machine room, flag(i) represents the status flag of the i-th conveyor; bandwith_machine(i) represents the first The network card bandwidth of the i transmitter; real_speed(i) represents the current actual network speed of the i-th transmitter. The actual network speed list of the machine is obtained in real time.
[0389] Any transmission machine i obtains the sum of the actual concurrency of the i-th transmission machine real_concurrenc_num(i), status flag flag(i), network card bandwidth bandwith_machine(i) and current actual network speed real_speed(i), and reports this machine to the server these messages.
[0390] The server saves and updates the information reported by the transmitter, and assigns limit_speed(i) to the i-th transmitter; the server returns the limit_speed(i) of the i-th transmitter to the i-th transmitter.
[0391] Among them, the second preset condition includes the following implementation methods.
[0392] The first implementation manner: if the server determines that the current transmission machine is not a high-optimum state transmission machine, that is, the previous transmission machine status identifier is not a high-optimization state, the server determines that the current transmission machine meets the second preset condition. At this time, the server needs to limit the limited network speed of the current transmitter, and then limit the bandwidth resources allocated to the current transmitter. In turn, it is ensured that sufficient bandwidth is allocated to the current transmitter in the high-optimal state first.
[0393] The second implementation method: if the server determines that if the number of high-optimized transmission machines in the current transmission machine room is not zero, that is, the current transmission machine room has other high-optimized transmission machines, the server determines The current conveyor meets the second preset condition. At this time, the server needs to limit the limited network speed of the current transmitter, and then limit the bandwidth resources allocated to the current transmitter. In turn, it is ensured that sufficient bandwidth is allocated to other transmitters in a high-optimal state first.
[0394] The third implementation method: If the server determines that the current actual total bandwidth of the computer room to which the current transmission machine belongs is greater than or equal to the preset bandwidth threshold, where the bandwidth threshold is related to the total outlet bandwidth of the computer room, then if the server determines that the current transmission machine meets the second preset condition. At this time, the server needs to limit the current transmission machine's restricted network speed. In an example, the preset bandwidth threshold is the product of the total outlet bandwidth of the computer room to which the current transmitter belongs and the preset ratio value; the preset ratio value is, for example, 0.5.
[0395] In an example, the limited network speed of the current transmitter is related to the first bandwidth parameter, the second bandwidth parameter, and the third bandwidth parameter.
[0396] Among them, the first bandwidth parameter is determined by the server according to the current actual network speed and network card bandwidth of each high-quality transmission machine in the computer room to which the current transmission machine belongs; The sum of the minimum bandwidth reserved by the optimal transmitter.
[0397] In an example, the first bandwidth parameter is
[0398] Among them, real_speed(j) is the current actual network speed of the j-th high-best state transmission machine, real_speed(j)*a is the network speed ratio value of the j-th high-best state transmission machine, and a is the fifth preset The fifth preset value is a positive number greater than 1, bandwith_machine(j) is the network card bandwidth of the j-th high-best state transmission machine, and j is a positive integer greater than or equal to 1.
[0399] The second bandwidth parameter is determined by the server according to the first bandwidth parameter and the total bandwidth of the outlet of the computer room to which the current transmitter belongs; the second bandwidth parameter is the maximum reserved for all ordinary transmitters in the computer room to which the current transmitter belongs The sum of bandwidth. In an example, the second bandwidth parameter is B=bandwith_idc-A; where bandwith_idc is the total outlet bandwidth of the computer room to which the current transmitter belongs, and A is the first bandwidth parameter.
[0400] The third bandwidth parameter is determined by the server according to the second bandwidth parameter and the total number of transmissions in the normal state in the computer room to which the current transmitter belongs; the third bandwidth parameter is the transmission of each normal state in the computer room to which the current transmitter belongs The maximum bandwidth reserved by the machine. In an example, the third bandwidth parameter is C=B/(|machine_ordinary|*b); where B is the second bandwidth parameter, and |machine_ordinary| is the total number of normal state transmission machines in the computer room to which the current transmission machine belongs, |machine_ordinary|*b is the sixth preset value, b is the seventh preset value, and the seventh preset value is a positive number greater than 0.
[0401] The limited network speed of the current transmitter is determined by the server according to the fourth preset value, the network card bandwidth of the current transmitter, and the third bandwidth parameter, where the limited network speed of the current transmitter is greater than or equal to the fourth preset value, and, The limited network speed of the current transmitter is less than or equal to the network card bandwidth of the current transmitter, and the fourth preset value is a positive number greater than zero. In an example, the limited network speed of the current transmission machine is max(d, min(bandwith_machine, C)); where bandwith_machine is the network card bandwidth of the current transmission machine, C is the third bandwidth parameter, and d is the fourth preset value.
[0402] Exemplarily, if the server determines that the current transmitter meets the second preset condition, it needs to calculate the limited bandwidth of the current transmitter. The server can obtain the information of each high-quality transmission machine in the computer room to which the current transmission machine belongs, and then read the current actual network speed and network card bandwidth of each high-quality transmission machine; each high-quality transmission The current actual network speed of the transmitter can be the actual average network speed (in MB/s) within the current 30s of the transmitter; the network card bandwidth of each high-optimized transmitter is its own fixed value.
[0403] The server calculates a first bandwidth parameter according to the current actual network speed and network card bandwidth of each high-quality transmission machine, where the first bandwidth parameter is predicted for all high-quality transmission machines in the computer room to which the current transmission machine belongs. The sum of the minimum bandwidth set aside.
[0404] In an example, when the server calculates the first bandwidth parameter, the server multiplies the current actual network speed of the j-th high-quality transmission machine in the machine room to which the current transmission machine belongs. Take a fifth preset value a, where the fifth preset value a is a positive number greater than 1, to obtain the network speed ratio value of the j-th high-best state transmission machine. For example, the network speed ratio value of the j-th high-best state transmitter=real_speed(j)*1.5, where real_speed(j) is the current actual network speed of the j-th high-best state transmitter, and 1.5 is the fifth default value.
[0405] Next, for the network speed ratio value of the j-th high-best state transmission machine in the machine room to which the current transmission machine belongs, the server takes the network speed ratio value of the j-th high-best state transmission machine and the j-th high-best state transmission The network card bandwidth of the machine is bandwith_machine(j), the minimum value between the two, obtains the limited bandwidth min(bandwith_machine(j), real_speed(j)*a) of the j-th high-best state transmission machine. Furthermore, for each high-best state transmission machine, the server can obtain the minimum value between 1.5 times the actual bandwidth of the high-best state transmission machine and the network card bandwidth of the high-best state transmission machine.
[0406] For example, the restricted bandwidth of the j-th high-best state transmission machine is min(bandwith_machine(j), real_speed(j)*1.5, where bandwith_machine(j) is the network card bandwidth of the j-th high-best state transmission machine, real_speed (j)*1.5*1.5 is the network speed ratio value of the j-th high-quality transmission machine.
[0407] Then, the server sums the restricted bandwidths of the high-optimized transmission machines to obtain the first bandwidth parameter
[0408] Furthermore, the server calculates the sum of the minimum bandwidth that can be reserved for all high-quality transmitters, which facilitates subsequent determination of the limited bandwidth of each high-quality transmitter, and reserves enough for each high-quality transmitter The bandwidth of the “minimum bandwidth” does not include the bandwidth competed by the transmitters in the high optimal state; that is, the first bandwidth parameter characterizes the minimum bandwidth that can be reserved for all the transmitters in the high optimal state Sum. For example, the first bandwidth parameter is sigma(j in machine_priority, min(bandwith_machine(j), real_speed(j)*1.5)), where sigma is the summation formula. machine_priority characterizes the sum of high-priority transmission machines in the same machine room; j in machine_priority characterizes the j-th high-priority transmission machine among all high-priority transmission machines in the same machine room.
[0409] The server can obtain the first bandwidth parameter A; the first bandwidth parameter A characterizes the sum of the minimum bandwidth that can be reserved for all high-quality transmission machines; and the server can obtain the exit of the computer room to which the current transmission machine belongs The total bandwidth bandwith_idc, the total bandwidth of the outlet is a fixed value; the server can subtract the first bandwidth parameter A from the total bandwidth bandwith_idc of the outlet, and then obtain the maximum reserved for all ordinary transmitters in the computer room to which the current transmitter belongs The sum of the bandwidth, that is, the second bandwidth parameter B=bandwith_idc-A is obtained. The second bandwidth parameter is the upper limit of the bandwidth of all transmitters in the normal state. The total export bandwidth, after subtracting the first bandwidth parameter, is to subtract the bandwidth of all high-optimized transmitters, and then reserve enough bandwidth for all high-optimized transmitters to ensure the bandwidth of high-optimized transmitters Resources.
[0410] For example, the second bandwidth parameter is (bandwith_idc-sigma(j in machine_priority, min(bandwith_machine(j), real_speed(j)*1.5))); where bandwith_idc is the total bandwidth of the outlet of the computer room to which the current transmitter belongs; sigma(j in machine_priority, min(bandwith_machine(j), real_speed(j)*1.5)), is the first bandwidth parameter mentioned above.
[0411] The server obtains the second bandwidth parameter B. The second bandwidth parameter B is the upper limit of the bandwidth of all normal state transmitters; the server calculates the third bandwidth parameter according to the second bandwidth parameter B and the total number of normal state transmitters in the computer room to which the current transmitter belongs |machine_ordinary| C. For example, the second bandwidth parameter is divided by the "total number of transmission machines in the normal state in the computer room to which the current transmission machine belongs" to obtain the third bandwidth parameter.
[0412] The above-mentioned third bandwidth parameter C characterizes the maximum bandwidth reserved for each ordinary transmitter in the computer room to which the current transmitter belongs. Furthermore, the bandwidth is reserved for the transmitter in the normal state to ensure that the transmitter in the normal state is allocated bandwidth resources.
[0413] In an example, when calculating the third bandwidth parameter, the server sums the total number of ordinary transmission machines in the machine room to which the current transmission machine belongs |machine_ordinary| and the seventh preset value b, and obtains a first Sixth preset value |machine_ordinary|*b; wherein, the seventh preset value b is a positive number greater than 0. Then, the server divides the second bandwidth parameter B by the sixth preset value |machine_ordinary|*b to obtain the third bandwidth parameter C=B/(|machine_ordinary|*b).
[0414] For example, the sixth preset value=(0.1+|machine_ordinary|), where |machine_ordinary| is "the total number of ordinary conveyors in the machine room to which the current conveyor belongs", and 0.1 is the seventh preset value. The third bandwidth parameter is (bandwith_idc-sigma(j in machine_priority,min(bandwith_machine(j),real_speed(j)*1.5)))/(0.1+|machine_ordinary|), the third bandwidth parameter is the transmission of each normal state The upper limit of the machine’s bandwidth. Wherein, the second bandwidth parameter is (bandwith_idc-sigma(j in machine_priority, min(bandwith_machine(j), real_speed(j)*1.5))).
[0415] The server obtains the third bandwidth parameter C; the third bandwidth parameter C characterizes the maximum bandwidth reserved for each normal state transmitter in the computer room to which the current transmitter belongs. In addition, the server can directly obtain the network card bandwidth of the current transmitter, and the network card bandwidth of the current transmitter is a fixed value.
[0416] Then, the server limits the restricted network speed of the current transmission machine according to the fourth preset value d, the network card bandwidth bandwith_machine of the current transmission machine, and the third bandwidth parameter C, so as to obtain the restricted network speed of the current transmission machine. Wherein, the fourth preset value is a positive number greater than zero. The obtained restricted network speed is greater than or equal to the fourth preset value, and the obtained restricted network speed is less than or equal to the network card bandwidth of the current transmitter.
[0417] In an example, the server takes the network card bandwidth bandwith_machine of the current transmission machine, the third bandwidth parameter C, and the minimum value between the two as the fourth bandwidth parameter min(bandwith_machine, C); taking the network card bandwidth and the third bandwidth parameter of the current transmission machine When the three bandwidth parameters are the minimum between the two, the limit network speed of the current transmitter can be restricted not to be too large. Then, the server takes the fourth preset value d, the fourth bandwidth parameter min (bandwith_machine, C), and the maximum value between the two is used as the current transmission machine's limited network speed max (d, min (bandwith_machine, C)); When the maximum value between the fourth preset value and the fourth bandwidth parameter is taken, the limiting network speed of the current transmitter can be restricted to not be too small.
[0418] For example, max(1, min(bandwith_machine(i), third bandwidth parameter)); where bandwith_machine(i) is the network card bandwidth of the i-th transmitter (ie, the current transmitter), and 1 is the fourth preset value. Among them, min(bandwith_machine(i), the third bandwidth parameter) can ensure that the current transmission machine's limiting network speed cannot be too large. max can ensure that the current transmission machine's limited network speed cannot be too small; and if min(bandwith_machine(i), the third bandwidth parameter is a very small value or a negative number, it can also guarantee the current transmission machine's limited network speed It is greater than or equal to 1 (that is, the fourth preset value). Through the above method, the current limited network speed of the transmission machine is controlled within the interval from 1 to bandwith_machine(i).
[0419] Through the above-mentioned specific technical process, the limited network speed of the current transmitter can be determined; the limited network speed is used to generate the total concurrency threshold of the current transmitter. Multiple parameters can be used to limit the restricted network speed to ensure that the restricted network speed will not be too high or too small.
[0420] 603. Each transmitter determines the first concurrency threshold of the current transmitter according to the current actual network speed of the current transmitter and the limited network speed, where the first concurrency threshold represents the available concurrency of the current transmitter under the limited network speed degree.
[0421] In an example, step 603 specifically includes:
[0422] In the first step of step 603, each transmission machine determines the network speed limit ratio of the current transmission machine according to the current limit network speed of the current transmission machine and the current actual network speed of the current transmission machine. Among them, the network speed limit ratio is the limit network speed and The ratio between the current actual network speeds.
[0423] In the second step of step 603, each transmitter determines the first concurrency threshold of the current transmitter according to the network speed limit ratio of the current transmitter and the sum of the actual concurrency of the current transmitter, where the sum of the actual concurrency is the current transmission The sum of the actual concurrency of each task in the transmission state in the machine.
[0424] Exemplarily, since each transmission machine is working, and each transmission machine has an actual network speed, the current transmission machine can read the current actual network speed of the current transmission machine. The current limited network speed of the transmission machine represents the maximum network speed that the transmission machine can reach. The actual network speed of the transmission machine represented by the current actual network speed can be based on the current actual network speed of the current transmission machine and the limit network speed. Calculate the total concurrency threshold of the current transmitter.
[0425] The current transmitter can limit the available concurrency of the current transmitter according to the current actual network speed and the limited network speed of the current transmitter, and calculate the first concurrency threshold of the current transmitter; that is, the first concurrency threshold represents The available concurrency of the current transmitter under the limited network speed.
[0426] In one example, the current transmission machine divides the current transmission machine's restricted network speed by the current actual transmission machine's current actual network speed, and then obtains the current transmission machine's network speed restriction ratio. Then, the current transmission machine multiplies the network speed limit ratio of the current transmission machine and the sum of the actual concurrency of the current transmission machine to obtain the first concurrency threshold for determining the current transmission machine; and the first concurrency threshold is an integer . Furthermore, the available concurrency of the current transmitter is obtained, so as to determine the total concurrency threshold of the current transmitter.
[0427] For example, the limit_speed(i) of the i-th transmitter is divided by the current actual speed of the i-th transmitter real_speed(i), and then multiplied by the sum of the actual concurrency of the i-th transmitter real_concurrency_num(i) , Get a value, and round the value to get the first concurrency threshold of the i-th transmitter=int(limit_speed(i)/real_speed(i)*real_concurrency_num(i)). Among them, int is a function of rounding down.
[0428] 604. Each transmitter determines the total concurrency threshold of the current transmitter according to the first concurrency threshold of the current transmitter and the preset initial total concurrency threshold, where the total concurrency threshold of the current transmitter is less than or equal to the initial concurrency Degree total threshold. Among them, the total concurrency threshold is the upper limit of the sum of the actual concurrency, and the sum of the actual concurrency is the sum of the actual concurrency of each task.
[0429] In an example, step 604 specifically includes:
[0430] In the first step of step 604, each transmitter determines the minimum value between the first concurrency threshold and the initial total concurrency threshold, which is the second concurrency threshold.
[0431] In the second step of step 604, each transmitter determines the maximum value between the eighth preset value and the second concurrency threshold, which is the total concurrency threshold of the current transmitter, where the eighth preset value is greater than A positive number equal to zero.
[0432] Exemplarily, after obtaining the first concurrency threshold of the current transmitter, an initial total concurrency threshold has been preset, and the initial total concurrency threshold is a larger concurrency; the current transmitter can use the initial concurrency The total threshold and the first concurrency threshold constrain the total concurrency threshold of the current transmitter, and then obtain the final total concurrency threshold. In the constraint process, it is necessary to control the final total concurrency threshold to be less than or equal to the initial total concurrency threshold.
[0433] In an example, the current transmitter takes the first concurrency threshold of the current transmitter, the total initial concurrency threshold, and the minimum between the two as the second concurrency threshold of the current transmitter; and then controls the concurrency of the current transmitter The total degree threshold cannot be too large. Then, the current transmitter takes the eighth preset value and the second concurrency threshold, and the maximum value between the two is used as the total concurrency threshold of the current transmitter; furthermore, the total concurrency threshold of the current transmitter cannot be too small. . Wherein, the eighth preset value is a positive number greater than or equal to zero.
[0434] For example, the second concurrency threshold of the i-th transmitter is min(init_concurrency_threshold(i),int(limit_speed(i)/real_speed(i)*real_concurrency_num(i))); where, int(limit_speed(i)/real_speed (i)*real_concurrency_num(i)) is the first concurrency threshold of the i-th transmitter. The total concurrency_threshold(i)=max(0,min(init_concurrency_threshold(i),int(limit_speed(i)/real_speed(i)*real_concurrency_num(i)))) of the concurrency_threshold(i)=max(0,min(init_concurrency_threshold(i))); where 0 is The eighth preset value.
[0435] Then, since the total concurrency threshold of the current transmitter indicates the sum of all concurrency resources available to the current transmitter, the current transmitter can be the task to be transmitted in the current transmitter according to the total concurrency threshold of the current transmitter Allocate concurrency (ie, concurrency resources). In an example, the current transmitter can allocate resources (ie, concurrency resources) for each task to be transmitted according to the priority of each task to be transmitted.
[0436] Then, the current transmitter separately transmits each task to be transmitted according to the resources allocated for each task to be transmitted.
[0437] Through the process of steps 603-604, configure different limit network speeds for different states of the transmitter, and then configure different total concurrency thresholds for different states of the transmitter, and improve the tasks with the first priority level (high-quality tasks) The total concurrency threshold reduces the total concurrency threshold of tasks that do not have the first priority level (ordinary tasks); and the total concurrency threshold of each transmitter can be dynamically adjusted in real time. Furthermore, it is ensured that the transmitter with the first priority level to be transmitted (high-quality task) gets more bandwidth resources, that is, it is guaranteed that the first-priority level to be transmitted (high-quality task) gets more bandwidth resources, and the Is transmitted.
[0438] Through steps 603-604, if there are high-optimized state transmitters and normal state transmitters in the same computer room, and the total bandwidth of the computer room is insufficient, it is necessary to limit the bandwidth of the normal state transmitters and idle state transmitters (ie, Limit the bandwidth of non-high-optimized transmitters); prioritize the allocation of bandwidth for high-optimized transmitters to ensure that the high-optimized transmitters occupy the outlet bandwidth of the room. Through the above-mentioned free competition and bandwidth restriction method, the high-optimized state transmitter can be allocated sufficient bandwidth, while the ordinary state transmitter is allocated the remaining bandwidth; and it can minimize the overall transmission of the machine room. The overall transmission speed.
[0439] In an example, after performing step 604, you can also perform figure 2 or image 3 The process of the embodiment.
[0440] In this embodiment, on the basis of the foregoing embodiment, the current transmission machine's restricted network speed is determined by analyzing the status identifiers of all the transmission machines in the computer room to which the current transmission machine belongs. The transmission machine that meets the requirements of free competition can compete in the way of free competition to determine the speed limit, and the transmission machine that does not meet the requirements of free competition is restricted by the method of restriction; further, it is guaranteed that the follow-up process is high-quality The transmitters preferentially compete for the total export bandwidth of the computer room, which can ensure that sufficient bandwidth is allocated for high-quality transmitters. Then, through the current actual network speed and limiting network speed and other parameters, the total concurrency threshold of the current transmitter is deployed; the total concurrency threshold cannot be too large or too small. So that the high-optimized state transmitter is allocated sufficient bandwidth, and the normal state transmitter is allocated the remaining bandwidth; and, the overall transmission speed of all transmitters in the computer room can be minimized. Furthermore, on the basis of the above-mentioned embodiments, it is ensured that high-quality transmissions and high-quality tasks can occupy more bandwidth resources, and high-quality tasks are guaranteed to be transmitted first and fast; at the same time, all tasks in the computer room can be high-speed For transmission, the transmitter can reuse bandwidth resources to ensure that bandwidth resources are not idle and maximize the overall transmission throughput of the computer room.
[0441] Figure 21 Is a schematic diagram according to the eleventh embodiment of this application, such as Figure 21 As shown, the conveyor processing system based on the computer room system provided in this embodiment includes a server and at least one conveyor, and each conveyor includes:
[0442] The sending unit 61 is configured to send the status identifier of the current transmitter to the server, where the status identifier is used to indicate that the transmitter is in an idle state, or a high-optimal state, or a normal state; the transmitter in the idle state is not transmitting tasks, The conveyor in the high priority state transmits tasks whose priority is higher than the preset priority threshold, and the transmitter in the normal state transmits tasks whose priority is lower than the preset priority threshold.
[0443] The receiving unit 62 is configured to receive the current limited network speed of the transmission machine sent by the server, wherein the server stores the attribute information of each transmission machine in the computer room to which the current transmission machine belongs, and the attribute information includes the status identification of the transmission machine and the transmission machine. The current actual network speed; the limiting network speed is determined by the server according to the status identification of each transmission machine.
[0444] The determining unit 63 is configured to determine the total concurrency threshold of the current transmitter according to the current actual network speed and the restricted network speed of the current transmitter, and the total concurrency threshold is used for data transmission of the transmitter.
[0445] In an example, the conveyor processing system based on the computer room system provided in this embodiment can also execute figure 2 or image 3 The technical solution of the illustrated embodiment; the conveyor processing system based on the computer room system provided in this embodiment may also include Picture 10 or Picture 11 The device of the illustrated embodiment.
[0446] The conveyor processing system based on the computer room system of this embodiment can execute Figure 19-20 The specific implementation process and technical principles of the technical solutions in the embodiments of are the same, and will not be repeated here.
[0447] Figure 22 Is a schematic diagram according to the twelfth embodiment of this application, such as Figure 22 Shown in Figure 21 On the basis of the illustrated embodiment, the attribute information also includes the network card bandwidth of the transmission machine; when the server determines that the current transmission machine meets the requirements of free competition according to the status identification of each transmission machine, the limit network speed of the current transmission machine is the server according to the free competition Determined by the way.
[0448] When the server determines that the current transmission machine does not meet the requirements of free competition according to the status identification of each transmission machine, the restricted network speed of the current transmission machine is determined by the server according to the network card bandwidth of the current transmission machine.
[0449] In an example, when the server determines that the current transmission machine meets the requirements of free competition according to the status identification of each transmission machine, the current transmission machine meets the first preset condition, and the network card bandwidth of the current transmission machine is the limit network speed of the current transmission machine .
[0450] Among them, the first preset condition is that the current actual total bandwidth of the computer room to which the current transmitter belongs is less than the preset bandwidth threshold, or the status of the current transmitter is identified as a high-optimum state, or the computer room to which the current transmitter belongs is in a high-optimal state The number of transmitters is zero; the bandwidth threshold is the product of the total bandwidth of the outlet of the computer room to which the current transmitter belongs and the preset ratio value.
[0451] In an example, the attribute information also includes the current actual network speed of the transmission; when the server determines that the current transmission does not meet the requirements of free competition according to the status identification of each transmission, the current transmission meets the second preset condition, and the current transmission The limited network speed of the transmission machine and the bandwidth of the network card of the current transmission machine, the total export bandwidth of the computer room to which the current transmission machine belongs, the current actual network speed of the high-quality transmission machine in the computer room to which the current transmission machine belongs, and the normal state in the computer room where the current transmission machine belongs The total number of conveyors are related.
[0452] Among them, the second preset condition is that the current actual total bandwidth of the computer room to which the current transmitter belongs is greater than or equal to the preset bandwidth threshold, or the status of the current transmitter is not in the high-optimal state, or the computer room to which the current transmitter is in the high-optimal state The number of transmitters is not zero; where the bandwidth threshold is the product of the total bandwidth of the outlet of the computer room to which the current transmitter belongs and the preset ratio value.
[0453] In an example, the limited network speed of the current transmitter is related to the first bandwidth parameter, the second bandwidth parameter, and the third bandwidth parameter.
[0454] Among them, the first bandwidth parameter is determined by the server according to the current actual network speed and network card bandwidth of each high-quality transmission machine in the computer room to which the current transmission machine belongs; The sum of the minimum bandwidth reserved by the optimal transmitter.
[0455] The second bandwidth parameter is determined by the server according to the first bandwidth parameter and the total bandwidth of the outlet of the computer room to which the current transmitter belongs; the second bandwidth parameter is the maximum reserved for all ordinary transmitters in the computer room to which the current transmitter belongs The sum of bandwidth.
[0456] The third bandwidth parameter is determined by the server according to the second bandwidth parameter and the total number of transmissions in the normal state in the computer room to which the current transmitter belongs; the third bandwidth parameter is the transmission of each normal state in the computer room to which the current transmitter belongs The maximum bandwidth reserved by the machine.
[0457] In addition, the limited network speed of the current transmitter is determined by the server according to the fourth preset value, the network card bandwidth of the current transmitter, and the third bandwidth parameter, where the limited network speed of the current transmitter is greater than or equal to the fourth preset value, In addition, the limited network speed of the current transmitter is less than or equal to the network card bandwidth of the current transmitter, and the fourth preset value is a positive number greater than zero.
[0458] In an example, the first bandwidth parameter is
[0459] Among them, real_speed(j) is the current actual network speed of the j-th high-best state transmission machine, real_speed(j)*a is the network speed ratio value of the j-th high-best state transmission machine, and a is the fifth preset The fifth preset value is a positive number greater than 1, bandwith_machine(j) is the network card bandwidth of the j-th high-best state transmission machine, and j is a positive integer greater than or equal to 1.
[0460] In an example, the second bandwidth parameter is B=bandwith_idc-A; where bandwith_idc is the total outlet bandwidth of the computer room to which the current transmitter belongs, and A is the first bandwidth parameter.
[0461] In an example, the third bandwidth parameter is C=B/(|machine_ordinary|*b).
[0462] Among them, B is the second bandwidth parameter, |machine_ordinary| is the total number of ordinary transmission machines in the machine room to which the current transmission machine belongs, |machine_ordinary|*b is the sixth preset value, b is the seventh preset value, and the first Seven preset value is a positive number greater than 0.
[0463] In an example, the current limited network speed of the transmission machine is max(d, min(bandwith_machine, C)).
[0464] Among them, bandwith_machine is the network card bandwidth of the current transmission machine, C is the third bandwidth parameter, and d is the fourth preset value.
[0465] In an example, the determining unit 63 includes:
[0466] The first determining subunit 631 is configured to determine the first concurrency threshold of the current transmission machine according to the current actual network speed of the current transmission machine and the restricted network speed, where the first concurrency threshold represents the current transmission machine under the restricted network speed The available concurrency.
[0467] The second determining subunit 632 is configured to determine the total concurrency threshold of the current transmitter according to the first concurrency threshold of the current transmitter and the preset initial total concurrency threshold, where the total concurrency threshold of the current transmitter is less than Equal to the total threshold of initial concurrency.
[0468] In an example, the first determining subunit 631 includes:
[0469] The first determining module 6311 is used to determine the network speed limit ratio of the current transmission machine according to the current limit network speed of the current transmission machine and the current actual network speed of the current transmission machine. The network speed limit ratio is the limit network speed and the current actual network speed. Ratio between speeds.
[0470] The second determining module 6312 is used to determine the first concurrency threshold of the current transmission machine according to the network speed limit ratio of the current transmission machine and the sum of the actual concurrency of the current transmission machine, where the sum of the actual concurrency is the sum of the current transmission machine The sum of the actual concurrency of each task in the transmission state.
[0471] In an example, the second determining subunit 632 includes:
[0472] The third determining module 6321 is configured to determine the minimum value between the first concurrency threshold and the initial total concurrency threshold, which is the second concurrency threshold.
[0473] The fourth determining module 6322 is used to determine the maximum value between the eighth preset value and the second concurrency threshold, which is the total concurrency threshold of the current transmitter, where the eighth preset value is a positive value greater than or equal to zero. number.
[0474] In an example, the conveyor processing system based on the computer room system provided in this embodiment can also execute figure 2 or image 3 The technical solution of the illustrated embodiment; the conveyor processing system based on the computer room system provided in this embodiment may also include Picture 10 or Picture 11 The device of the illustrated embodiment.
[0475] The conveyor processing system based on the computer room system of this embodiment can execute Figure 19-20 The specific implementation process and technical principles of the technical solutions in the embodiments of are the same, and will not be repeated here.
[0476] Figure 23 Is a schematic diagram according to the thirteenth embodiment of this application, such as Figure 23 As shown, the data transmission method based on the transmitter provided in this embodiment includes:
[0477] 701. According to the total concurrency threshold of the current transmitter and the actual concurrency of each task in the current transmitter, determine the expected concurrency of tasks to be transmitted with different priorities, where the tasks have priority, and the total concurrency threshold is The upper limit of the sum of the actual concurrency, the sum of the actual concurrency is the sum of the actual concurrency of each task; the expected concurrency is characterized by the number of resources allocated by the task to be transmitted, and the expected concurrency of tasks to be transmitted with different priorities is different.
[0478] Exemplarily, the execution subject of this embodiment may be a transmitter, or a data transmission device or device based on a transmitter, or other devices or devices that can execute the method of this embodiment. This embodiment is described with the execution subject as the transmission machine.
[0479] You can participate in this step image 3 The steps 101-102 shown are not repeated here.
[0480] 702. Start resources corresponding to the number of resources represented by the expected concurrency of each task to be transmitted, and respectively transmit each task to be transmitted.
[0481] Illustratively, this step can participate image 3 The step 103 shown is not repeated here.
[0482] The technical effect of this embodiment can be referred to image 3 The technical effect of this is not repeated here.
[0483] Figure 24 Is a schematic diagram according to the fourteenth embodiment of this application, such as Figure 24 As shown, the electronic device 70 in this embodiment may include: a processor 71 and a memory 72.
[0484] The memory 72 is used to store programs; the memory 72 may include a volatile memory (English: volatile memory), such as random-access memory (English: random-access memory, abbreviation: RAM), such as static random-access memory (English: static random-access memory, abbreviation: SRAM), double data rate synchronous dynamic random access memory (English: Double Data Rate Synchronous Dynamic Random Access Memory, abbreviation: DDR SDRAM), etc.; memory can also include non-volatile memory ( English: non-volatile memory), such as flash memory (English: flash memory). The memory 72 is used to store computer programs (such as application programs and functional modules that implement the above methods), computer instructions, etc., and the above computer programs, computer instructions, etc. may be partitioned and stored in one or more memories 72. In addition, the aforementioned computer programs, computer instructions, data, etc. can be called by the processor 71.
[0485] The aforementioned computer programs, computer instructions, etc. may be partitioned and stored in one or more memories 72. In addition, the aforementioned computer programs, computer data, etc. can be called by the processor 71.
[0486] The processor 71 is configured to execute a computer program stored in the memory 72 to implement the above figure 2 ,or image 3 ,or Figure 23 ,or Figure 14 ,or Figure 15 Each step in the method involved in the embodiment.
PUM
Description & Claims & Application Information
We can also present the details of the Description, Claims and Application information to help users get a comprehensive understanding of the technical details of the patent, such as background art, summary of invention, brief description of drawings, description of embodiments, and other original content. On the other hand, users can also determine the specific scope of protection of the technology through the list of claims; as well as understand the changes in the life cycle of the technology with the presentation of the patent timeline. Login to view more.