Data transmission method, system, node and readable storage medium

Abstract

The present invention discloses a data transmission method, system, node and readable storage medium. The data transmission method comprises: obtaining data to be forwarded according to a preset time of business restriction; adjusting the data length of the data to be forwarded according to a preset value of bandwidth speed limit to obtain the data forwarded this time; and sending the data forwarded this time to the next node. The present invention sets a preset time of business restriction so that the current node will not perform data transmission during the peak time of normal business handling, thereby effectively reducing the occupation of remote broadband during normal business handling time. At the same time, when sending remote data, the preset value of bandwidth speed limit occupied by data transmission will be further limited, thereby avoiding the problem of remote data transmission being completely occupied due to a surge in data in a short period of time, further alleviating the interference with normal business handling.

Description

Technical Field

[0001] The present invention relates to the field of information processing, and in particular to a data transmission method, system, node and readable storage medium. Background Art

[0002] Currently, there are various data transmission scenarios between enterprise systems. When data is transmitted remotely, the bandwidth is often occupied because the network bandwidth for remote transmission is small, which affects the normal business operations of the system and causes troubles for operators and users. Summary of the invention

[0003] The present invention aims to solve at least one of the technical problems existing in the prior art. To this end, the present invention proposes a data transmission method, which solves the problem that normal business handling is affected when data is transmitted in different places.

[0004] The present invention also proposes a data transmission system, a node and a computer-readable storage medium.

[0005] A data transmission method according to a first aspect of the present invention includes:

[0006] Get the data to be forwarded at a preset time according to business restrictions;

[0007] Adjust the data length of the data to be forwarded according to the preset bandwidth speed limit value to obtain the data forwarded this time;

[0008] The forwarded data is sent to the next node.

[0009] The data transmission method according to the embodiment of the present invention has at least the following beneficial effects:

[0010] By setting a preset time for business restrictions, the current node will not transmit data during the peak hours of normal business processing, thereby effectively reducing the occupancy of remote broadband during normal business processing hours. At the same time, when sending data remotely, the bandwidth speed limit preset value occupied by data transmission will be further limited, thereby avoiding the problem of remote data transmission being completely occupied due to a short-term data surge, further alleviating interference with normal business processing.

[0011] According to some embodiments of the present invention, obtaining the data to be forwarded at a preset time according to the service restriction includes:

[0012] If the current time is within the service restriction preset time, stop obtaining the to-be-forwarded data from the data cache module, wherein the data cache module is used to cache the to-be-forwarded data sent by the previous node.

[0013] According to some embodiments of the present invention, obtaining the data to be forwarded at a preset time according to the service restriction includes:

[0014] If the current time is not within the service restriction preset time, the to-be-forwarded data is obtained from a data cache module, wherein the data cache module is used to cache the to-be-forwarded data sent by the previous node.

[0015] According to some embodiments of the present invention, the step of adjusting the data length of the data to be forwarded according to the preset bandwidth speed limit value to obtain the currently forwarded data includes:

[0016] If the data length of the currently read data to be forwarded exceeds the preset value of the bandwidth speed limit, the currently read data to be forwarded is discarded, and the data length of the re-read data to be forwarded is less than the data length of the currently read data to be forwarded, until the data length of the re-read data to be forwarded is less than or equal to the preset value of the bandwidth speed limit, to obtain the forwarded data this time.

[0017] According to some embodiments of the present invention, the step of adjusting the data length of the data to be forwarded according to the preset bandwidth speed limit value to obtain the currently forwarded data includes:

[0018] If the data length of the currently read data to be forwarded is less than or equal to the preset bandwidth speed limit value, the data to be forwarded is used as the currently forwarded data.

[0019] According to some embodiments of the present invention, the data transmission method further includes:

[0020] The data to be forwarded is encrypted.

[0021] According to some embodiments of the present invention, the data transmission method further includes:

[0022] Acquire configuration information, where the configuration information includes the service restriction preset time and the wide speed limit preset value.

[0023] A data transmission system according to a second aspect of an embodiment of the present invention includes:

[0024] A data receiving unit, used to obtain the data to be forwarded according to the preset time of the service restriction;

[0025] A data reading unit, used for adjusting the data length of the data to be forwarded according to the preset bandwidth speed limit value, to obtain the data to be forwarded this time;

[0026] The data sending unit is used to send the forwarded data to the next node.

[0027] The data transmission system according to the embodiment of the present invention has at least the following beneficial effects:

[0028] By setting a preset time for business restrictions, the current node will not transmit data during the peak hours of normal business processing, thereby effectively reducing the occupancy of remote broadband during normal business processing hours. At the same time, when sending data remotely, the bandwidth speed limit preset value occupied by data transmission will be further limited, thereby avoiding the problem of remote data transmission being completely occupied due to a short-term data surge, further alleviating interference with normal business processing.

[0029] According to the third aspect of the present invention, the node includes a memory, a communication module, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the above-mentioned data transmission method when executing the computer program. Since the computer program executes all the technical solutions of the data transmission method of the above-mentioned embodiment, it at least has all the beneficial effects brought by the technical solutions of the above-mentioned embodiment.

[0030] According to the computer-readable storage medium of the fourth aspect embodiment of the present invention, computer executable instructions are stored, and the computer executable instructions are used to execute the data transmission method as described above. Since the computer-readable storage medium adopts all the technical solutions of the data transmission method of the above embodiment, it at least has all the beneficial effects brought by the technical solutions of the above embodiment.

[0031] Other features and advantages of the present invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0033] Figure 1 is a system schematic diagram of a working system provided by an embodiment of the present invention;

[0034] Figure 2 is a flow chart of a data transmission method provided by an embodiment of the present invention;

[0035] Figure 3 is a flowchart of a data transmission method provided by another embodiment of the present invention. DETAILED DESCRIPTION

[0036] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be understood as limiting the present invention.

[0037] In the description of the present invention, if there is a description of first, second, etc., it is only for the purpose of distinguishing technical features, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features or implicitly indicating the order of the indicated technical features.

[0038] In the description of the present invention, it should be understood that descriptions involving orientation, such as orientation or positional relationship indicated as up, down, etc., are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present invention.

[0039] In the description of the present invention, it should be noted that, unless otherwise clearly defined, terms such as setting, installing, connecting, etc. should be understood in a broad sense, and technicians in the relevant technical field can reasonably determine the specific meanings of the above terms in the present invention in combination with the specific content of the technical solution.

[0040] The technical solution of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described below are only some embodiments of the present invention, not all embodiments.

[0041] In order to better describe the data transmission method, system, node and readable storage medium of the embodiment of the present invention, a working system is proposed here, such as Figure 1 As shown, the working system includes a first computer room and a second computer room. The first computer room deploys a control module, a configuration library, a data cache module, a data receiving module and an encryption module. The configuration library is used to store configuration information. The second computer room deploys a decryption module, a data output module and a data storage module. After the administrator sends a configuration instruction to the first computer room through the web (World Wide Web, Global Wide Area Network), the data receiving module can obtain the configuration information corresponding to the configuration instruction and complete the initialization configuration. After that, the first computer room can complete the caching, encryption and forwarding of the data to be forwarded according to the configuration information, and forward it to the second computer room. After receiving the data received by the first computer room, the second computer room will receive, decrypt and store it in the data storage module.

[0042] It should be noted that the working system proposed in this embodiment is for more clearly illustrating the technical solution of the embodiment of the present invention, and does not constitute a limitation on the technical solution provided by the embodiment of the present invention.

[0043] See also Figure 2 As shown, Figure 2 is a flow chart of a data transmission method provided by an embodiment of the present invention, the data transmission method includes but is not limited to steps S100 to S300,

[0044] Step S100, obtaining data to be forwarded according to a preset time limit of a service;

[0045] Step S200, adjusting the data length of the data to be forwarded according to the preset bandwidth speed limit value to obtain the data forwarded this time;

[0046] Step S300, sending the forwarded data to the next node.

[0047] The business restriction preset time represents the time when the sending of data to be forwarded is not allowed. During this time period, the data receiving module will stop reading the data to be forwarded from the data cache module to ensure that normal office business is not impacted as much as possible. The data to be forwarded will only be read and forwarded in the time period exceeding the time period corresponding to the business restriction preset time.

[0048] In the process of forwarding data, the impact of occupying network bandwidth on normal business will be further considered, so as to use the preset value of bandwidth speed limit to constrain the transmission rate of data transmitted by the data receiving module, so that the amount of data transmitted each time is within the constraint range of the preset value of bandwidth speed limit. In addition, when the amount of data to be forwarded read each time exceeds the target length, the data length will be adjusted to the range constrained by the preset value of bandwidth speed limit, which can not only avoid data loss, but also ensure that too much bandwidth is not occupied during data transmission. Finally, after the dual restriction and adjustment of the preset time of business restriction and the preset value of bandwidth speed limit, the forwarded data read from the data cache module can be transmitted to the next node (for example: the second computer room).

[0049] The data transmission method of the embodiment of the present invention sets a business restriction preset time so that the current node will not transmit data during the peak hours of normal business processing, thereby effectively reducing the occupation of remote broadband during normal business processing hours. At the same time, when remote data is sent, the bandwidth speed limit preset value occupied by data transmission will be further limited, thereby avoiding the problem of remote data transmission being completely occupied due to a short-term data surge, further alleviating interference with normal business processing.

[0050] In some embodiments, according to some embodiments of the present invention, step S100 includes but is not limited to the following steps:

[0051] If the current time is within the service restriction preset time, stop obtaining the data to be forwarded from the data cache module, wherein the data cache module is used to cache the data to be forwarded sent by the previous node.

[0052] In the practice period corresponding to the preset time of the business limit, the data receiving module will stop reading the data to be forwarded from the data cache module, and then stop sending the forwarded data to the next node. At this time, the previous node (such as other business systems or higher-level data centers) may continue to send the data to be forwarded to the first computer room. In this case, these data to be forwarded will be stored in the data cache module of the first computer room in the form of a queue in chronological order. After exceeding the preset time of the business limit, they will be read and sent again.

[0053] In some embodiments, step S100 further includes the following steps:

[0054] If the current time is not within the service restriction preset time, the data to be forwarded is obtained from the data cache module, wherein the data cache module is used to cache the data to be forwarded sent by the previous node.

[0055] When the time period corresponding to the preset time of the business limit is exceeded, the data receiving module will read the data to be forwarded according to the time sequence of the data to be forwarded cached in the data cache module, and then transmit it to the next node; it should be noted that during the forwarding process, if there is data sent to the first computer room, this data will be stored at the end of the cached data queue in the data cache module, and will continue to be sent in chronological order after the backlog of data to be forwarded is sent.

[0056] In some embodiments, step S200 includes but is limited to the following steps:

[0057] If the data length of the currently read data to be forwarded exceeds the preset value of the bandwidth speed limit, the currently read data to be forwarded is discarded, and the data length of the re-read data to be forwarded is less than the data length of the currently read data to be forwarded, until the data length of the re-read data to be forwarded is less than or equal to the preset value of the bandwidth speed limit, and the data forwarded this time is obtained.

[0058] When reading data, in order to ensure the completeness of the data, the data will be read one by one. Therefore, when reading data, only the approximate number M can be estimated according to the configuration. However, after reading M data, it is likely that the bandwidth required for a single data transmission will exceed the preset value of the bandwidth speed limit. At this time, in order to avoid speeding and to ensure the integrity of data transmission, the M data previously read will be discarded, and then M-1 data will be re-read to determine whether it exceeds the preset value of the bandwidth speed limit. If it still exceeds, the number of data read will be further reduced until the final read data to be forwarded is within the constraint range of the preset value of the bandwidth speed limit, and finally sent out as the data sent this time. It should be noted that the data in the data cache module will not be discarded during the reading stage, but will be discarded or overwritten after the forwarded data is sent this time to ensure the integrity of the final transmitted data.

[0059] In some embodiments, step S200 further includes the following steps:

[0060] If the length of the data to be forwarded currently read is less than or equal to the preset value of the bandwidth limit, the data to be forwarded will be used as the data to be forwarded this time.

[0061] If the data length of the data to be forwarded read by the data receiving module does not exceed the preset bandwidth speed limit value, it means that the data transmission this time will not exceed the constraint range of the preset bandwidth speed limit value. Therefore, the read data to be forwarded can be directly sent.

[0062] In some embodiments, the data transmission method further includes:

[0063] The data to be forwarded is encrypted.

[0064] For the security of data transmission, data encryption will be performed first during data transmission to prevent non-related personnel or organizations from stealing business information. The data to be forwarded read by the data receiving module will be encrypted by the encryption module and then transmitted to the second computer room. The second computer room will be decrypted by the decryption module and then transmitted to the data storage module. It should be noted that because the data needs to be encrypted and the data length of the data will be changed during encryption, in order to ensure that the data transmission process does not exceed the constraint requirements of the preset bandwidth speed limit, the data receiving module will first encrypt the data after reading the data to be forwarded, and then determine whether the data length of the data exceeds the constraint requirements of the preset bandwidth speed limit.

[0065] In some embodiments, the encryption process may directly use the 3DES reversible algorithm for encryption, or may use other existing encryption algorithms for encryption.

[0066] like Figure 3 As shown, in some embodiments, the data transmission method further includes step S400,

[0067] Step S400, obtaining configuration information, the configuration information including a service restriction preset time and a broadband speed preset value.

[0068] Before data is received and transmitted, in order to ensure that the transmitted data can be subject to time and bandwidth constraints, configuration information will be obtained in advance, and after the configuration information is obtained, the initialization configuration will be completed.

[0069] In order to better illustrate the data transmission method of the embodiment of the present application, a specific embodiment is further described here. In this specific embodiment, the service restriction preset time is 8:00 to 18:00, the bandwidth speed limit preset value is 1M / S, and the encryption algorithm is a 3DES reversible algorithm.

[0070] The administrator sends the configuration instructions to the configuration library in the WEB interface, and the data receiving module reads the configuration information corresponding to the configuration instructions (including at least the preset time of service restriction and the preset value of bandwidth speed limit), and completes the initialization settings;

[0071] The data receiving module continuously receives the data to be forwarded transmitted by the external system and stores it in the data cache module;

[0072] If the current time is between 8:00 and 18:00, the received data to be forwarded will be continuously cached in the data cache module;

[0073] If the current time is not between 8:00 and 18:00, a thread is started to read the data to be forwarded from the data cache module. The number of data to be read for the first time can be M according to the configuration information, and the M data read are encrypted using the 3DES reversible algorithm to obtain the encrypted data to be forwarded; it is determined whether the data length of the encrypted data to be forwarded exceeds 1M. If so, the data read this time is discarded, and M-1 data are read again, and then it is determined again whether it exceeds 1M, until the data length of the encrypted data to be forwarded is less than 1M, and the data to be forwarded at this time is used as the data to be forwarded this time; in addition, when the encrypted data length of the M data read for the first time is less than 1M, it can be directly used as the data to be forwarded this time;

[0074] The forwarded data is forwarded to the decryption module in the second computer room, decrypted, and sent to the data storage module for storage.

[0075] The data transmission method of this specific embodiment sets a preset service restriction time so that the current node will not transmit data during the peak hours of normal business processing, thereby effectively reducing the occupancy of remote broadband during normal business processing hours. At the same time, when remote data is sent, the bandwidth speed limit preset value occupied by data transmission will be further limited, thereby avoiding the problem of remote data transmission being completely occupied due to a short-term data surge, further alleviating interference with normal business processing.

[0076] An embodiment of the present invention further provides a data transmission system, the data transmission system comprising: a data receiving unit, a data reading unit and a data sending unit.

[0077] A data receiving unit, used to obtain the data to be forwarded according to the preset time of the service restriction;

[0078] A data reading unit is used to adjust the data length of the data to be forwarded according to the preset value of the bandwidth speed limit to obtain the data forwarded this time;

[0079] The data sending unit is used to send the forwarded data to the next node.

[0080] The business restriction preset time represents the time when the sending of data to be forwarded is not allowed. During this time period, the data receiving unit will stop reading the data to be forwarded from the data cache module to ensure that normal office business is not impacted as much as possible. The data to be forwarded will only be read and forwarded in the time period exceeding the time period corresponding to the business restriction preset time.

[0081] In the process of forwarding data, the impact of occupying network bandwidth on normal business will be further considered, so as to use the bandwidth speed limit preset value to constrain the transmission rate of data transmitted by the data receiving module, so that the amount of data transmitted each time is within the constraint range of the bandwidth speed limit preset value. In addition, when the amount of data to be forwarded read by the data reading unit each time exceeds the target length, the data length will be adjusted to the range constrained by the bandwidth speed limit preset value. This can not only avoid data loss, but also ensure that too much bandwidth is not occupied during data transmission. Finally, after the dual restrictions and adjustments of the business restriction preset time and the bandwidth speed limit preset value, the forwarded data read from the data cache module can be transmitted to the next node (for example: the second computer room) through the data sending unit.

[0082] The data transmission system of the embodiment of the present invention sets a preset service restriction time so that the current node will not transmit data during the peak hours of normal business processing, thereby effectively reducing the occupancy of remote broadband during normal business processing hours. At the same time, when remote data is sent, the bandwidth speed limit preset value occupied by data transmission will be further limited, thereby avoiding the problem of remote data transmission being completely occupied due to a surge in data in a short period of time, further alleviating interference with normal business processing.

[0083] In addition, an embodiment of the present invention further provides a node, which includes a memory, a communication module, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the above-mentioned data transmission method when executing the computer program.

[0084] In addition, an embodiment of the present invention further provides a computer-readable storage medium, the computer-readable storage medium stores computer-executable instructions, the computer-executable instructions are used to execute the data transmission method as described above, for example, by a processor in the embodiment of the above node, so that the above processor can execute the data transmission method in the above embodiment, for example, execute the above described Figure 2 , Figure 3 The method in .

[0085] The non-transient software program and instructions required to implement the data transmission method of the above embodiment are stored in the memory. When executed by the processor, the data transmission method of the above embodiment is executed, for example, the above described Figure 2, Figure 3 The method in .

[0086] It will be appreciated by those skilled in the art that all or some of the steps and systems in the disclosed method above may be implemented as software, firmware, hardware and appropriate combinations thereof. Some physical components or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor or a microprocessor, or may be implemented as hardware, or may be implemented as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or a non-transitory medium) and a communication medium (or a temporary medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other storage unit technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassette, magnetic tape, disk storage or other magnetic storage device, or any other medium that may be used to store desired information and may be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0087] The embodiments of the present invention are described in detail above with reference to the accompanying drawings, but the present invention is not limited to the above embodiments, and various changes can be made within the knowledge scope of ordinary technicians in the relevant technical field without departing from the purpose of the present invention.

Claims

1. A data transmission method, characterized in that: include: Get the data to be forwarded at a preset time according to business restrictions; Adjust the data length of the data to be forwarded according to the preset bandwidth speed limit value to obtain the data forwarded this time; Sending the forwarded data to the next node; The obtaining of the data to be forwarded at a preset time according to the service restriction includes: If the current time is within the preset time of the service restriction, stop obtaining the data to be forwarded from the data cache module, wherein the data cache module is used to cache the data to be forwarded sent by the previous node, and the data to be forwarded cached in the data cache module will first be stored in the data cache module in the form of a queue in chronological order; The step of adjusting the data length of the data to be forwarded according to the preset bandwidth speed limit value to obtain the forwarded data includes: If the data length of the currently read data to be forwarded exceeds the preset value of the bandwidth speed limit, the currently read data to be forwarded is discarded, and the data length of the re-read data to be forwarded is less than the data length of the currently read data to be forwarded, until the data length of the re-read data to be forwarded is less than or equal to the preset value of the bandwidth speed limit, to obtain the forwarded data this time.

2. The data transmission method according to claim 1, characterized in that: The obtaining of the data to be forwarded at a preset time according to the service restriction includes: If the current time is not within the service restriction preset time, the to-be-forwarded data is obtained from a data cache module, wherein the data cache module is used to cache the to-be-forwarded data sent by the previous node.

3. The data transmission method according to claim 1, characterized in that: The step of adjusting the data length of the data to be forwarded according to the preset bandwidth speed limit value to obtain the forwarded data includes: If the data length of the currently read data to be forwarded is less than or equal to the preset bandwidth speed limit value, the data to be forwarded is used as the currently forwarded data.

4. The data transmission method according to claim 1, characterized in that: The data transmission method further comprises: The data to be forwarded is encrypted.

5. The data transmission method according to claim 1, characterized in that: The data transmission method further comprises: Acquire configuration information, where the configuration information includes the service restriction preset time and the wide speed limit preset value.

6. A data transmission system, characterized in that: include: A data receiving unit, used to obtain the data to be forwarded according to the preset time of the service restriction; A data reading unit, used for adjusting the data length of the data to be forwarded according to the preset bandwidth speed limit value, to obtain the data to be forwarded this time; A data sending unit, used for sending the currently forwarded data to the next node; The obtaining of the data to be forwarded at a preset time according to the service restriction includes: If the current time is within the preset time of the service restriction, stop obtaining the data to be forwarded from the data cache module, wherein the data cache module is used to cache the data to be forwarded sent by the previous node, and the data to be forwarded cached in the data cache module will first be stored in the data cache module in the form of a queue in chronological order; The step of adjusting the data length of the data to be forwarded according to the preset bandwidth speed limit value to obtain the forwarded data includes: If the data length of the currently read data to be forwarded exceeds the preset value of the bandwidth speed limit, the currently read data to be forwarded is discarded, and the data length of the re-read data to be forwarded is less than the data length of the currently read data to be forwarded, until the data length of the re-read data to be forwarded is less than or equal to the preset value of the bandwidth speed limit, to obtain the forwarded data this time.

7. A node, comprising a memory, a communication module, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the data transmission method according to any one of claims 1 to 5 is implemented.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable a computer to execute the data transmission method according to any one of claims 1 to 5.

Images