A data transmission method and related apparatus

Abstract

The application discloses a data transmission method and related device, and relates to the field of cloud services, and obtains management and control data of a target host and operation and maintenance data collected by a target data collection plug-in on the target host. The operation and maintenance data is sent to an operation and maintenance data gateway by using at least one preset bidirectional communication link, and then the operation and maintenance data is forwarded to a target service node in a server by the operation and maintenance data gateway. The management and control data is sent to a management and control data gateway by using a management and control data transmission link, and then the management and control data is forwarded to a management and control service node in the server by the management and control data gateway. The operation and maintenance data channel and the management and control channel are separated, the throughput capacity of massive data in an operation and maintenance scene can be greatly improved, the transmission efficiency is improved, and alarm delay is avoided. By separating the management and control channel, smooth transmission of small amount of management and control information is ensured, link interruption caused by heartbeat reporting timeout and channel blockage can be effectively avoided, and therefore the robustness of operation and maintenance control end connection is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of cloud services, and in particular to a data transmission method and related device. BACKGROUND

[0002] With the rapid growth of cloud computing operation scale, from the general scale of the cloud, the physical servers have reached tens of thousands, the cloud servers have exceeded one hundred thousand, the cloud products have exceeded nearly one hundred, and the cloud applications have exceeded several hundred. The accompanying operation and maintenance pressure also increases day by day. The basic monitoring, link monitoring, log monitoring, automation, and stress testing of various operation and maintenance scenarios will produce a large amount of operation and maintenance data. How to efficiently transmit large amounts of data and avoid server offline due to data backlog caused by a large number of proxy end reporting timeouts has become a problem that needs to be solved. SUMMARY

[0003] In view of the above problems, the present application provides a data transmission method and related device to achieve the purpose of improving transmission efficiency and avoiding alarm delay. The specific scheme is as follows:

[0004] The first aspect of the present application provides a data transmission method, comprising:

[0005] obtaining management and control data of a target host and operation and maintenance data collected by a target data collection plug-in on the target host;

[0006] sending the operation and maintenance data to an operation and maintenance data gateway using at least one preset bidirectional communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to a target service node in a server, the at least one preset bidirectional communication link being a data transmission link associated with the target data collection plug-in and pre-constructed;

[0007] sending the management and control data to a management and control data gateway using a management and control data transmission link to trigger the management and control data gateway to forward the management and control data to a management and control service node in the server.

[0008] In one possible implementation, the sending of the operation and maintenance data to the operation and maintenance data gateway using at least one preset bidirectional communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to a target service node in a server comprises:

[0009] determining the at least one preset bidirectional communication link from the pre-constructed bidirectional communication links according to the identifier of the target data collection plug-in;

[0010] sending the operation and maintenance data to the operation and maintenance data gateway using the at least one preset bidirectional communication link.

[0011] In a possible implementation, the process of constructing the at least one preset bidirectional communication link comprises:

[0012] In response to a bidirectional communication link adding operation of a user in the operation management interface, a bidirectional communication link adding interface is displayed;

[0013] In response to a parameter setting completion operation of the user in the bidirectional communication link adding interface, a bidirectional communication link is generated according to parameters entered by the user in the bidirectional communication link adding interface.

[0014] In a possible implementation, the process of generating a bidirectional communication link according to parameters entered by the user in the bidirectional communication link adding interface comprises:

[0015] According to basic information in the bidirectional communication link adding interface, an identifier of the bidirectional communication link is generated;

[0016] According to a link address of the server in the bidirectional communication link adding interface, a forwarding route of the bidirectional communication link is generated in the operation and maintenance data gateway.

[0017] In a possible implementation, the process of generating a bidirectional communication link according to parameters entered by the user in the bidirectional communication link adding interface further comprises:

[0018] According to node adjustment information in the bidirectional communication link adding interface, a service node associated with the bidirectional communication link on the server is obtained.

[0019] In a possible implementation, the process of generating a bidirectional communication link according to parameters entered by the user in the bidirectional communication link adding interface further comprises:

[0020] According to proxy information in the bidirectional communication link adding interface, a proxy is added for the bidirectional communication link, and the proxy initiates a request for establishing the bidirectional communication link in a hot-activated manner.

[0021] The second aspect of the present application provides a data transmission device, comprising:

[0022] An operation and maintenance data acquisition module is configured to acquire management and control data of a target host and operation and maintenance data collected by a target data collection plug-in on the target host;

[0023] An operation and maintenance data transmission module is configured to send the operation and maintenance data to an operation and maintenance data gateway using at least one preset bidirectional communication link, so as to trigger the operation and maintenance data gateway to forward the operation and maintenance data to a target service node in a server, the at least one preset bidirectional communication link being a data transmission link pre-constructed and associated with the target data collection plug-in; and

[0024] The control data transmission module is configured to send the control data to a control data gateway via a control data transmission link, so as to trigger the control data gateway to forward the control data to a control service node in the server.

[0025] The fourth aspect of the present application provides an electronic device, comprising at least one processor and a memory connected to the processor, wherein:

[0026] The memory is configured to store a computer program.

[0027] The processor is configured to execute the computer program, so as to enable the electronic device to implement the data transmission method of the first aspect or any implementation manner of the first aspect.

[0028] The fifth aspect of the present application provides a computer storage medium, which carries one or more computer programs, and when the one or more computer programs are executed by an electronic device, the electronic device can implement the data transmission method of the first aspect or any implementation manner of the first aspect.

[0029] According to the above technical solution, the data transmission method provided by the present application acquires control data of a target host and operation and maintenance data collected by a target data collection plug-in on the target host. The operation and maintenance data is sent to an operation and maintenance data gateway via at least one preset bidirectional communication link, and then the operation and maintenance data is forwarded to a target service node in the server by the operation and maintenance data gateway. The control data is sent to a control data gateway via a control data transmission link, and then the control data is forwarded to a control service node in the server by the control data gateway. The operation and maintenance data channel and the control channel are separated, which can greatly improve the throughput capacity of massive data in the operation and maintenance scene, improve the transmission efficiency, and avoid alarm delay. By separating the control channel, the smooth transmission of small amount of control information is ensured, which can effectively avoid link interruption caused by heartbeat reporting timeout and channel blockage, thereby greatly improving the robustness of the operation and maintenance control end connection. BRIEF DESCRIPTION OF DRAWINGS

[0030] The above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent by describing in detail the following specific embodiments with reference to the attached drawings. Throughout the drawings, the same or similar reference numerals refer to the same or similar elements. It should be understood that the drawings are schematic, and the original and elements are not necessarily drawn according to the scale.

[0031] Figure 1A structural diagram of a data transmission system provided in the present application is shown in FIG. 1.

[0032] Figure 2 A structural diagram of a terminal provided in the present application is shown in FIG. 2.

[0033] Figure 3 A structural diagram of a server provided in the present application is shown in FIG. 3.

[0034] Figure 4 A flow chart of a data transmission method provided in the present application is shown in FIG. 4.

[0035] Figure 5 A data management device based on websocket multi-channel provided in the present application is shown in FIG. 5.

[0036] Figure 6 A data reporting flow chart provided in the present application is shown in FIG. 6.

[0037] Figure 7 A schematic diagram of a running management interface provided in the present application is shown in FIG. 7.

[0038] Figure 8 Another schematic diagram of a running management interface provided in the present application is shown in FIG. 8.

[0039] Figure 9 A structural diagram of a data transmission device provided in the present application is shown in FIG. 9.

[0040] Figure 10 A structural diagram of an electronic device provided in the present application is shown in FIG. 10. DETAILED DESCRIPTION

[0041] The embodiments of the present application are described below in conjunction with the accompanying drawings. The terms used in the embodiment part of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application.

[0042] The embodiments of the present application are described below in conjunction with the accompanying drawings. It is known to those skilled in the art that as technology develops and new scenarios appear, the technical solutions provided by the embodiments of the present application are also applicable to similar technical problems.

[0043] The terms "first", "second", and the like in the description and in the claims of the present application and above-described drawings are used to distinguish similar objects and are not necessarily used to describe a specific sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances and that the embodiments of the present application are capable of functioning in other sequences than described or otherwise illustrated herein. Moreover, the terms "comprise", "have" and any variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements is not necessarily limited to those elements, but can include other elements not expressly listed or inherent to such process, method, article, or apparatus.

[0044] Referring to Figure 1 , Figure 1 An architecture diagram of a data transmission system is shown. The system can include a terminal 100 and a server 200. The server 200 can include one or more servers (as an example, one server is described in the following embodiments), and the server 200 can provide a method provided by the embodiments of the present application for one or more terminals. Figure 1

[0045] The terminal 100 can install an application program configured for a two-way communication link. The application program and a webpage can provide an interface, and the terminal 100 can receive relevant parameters input by a user on the two-way communication link interface and send the parameters to the server 200. The server 200 can obtain a processing result based on the received parameters and return the processing result to the terminal 100.

[0046] It should be understood that in some optional implementations, the terminal 100 can also complete the action of obtaining a processing result based on received parameters by itself without the cooperation of the server, and the embodiments of the present application are not limited thereto.

[0047] Next, the product form of the terminal 100 is described. Figure 1

[0048] The terminal 100 in the embodiments of the present application can be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), and the like, and the embodiments of the present application are not limited thereto.

[0049] Figure 2 An optional hardware structure diagram of the terminal 100 is shown.​​

[0050] Reference Figure 2 As shown, the terminal 100 can include a radio frequency unit 110, a memory 120, an input unit 130, a display unit 140, a camera 150 (optional), an audio circuit 160 (optional), a speaker 161 (optional), a microphone 162 (optional), a headphone jack 163 (optional), a processor 170, an external interface 180, a power supply 190, and the like. Those skilled in the art can understand that the terminal 100 can include more or less components than those shown, or combine some components, or different components. Figure 2 The terminal or multi-functional device is merely an example and does not constitute a limitation on the terminal or multi-functional device, which can include more or less components than those shown, or combine some components, or different components.

[0051] The input unit 130 can be used to receive inputted digital or character information, and to generate key signal input related to user settings and function control of the portable multi-functional device. Specifically, the input unit 130 can include a touch screen 131 (optional) and / or other input devices 132. The touch screen 131 can collect touch operations of a user thereon or adjacent thereto (such as operations of the user using a finger, a joint, a stylus, or any suitable object on or adjacent to the touch screen), and drive corresponding connected devices according to a pre-set program. The touch screen can detect touch actions of the user on the touch screen, convert the touch actions into touch signals and send the touch signals to the processor 170, and can receive commands from the processor 170 and execute the commands; the touch signals at least include touch point coordinate information. The touch screen 131 can provide an input interface and an output interface between the terminal 100 and the user. In addition, the touch screen can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch screen 131, the input unit 130 can also include other input devices. Specifically, the other input devices 132 can include one or more of, but are not limited to, a physical keyboard, function keys (such as volume control keys, on-off keys, etc.), a trackball, a mouse, a joystick, and the like.

[0052] The input devices 132 can receive inputted data and the like.

[0053] The display unit 140 can be used to display information inputted by the user or provided to the user, various menus of the terminal 100, interactive interfaces, file display, and / or playing of any kind of multimedia files. In the embodiments of the present application, the display unit 140 can be used to display interfaces of two-way communication link configuration, processing results, and the like.

[0054] The memory 120 can be used to store instructions and data, the memory 120 can mainly include a storage instruction area and a storage data area, the storage data area can store various data such as multimedia files, texts, etc.; the storage instruction area can store software units required by at least one function such as operating system, application, instructions, etc., or their subsets, extended sets. It can also include non-volatile random access memory; provide support for control software and applications including management of hardware, software and data resources in the computing processing device. Also used for the storage of multimedia files, and the storage of running programs and applications.

[0055] The processor 170 is the control center of the terminal 100, connects each part of the whole terminal 100 by various interfaces and lines, executes various functions of the terminal 100 and processes data by running or executing instructions stored in the memory 120 and calling data stored in the memory 120, thereby overall controlling the terminal device. Optionally, the processor 170 can include one or more processing units; preferably, the processor 170 can integrate an application processor and a modem processor, wherein the application processor mainly processes operating system, user interface and application program, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 170. In some embodiments, the processor, the memory, can be realized on a single chip, and in some embodiments, they can also be realized on independent chips respectively. The processor 170 can also be used to generate corresponding operation control signals to the corresponding components of the computing processing device, read and process data in the software, especially read and process data and programs in the memory 120, so that each functional module therein executes corresponding functions, thereby controlling the corresponding components to act according to the requirements of the instructions.

[0056] The RF unit 110 (optional) can be used to receive and send signals in transceiving information or communication process, for example, receiving the downlink information of the base station, and processing by the processor 170. In addition, the uplink data is sent to the base station. Generally, the RF circuit includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, etc. In addition, the RF unit 110 can also communicate with network devices and other devices through wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to global system for mobile communication (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), email, short messaging service (SMS), etc.

[0057] In the embodiments of the present application, the RF unit 110 can send the configuration data of the bidirectional communication link to the server 200, and receive the processing result of the configuration of the bidirectional communication link sent by the server 200.

[0058] It should be understood that the RF unit 110 is optional, which can be replaced by other communication interfaces, for example, a network interface.

[0059] The terminal 100 further includes a power supply 190 (such as a battery) for supplying power to each component. Preferably, the power supply can be logically connected to the processor 170 through a power management system, so that the power management system can realize the functions of managing charging, discharging, and power consumption management, etc.

[0060] The terminal 100 further includes an external interface 180, which can be a standard Micro USB interface, or a multi-pin connector, and can be used to connect the terminal 100 with other devices for communication, or can be used to connect a charger for charging the terminal 100.

[0061] Although not shown, the terminal 100 can also include a flash, a wireless fidelity (WiFi) module, a Bluetooth module, sensors with different functions, etc., which will not be described here. Some or all of the methods described below can be applied in the terminal 100 as shown. Figure 2 shown.

[0062] Next, the product form of the server 200 is described. Figure 1

[0063] Figure 3 A structural diagram of the server 200 is provided, as shown in the figure. Figure 3 The server 200 includes a bus 201, a processor 202, a communication interface 203, and a memory 204. The processor 202, the memory 204, and the communication interface 203 communicate through the bus 201.

[0064] The bus 201 can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 In the figure, only one thick line is used, but it does not mean that there is only one bus or one type of bus.

[0065] The processor 202 can be any one or more of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP), etc.

[0066] The memory 204 can include a volatile memory, such as a random access memory (RAM). The memory 204 can also include a non-volatile memory, such as a read-only memory (ROM), a flash memory, a mechanical hard disk drive (HDD), or a solid state drive (SSD).

[0067] The memory 204 can be used to store software code related to the data transmission method, and the processor 202 can execute the steps of the chip data transmission method, or can schedule other units to realize the corresponding functions.

[0068] ​It should be understood that the terminal 100 and the server 200 described above can be centralized or distributed devices, and the processors (for example, the processor 170 and the processor 202) in the terminal 100 and the server 200 can be hardware circuits (such as an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a general-purpose processor, a digital signal processor (DSP), a microprocessor, a microcontroller, or the like) or a combination of these hardware circuits. For example, the processor can be a hardware system with an instruction execution function, such as a CPU, a DSP, or the like, or a hardware system without an instruction execution function, such as an ASIC, an FPGA, or the like, or a combination of the hardware system without the instruction execution function and the hardware system with the instruction execution function.

[0069] The control platform is a main tool for collecting data of machines and issuing execution of various tasks. On one hand, the control platform has a collection function and can obtain various operation and maintenance data of machines through different business plug-ins, including second-level monitoring data, log data, automatic execution result data, and test result data. On the other hand, the control platform has a control function and is an important means for remotely managing the agent end of the machine, including installation, upgrading, and heartbeat reporting. Therefore, the control technology plays an important supporting role in the upper-layer automation task and monitoring business layer requirements and plays a role of ballast in the operation of the entire operation and maintenance platform.

[0070] Currently, in order to solve the efficient transmission of large amounts of data and the management of a large number of control agents, there are two existing solutions in the industry. One is to set flow control after local caching and report to the server in batches. The other is to perform data processing locally to complete data aggregation, threshold analysis, alarm triggering, and the like, thereby reducing the amount of data to be reported. However, both solutions have disadvantages and are not suitable for data transmission.

[0071] In scheme 1, the agent completes task execution and data collection according to the collection period and the collection strategy, and then stores the data in the local cache, initiates an http short connection through the agent end, and transmits the data to the server in batches. Although this solution can solve the problem by transmitting the data in batches, it still has the following three problems: 1. Since the http connection can only be initiated from the agent end and does not have the ability to push from the server, the collection strategy needs to be fixed in the agent. When the collection strategy needs to be updated, the agent needs to be updated in full, which does not have the ability to update the collection index flexibly, especially the customized collection package. When the number of agents reaches tens of thousands, the full update period is long, and the establishment of the http short connection needs to be initiated frequently, which consumes a large amount of machine network resources and port resources; 2. When the amount of data increases, the data transmission delay will increase, causing alarm delay, agent heartbeat report timeout and other problems; 3. To avoid the agent end occupying too many machine resources and affecting the business system, the agent generally has a self-destruction mechanism. When the local cache exceeds the threshold, the agent will automatically restart to release the cache to the local business process, which will cause a large number of agent offline alarms, submerge normal alarms and cause panic.

[0072] In scheme two, the data is collected and processed locally, the data aggregation, threshold analysis and alarm triggering are completed, and the amount of data to be reported is reduced. Although this solution can reduce data transmission by processing data locally, it still has the following problems: 1. The agent end needs to complete data aggregation, threshold analysis, alarm triggering and data uploading by using the processing capacity of the agent end, which will greatly increase the complexity of the agent end and the consumption of local CPU and memory resources, and will affect the operation of the original business system and cause a phenomenon of taking the place of others. 2. The collection strategy and data processing strategy are fixed in the local agent, which will cause a fat terminal phenomenon and cannot change the collection strategy dynamically, which is contrary to the concept of thin terminal in the cloud computing era and is not in line with the trend of the times.

[0073] To solve the above problems, the embodiment of the present application provides a data transmission method. The data transmission method of the embodiment of the present application will be described in detail below with reference to the drawings.

[0074] Referring to Figure 4 , Figure 4 The flow of the data transmission method provided by the embodiment of the present application is shown in Figure 4 The data transmission method provided by the embodiment of the present application can include steps 401 to 403, which will be described in detail below.

[0075] 401. Obtain the management and control data of the target host and the operation and maintenance data collected by the target data collection plug-in on the target host.

[0076] Specifically, referring to Figure 5As shown on the left side, the agent on the host collects control data such as installation data, upgrade data, heartbeat reporting data and the like in a normal operation condition. By deploying a reporting data plug-in on the agent, other data of the host can be collected, such as operation log data by a log plug-in and corresponding monitoring data by monitoring host transmission data through a link tracking plug-in.

[0077] The agent can obtain control data and operation and maintenance data by actively initiating a data acquisition request to the plug-ins. The data can also be obtained by the plug-ins in a form of actively initiating data reporting at a regular time.

[0078] 402. The operation and maintenance data is sent to an operation and maintenance data gateway through at least one preset bidirectional communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to a target service node in the server, and the at least one preset bidirectional communication link is a data transmission link associated with the target data collection plug-in and pre-constructed.

[0079] 403. The control data is sent to a control data gateway through a control data transmission link to trigger the control data gateway to forward the control data to a control service node in the server.

[0080] Specifically, referring to Figure 5 As shown, the agent sends the collected control data such as installation data, upgrade data, heartbeat reporting data and the like to the control data gateway by default using the control data transmission link, and then the control data gateway uploads the operation and maintenance data to the control service node in the server. For the operation and maintenance data, a bidirectional communication link is pre-set for each plug-in, and after load balancing, the operation and maintenance data is forwarded to the corresponding operation and maintenance service node in the server through the operation and maintenance data gateway. The bidirectional communication link can be a data link constructed by Websocket. Websocket is a protocol for full-duplex communication on a single TCP connection. It first performs a handshake process through the http protocol to upgrade the connection from the http protocol to the Websocket protocol. Once the connection is established, the client and the server can send and receive data frames for bidirectional communication through the connection. These data frames contain data to be transmitted and some metadata such as data length and data type, which makes up for the lack of persistent communication capability of the http protocol. In addition, the Websocket protocol also provides masking of data to increase the security of data transmission.

[0081] When the bidirectional communication link is used to send the operation and maintenance data, the same type of business data can be allocated to multiple links for transmission to improve the efficiency of data transmission, and a websocket can carry multiple types of business data.

[0082] By increasing the new operation and maintenance data routing distribution of the bidirectional transmission link, the reporting data of the corresponding collection module or plug-in is independently carried, so that the normal collection of the management data of the host is not affected, the proxy is effectively prevented from being offline in a large area due to the blocking of the management channel, the fault range is effectively controlled, the robustness of the operation and maintenance control terminal connection is greatly improved, and the effect of bearing large-flow data reporting and carrying is achieved.

[0083] As a feasible implementation manner of the above embodiment, in order to improve the real-time performance of data transmission, the step 402 of sending the operation and maintenance data to the operation and maintenance data gateway by using at least one preset bidirectional communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to the target service node in the server includes the following steps.

[0084] According to the identifier of the target data collection plug-in, at least one preset bidirectional communication link is determined from the pre-constructed bidirectional communication link; and then the operation and maintenance data is sent to the operation and maintenance data gateway by using at least one preset bidirectional communication link.

[0085] Specifically, the construction process of the at least one preset bidirectional communication link can specifically include the following steps.

[0086] Step 11, in response to a bidirectional communication link adding operation of a user in a running management interface, a bidirectional communication link adding interface is displayed.

[0087] Step 12, in response to a parameter setting completion operation of a user in the bidirectional communication link adding interface, a bidirectional communication link is generated according to the parameters entered by the user in the bidirectional communication link adding interface.

[0088] The identifier of the bidirectional communication link can be generated according to the basic information in the bidirectional communication link adding interface.

[0089] According to the link address of the server in the bidirectional communication link adding interface, a forwarding route of the bidirectional communication link is generated in the operation and maintenance data gateway.

[0090] Referring to Figure 7 , when a user creates a new data access configuration, the user enters a transmission management page, selects an area (such as a data access box shown on the right side of Figure 7 ) to be configured with multiple channels. By clicking the data access, the user enters a parameter configuration interface. Referring to Figure 8 , when the user configures the routing parameters of the new data channel, the user fills in the basic information, including the name and code, fills in the uplink address of the proxy connection service end, which is generally a virtual IP address of an LVS (Linux Virtual Server, a virtual server cluster system), and then clicks a confirm button to form a bidirectional communication link of a new routing gateway forwarding strategy.

[0091] The information of the node in the bidirectional communication link adding interface can be adjusted to obtain the service node associated with the bidirectional communication link on the server. The information of the agent in the bidirectional communication link adding interface is adjusted to add an agent for the bidirectional communication link, and the agent initiates a request for establishing the bidirectional communication link in a hot-activated manner.

[0092] The route of the newly generated bidirectional communication link can be connected by adding the corresponding service node on the server in the service node option bar (not shown in the figure) by using the adjust node function. The agent corresponding to the bidirectional communication link can be added in the agent option bar by using the edit agent function. The newly added agent initiates a new link establishment request in a hot-activated manner to complete the establishment of the new websocket link.

[0093] Thus, by separating different types of data channels and control channels, the throughput capacity of massive data in a multi-dimensional operation and maintenance scenario can be greatly improved, the transmission efficiency can be improved, the alarm delay can be avoided, the websocket channel can be dynamically expanded, the user experience can be improved, the hot-activated effect can be achieved, and the user experience can be improved. On the other hand, the control channel is separated to ensure smooth transmission of small amount of control information, which can effectively avoid heartbeat reporting timeout and channel blockage caused link interruption, causing large-area offline of agents, causing alarm storm and causing panic, thereby achieving the effect of greatly improving the robustness of the operation and maintenance control terminal connection and bearing large-flow data reporting.

[0094] As a specific application of the above data transmission method, referring to Figure 6 Fig. 1 shows a data collection and reporting process of log data, wherein logmon is a log data collection plug-in, Agent is an agent, Ant-Controller-Gateway is a control data gateway, and Ant-Data-Gateway is an operation and maintenance data gateway. The process of data transmission can specifically include:

[0095] After the user installs the logmon plug-in on the target machine and configures the collection strategy, the plug-in will collect the log according to the path and collection frequency specified in the strategy.

[0096] The log data collected by the plug-in is first pushed to the Agent agent end and returns an ack confirming the arrival, and then the Agent pushes the business data of logmon (when there is a new bidirectional communication link, that is, when there is a forwarding strategy) to the new Ant-Data-Gateway through the new websocket link and routes it to the service node, and can distribute the same type of business data to multiple links for transmission.

[0097] The Ant-Controller-Gateway routing forwarding is used by default when there is no corresponding bidirectional communication link, i.e., no forwarding strategy exists.

[0098] The Ant-Controller-Gateway routing forwarding is also used by default for the management data of the Agent and the control data of the remaining plug-ins without newly defined links.

[0099] The above introduces a data transmission method provided by the embodiment of the application, and the following introduces a device for executing the data transmission method.

[0100] Please refer to Figure 9 , Figure 9 A structure diagram of a data transmission device provided by the embodiment of the application is shown in FIG. 1. As shown in the figure, the data transmission device comprises: Figure 9

[0101] The operation and maintenance data acquisition module 901 is configured to acquire the control data of the target host and the operation and maintenance data collected by the target data collection plug-in on the target host.

[0102] The operation and maintenance data transmission module 902 is configured to send the operation and maintenance data to an operation and maintenance data gateway using at least one preset bidirectional communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to a target service node in a server, the at least one preset bidirectional communication link being a data transmission link associated with the target data collection plug-in and pre-constructed; and

[0103] The control data transmission module 903 is configured to send the control data to a control data gateway using a control data transmission link to trigger the control data gateway to forward the control data to a control service node in the server.

[0104] In a possible implementation, the process in which the operation and maintenance data transmission module 902 sends the operation and maintenance data to the operation and maintenance data gateway using at least one preset bidirectional communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to the target service node in the server comprises:

[0105] According to the identifier of the target data collection plug-in, the at least one preset bidirectional communication link is determined from the pre-constructed bidirectional communication links.

[0106] The operation and maintenance data is sent to the operation and maintenance data gateway using the at least one preset bidirectional communication link.

[0107] In a possible implementation, the construction process of the at least one preset bidirectional communication link in the operation and maintenance data transmission module 902 comprises:

[0108] ​In response to a two-way communication link adding operation of the user in the operation management interface, a two-way communication link adding interface is displayed;

[0109] In response to a parameter setting completion operation of the user in the two-way communication link adding interface, a two-way communication link is generated according to parameters entered by the user in the two-way communication link adding interface.

[0110] In a possible implementation, the process of generating a two-way communication link by the operation and maintenance data transmission module 902 according to parameters entered by the user in the two-way communication link adding interface includes:

[0111] According to basic information in the two-way communication link adding interface, an identifier of the two-way communication link is generated;

[0112] According to a link address of the server in the two-way communication link adding interface, a forwarding route of the two-way communication link is generated in the operation and maintenance data gateway.

[0113] In a possible implementation, the process of generating a two-way communication link by the operation and maintenance data transmission module 902 according to parameters entered by the user in the two-way communication link adding interface further includes:

[0114] According to node adjustment information in the two-way communication link adding interface, a service node associated with the two-way communication link on the server is obtained.

[0115] In a possible implementation, the process of generating a two-way communication link by the operation and maintenance data transmission module 902 according to parameters entered by the user in the two-way communication link adding interface further includes:

[0116] According to proxy information in the two-way communication link adding interface, a proxy is added for the two-way communication link, and the proxy initiates a request for establishing the two-way communication link in a hot-activated manner.

[0117] The embodiment of the present application also provides an electronic device. Referring to Figure 10 The electronic device shown in the figure shows a structure diagram suitable for realizing the electronic device in the embodiment of the present application. The electronic device in the embodiment of the present application can include but is not limited to fixed terminals such as mobile phones, notebook computers, PDAs (personal digital assistants), PADs (tablet computers), desktop computers, etc. Figure 10 The electronic device shown is only an example and should not impose any restrictions on the functions and use range of the embodiment of the present application.

[0118] As Figure 10As shown, the electronic device can include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 1001 that can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 1002 or loaded into a random access memory (RAM) 1003 from a storage device 1008. In a state in which the electronic device is powered on, various programs and data required for operation of the electronic device are also stored in the RAM 1003. The processing device 1001, the ROM 1002, and the RAM 1003 are connected to each other through a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0119] Generally, the following devices can be connected to the I / O interface 1005: input devices 1006 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 1007 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 1008 including, for example, a memory card, a hard disk, etc.; and communication devices 1009. The communication devices 1009 can allow the electronic device to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 10 An electronic device having various devices is shown, but it is understood that all of the shown devices are not required to be implemented or possessed. More or fewer devices can be alternatively implemented or possessed.

[0120] The embodiments of the present application also provide a computer program product including computer readable instructions, which, when executed on an electronic device, cause the electronic device to implement any of the data transmission methods provided by the embodiments of the present application.

[0121] The embodiments of the present application also provide a computer readable storage medium carrying one or more computer programs, which, when executed by an electronic device, can cause the electronic device to implement any of the data transmission methods provided by the embodiments of the present application.

[0122] In addition, it should be noted that the device embodiments described above are merely illustrative, wherein the units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e., they can be located in one place, or distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the embodiments. In addition, the connection relationship between the modules in the device embodiments provided by the present application indicates that there is a communication connection between them, which can be implemented as one or more communication buses or signal lines.

[0123] Those skilled in the art can clearly understand that the application can be implemented by means of software plus necessary universal hardware, and of course can also be implemented by means of dedicated hardware including special integrated circuit, special CPU, special memory, special component, etc. Generally, any function completed by computer program can be easily implemented by corresponding hardware, and the specific hardware structure for implementing the same function can also be various, such as analog circuit, digital circuit or special circuit, etc. However, for the application, software program implementation is a better embodiment. Based on such understanding, the technical solution of the application or the part of the application which makes contribution to the prior art can be embodied in the form of software product, which is stored in readable storage medium, such as computer floppy disk, U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk, etc., and includes a plurality of instructions for making a computer device (which can be personal computer, training device or network device, etc.) execute the method described in various embodiments of the application.

[0124] In the above embodiments, the implementation can be achieved by software, hardware, firmware or any combination thereof, entirely or partially. When implemented by software, the implementation can be achieved in the form of a computer program product, entirely or partially.

[0125] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the flow or function described in the embodiments of the application is generated entirely or partially. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another, for example, the computer instructions can be transmitted from one website, computer, training device or data center to another website, computer, training device or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that can be stored by the computer or a data storage device such as training device, data center, etc. integrated with one or more available media sets. The available medium can be magnetic medium (such as floppy disk, hard disk, magnetic tape), optical medium (such as DVD) or semiconductor medium (such as solid state disk (SSD)) etc.

Claims

1. A data transmission method, characterized by, The method comprises: acquiring management and control data of a target host and operation and maintenance data collected by a target data collection plug-in on the target host; sending the operation and maintenance data to an operation and maintenance data gateway using at least one preset bidirectional communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to a target service node in a server, the at least one preset bidirectional communication link being a data transmission link associated with the target data collection plug-in and pre-constructed; sending the management and control data to a management and control data gateway using a management and control data transmission link to trigger the management and control data gateway to forward the management and control data to a management and control service node in the server.

2. The data transmission method of claim 1, wherein, The sending of the operation and maintenance data to the operation and maintenance data gateway using the at least one preset bidirectional communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to the target service node in the server comprises: determining the at least one preset bidirectional communication link from pre-constructed bidirectional communication links according to an identifier of the target data collection plug-in; sending the operation and maintenance data to the operation and maintenance data gateway using the at least one preset bidirectional communication link.

3. The data transmission method of claim 1, wherein, The construction process of the at least one preset bidirectional communication link comprises: in response to a bidirectional communication link adding operation of a user in a running management interface, displaying a bidirectional communication link adding interface; in response to a parameter setting completion operation of the user in the bidirectional communication link adding interface, generating a bidirectional communication link according to parameters entered by the user in the bidirectional communication link adding interface.

4. The data transmission method of claim 3, wherein, The generation of the bidirectional communication link according to the parameters entered by the user in the bidirectional communication link adding interface comprises: generating an identifier of the bidirectional communication link according to basic information in the bidirectional communication link adding interface; generating a forwarding route of the bidirectional communication link in the operation and maintenance data gateway according to a link address of the server in the bidirectional communication link adding interface.

5. The data transmission method of claim 3, wherein, The generation of the bidirectional communication link according to the parameters entered by the user in the bidirectional communication link adding interface further comprises: obtaining a service node associated with the bidirectional communication link on the server according to node adjustment information in the bidirectional communication link adding interface.

6. The data transmission method of claim 3, wherein, The generation of the bidirectional communication link according to the parameters entered by the user in the bidirectional communication link adding interface further comprises: adding a proxy for the bidirectional communication link according to proxy information in the bidirectional communication link adding interface, and causing the proxy to initiate a request for establishing the bidirectional communication link in a hot-activated manner.

7. A data transmission apparatus, characterized by comprising: The method comprises: an operation and maintenance data acquisition module, configured to acquire management and control data of a target host and operation and maintenance data collected by a target data collection plug-in on the target host; an operation and maintenance data transmission module, configured to send the operation and maintenance data to an operation and maintenance data gateway using at least one preset bidirectional communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to a target service node in a server, the at least one preset bidirectional communication link being a data transmission link associated with the target data collection plug-in and pre-constructed; and The management and control data transmission module is configured to send the management and control data to a management and control data gateway via a management and control data transmission link, so as to trigger the management and control data gateway to forward the management and control data to a management and control service node in the server.

8. A computer program product, characterised in that, The computer readable instructions, when executed on an electronic device, cause the electronic device to implement the data transmission method according to any one of claims 1 to 6.

9. An electronic device, comprising: The electronic device comprises at least one processor and a memory connected to the processor, wherein: The memory is configured to store a computer program; The processor is configured to execute the computer program, so that the electronic device can implement the data transmission method according to any one of claims 1 to 6.

10. A computer storage medium, characterized in that, The storage medium carries one or more computer programs, which, when executed by an electronic device, can cause the electronic device to implement the data transmission method according to any one of claims 1 to 6.

Images