Data transmission method and related device

Abstract

The invention discloses a data transmission method and a related device, relates to the field of cloud services, and aims at obtaining control data of a target host and operation and maintenance data collected by a target data collection plug-in on the target host. And sending the operation and maintenance data to an operation and maintenance data gateway by using at least one preset bidirectional communication link, and then forwarding the operation and maintenance data to a target service node in a server by the operation and maintenance data gateway. And sending the control data to a control data gateway by using a control data transmission link, and forwarding the control data to a control service node in the server by the control data gateway. Through separation of the operation and maintenance data channel and the control channel, the throughput capacity of mass data in an operation and maintenance scene can be greatly improved, the transmission efficiency is improved, and alarm delay is avoided. The control channel is independent, smooth transmission of control information of a small data volume is guaranteed, link interruption caused by heartbeat report timeout and channel blockage can be effectively avoided, and therefore the robustness of communication of the operation and maintenance acquisition and control end is improved.

Description

Technical Field

[0001] The present application relates to the field of cloud service technology, and in particular to a data transmission method and related devices. Background Art

[0002] With the rapid growth of cloud computing operations, from the perspective of the general scale of the cloud, there are tens of thousands of physical servers, more than 100,000 cloud servers, nearly 100 cloud products, and hundreds of cloud applications. The accompanying operation and maintenance pressure is also increasing day by day. Various operation and maintenance scenarios such as basic monitoring, link monitoring, log monitoring, automation, and dialing will generate massive amounts of operation and maintenance data. How to efficiently transmit large amounts of data and avoid server offline caused by a large number of agent reports timeouts due to data backlog has become an urgent problem to be solved. Summary of the invention

[0003] In view of the above problems, the present application provides a data transmission method and related devices to achieve the purpose of improving transmission efficiency and avoiding alarm delay. The specific scheme is as follows:

[0004] The first aspect of the present application provides a data transmission method, comprising:

[0005] Obtaining control data of the target host and operation and maintenance data collected by the target data collection plug-in on the target host;

[0006] Sending the operation and maintenance data to the operation and maintenance data gateway using at least one preset two-way communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to the target service node in the server, wherein the at least one preset two-way communication link is a pre-built data transmission link associated with the target data acquisition plug-in;

[0007] The control data is sent to the control data gateway using a control data transmission link to trigger the control data gateway to forward the control data to the control service node in the server.

[0008] In a possible implementation, sending the operation and maintenance data to an operation and maintenance data gateway using at least one preset two-way communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to a target service node in a server includes:

[0009] Determining the at least one preset two-way communication link from pre-built two-way communication links according to the identifier of the target data acquisition plug-in;

[0010] The operation and maintenance data is sent to the operation and maintenance data gateway using the at least one preset two-way communication link.

[0011] In a possible implementation, the process of establishing the at least one preset bidirectional communication link includes:

[0012] In response to the user's operation of adding a two-way communication link in the operation management interface, displaying a two-way communication link adding interface;

[0013] In response to the user completing the parameter setting operation in the two-way communication link adding interface, a two-way communication link is generated according to the parameters entered by the user in the two-way communication link adding interface.

[0014] In a possible implementation, generating a two-way communication link according to the parameters entered by the user on the two-way communication link adding interface includes:

[0015] Generate an identifier of the two-way communication link according to the basic information in the two-way communication link adding interface;

[0016] According to the link address of the server in the two-way communication link adding interface, a forwarding route of the two-way communication link is generated in the operation and maintenance data gateway.

[0017] In a possible implementation, generating a two-way communication link according to the parameters entered by the user on the two-way communication link adding interface further includes:

[0018] According to the node adjustment information in the two-way communication link adding interface, the service node associated with the two-way communication link on the server is obtained.

[0019] In a possible implementation, generating a two-way communication link according to the parameters entered by the user on the two-way communication link adding interface further includes:

[0020] According to the proxy information in the two-way communication link adding interface, a proxy is added to the two-way communication link, and the proxy initiates a request to establish the two-way communication link in a hot-effective manner.

[0021] A second aspect of the present application provides a data transmission device, including:

[0022] An operation and maintenance data acquisition module, used to acquire control data of a target host and operation and maintenance data collected by a target data collection plug-in on the target host;

[0023] An operation and maintenance data transmission module, used to send the operation and maintenance data to the operation and maintenance data gateway using at least one preset two-way communication link, so as to trigger the operation and maintenance data gateway to forward the operation and maintenance data to the target service node in the server, wherein the at least one preset two-way communication link is a pre-built data transmission link associated with the target data acquisition plug-in; and

[0024] A control data transmission module is used to send the control data to the control data gateway using the control data transmission link to trigger the control data gateway to forward the control data to the control service node in the server. A third aspect of the present application provides a computer program product, including computer-readable instructions, which, when executed on an electronic device, enables the electronic device to implement the data transmission method of the first aspect or any implementation of the first aspect.

[0025] A fourth aspect of the present application provides an electronic device, comprising at least one processor and a memory connected to the processor, wherein:

[0026] The memory is used to store computer programs;

[0027] The processor is used to execute the computer program so that the electronic device can implement the data transmission method of the first aspect or any implementation manner of the first aspect.

[0028] A fifth aspect of the present application provides a computer storage medium, which carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can implement the data transmission method of the first aspect or any implementation of the first aspect.

[0029] By means of the above technical scheme, the data transmission method provided by the present application obtains the control data of the target host and the operation and maintenance data collected by the target data collection plug-in on the target host. The operation and maintenance data is sent to the operation and maintenance data gateway using at least one preset two-way communication link, and then the operation and maintenance data gateway forwards the operation and maintenance data to the target service node in the server. The control data is sent to the control data gateway using the control data transmission link, and then the control data gateway forwards the control data to the control service node in the server. By separating the operation and maintenance data channel and the control channel, the throughput capacity of massive data in the operation and maintenance scenario can be greatly improved, the transmission efficiency can be improved, and alarm delays can be avoided. By separating the control channel and ensuring the smooth transmission of small-volume control information, the link interruption caused by heartbeat reporting timeout and channel blocking can be effectively avoided, thereby greatly improving the robustness of the operation and maintenance acquisition and control terminal connection. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0031] Figure 1A structural diagram of a data transmission system provided for this application;

[0032] Figure 2 A structural diagram of a terminal provided for this application;

[0033] Figure 3 A structural diagram of a server provided for this application;

[0034] Figure 4 A flowchart of a data transmission method provided by this application;

[0035] Figure 5 A diagram of a data management device based on websocket multi-channel provided for this application;

[0036] Figure 6 Data reporting flow chart provided for this application;

[0037] Figure 7 A schematic diagram of the operation management interface provided for this application;

[0038] Figure 8 Another schematic diagram of the operation management interface provided for this application;

[0039] Fig. 9 A structural diagram of a data transmission device provided by this application;

[0040] Fig.10 This is a structural diagram of the electronic device provided for this application. DETAILED DESCRIPTION

[0041] The following describes the embodiments of the present application in conjunction with the drawings in the embodiments of the present application. The terms used in the implementation method section of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application.

[0042] The embodiments of the present application are described below in conjunction with the accompanying drawings. Those skilled in the art will appreciate that, with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0043] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and need not be used to describe a specific order or sequential order. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, which is only to describe the distinction mode adopted by the objects of the same attributes when describing in the embodiments of the present application. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, so that the process, method, system, product or equipment comprising a series of units need not be limited to those units, but may include other units that are not clearly listed or inherent to these processes, methods, products or equipment.

[0044] See also Figure 1 , Figure 1 1 shows a schematic diagram of the architecture of a data transmission system. The system may include a terminal 100 and a server 200. The server 200 may include one or more servers ( Figure 1 In the example, a server is included, and the server 200 can provide the method provided in the embodiment of the present application for one or more terminals.

[0045] Among them, an application for configuring a two-way communication link can be installed on the terminal 100. The above application and web page can provide an interface. The terminal 100 can receive relevant parameters entered by the user on the two-way communication link interface and send the above parameters to the server 200. The server 200 can obtain processing results based on the received parameters and return the processing results to the terminal 100.

[0046] It should be understood that in some optional implementations, the terminal 100 can also complete the action of obtaining the processing result based on the received parameters by itself without the cooperation of the server, and the embodiments of the present application are not limited to this.

[0047] Next describe Figure 1 The product form of the mid-terminal 100;

[0048] The terminal 100 in the embodiment of the present application can be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc., and the embodiment of the present application does not impose any limitation on this.

[0049] Figure 2 An optional hardware structure diagram of the terminal 100 is shown.

[0050] refer to Figure 2 As shown, the terminal 100 may include a radio frequency unit 110, a memory 120, an input unit 130, a display unit 140, a camera 150 (optional), an audio circuit 160 (optional), a speaker 161 (optional), a microphone 162 (optional), an earphone jack 163 (optional), a processor 170, an external interface 180, a power supply 190 and other components. Those skilled in the art will appreciate that Figure 2 These are merely examples of terminals or multi-function devices and do not constitute limitations on the terminals or multi-function devices, which may include more or fewer components than those shown in the figures, or combinations of certain components, or different components.

[0051] The input unit 130 can be used to receive input digital or character information, and generate key signal input related to the user settings and function control of the portable multifunctional device. Specifically, the input unit 130 may include a touch screen 131 (optional) and / or other input devices 132. The touch screen 131 can collect the user's touch operations on or near it (such as the user's operation on or near the touch screen using any suitable object such as fingers, joints, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch screen can detect the user's touch action on the touch screen, convert the touch action into a touch signal and send it to the processor 170, and can receive and execute the command sent by the processor 170; the touch signal at least includes the touch point coordinate information. The touch screen 131 can provide an input interface and an output interface between the terminal 100 and the user. In addition, the touch screen can be implemented using multiple types such as resistive, capacitive, infrared and surface acoustic wave. In addition to the touch screen 131, the input unit 130 can also include other input devices. Specifically, other input devices 132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, and the like.

[0052] Among them, the input device 132 can receive input data and the like.

[0053] The display unit 140 may be used to display information input by the user or provided to the user, various menus of the terminal 100, interactive interfaces, file display, and / or playback of any multimedia file. In the embodiment of the present application, the display unit 140 may be used to display an interface of a two-way communication link configuration, processing results, etc.

[0054] The memory 120 can be used to store instructions and data. The memory 120 can mainly include an instruction storage area and a data storage area. The data storage area can store various data, such as multimedia files, texts, etc.; the instruction storage area can store software units such as operating systems, applications, instructions required for at least one function, or their subsets and extensions. It can also include a non-volatile random access memory; provide the processor 170 with hardware, software and data resources including management of computing and processing equipment, and support control software and applications. It is also used for the storage of multimedia files, and the storage of running programs and applications.

[0055] The processor 170 is the control center of the terminal 100. It uses various interfaces and lines to connect various parts of the entire terminal 100. By running or executing instructions stored in the memory 120 and calling data stored in the memory 120, it executes various functions of the terminal 100 and processes data, thereby controlling the terminal device as a whole. Optionally, the processor 170 may include one or more processing units; preferably, the processor 170 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application program, and the modem processor mainly processes wireless communication. It is understandable that the above-mentioned modem processor may not be integrated into the processor 170. In some embodiments, the processor and the memory may be implemented on a single chip, and in some embodiments, they may also be implemented separately on separate chips. The processor 170 may also be used to generate corresponding operation control signals, send them to corresponding components of the computing and processing device, read and process data in the software, especially read and process data and programs in the memory 120, so that each functional module therein performs corresponding functions, thereby controlling the corresponding components to act according to the requirements of the instructions.

[0056] The radio frequency unit 110 (optional) can be used for receiving and sending information or receiving and sending signals during a call, for example, after receiving the downlink information of the base station, it is sent to the processor 170 for processing; in addition, the designed uplink data is sent to the base station. Generally, the RF circuit includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, LNA), a duplexer, etc. In addition, the radio frequency unit 110 can also communicate with network devices and other devices through wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile communication (Global System of Mobile communication, GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access, CDMA), Wideband Code Division Multiple Access (Wideband Code Division Multiple Access, WCDMA), Long Term Evolution (Long Term Evolution, LTE), email, Short Messaging Service (SMS), etc.

[0057] In this embodiment of the present application, the radio frequency unit 110 can send the configuration data of the two-way communication link to the server 200, and receive the processing result of the two-way communication link configuration sent by the server 200.

[0058] It should be understood that the radio frequency unit 110 is optional and can be replaced by other communication interfaces, such as a network port.

[0059] The terminal 100 also includes a power supply 190 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 170 through a power management system, so that the power management system can manage functions such as charging, discharging, and power consumption.

[0060] The terminal 100 further includes an external interface 180 , which may be a standard Micro USB interface or a multi-pin connector, and may be used to connect the terminal 100 to communicate with other devices, or to connect a charger to charge the terminal 100 .

[0061] Although not shown, the terminal 100 may also include a flashlight, a wireless fidelity (WiFi) module, a Bluetooth module, sensors with different functions, etc., which are not described in detail here. Some or all of the methods described below may be applied in the following embodiments. Figure 2 In the terminal 100 shown.

[0062] Next describe Figure 1 The product form of the server 200;

[0063] Figure 3 A structural diagram of a server 200 is provided, such as Figure 3 As shown, the server 200 includes a bus 201, a processor 202, a communication interface 203, and a memory 204. The processor 202, the memory 204, and the communication interface 203 communicate with each other via the bus 201.

[0064] The bus 201 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0065] The processor 202 may be any one or more of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).

[0066] The memory 204 may include a volatile memory, such as a random access memory (RAM). The memory 204 may also include a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid state drive (SSD).

[0067] The memory 204 may be used to store software codes related to the data transmission method, and the processor 202 may execute the steps of the data transmission method of the chip, and may also schedule other units to implement corresponding functions.

[0068] It should be understood that the above-mentioned terminal 100 and server 200 can be centralized or distributed devices, and the processors in the above-mentioned terminal 100 and server 200 (such as processor 170 and processor 202) can be hardware circuits (such as application specific integrated circuit (ASIC), field-programmable gate array (FPGA), general-purpose processor, digital signal processor (DSP), microprocessor or microcontroller, etc.), or a combination of these hardware circuits. For example, the processor can be a hardware system with an instruction execution function, such as a CPU, DSP, etc., or a hardware system without an instruction execution function, such as an ASIC, FPGA, etc., or a combination of the above-mentioned hardware systems without an instruction execution function and hardware systems with an instruction execution function.

[0069] The acquisition and control platform is the main tool for collecting various machine data and issuing various operation tasks. On the one hand, it has the acquisition function, and can obtain various operation and maintenance data of the managed machines through different business plug-ins, including second-level monitoring data, log data, automated execution result data, dial test result data, etc. On the other hand, it has the management and control function, which is an important means of remotely managing the agent on the managed machine, including installation, upgrade, heartbeat reporting, etc. Therefore, acquisition and control technology plays an important supporting role in the upper-level business layer requirements such as automated operations and monitoring, and plays the role of ballast in the operation of the entire operation and maintenance platform.

[0070] Currently, there are two solutions in the industry to solve the problem of efficient transmission of large amounts of data and management of massive acquisition and control agents: one is to set flow control after local caching and report to the server in batches. The other is to process data locally to complete data aggregation, threshold analysis, alarm triggering, etc. to reduce the amount of data reported. However, both have disadvantages and are no longer suitable for data transmission.

[0071] In solution 1, after the agent completes task execution and data collection according to the collection cycle and collection strategy, it first caches the data locally, then initiates an http short connection through the agent, and transmits the data to the server in batches. Although this method of reporting in batches using flow control can solve such problems, there are three problems with this solution: 1. Since the http connection can only be initiated from the agent and does not have the ability to push data to the server, the collection strategy needs to be solidified in the agent. When the collection strategy needs to be updated, the agent needs to be fully updated. It does not have the ability to flexibly update collection indicators, especially customized collection packages. When the number of agents reaches tens of thousands, the full update cycle is long, and it is necessary to frequently initiate the establishment of http short connections, consuming more machine network resources and port resources; 2. When the amount of business carried increases and the amount of data surges, it will cause data transmission delays, alarm delays, agent heartbeat reporting timeouts, and other problems; 3. In order to avoid the agent occupying too many machine operating resources and affecting the business system, the agent generally has a self-destruction mechanism. When the local cache exceeds the threshold, the agent will automatically restart and release the cache to the local business process, which will cause a large number of agents to be offline. Alarm storms, drowning normal alarms and causing panic.

[0072] Solution 2: Data is collected and processed locally to complete data aggregation, threshold analysis, alarm triggering, etc., to reduce the amount of data reported. Although this solution can reduce data transmission by local data processing, it has the following problems: 1. Completing data aggregation, threshold analysis, alarm triggering, data uploading and other functions through the processing capabilities of the agent locally will greatly increase the complexity of the agent and the consumption of local CPU and memory resources, which will affect the operation of the original business system and cause the phenomenon of overshadowing the main function. 2. Solidifying the collection strategy and data processing strategy locally will produce the phenomenon of fat terminals, and the collection and control strategy cannot be changed flexibly and dynamically, which is contrary to the concept of thin terminals in the cloud computing era and does not conform to the general trend of the times.

[0073] In order to solve the above problems, the embodiment of the present application provides a data transmission method. The data transmission method of the embodiment of the present application is described in detail below with reference to the accompanying drawings.

[0074] Reference Figure 4 , Figure 4 A schematic diagram of a data transmission method provided in an embodiment of the present application is shown in FIG. Figure 4 As shown, a data transmission method provided in an embodiment of the present application may include steps 401 to 403, and these steps are described in detail below.

[0075] 401. Obtain control data of the target host and operation and maintenance data collected by the target data collection plug-in on the target host.

[0076] Specifically, refer to Figure 5As shown on the left, under normal operation, the agent on the host will collect management data such as installation data, upgrade data, heartbeat reporting data, etc. By deploying a plug-in for reporting data on the agent, other data of the host can be collected, such as collecting operation log data through a log plug-in, and monitoring host transmission data through a link tracking plug-in to obtain corresponding monitoring data.

[0077] The agent can obtain control data and operation and maintenance data by actively initiating data acquisition requests to these plug-ins. It can also obtain data by actively initiating data reporting at regular intervals through plug-ins.

[0078] 402. Send the operation and maintenance data to the operation and maintenance data gateway using at least one preset two-way communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to the target service node in the server. At least one preset two-way communication link is a pre-built data transmission link associated with the target data acquisition plug-in.

[0079] 403. Send the control data to the control data gateway using the control data transmission link to trigger the control data gateway to forward the control data to the control service node in the server.

[0080] Specifically, refer to Figure 5 As shown in the figure, the agent uses the control data transmission link by default to send the collected control data such as installation data, upgrade data, heartbeat reporting data, etc. to the control data gateway, and then the control data gateway uploads the operation and maintenance data to the control service node of the server. For operation and maintenance data, the bidirectional communication link pre-set for each plug-in can be used. After load balancing, it is forwarded to the corresponding operation and maintenance service node on the server through the operation and maintenance data gateway. Among them, the bidirectional communication link can use the data link constructed by Websocket. Websocket is a protocol for full-duplex communication on a single TCP connection. It first performs a handshake process through the http protocol to upgrade the connection from the http protocol to the Websocket protocol. Once the connection is established, the client and the server can send and receive data frames through this connection for bidirectional communication. These data frames contain the data to be transmitted and some metadata, such as data length, data type, etc., which makes up for the shortcomings of the http protocol in persistent communication capabilities. In addition, the Websocket protocol also provides mask processing for data to increase the security of data transmission.

[0081] When using a two-way communication link to send operation and maintenance data, in order to improve the efficiency of data transmission, the same type of business data can be distributed to multiple links for transmission, and one websocket can carry multiple business data.

[0082] By adding a new bidirectional transmission link for the routing and distribution of operation and maintenance data, the corresponding collection module or plug-in's reported data can be independently carried, thereby ensuring that the normal collection of the host's control data will not be affected, effectively avoiding large-scale offline of agents due to management channel blockage, and effectively controlling the scope of the fault. It can also greatly improve the robustness of the operation and maintenance acquisition and control terminal, and can withstand the effect of large-volume data reporting and transportation.

[0083] As a feasible implementation of the above embodiment, in order to improve the real-time performance of data transmission, the above step 402, sending the operation and maintenance data to the operation and maintenance data gateway using at least one preset two-way communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to the target service node in the server, includes:

[0084] According to the identification of the target data acquisition plug-in, at least one preset two-way communication link is determined from the pre-built two-way communication links; and then the operation and maintenance data is sent to the operation and maintenance data gateway using the at least one preset two-way communication link.

[0085] Specifically, the process of establishing at least one preset bidirectional communication link may specifically include:

[0086] Step 11: In response to the user's operation of adding a two-way communication link in the operation management interface, a two-way communication link adding interface is displayed.

[0087] Step 12: In response to the user completing the parameter setting operation in the two-way communication link adding interface, a two-way communication link is generated according to the parameters entered by the user in the two-way communication link adding interface.

[0088] The identification of the two-way communication link can be generated according to the basic information in the two-way communication link adding interface;

[0089] According to the link address of the server in the two-way communication link addition interface, a forwarding route for the two-way communication link is generated in the operation and maintenance data gateway.

[0090] Reference Figure 7 As shown, when a user creates a new data access configuration, enter the transmission management page and select the area to be configured with multiple channels (such as Figure 7 Click Data Access to enter the parameter configuration interface. Figure 8 As shown, when configuring the routing parameters of a new data channel, the user fills in the basic information, including the name and code, and the uplink address of the proxy connection server, which is generally the virtual IP address of the LVS (Linux Virtual Server, a virtual server cluster system), and then clicks the OK button to form a two-way communication link for the new routing gateway forwarding strategy.

[0091] The service node associated with the two-way communication link on the server can be obtained according to the node adjustment information in the two-way communication link adding interface. According to the proxy information in the two-way communication link adding interface, a proxy is added to the two-way communication link, and the proxy initiates a request to establish the two-way communication link in a hot-effective manner.

[0092] Here, you can use the Adjust Node function in the Service Node Options column (not shown in the figure) to add the corresponding service node on the server, thereby connecting to the route of the newly generated two-way communication link. In the Use Proxy column, you can use the Edit Proxy function to add the proxy corresponding to the two-way communication link. The newly added proxy will initiate a new link establishment request in a hot-effective manner to complete the establishment of a new websocket link.

[0093] In this way, by separating different types of data channels and control channels, we can not only greatly improve the throughput capacity of massive data in multi-dimensional operation and maintenance scenarios, improve transmission efficiency, and avoid alarm delays, but also dynamically expand the capacity of the websocket channel to improve user experience, achieve hot effectiveness, and improve user experience. On the other hand, the control channel is separated to ensure the smooth transmission of small-volume control information, which can effectively avoid heartbeat reporting timeouts and link interruptions caused by channel blocking, causing large-scale offline agents, generating alarm storms, and causing panic, thereby greatly improving the robustness of the operation and maintenance procurement and control end connection, and being able to withstand the effect of large-volume data reporting and transportation.

[0094] As a specific application of the above data transmission method, refer to Figure 6 As shown in the figure, taking the data collection and reporting of log data as an example, logmon is the log data collection plug-in, Agent is the agent, Ant-Controller-Gateway is the management and control data gateway, and Ant-Data-Gateway is the operation and maintenance data gateway. The data transmission process can specifically include:

[0095] After the user installs the logmon plug-in on the target machine and configures the collection policy, the plug-in will complete the log collection according to the path and collection frequency specified in the policy.

[0096] The log data collected by the plug-in is first pushed to the Agent, and an ack is returned to confirm the delivery. Then the Agent pushes the business data of logmon (when there is a corresponding new two-way communication link, that is, when there is a forwarding strategy) to the new Ant-Data-Gateway via the new Websocket link and routes it to the service node. The same type of business data can be distributed to multiple links for transmission.

[0097] When there is no corresponding two-way communication link, that is, when there is no forwarding strategy, the default Ant-Controller-Gateway routing forwarding is used.

[0098] The default Ant-Controller-Gateway routing will also be used for Agent management data and other plug-in acquisition and control data without newly defined links.

[0099] A data transmission method provided in an embodiment of the present application is introduced above, and a device for executing the above data transmission method will be introduced below.

[0100] See also Fig. 9 , Fig. 9 This is a schematic diagram of the structure of a data transmission device provided in an embodiment of the present application. Fig. 9 As shown, the data transmission device comprises:

[0101] The operation and maintenance data acquisition module 901 is used to acquire the control data of the target host and the operation and maintenance data collected by the target data collection plug-in on the target host;

[0102] An operation and maintenance data transmission module 902 is used to send the operation and maintenance data to the operation and maintenance data gateway using at least one preset two-way communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to the target service node in the server, wherein the at least one preset two-way communication link is a pre-built data transmission link associated with the target data acquisition plug-in; and

[0103] The control data transmission module 903 is used to send the control data to the control data gateway using the control data transmission link, so as to trigger the control data gateway to forward the control data to the control service node in the server.

[0104] In a possible implementation, the operation and maintenance data transmission module 902 sends the operation and maintenance data to the operation and maintenance data gateway using at least one preset two-way communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to the target service node in the server, including:

[0105] Determining the at least one preset two-way communication link from pre-built two-way communication links according to the identifier of the target data acquisition plug-in;

[0106] The operation and maintenance data is sent to the operation and maintenance data gateway using the at least one preset two-way communication link.

[0107] In a possible implementation, the process of establishing at least one preset bidirectional communication link in the operation and maintenance data transmission module 902 includes:

[0108] In response to the user's operation of adding a two-way communication link in the operation management interface, displaying a two-way communication link adding interface;

[0109] In response to the user completing the parameter setting operation in the two-way communication link adding interface, a two-way communication link is generated according to the parameters entered by the user in the two-way communication link adding interface.

[0110] In a possible implementation, the process of the operation and maintenance data transmission module 902 generating a two-way communication link according to the parameters entered by the user in the two-way communication link adding interface includes:

[0111] Generate an identifier of the two-way communication link according to the basic information in the two-way communication link adding interface;

[0112] According to the link address of the server in the two-way communication link adding interface, a forwarding route of the two-way communication link is generated in the operation and maintenance data gateway.

[0113] In a possible implementation, the process of the operation and maintenance data transmission module 902 generating a two-way communication link according to the parameters entered by the user in the two-way communication link adding interface further includes:

[0114] According to the node adjustment information in the two-way communication link adding interface, the service node associated with the two-way communication link on the server is obtained.

[0115] In a possible implementation, the process of the operation and maintenance data transmission module 902 generating a two-way communication link according to the parameters entered by the user in the two-way communication link adding interface further includes:

[0116] According to the proxy information in the two-way communication link adding interface, a proxy is added to the two-way communication link, and the proxy initiates a request to establish the two-way communication link in a hot-effective manner.

[0117] The present application also provides an electronic device in an embodiment. Fig.10 As shown, it shows a schematic diagram of the structure of an electronic device suitable for implementing the embodiment of the present application. The electronic device in the embodiment of the present application may include but is not limited to fixed terminals such as mobile phones, laptops, PDAs (personal digital assistants), PADs (tablet computers), desktop computers, etc. Fig.10 The electronic device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0118] like Fig.10As shown, the electronic device may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 to a random access memory (RAM) 1003. When the electronic device is powered on, various programs and data required for the operation of the electronic device are also stored in the RAM 1003. The processing device 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0119] Typically, the following devices may be connected to the I / O interface 1005: an input device 1006 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 1007 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1008 including, for example, a memory card, a hard disk, etc.; and a communication device 1009. The communication device 1009 may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. Although Fig.10 An electronic device having various devices is shown, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0120] An embodiment of the present application also provides a computer program product including computer-readable instructions. When the computer-readable instructions are executed on an electronic device, the electronic device implements any one of the data transmission methods provided in the embodiments of the present application.

[0121] A computer-readable storage medium is also provided in an embodiment of the present application. The storage medium carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can implement any data transmission method provided in the embodiment of the present application.

[0122] It should also be noted that the device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, in the drawings of the device embodiments provided by the present application, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines.

[0123] Through the description of the above implementation mode, the technicians in the field can clearly understand that the present application can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc. In general, all functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present application, software program implementation is a better implementation mode in more cases. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, a U disk, a mobile hard disk, a ROM, a RAM, a disk or an optical disk, etc., including a number of instructions to enable a computer device (which can be a personal computer, a training device, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0124] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0125] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, a computer, a training device, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, training device, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a training device, a data center, etc. that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)), etc.

Claims

1. A data transmission method, characterized in that: include: Obtaining control data of the target host and operation and maintenance data collected by the target data collection plug-in on the target host; Sending the operation and maintenance data to the operation and maintenance data gateway using at least one preset two-way communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to the target service node in the server, wherein the at least one preset two-way communication link is a pre-built data transmission link associated with the target data acquisition plug-in; The control data is sent to the control data gateway using a control data transmission link to trigger the control data gateway to forward the control data to the control service node in the server.

2. The data transmission method according to claim 1, characterized in that: The sending the operation and maintenance data to the operation and maintenance data gateway using at least one preset two-way communication link to trigger the operation and maintenance data gateway to forward the operation and maintenance data to a target service node in the server includes: Determining the at least one preset two-way communication link from pre-built two-way communication links according to the identifier of the target data acquisition plug-in; The operation and maintenance data is sent to the operation and maintenance data gateway using the at least one preset two-way communication link.

3. The data transmission method according to claim 1, characterized in that: The process of establishing the at least one preset two-way communication link includes: In response to the user's operation of adding a two-way communication link in the operation management interface, displaying a two-way communication link adding interface; In response to the user completing the parameter setting operation in the two-way communication link adding interface, a two-way communication link is generated according to the parameters entered by the user in the two-way communication link adding interface.

4. The data transmission method according to claim 3, characterized in that: The generating of the two-way communication link according to the parameters entered by the user in the two-way communication link adding interface includes: Generate an identifier of the two-way communication link according to the basic information in the two-way communication link adding interface; According to the link address of the server in the two-way communication link adding interface, a forwarding route of the two-way communication link is generated in the operation and maintenance data gateway.

5. The data transmission method according to claim 3, characterized in that: The generating of the two-way communication link according to the parameters entered by the user in the two-way communication link adding interface also includes: According to the node adjustment information in the two-way communication link adding interface, the service node associated with the two-way communication link on the server is obtained.

6. The data transmission method according to claim 3, characterized in that: The generating of the two-way communication link according to the parameters entered by the user in the two-way communication link adding interface also includes: According to the proxy information in the two-way communication link adding interface, a proxy is added to the two-way communication link, and the proxy initiates a request to establish the two-way communication link in a hot-effective manner.

7. A data transmission device, characterized in that: include: An operation and maintenance data acquisition module, used to acquire control data of a target host and operation and maintenance data collected by a target data collection plug-in on the target host; An operation and maintenance data transmission module, used to send the operation and maintenance data to the operation and maintenance data gateway using at least one preset two-way communication link, so as to trigger the operation and maintenance data gateway to forward the operation and maintenance data to the target service node in the server, wherein the at least one preset two-way communication link is a pre-built data transmission link associated with the target data acquisition plug-in; and The control data transmission module is used to send the control data to the control data gateway using the control data transmission link, so as to trigger the control data gateway to forward the control data to the control service node in the server.

8. A computer program product, characterized in that It comprises computer-readable instructions, and when the computer-readable instructions are executed on an electronic device, the electronic device implements the data transmission method as claimed in any one of claims 1 to 6.

9. An electronic device, characterized in that: The method comprises at least one processor and a memory connected to the processor, wherein: The memory is used to store computer programs; The processor is used to execute the computer program so that the electronic device can implement the data transmission method as described in any one of claims 1 to 6.

10. A computer storage medium, characterized in that: The storage medium carries one or more computer programs, and when the one or more computer programs are executed by an electronic device, the electronic device can implement the data transmission method as described in any one of claims 1 to 6.

Images