Multi-server log collection method, device and system

Abstract

The invention provides a multi-server log collection method, device and system, is applied to the technical field of computers, and provides the scheme for solving the problems of complex wiring and high cost of a log collection mode in the related technology, each server is provided with a first wireless receiving and transmitting module, and the first wireless receiving and transmitting module is provided with a second wireless receiving and transmitting module; a second wireless transceiver module is arranged in the data transmission device of each cabinet, and the data transmission devices are connected with log management equipment. Comprising the following steps: receiving a baseboard management controller system log sent by a first wireless transceiver module on each server in a current cabinet through a second wireless transceiver module of the current cabinet; determining a target data transmission device according to the current load condition; sending the system log of the baseboard management controller to log management equipment through the target data transmission device; the number of wires can be greatly reduced, so that the wiring complexity is reduced, the wiring cost is reduced, and maintenance is easy.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a multi-server log collection method, device and system. Background Art

[0002] Server status monitoring and troubleshooting mainly rely on BMC (Baseboard Management Controller) system logs. In related technologies, each server is connected to the data center equipment through a wired connection, and the BMC system logs of each server are collected through a wired method. However, due to the large number of servers, the wired log collection method leads to complex wiring, difficult maintenance, and high costs.

[0003] It can be seen that how to reduce the wiring complexity of BMC log collection, reduce the maintenance difficulty and wiring cost is a problem that technical personnel in this field need to solve. Summary of the invention

[0004] The purpose of the embodiments of the present invention is to provide a multi-server log collection method, device and system, which can reduce wiring complexity, facilitate maintenance, and reduce wiring costs.

[0005] To solve the above technical problems, an embodiment of the present invention provides a log collection method for multiple servers, wherein each server is provided with a first wireless transceiver module, and a data transmission device of each cabinet is provided with a second wireless transceiver module, and the data transmission device is connected to a log management device. The method is applied to the data transmission device, and includes:

[0006] Receiving, through the second wireless transceiver module of the current cabinet, a baseboard management controller system log sent by the first wireless transceiver module of each server located in the current cabinet;

[0007] Determine the target data transmission device according to the current load condition;

[0008] The baseboard management controller system log is sent to the log management device through the target data transmission device.

[0009] In some embodiments, determining the target data transmission device according to the current load condition includes:

[0010] Acquire data transmission status information of a current data transmission device, and calculate a comprehensive evaluation index of the current data transmission device according to the data transmission status information;

[0011] When the comprehensive evaluation index of the current data transmission device is less than or equal to a preset threshold, the current data transmission device is used as a target data transmission device;

[0012] When the comprehensive evaluation index of the current data transmission device is greater than the preset threshold, a target data transmission device is determined from the data transmission devices of other cabinets.

[0013] In some embodiments, the data transmission status information includes one or more of the current data load, the maximum processable data load, the remaining transmission capacity with the log management device, the distance between the log management device, the remaining battery power of the battery used to power the current data transmission device, and the current data transmission efficiency.

[0014] In some embodiments, it also includes:

[0015] Obtain the remaining battery power sent by the data transmission devices of each other cabinet;

[0016] The calculating the comprehensive evaluation index of the current data transmission device according to the data transmission status information includes:

[0017] Calculating a load balancing factor according to the current data load and the maximum processable data load;

[0018] Calculating a transmission capacity factor according to a remaining transmission capacity with the log management device and a distance between the log management device and the log management device;

[0019] Determine a battery power factor according to the remaining battery power of the current data transmission device and the remaining battery power corresponding to the data transmission devices of other cabinets;

[0020] Obtaining a first weight value corresponding to the load balancing factor, a second weight value corresponding to the transmission capacity factor, and a third weight value corresponding to the battery power factor;

[0021] According to the first weight value, the second weight value and the third weight value, combined with the load balancing factor, the transmission capacity factor and the battery power factor, a comprehensive evaluation index of the current data transmission device is obtained.

[0022] In some embodiments, determining the target data transmission device from the data transmission devices of other cabinets includes:

[0023] Acquire data information sent by the second wireless transceiver modules in the data transmission devices of each other cabinet through the current second wireless transceiver module;

[0024] Analyze each of the data information to determine the cabinet position of each other cabinet and the comprehensive evaluation index of the data transmission device;

[0025] According to the cabinet positions of other cabinets and the cabinet position of the current cabinet, each adjacent cabinet located within a preset range is determined from other mechanisms;

[0026] According to the comprehensive evaluation indicators respectively corresponding to the data transmission devices of the adjacent cabinets, the data transmission device corresponding to the minimum comprehensive evaluation indicator is determined, and the data transmission device corresponding to the minimum comprehensive evaluation indicator is used as the target data transmission device.

[0027] In some embodiments, in the case of determining the target data transmission device from the data transmission devices of other cabinets, the method further includes:

[0028] Using the current data transmission device as the target data transmission device at the same time;

[0029] The sending of the baseboard management controller system log to the log management device through the target data transmission device comprises:

[0030] Sending a first preset proportion of the baseboard management controller system log in the baseboard manager system log to a second wireless transceiver module of a target data transmission device determined from the data transmission devices of other cabinets through the current second wireless transceiver module, so that the target data transmission device determined from the data transmission devices of other cabinets sends the first preset proportion of the baseboard management controller system log to the log management device;

[0031] The remaining baseboard management controller system logs in the baseboard manager system log are sent to the log management device through the current data transmission device.

[0032] In some embodiments, the first wireless transceiver module and / or the second wireless transceiver module is a wireless transceiver module implemented based on cooperative short wave communication technology; the method further includes:

[0033] Get current environment parameters;

[0034] The wavelength of the current second wireless transceiver module is adjusted according to the current environmental parameters.

[0035] In some embodiments, the baseboard management controller system log is obtained by collecting the baseboard management controller log data of the server by the baseboard management controller agent module on the server according to a pre-set log collection strategy; the log collection strategy is determined based on a specified log type and / or log level and / or collection frequency.

[0036] Another aspect of the embodiment of the present invention provides a log collection device for multiple servers, wherein each server is provided with a first wireless transceiver module, and a data transmission device of each cabinet is provided with a second wireless transceiver module, and the data transmission device is connected to the log management device by wire. The device is applied to the data transmission device, and includes:

[0037] A receiving module, used for receiving, through a second wireless transceiver module of a current cabinet, a baseboard management controller system log sent by a first wireless transceiver module on each server in the current cabinet;

[0038] A determination module, used to determine a target data transmission device according to a current load condition;

[0039] The sending module is used to send the baseboard management controller system log to the log management device through the target data transmission device.

[0040] Another aspect of an embodiment of the present invention provides a multi-server log collection system, comprising a first wireless transceiver module disposed on each server, a data transmission device disposed on each cabinet, a log management device connected to the data transmission device of each cabinet, and a second wireless transceiver module, a memory, and a processor disposed in the data transmission device; wherein:

[0041] Memory for storing computer programs;

[0042] A processor is used to execute the computer program to implement the steps of the multi-server log collection method as described above.

[0043] It can be seen from the above technical solution that the beneficial effects of the present invention are:

[0044] An embodiment of the present invention provides a log collection method for multiple servers, wherein each server is provided with a first wireless transceiver module, a data transmission device of each cabinet is provided with a second wireless transceiver module, and the data transmission device is connected to a log management device. The method is applied to the data transmission device, comprising: receiving a baseboard management controller system log sent by a first wireless transceiver module on each server located in the current cabinet through the second wireless transceiver module of the current cabinet; determining a target data transmission device according to the current load situation; and sending the baseboard management controller system log to the log management device through the target data transmission device.

[0045] It can be seen that in the embodiment of the present invention, each server inside each cabinet is provided with a first wireless transceiver module, and the data transmission device on the cabinet is provided with a second wireless transceiver module. Each server inside the cabinet can use the first wireless transceiver module to wirelessly send the baseboard management controller system log to the second wireless transceiver module of the data transmission device of the cabinet. The data transmission device in the cabinet can determine the target data transmission device from itself and the various data transmission devices of other cabinets according to the current load situation. Since the data transmission device of each cabinet has established a connection with the log management device, the received baseboard management controller system log can be sent to the log management device through the target data transmission device. In the embodiment of the present invention, by setting the first wireless transceiver module on the server and setting the second wireless transceiver module on the data transmission device of the cabinet, the number of wiring can be greatly reduced, thereby reducing the complexity of wiring, reducing the wiring cost, and facilitating maintenance.

[0046] In addition, the present invention also provides a corresponding implementation device and system for the log collection method of multiple servers, which further makes the method more practical, and the device and system have corresponding advantages. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0048] Figure 1 A schematic diagram of a flow chart of a baseboard management controller system log method provided by an embodiment of the present invention;

[0049] Figure 2 A schematic diagram of the architecture of a baseboard management controller system log system provided by an embodiment of the present invention;

[0050] Figure 3 A schematic flow chart of another baseboard management controller system log method provided by an embodiment of the present invention;

[0051] Figure 4 A schematic diagram of deployment preparation and server software deployment provided by an embodiment of the present invention;

[0052] Figure 5 A schematic diagram of a log collection and preprocessing process provided by an embodiment of the present invention;

[0053] Figure 6 A schematic diagram of an encryption and processing process in a log transmission process provided by an embodiment of the present invention;

[0054] Figure 7 A log management process diagram of a log management device provided by an embodiment of the present invention;

[0055] Figure 8 A schematic diagram of a log backup, recovery and maintenance process of a log management device provided by an embodiment of the present invention;

[0056] Fig. 9 A structural schematic diagram of a baseboard management controller system log device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0057] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0058] The terms "including" and "having" in the specification of the present invention and the above-mentioned drawings, as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may include steps or units that are not listed.

[0059] In order to enable those skilled in the art to better understand the solution of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0060] In the related art, the baseboard management controller system log (ie, BMC log) is mainly collected by wired means, but the wired collection method leads to complex wiring, difficult maintenance, and high wiring cost. In view of this, the embodiment of the present invention provides a multi-server log collection method that reduces wiring complexity, reduces wiring cost, and is easy to maintain.

[0061] Next, a multi-server log collection method provided by an embodiment of the present invention is described in detail. Figure 1 A flow chart of a multi-server log collection method provided by an embodiment of the present invention is provided. Each server is provided with a first wireless transceiver module, a data transmission device in each cabinet is provided with a second wireless transceiver module, and the data transmission device is connected to the log management device.

[0062] It should be noted that if Figure 2 The architecture diagram of the multi-server log collection system shown in FIG. 1 shows, in the embodiment of the present invention, each server (such as Figure 2The servers 1 to n in the example are configured with corresponding first wireless transceiver modules A, which have wireless transmission and reception functions. In practical applications, in order to further ensure the redundancy and stability of data transmission, two sets of first wireless transceiver modules can be configured for each server, one of which is used as the main module and the other as the backup module. When the main module fails, the backup module can be used for data transmission. In the embodiment of the present invention, each cabinet (such as Figure 2 The cabinets 1 to m shown are equipped with corresponding data transmission devices, and the data transmission devices are provided with a second wireless transceiver module B. Each server located in the cabinet can communicate wirelessly with the second wireless transceiver module B on the cabinet through the corresponding first wireless transceiver module A, wherein the second wireless transceiver module B can be isolated from other networks through a separate network layout, thereby improving the security of data transmission. The data transmission device is connected to the log management device. In actual applications, if the log management device is far away from the data transmission device, the data transmission device can be connected to the log management device by wired connection, thereby ensuring the stability and security of data transmission between the data transmission device on the cabinet and the log management device.

[0063] In addition, in practical applications, each first wireless transceiver module and the second wireless transceiver module may be configured with a corresponding power supply battery to ensure that the module can continue to work for a period of time in the event of a power outage, thereby better ensuring the continuity and integrity of data transmission.

[0064] The method is applied to the data transmission device in each cabinet, and a cabinet is taken as an example for detailed description. The method includes:

[0065] S110: receiving, through the second wireless transceiver module of the current cabinet, a baseboard management controller system log sent by the first wireless transceiver module of each server located in the current cabinet;

[0066] It can be understood that each server located in the current cabinet can respectively send the baseboard management controller system log collected by the BMC on the server to the second wireless transceiver module of the data transmission device of the current cabinet through its respective first wireless transceiver module, and the data transmission device can receive the baseboard management controller system log sent by each server located in the current cabinet.

[0067] S120: Determine a target data transmission device according to the current load condition;

[0068] It should be noted that, considering the load conditions of the data transmission device, in order to ensure the stability and security of data transmission, the data transmission device can determine the target data transmission device based on the current load conditions. In actual applications, the target data transmission device can be determined from its own data transmission device and the data transmission devices of other cabinets.

[0069] S130: Sending the baseboard management controller system log to the log management device through the target data transmission device.

[0070] After the target data transmission device is determined, the baseboard management controller system logs sent by each server in the current cabinet can be sent to the log management device through the target data transmission device for centralized storage and management.

[0071] In practical applications, considering that SSC (Synthetic Shortwave Communication) has the advantages of high stability, strong reliability and strong anti-interference ability, the first wireless transceiver module and / or the second wireless transceiver module in the embodiment of the present invention is a wireless transceiver module implemented based on SSC technology, thereby improving the stability, reliability and anti-interference of data transmission.

[0072] It can be seen that in the embodiment of the present invention, each server inside each cabinet is provided with a first wireless transceiver module, and the data transmission device on the cabinet is provided with a second wireless transceiver module. Each server inside the cabinet can use the first wireless transceiver module to wirelessly send the baseboard management controller system log to the second wireless transceiver module of the data transmission device of the cabinet. The data transmission device in the cabinet can determine the target data transmission device from itself and the various data transmission devices of other cabinets according to the current load situation. Since the data transmission device of each cabinet has established a connection with the log management device, the received baseboard management controller system log can be sent to the log management device through the target data transmission device. In the embodiment of the present invention, by setting the first wireless transceiver module on the server and setting the second wireless transceiver module on the data transmission device of the cabinet, the number of wiring can be greatly reduced, thereby reducing the complexity of wiring, reducing the wiring cost, and facilitating maintenance.

[0073] In some embodiments, the process of determining the target data transmission device according to the current load condition may include:

[0074] Acquire data transmission status information of the current data transmission device, and calculate a comprehensive evaluation index of the current data transmission device according to the data transmission status information;

[0075] When the comprehensive evaluation index of the current data transmission device is less than or equal to a preset threshold, the current data transmission device is used as a target data transmission device;

[0076] When the comprehensive evaluation index of the current data transmission device is greater than a preset threshold, a target data transmission device is determined from the data transmission devices of other cabinets.

[0077] It should be noted that by monitoring its own data transmission device to determine whether it is busy, if it is busy, it can determine the target data transmission device from the data transmission devices of other cabinets. If it is not busy, its own data transmission device can be used as the target data transmission device.

[0078] In practical applications, the comprehensive evaluation index of the current data transmission device can be calculated based on the data transmission status information of the current data transmission device, wherein the comprehensive evaluation index can reflect the load condition of the data transmission device. It is further determined whether the comprehensive evaluation index of the current data transmission device is less than or equal to the preset threshold value. If it is less than or equal to the preset threshold value, it means that the current data transmission device is not busy and can continue to transmit more data. At this time, the current data transmission device in the current cabinet can be used as the target data transmission device, and the baseboard management controller system logs received from each server are sent to the log management device. If the comprehensive evaluation index of the current data transmission device is greater than the preset threshold value, it means that the current data transmission device is busy and cannot carry the transmission of all baseboard management controller system logs. At this time, the target data transmission device can be determined from the data transmission devices of other cabinets so that the baseboard management controller system logs can be sent to the log management device through the target data transmission device.

[0079] In some embodiments, when the target data transmission device is determined from the data transmission devices of other cabinets, the method may further include:

[0080] Using the current data transmission device as the target data transmission device at the same time;

[0081] Sending the baseboard management controller system log to the log management device through the target data transmission device includes:

[0082] Sending a first preset proportion of the baseboard management controller system log in the baseboard manager system log to the second wireless transceiver module of the target data transmission device determined from the data transmission devices of other cabinets through the current second wireless transceiver module, so that the target data transmission device determined from the data transmission devices of other cabinets sends the first preset proportion of the baseboard management controller system log to the log management device;

[0083] The remaining baseboard management controller system logs in the baseboard manager system log are sent to the log management device through the current data transmission device.

[0084] It is understandable that in actual applications, if the comprehensive evaluation index of the current data transmission device is greater than a preset threshold, a data transmission device can be coordinated from the data transmission devices of other cabinets to share the data transmission work, thereby avoiding data congestion or loss. Therefore, in an embodiment of the present invention, after determining a target data transmission device from the data transmission devices of other cabinets, the current data transmission device of the current cabinet can also be used as a target transmission device at the same time. All baseboard management controller system logs to be sent to the log management device can be divided into two parts, one part is the baseboard management controller system log of the first preset proportion, and the other part is the baseboard management controller system log of the remaining proportion. The data transmission devices of different cabinets can communicate with each other through their respective second wireless transceiver modules. Therefore, the current data transmission device in the embodiment of the present invention can, on the one hand, send a first preset proportion of the baseboard management controller system logs to the second wireless transceiver module of the target data transmission device selected from the data transmission devices of other cabinets through the second wireless transceiver module of the current data transmission device, and then send this part of the baseboard management controller system logs to the log management device through the target data transmission device; on the other hand, the current data transmission device sends the remaining part of the baseboard management controller system logs directly to the log management device, thereby better ensuring the stability and security of data transmission, and better maintaining load balancing.

[0085] In some embodiments, the data transmission status information that can reflect the load conditions in the embodiments of the present invention may include one or more of the current data load Li, the maximum processable data load Ci, the remaining transmission capacity Ri with the log management device, the distance Di between the log management device, the remaining battery power Pi of the battery used to power the current data transmission device, and the current data transmission efficiency Ti.

[0086] In some embodiments, when the data transmission status information includes all of the above current data load Li, the maximum processable data load Ci, the remaining transmission capacity Ri with the log management device, the distance Di between the log management device, the remaining battery power Pi and the current data transmission efficiency Ti, the method may also include:

[0087] Obtain the remaining battery power sent by the data transmission devices of each other cabinet;

[0088] The above process of calculating the comprehensive evaluation index of the current data transmission device according to the data transmission status information may include:

[0089] The load balancing factor Ei is calculated based on the current data load Li and the maximum processable data load Ci; wherein the current data load Li and the maximum processable data load Ci can be multiplied to obtain the load balancing factor Ei, that is, Ei=Li*Ci.

[0090] The transmission capacity factor Fi is calculated based on the remaining transmission capacity Ri with the log management device and the distance Di between the log management device; wherein the remaining transmission capacity Ri with the log management device and the distance Di between the log management device can be multiplied to obtain the transmission capacity factor Fi, that is, Fi=Ri*Di.

[0091] The battery power factor Gi is determined based on the remaining battery power Pi of the current data transmission device and the remaining battery power Pi corresponding to the data transmission devices of other cabinets; wherein the remaining battery power with the largest value can be selected from the remaining battery powers as the battery power factor, that is, Gi=max(Pi).

[0092] Obtain a first weight value w1 corresponding to the load balancing factor, a second weight value w2 corresponding to the transmission capacity factor, and a third weight value w3 corresponding to the battery power factor;

[0093] According to the first weight value w1, the second weight value w2 and the third weight value w3, combined with the load balancing factor Ei, the transmission capacity factor Fi= and the battery power factor Gi, a comprehensive evaluation index Hi of the current data transmission device is obtained.

[0094] It is understandable that in the embodiment of the present invention, the weight values ​​corresponding to each factor can be predetermined to balance the importance of each factor, and then the comprehensive evaluation index of the current data transmission device can be obtained according to each weight value and the corresponding factor. That is, the comprehensive evaluation index Hi of the current data transmission device = w1*Ei+w2*Fi+w3*Gi.

[0095] For the data transmission device in each cabinet, its own comprehensive evaluation index is obtained according to the above method.

[0096] In some embodiments, the process of determining the target data transmission device from the data transmission devices of other cabinets may include:

[0097] Acquire data information sent by the second wireless transceiver modules in the data transmission devices of each other cabinet through the current second wireless transceiver module;

[0098] Analyze each piece of data information to determine the cabinet locations of other cabinets and the comprehensive evaluation indicators of data transmission devices;

[0099] According to the cabinet positions of other cabinets and the cabinet position of the current cabinet, each adjacent cabinet located within a preset range is determined from other mechanisms;

[0100] According to the comprehensive evaluation indicators respectively corresponding to the data transmission devices of each adjacent cabinet, the data transmission device corresponding to the minimum comprehensive evaluation indicator is determined, and the data transmission device corresponding to the minimum comprehensive evaluation indicator is used as the target data transmission device.

[0101] It can be understood that in the embodiment of the present invention, the current second wireless transceiver module located in the current data transmission device obtains the data information sent by the second wireless transceiver module in the data transmission device of each other cabinet, and the data information may include the cabinet position and the comprehensive evaluation index. Then, according to the cabinet position of each other cabinet and the cabinet position of the current cabinet, the distance between the current cabinet and each other cabinet is determined, and each adjacent cabinet whose distance from the current cabinet is less than the distance threshold (for example, 10m) is determined from each other cabinet; or, with the current cabinet as the center and the first distance (for example, 10m) as the radius, a preset range is determined, wherein the specific values ​​of the first distance and the distance threshold can be determined according to actual needs, and each adjacent cabinet located within the preset range is determined according to the cabinet position of each other cabinet. Further, according to the comprehensive evaluation indexes corresponding to the data transmission devices of each adjacent cabinet, the data transmission device with the smallest comprehensive evaluation index is screened out, and the data transmission device is used as the target data transmission device determined from the data transmission devices of each other adjacent cabinet.

[0102] In some embodiments, the method may further include:

[0103] When the distance between the cabinet where the data transmission device corresponding to the minimum comprehensive evaluation index is located and the current data transmission device as a cabinet is greater than a preset distance, determining a transit data transmission device from the data transmission devices of the remaining adjacent cabinets;

[0104] Sending the baseboard management controller system log to the log management device through the target data transmission device includes:

[0105] The baseboard management controller system log is sent to the second wireless transceiver module of the transit data transmission device through the current second wireless transceiver module, so that the baseboard management controller system log is sent to the second wireless transceiver module of the target data transmission device through the second wireless transceiver module of the transit data transmission device, so that the target data transmission device sends the baseboard management controller system log to the log management device.

[0106] It should be noted that if the distance between the cabinet where the target data transmission device determined from the data transmission devices of other adjacent cabinets is located and the current cabinet is greater than a preset distance (for example, 5m), direct data transmission by the second wireless transceiver module between the two may result in data loss due to the long distance. Therefore, in order to ensure the security and integrity of data transmission in this case, in an embodiment of the present invention, a transit data transmission device can be selected from the data transmission devices of other adjacent cabinets, and then the baseboard management controller system log or the first preset proportion of the baseboard management controller system log is sent to the second wireless transceiver module of the transit data transmission device through the second wireless transceiver module of the current data transmission device, and then the transit data transmission device sends the baseboard management controller system log or the first preset proportion of the baseboard management controller system log to the second wireless transceiver module of the target data transmission device through its own second wireless transceiver module, so that after the target data transmission device receives these log data, it sends these log data to the log management device.

[0107] In addition, it should be noted that after some baseboard management controller system logs are assigned to target data transmission devices determined from other adjacent cabinets for transmission, the data transmission status information of the data transmission devices in all cabinets participating in the data transmission (current data load Li, maximum processable data load Ci, remaining transmission capacity Ri with the log management device, distance Di with the log management device, remaining battery power Pi and current data transmission efficiency Ti) can be recalculated, so as to better maintain load balancing.

[0108] In some embodiments, the method may further include:

[0109] Get current environment parameters;

[0110] The wavelength of the current second wireless transceiver module is adjusted according to the current environmental parameters.

[0111] It should be noted that in the embodiment of the present invention, the wavelength of the second wireless transceiver module can be adjusted according to the current environmental parameters (such as temperature T, humidity H and medium type M, etc.), and of course, the wavelength of the first wireless transceiver module can also be adjusted.

[0112] For example, the environmental adaptability index E can be obtained according to the current environmental parameters, E=f(T, H, M)=w1'*T+ w2'*H+w3'*M. The adjusted wavelength is λ=E*λi, where λi is the current wavelength, and w1', w2', and w3' represent the weight coefficients of T, H, and M, respectively.

[0113] In some embodiments, the method may further include:

[0114] According to the current received signal strength, the amplification factor of the current second wireless transceiver module is adjusted.

[0115] In the embodiment of the present invention, the amplification factor of the current second wireless transceiver module can also be adjusted according to the current received signal strength according to the relationship A=f(L, H')=C1*L+C2*H, where A represents the adjusted amplification factor, L is the distance between the second wireless transceiver module and the transmitting end, H' is the current received signal strength, and C1 and C2 represent constants. In addition, in practical applications, the amplification factor of each first wireless transceiver module can also be adjusted according to the above relationship.

[0116] It should also be noted that in the embodiment of the present invention, the external shortwave interference I can also be detected, and the offset wave can be calculated based on the shortwave interference I, where the offset wave C=-I2πλ, where C represents the wavelength of the offset wave and λ represents the wavelength of the interference wave.

[0117] The first wireless transceiver module and the second wireless transceiver module in the embodiment of the present invention can both use SSC technology to implement an intelligent routing function, and automatically select the best communication path according to the current network status and device location.

[0118] In practical applications, SSC technology integrates machine learning algorithms to improve the adaptability to environmental changes and communication efficiency through continuous learning and optimization; it can use multi-dimensional signal processing technologies, such as spatial diversity and polarization diversity, to improve the robustness and anti-interference ability of the signal; it can also integrate energy harvesting functions to collect energy from the environment, such as solar energy and vibration energy, to achieve self-sufficiency. In addition, the Advanced Encryption Standard (AES) can be used for end-to-end encryption during data transmission to ensure data transmission security, Encrypted Data = E (Key, Plain Data).

[0119] It is understandable that if Figure 3In the embodiment of the present invention shown, after the BMC system log of the server is generated, the first wireless transceiver module arranged on the server will send the collected BMC system log to the second wireless transceiver module of the data transmission device on the cabinet, thereby sending the BMC system log to the data transmission device of the cabinet. The data transmission device further performs load evaluation. If load balancing is required, a target data transmission device is determined from the data transmission devices of other cabinets through coordination, and the BMC system log is sent to the log management device. If load balancing is not required, the received BMC system log is directly sent to the log management device through the data transmission device. After receiving the BMC system log, the log management device stores the BMC system log, and can also process and analyze the log, and monitor the system status and performance.

[0120] In one embodiment, the baseboard management controller system log in the embodiment of the present invention is obtained by collecting the baseboard management controller log data of the server by the baseboard management controller agent module on the server according to a pre-set log collection strategy; the log collection strategy is determined based on a specified log type and / or log level and / or collection frequency.

[0121] It should be noted that the baseboard management controller agent module, also known as the BMC agent module, can collect the BMC log data of the server in real time, and can also perform necessary data cleaning, formatting and classification processing on the BMC log data to reduce the complexity of subsequent storage and analysis. The pre-processed log data is transmitted wirelessly to the data transmission device of the cabinet through SSC technology and then transmitted to the log management device. Advanced encryption algorithms are used to encrypt the data during the transmission process to ensure data security. At the same time, a data integrity verification mechanism is added to ensure the integrity of the data during the transmission process.

[0122] The following describes the log collection and transmission process of the baseboard management controller agent module:

[0123] It should be noted that if Figure 4 As shown, each server can be firstly configured and tested for performance to ensure that the deployment requirements are met, and each wireless transceiver module based on SSC communication (including the first wireless transceiver module and the second wireless transceiver module) can be tested for compatibility to ensure the communication stability between the data transmission device and the server and the log management device. After the deployment preparation is completed, the BMC agent software (that is, the BMC agent module) is deployed on each server respectively, and the first wireless transceiver module based on SSC communication is configured for the server to ensure that the BMC agent module can be started normally and establish a communication connection with the first wireless transceiver module.

[0124] like Figure 5As shown, you can first perform initial configuration, and after the initial configuration is completed, perform real-time log collection, and intelligently filter the collected logs. Then, preprocess the data, clean and classify it, and desensitize sensitive data. After completing the preprocessing, you can obtain the collected log data.

[0125] Initialization configuration phase: After starting the BMC agent module, perform necessary initialization operations, such as loading configuration files, setting log collection policies, etc. At the same time, configure relevant parameters of the log management device, such as storage path, access rights, etc.

[0126] Real-time log collection and intelligent filtering stage: The BMC agent module starts to collect the BMC log data of the server in real time, including system logs, application logs, etc., and performs preliminary screening and formatting on the collected log data. The BMC agent module can first configure the log collection strategy. The log collection measurement can include specifying the log type, log level, and collection frequency, etc., to meet the log collection requirements in different scenarios, wherein the specific content of the log type, log level, and collection frequency can be determined according to actual needs, and the embodiment of the present invention does not make special restrictions on this. The BMC agent module can further monitor the log generation of the server in real time, adopt an asynchronous collection method, ensure that the log collection is performed based on the log collection strategy without blocking the normal operation of the server, and perform preliminary screening on the collected log data, remove invalid or duplicate information, and convert the format of the screened log data into a unified format for subsequent processing and query. For the log data after the format conversion, filtering can be performed according to information such as log content, source or timestamp to reduce the collection of invalid logs, thereby improving the collection efficiency. Then, compression technology is used to compress the large amount of filtered log data, thereby reducing the storage space occupied, and compression technology is applied during the transmission process to reduce the transmission bandwidth requirement.

[0127] During the log collection process, a buffer can be used to temporarily store the collected log data to achieve asynchronous collection. When the buffer is full or meets specific conditions, the data is transmitted in batches to the log management device through the first wireless transceiver module and the data transmission device of the cabinet. Among them, for large servers or high-concurrency scenarios, multi-threading or parallel processing technology can be used to collect data from multiple log sources at the same time to improve collection speed and efficiency; the log level can also be dynamically adjusted according to the system operation status and user needs, and log information of different levels can be flexibly collected to meet the different needs of troubleshooting and normal operation.

[0128] Data preprocessing stage: To facilitate subsequent analysis and query, the collected log data can be further cleaned, classified and labeled. In addition, to further ensure data security, sensitive data can also be desensitized.

[0129] like Figure 6 As shown, before the BMC proxy module sends the BMC system log data, the BMC proxy module can use an encryption algorithm to further encrypt the processed log data to ensure data security during wireless transmission, and perform data integrity check on the encrypted data (that is, add a checksum or a checksum) to verify the integrity of the data at the receiving end, thereby ensuring that the data is not tampered with or lost during transmission.

[0130] The encrypted and verified log data is transmitted to the data transmission device in the cabinet through the first wireless transceiver module based on the SSC technology, and then transmitted to the log management device through the data transmission device, thereby realizing wireless transmission between the BMC agent module and the log management device. Among them, the SSC technology has the communication capability of multiple terminals, high bandwidth and low latency, ensuring that the log data can be transmitted to the log management device in real time and efficiently.

[0131] Since the amount of log data to be transmitted may be large, the BMC proxy module can process the encrypted and verified log data in packets, each data packet contains a portion of the log data and carries a sequence identifier so that the data can be reassembled in the correct order at the receiving end. During the wireless transmission process, due to possible network instability or interference factors, the data packet may be lost or damaged. In view of this, in the embodiment of the present invention, when the receiving end detects that the data packet is lost or damaged, a retransmission request can be sent to the sending end. After receiving the request, the sending end will resend the corresponding data packet until the receiving end correctly receives and confirms it.

[0132] In order to ensure stable data transmission, the BMC agent module can also monitor the network bandwidth and transmission status, and dynamically adjust the transmission rate and data packet size according to the network bandwidth and transmission status to avoid network congestion and data loss. At the same time, the receiving end will also send flow control signals to the sending end according to its own processing capabilities to coordinate the transmission speed of both parties. During the wireless transmission process, the BMC agent module will monitor the transmission status in real time, including key indicators such as transmission speed, number of data packets, number of retransmissions, etc., and record important events and abnormal situations in the transmission process in the log for subsequent analysis and troubleshooting.

[0133] It should be noted that the log management device in the embodiment of the present invention can use a high-performance storage system to receive and store BMC log data from each server. After receiving the baseboard manager system log of each server, the log management device performs partition storage management on the log data to improve data retrieval efficiency; it can also establish an efficient indexing mechanism to facilitate users to quickly locate and analyze specific log data. In addition, if Figure 7As shown, you can also set up a system monitoring function to monitor the status of log collection, transmission, and storage in real time, and trigger an alarm notification in time if an abnormal situation is found so that the administrator can handle it; you can also provide log query and analysis, as well as handle and issue an alarm notification when a potential alarm event is found.

[0134] It is understandable that the log management device receives the baseboard manager system log data from each server, decrypts and verifies the log data, and after verifying the data integrity, partitions and stores the log data according to the preset storage strategy and establishes corresponding indexes. The log management device can monitor the status of log collection, transmission and storage in real time, and if there is an abnormality (such as transmission interruption or storage failure, etc.), an alarm prompt is issued to notify the administrator to handle it.

[0135] The log management device can receive the query log instruction through the API interface, and then determine the corresponding log data from the stored log data according to the query log instruction for display. The query log instruction can be input by the user through the API interface. The log management device can also obtain the query conditions selected by the user, quickly locate the problem according to the query conditions and the corresponding data analysis strategy, and perform performance optimization.

[0136] The log management device can analyze the received baseboard manager system log data or the stored baseboard manager system log data to obtain the log data analysis results, and identify potential alarm events based on the log data analysis results, and determine the level of potential alarm events. For important alarm events, an alarm notification is triggered to remind the administrator to handle them in time.

[0137] In addition, if Figure 8 As shown, the log management device can also regularly back up the stored baseboard manager system log data to prevent data loss, and establish a data recovery mechanism. When data loss is detected, the lost data is recovered based on the backup data, thereby ensuring rapid recovery in the event of data loss or damage. In actual applications, the BMC agent software can also be regularly updated, the SSC-based wireless transceiver module can be optimized, and the storage system can be expanded. In addition, the system security can be reinforced, such as strengthening access control and preventing malicious attacks, thereby ensuring the data security and stable operation of the system.

[0138] The present invention also provides a corresponding device for the log collection method of multiple servers, which further makes the method more practical. Among them, the device can be described from the perspective of functional modules and hardware. The following is an introduction to the log collection device of multiple servers provided by the present invention. The device is used to implement the log collection method of multiple servers provided by the present invention. In this embodiment, the log collection device of multiple servers may include or be divided into one or more program modules, and the one or more program modules are stored in a storage medium and executed by one or more processors to complete the log collection method of multiple servers disclosed in the above embodiment. The program module referred to in the present invention refers to a series of computer program instruction segments that can complete specific functions, which is more suitable for describing the execution process of the log collection device of multiple servers in the storage medium than the program itself. The following description will specifically introduce the functions of each program module of this embodiment. The log collection device of multiple servers described below and the log collection method based on multiple servers described above can be referred to each other.

[0139] From the perspective of functional modules, see Fig. 9 , Fig. 9 This is a structural diagram of a multi-server log collection device provided by the present invention. In the embodiment of the present invention, each server is provided with a first wireless transceiver module, and a second wireless transceiver module is provided in a data transmission device of each cabinet. The data transmission device is connected to the log management device by wire. The multi-server log collection device is applied to the data transmission device, and includes:

[0140] The receiving module 11 is used to receive the baseboard management controller system log sent by the first wireless transceiver module on each server in the current cabinet through the second wireless transceiver module of the current cabinet;

[0141] A determination module 12, used to determine a target data transmission device according to a current load condition;

[0142] The sending module 13 is used to send the baseboard management controller system log to the log management device through the target data transmission device.

[0143] In some embodiments, the determination module 12 includes:

[0144] A calculation unit, used to obtain data transmission status information of the current data transmission device, and calculate a comprehensive evaluation index of the current data transmission device according to the data transmission status information;

[0145] A first determining unit, configured to use the current data transmission device as a target data transmission device when the comprehensive evaluation index of the current data transmission device is less than or equal to a preset threshold;

[0146] The second determining unit is configured to determine a target data transmission device from the data transmission devices in other cabinets when the comprehensive evaluation index of the current data transmission device is greater than a preset threshold.

[0147] In some embodiments, the data transmission status information includes one or more of the current data load, the maximum processable data load, the remaining transmission capacity with the log management device, the distance between the log management device, the remaining battery power and the current data transmission efficiency.

[0148] In some embodiments, the apparatus further comprises:

[0149] A first acquisition module is used to acquire the remaining battery power sent by the data transmission device of each other cabinet;

[0150] Computing unit, including:

[0151] A first calculation subunit, configured to calculate a load balancing factor according to a current data load and a maximum processable data load;

[0152] The second calculation subunit calculates a transmission capacity factor according to a remaining transmission capacity with the log management device and a distance with the log management device;

[0153] The third calculation subunit determines a battery power factor according to the remaining battery power of the current data transmission device and the remaining battery power corresponding to the data transmission devices of other cabinets;

[0154] A first acquisition subunit, used to acquire a first weight value corresponding to the load balancing factor, a second weight value corresponding to the transmission capacity factor, and a third weight value corresponding to the battery power factor;

[0155] The fourth calculation subunit obtains a comprehensive evaluation index of the current data transmission device according to the first weight value, the second weight value and the third weight value, in combination with the load balancing factor, the transmission capacity factor and the battery power factor.

[0156] In some embodiments, the second determining unit includes:

[0157] A second acquisition subunit is used to acquire data information sent by the second wireless transceiver modules in the data transmission devices of each other cabinet through the current second wireless transceiver module;

[0158] A first determination subunit is used to parse each piece of data information and determine the cabinet position of each other cabinet and the comprehensive evaluation index of the data transmission device;

[0159] A second determining subunit is used to determine each adjacent cabinet located within a preset range from other cabinets according to the cabinet positions of other cabinets and the cabinet position of the current cabinet;

[0160] The third determination subunit is used to determine the data transmission device corresponding to the minimum comprehensive evaluation index according to the comprehensive evaluation indexes corresponding to the data transmission devices of each adjacent cabinet, and use the data transmission device corresponding to the minimum comprehensive evaluation index as the target data transmission device.

[0161] In some embodiments, when the target data transmission device is determined from the data transmission devices of other cabinets, the method further includes:

[0162] A third determining unit, configured to use the current data transmission device as a target data transmission device at the same time;

[0163] The sending module 13 includes:

[0164] A first sending unit is used to send a first preset proportion of the baseboard management controller system log in the baseboard manager system log to the second wireless transceiver module of the target data transmission device determined from the data transmission devices of other cabinets through the current second wireless transceiver module, so that the target data transmission device determined from the data transmission devices of other cabinets sends the first preset proportion of the baseboard management controller system log to the log management device;

[0165] The second sending unit is used to send the remaining baseboard management controller system logs in the baseboard manager system log to the log management device through the current data transmission device.

[0166] In some embodiments, the first wireless transceiver module and / or the second wireless transceiver module are wireless transceiver modules implemented based on cooperative short wave communication technology; the device further includes:

[0167] The second acquisition module is used to obtain current environmental parameters;

[0168] The adjustment module is used to adjust the wavelength of the current second wireless transceiver module according to the current environmental parameters.

[0169] In some embodiments, the baseboard management controller system log is obtained by a baseboard management controller agent module on the server collecting baseboard management controller log data of the server according to a preset log collection policy.

[0170] It should be noted that the multi-server log collection device in the embodiment of the present invention has the same beneficial effects as the multi-server log collection method provided in the above embodiment, and for the specific introduction of the multi-server log collection method involved in the embodiment of the present invention, please refer to the above embodiment, and this application will not repeat it here.

[0171] On the basis of the above embodiment, an embodiment of the present invention further provides a multi-server log collection system, comprising a first wireless transceiver module arranged on each server, a data transmission device arranged on each cabinet, a log management device connected to the data transmission device of each cabinet, and a second wireless transceiver module, a memory and a processor arranged in the data transmission device; wherein:

[0172] Memory for storing computer programs;

[0173] A processor is used to execute the computer program to implement the steps of the multi-server log collection method as described above.

[0174] Among them, the processor may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor can be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 21 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0175] The memory may include one or more computer-readable storage media, which may be non-transitory. The memory may also include high-speed random access memory, and non-volatile memory, such as one or more disk storage devices, flash memory storage devices.

[0176] It is understandable that if the multi-server log collection method in the above embodiment is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or part of the contribution to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium to execute all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), electrically erasable programmable ROM, register, hard disk, removable disk, CD-ROM, magnetic disk or optical disk and other media that can store program code.

[0177] The above is a detailed introduction to a multi-server log collection method, device and system provided by an embodiment of the present invention. Each embodiment in the specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same and similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part description.

[0178] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0179] The above is a detailed introduction to a multi-server log collection method, device and system provided by the present invention. This article uses specific examples to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. It should be pointed out that for ordinary technicians in this technical field, without departing from the principles of the present invention, the present invention can also be improved and modified, and these improvements and modifications also fall within the scope of protection of the claims of the present invention.

Claims

1. A multi-server log collection method, characterized in that: Each server is provided with a first wireless transceiver module, and a data transmission device in each cabinet is provided with a second wireless transceiver module. The data transmission device is connected to a log management device. The method is applied to the data transmission device, and includes: Receiving, through the second wireless transceiver module of the current cabinet, a baseboard management controller system log sent by the first wireless transceiver module of each server located in the current cabinet; Determine the target data transmission device according to the current load condition; The baseboard management controller system log is sent to the log management device through the target data transmission device.

2. The multi-server log collection method according to claim 1, characterized in that: Determining the target data transmission device according to the current load condition includes: Acquire data transmission status information of a current data transmission device, and calculate a comprehensive evaluation index of the current data transmission device according to the data transmission status information; When the comprehensive evaluation index of the current data transmission device is less than or equal to a preset threshold, the current data transmission device is used as a target data transmission device; When the comprehensive evaluation index of the current data transmission device is greater than the preset threshold, a target data transmission device is determined from the data transmission devices of other cabinets.

3. The multi-server log collection method according to claim 2, characterized in that: The data transmission status information includes one or more of the current data load, the maximum processable data load, the remaining transmission capacity with the log management device, the distance between the log management device, the remaining battery power of the battery used to power the current data transmission device, and the current data transmission efficiency.

4. The multi-server log collection method according to claim 3, characterized in that: Also includes: Obtain the remaining battery power sent by the data transmission devices of each other cabinet; The calculating the comprehensive evaluation index of the current data transmission device according to the data transmission status information includes: Calculating a load balancing factor according to the current data load and the maximum processable data load; Calculating a transmission capacity factor according to a remaining transmission capacity with the log management device and a distance between the log management device and the log management device; Determine a battery power factor according to the remaining battery power of the current data transmission device and the remaining battery power corresponding to the data transmission devices of other cabinets; Obtaining a first weight value corresponding to the load balancing factor, a second weight value corresponding to the transmission capacity factor, and a third weight value corresponding to the battery power factor; According to the first weight value, the second weight value and the third weight value, combined with the load balancing factor, the transmission capacity factor and the battery power factor, a comprehensive evaluation index of the current data transmission device is obtained.

5. The multi-server log collection method according to claim 4, characterized in that: The step of determining the target data transmission device from the data transmission devices of other cabinets includes: Acquire data information sent by the second wireless transceiver modules in the data transmission devices of each other cabinet through the current second wireless transceiver module; Analyze each of the data information to determine the cabinet position of each other cabinet and the comprehensive evaluation index of the data transmission device; According to the cabinet positions of other cabinets and the cabinet position of the current cabinet, each adjacent cabinet located within a preset range is determined from other mechanisms; According to the comprehensive evaluation indicators respectively corresponding to the data transmission devices of the adjacent cabinets, the data transmission device corresponding to the minimum comprehensive evaluation indicator is determined, and the data transmission device corresponding to the minimum comprehensive evaluation indicator is used as the target data transmission device.

6. The multi-server log collection method according to any one of claims 2 to 5, characterized in that: In the case where the target data transmission device is determined from the data transmission devices of other cabinets, the method further includes: Using the current data transmission device as the target data transmission device at the same time; The sending of the baseboard management controller system log to the log management device through the target data transmission device comprises: Sending a first preset proportion of the baseboard management controller system log in the baseboard manager system log to a second wireless transceiver module of a target data transmission device determined from the data transmission devices of other cabinets through the current second wireless transceiver module, so that the target data transmission device determined from the data transmission devices of other cabinets sends the first preset proportion of the baseboard management controller system log to the log management device; The remaining baseboard management controller system logs in the baseboard manager system log are sent to the log management device through the current data transmission device.

7. The multi-server log collection method according to claim 6, characterized in that: The first wireless transceiver module and / or the second wireless transceiver module are wireless transceiver modules implemented based on cooperative short wave communication technology; the method also includes: Get current environment parameters; The wavelength of the current second wireless transceiver module is adjusted according to the current environmental parameters.

8. The multi-server log collection method according to claim 6, characterized in that: The baseboard management controller system log is obtained by the baseboard management controller agent module on the server collecting the baseboard management controller log data of the server according to a preset log collection strategy; the log collection strategy is determined based on a specified log type and / or log level and / or collection frequency.

9. A multi-server log collection device, characterized in that: Each server is provided with a first wireless transceiver module, and a data transmission device in each cabinet is provided with a second wireless transceiver module. The data transmission device is connected to the log management device by wire. The device is applied to the data transmission device and includes: A receiving module, used for receiving, through a second wireless transceiver module of a current cabinet, a baseboard management controller system log sent by a first wireless transceiver module on each server in the current cabinet; A determination module, used to determine a target data transmission device according to a current load condition; The sending module is used to send the baseboard management controller system log to the log management device through the target data transmission device.

10. A multi-server log collection system, characterized in that: It includes a first wireless transceiver module arranged on each server, a data transmission device arranged on each cabinet, a log management device connected to the data transmission device of each cabinet, and a second wireless transceiver module, a memory and a processor arranged in the data transmission device; wherein: Memory for storing computer programs; A processor, configured to execute the computer program to implement the steps of the multi-server log collection method as claimed in any one of claims 1 to 8.

Images