Data processing method and device, storage medium and electronic equipment

Abstract

The invention discloses a data processing method and device, a storage medium and electronic equipment, and relates to the technical field of computers.The method comprises the steps that firstly, operation and maintenance data of a server and the equipment type of the server are obtained; determining a target data type according to the equipment type; dynamically adjusting a transmission period and an interface channel parameter according to a target data type; and sending the operation and maintenance data to a target controller based on the dynamically adjusted transmission period and interface channel parameters. Compared with the prior art, the target data can be accurately collected, the transmission process is optimized, unnecessary data transmission is reduced, meanwhile, the timeliness and accuracy of the data are ensured, data transmission configuration can be dynamically adjusted according to actual requirements, the method and device are suitable for diversified hardware environments and business scenes, and the user experience is improved. Therefore, potential problems in server operation can be found in time, measures can be taken in advance to solve the problems, and the stability and service continuity of the system are improved.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular, to a data processing method, apparatus, storage medium, and electronic device. Background Art

[0002] In the daily operation and maintenance of a server, whether the server is starting up or a certain device in it is replaced, quickly obtaining the operation and maintenance data of the device is crucial for subsequent operations and management. By collecting this operation and maintenance data, the running performance of the server can be effectively grasped, potential problems can be timely detected, and the stable and efficient operation of the server can be ensured.

[0003] Currently, related technologies cannot dynamically adjust data transmission configurations according to actual needs, and it is difficult to adapt to diverse hardware environments and business scenarios. Summary of the Invention

[0004] The present disclosure provides a data processing method, apparatus, storage medium, and electronic device. Its main purpose is to solve the problem that related technologies cannot dynamically adjust data transmission configurations according to actual needs and are difficult to adapt to diverse hardware environments and business scenarios.

[0005] In a first aspect, the present application provides a data processing method, including:

[0006] Obtaining operation and maintenance data of a server and the device type of the server;

[0007] Determining a target data type according to the device type;

[0008] Dynamically adjusting a transmission period and interface channel parameters according to the target data type;

[0009] Based on the dynamically adjusted transmission period and interface channel parameters, sending the operation and maintenance data to a target controller.

[0010] In a second aspect, the present application provides a data processing method, including:

[0011] Receiving operation and maintenance data sent by a server side, where the operation and maintenance data is sent based on dynamically adjusted transmission period and interface channel parameters, and the transmission period and interface channel parameters are dynamically adjusted according to a target data type determined according to the device type of the server;

[0012] Processing the operation and maintenance data.

[0013] In a third aspect, the present application provides a data processing apparatus, including:

[0014] An obtaining module, configured to obtain operation and maintenance data of a server and the device type of the server;

[0015] A determination module, configured to determine a target data type according to the device type;

[0016] An adjustment module, configured to dynamically adjust a transmission period and interface channel parameters according to the target data type;

[0017] A sending module, configured to send the operation and maintenance data to a target controller based on the dynamically adjusted transmission period and interface channel parameters.

[0018] In a fourth aspect, the present application provides a data processing device, including:

[0019] A receiving module, configured to receive operation and maintenance data sent by a server side, where the operation and maintenance data is sent based on the dynamically adjusted transmission period and interface channel parameters, and the transmission period and interface channel parameters are dynamically adjusted according to a target data type determined according to the device type of the server;

[0020] A processing module, configured to process the operation and maintenance data.

[0021] In a fifth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method according to the first aspect or the second aspect is implemented.

[0022] In a sixth aspect, the present application provides an electronic device, including a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, and when the processor executes the computer program, the method according to the first aspect or the second aspect is implemented.

[0023] In a seventh aspect, the present application provides a computer program product, on which a computer program is stored, and when the computer program is executed by a processor, the method according to the first aspect or the second aspect is implemented.

[0024] The data processing method, apparatus, storage medium, and electronic device provided by the present disclosure, wherein the method includes: first, obtaining the operation and maintenance data of the server and the device type of the server; then, determining the target data type according to the device type; then, dynamically adjusting the transmission period and interface channel parameters according to the target data type; and based on the dynamically adjusted transmission period and interface channel parameters, sending the operation and maintenance data to the target controller. Compared with the current related technologies, the present application can improve the operation and maintenance efficiency, accurately collect the target data and optimize the transmission process, reduce unnecessary data transmission, and ensure the timeliness and accuracy of the data by accurately obtaining the operation and maintenance data and device type of the server and dynamically adjusting the transmission period and interface channel parameters according to the device type. It can also adapt to different types of server devices, dynamically adjust the data transmission configuration according to actual needs, adapt to diverse hardware environments and business scenarios, and then timely discover potential problems in the server operation, take measures in advance to solve them, thereby improving the stability and business continuity of the system.

[0025] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present application, nor is it used to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the embodiments of the present application, the following will briefly introduce the drawings required for use in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0027] Figure 1 The flowchart of a data processing method provided by an embodiment of the present application is shown;

[0028] Figure 2 The flowchart of an example provided by an embodiment of the present application is shown;

[0029] Figure 3 The flowchart of an example provided by an embodiment of the present application is shown;

[0030] Figure 4 The flowchart of another data processing method provided by an embodiment of the present application is shown;

[0031] Figure 5 The flowchart of an example provided by an embodiment of the present application is shown;

[0032] Figure 6 The structural diagram of a data processing apparatus provided by an embodiment of the present application is shown;

[0033] Figure 7 The figure shows a schematic structural diagram of another data processing device provided by an embodiment of the present application. Detailed implementation manners

[0034] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts shall fall within the protection scope of the present application.

[0035] It should be noted that in the description of the present application, the terms "include", "comprise" or any other variant thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or device including a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or device. The terms "first", "second", etc. in the present application are used to distinguish similar objects and are not used to describe a specific order or sequence.

[0036] Currently, a complete server consists of many devices, including a processor, memory, hard disk, network card, etc.; when the server starts up or a certain device is replaced, we need to immediately obtain some fixed asset information of the device for relevant personnel to refer to; at the same time, in some cases, we need to monitor the real-time data of some devices on the server, such as: the utilization rates of the processor, memory, and hard disk, the presence status of the network card and array card, and the transmission speed of the network card port, etc. Through these data, we can master part of the real-time performance of the server and understand the operating status of the server in a timely manner.

[0037] In the related art, the fixed information of server devices (such as device serial numbers, manufacturers, firmware version numbers, device specifications and models, etc.) is usually collected and parsed by the Basic Input / Output System (BIOS), and then the data is stored in a fixed shared memory area. The Baseboard Management Controller (BMC) then reads the required information from the shared memory and places it on the DBus Message Bus System (DBUS) by device category for other processes to use. For real-time updated information, such as CPU utilization and memory utilization, the Management Engine (ME) transmits it to the BMC through the Intelligent Platform Management Interface (IPMI) protocol, and after the BMC parses it, it is also placed on the DBUS by device category.

[0038] The above implementation has problems in many aspects: First, the multi-channel acquisition mechanism it adopts leads to a complex data link. Among them, the fixed asset information depends on the BIOS to collect and write into the shared memory area, and then the BMC reads and parses it through specific interfaces such as the Keyboard Controller Style Interface (KCS) and Block Transfer (BT); the real-time performance data is indirectly collected through the ME or the Platform Environment Control Interface (PECI), etc., and is transmitted to the BMC via the IPMI protocol, which increases the risks of data loss, inconsistent parsing, and transmission delay. Second, there is a lack of flexibility and configurability. Since the related solutions usually adopt fixed acquisition strategies, they cannot dynamically adjust the acquisition device type, data frequency, and transmission strategy according to actual needs, and it is difficult to adapt to diverse hardware environments and business scenarios. Finally, its real-time performance is insufficient. The World Wide Web monitoring interface usually uses the Polling mechanism to obtain data through the Redfish interface, and cannot achieve real-time synchronous updates, resulting in lagging monitoring data and affecting the operation and maintenance efficiency. In summary, these problems jointly limit the efficiency and applicability of the system.

[0039] Based on the problems existing in the above server configuration, in order to improve the technical problem that the related technology cannot dynamically adjust the data transmission configuration according to actual needs and is difficult to adapt to diverse hardware environments and business scenarios. This embodiment provides a data processing method, which is applied to the server side, as Figure 1 shown, the method includes the following steps:

[0040] Step 101: Obtain the operation and maintenance data of the server and the device type of the server.

[0041] Exemplarily, the operation and maintenance data usually can include real-time performance data such as the utilization rate of the Central Processing Unit (CPU), the memory usage rate, the disk I / O throughput, the network card port rate, the temperature and charging status of the array card battery, etc., and the fixed asset information such as the device serial number, manufacturer, model, firmware version, logical disk partition information, RAID card configuration, etc. These data can be directly obtained through the operating system kernel interfaces such as sysfs, procfs, and SMBIOS. At the same time, it also supports dynamically loading specific kernel modules through the extended plug-in mechanism to obtain more hardware details, realizing the sending of the server device asset information and real-time performance data through a unified channel, reducing the number of data transfers and parsing times, and improving the reliability and accuracy of data transmission.

[0042] Exemplarily, the device type includes characteristics such as the architecture type and the server size, and can be mainly identified and extracted through system management tools (such as IPMI, Redfish).

[0043] Optionally, step 101 may specifically include: obtaining the encapsulated operation and maintenance data from the directory file corresponding to the device type.

[0044] Optionally, the method of this embodiment may specifically further include: collecting the operation and maintenance data of the server; classifying and encapsulating the collected operation and maintenance data according to the device type of the server; storing the encapsulated operation and maintenance data in the directory file corresponding to the device type.

[0045] In some examples, the collected operation and maintenance data can be classified and encapsulated according to the device type (such as CPU, memory, disk, network card, etc.) to generate standardized JSON or XML format data for easy unified processing and transmission. To optimize the transmission efficiency and security, this module also supports data compression and encryption functions. Data compression is performed using a decompression format such as GZIP to reduce the amount of data transmitted, and at the same time, encryption technologies such as AES-256 are used to ensure the security of the data during transmission. This series of technical features not only improves the standardization and convenience of data processing, but also enhances the security and efficiency of data transmission, laying a foundation for subsequent data analysis and management.

[0046] Optionally, the operation and maintenance data of the above collection server may specifically include: defining a data collection policy through a configuration file, where the data collection policy includes at least one of a target server list, a data collection frequency, and a data filtering rule; based on the data collection policy, collecting the operation and maintenance data of the server through an operating system kernel interface, and the operation and maintenance data includes fixed asset information and real-time performance data.

[0047] In some examples, such as Figure 2 shown, the data cache forwarding system obtains device data through an operating system kernel interface (such as sysfs, procfs, etc.) and persistently stores this data in the corresponding device data file in the local directory of the operating system. This process ensures the efficient collection and storage of data, providing a basis for subsequent data processing and forwarding.

[0048] For example, the data collection module in the data processing system directly obtains device information through the operating system kernel interface, including the fixed asset information of the server, such as detailed information like device serial number, manufacturer, model, firmware version, logical disk partition information, and RAID card configuration. At the same time, this module can collect performance data in real time, such as key indicators like CPU utilization rate, memory usage rate, disk I / O throughput, network card port rate, and the temperature and charging status of the array card battery. In addition, it supports an extended plug-in mechanism that allows dynamic loading of kernel modules to obtain information about specific hardware, enhancing the flexibility and adaptability of the system, enabling the data collection module to be easily customized and extended according to needs. This design not only ensures the accuracy and integrity of the data but also improves the compatibility and response ability of the system to different hardware environments.

[0049] Exemplarily, the system can enable users to configure the device items and frequencies for acquisition and forwarding by themselves, improving the flexibility and adaptability of the system. For example, persistently store the data in the local directory (such as / var / cache / device_info / ) according to the configured frequency, and support custom storage policies, such as partition storage based on timestamps and rolling overwrite mechanisms, to optimize data management and storage efficiency. At the same time, the system uses the Least Recently Used (LRU) algorithm to manage the cache data, ensuring that frequently accessed data can be quickly responded to, thereby improving the overall system performance and user experience. It not only ensures the effective preservation and reasonable management of the data but also improves the speed and reliability of data access through an efficient cache policy. The collected data is stored in the corresponding directory files by device category through the data cache module, ensuring the structuring and orderliness of the data, which is convenient for subsequent data processing and analysis.

[0050] Step 102: Determine the target data type according to the device type.

[0051] Exemplarily, specific device types such as CPU, memory, hard disk, or network devices are identified according to the settings in the configuration file. For the CPU and memory, data on utilization rate and usage rate are obtained through the / proc / stat and free - m commands respectively; for the hard disk, information such as the serial number is collected using the smartctl command; and for network devices, information such as the rate of relevant data is obtained through ethtool.

[0052] Step 103: Dynamically adjust the transmission period and interface channel parameters according to the target data type.

[0053] Exemplarily, as defined through a configuration file (such as / etc / device_monitor.conf), data collection and transmission can be flexibly and efficiently controlled by the data processing system. After identifying the target data type, the collection frequency and transmission period can be flexibly adjusted accordingly. For example, for key performance indicators, a higher collection frequency may be set, such as multiple times per second, to ensure real - time monitoring; while for device asset information, a lower collection frequency, such as once per hour, can be adopted.

[0054] In some examples, the collection policies configured through the configuration file include specifying a list of target devices, setting the collection frequency (such as once per second or once per minute), and applying data filtering rules to screen the required information. The transmission policy involves determining the data type to be sent to the BMC, the transmission period, and the IPMI channel parameters (such as the target address and encryption key) to ensure the security and pertinence of data transmission. After the operating system installs the data processing system and configures it correctly, the required information can be automatically collected and data can be automatically sent to the BMC through the IPMI channel, reducing manual intervention and improving the automation level of the system.

[0055] In some examples, the data processing system also supports dynamic configuration updates. Using the SIGHUP signal to notify the service to reload the configuration file enables adaptation to new configuration requirements without restarting the service, enhancing the flexibility and response speed of the system. Thereby, the accuracy of data collection, the efficiency and security of transmission are ensured, and rapid adjustment can be made according to needs.

[0056] Step 104: Send the operation and maintenance data to the target controller based on the dynamically adjusted transmission period and interface channel parameters.

[0057] In some examples, such as Figure 3As shown, the data caching and forwarding system (data processing system) in the operating system obtains device data through the operating system kernel interface and persists it in the corresponding device data files in the local directory. Subsequently, the data sending module reads the required device data from these local files, encapsulates the data into a load that can be parsed by the BMC through the IPMIOEM command, and sends it to the BMC at the configured frequency. During this process, the data can be transmitted through multiple channels (such as LAN, USB, IPMB), and a load balancing strategy is adopted to ensure the stability and efficiency of data transmission. The BMC receives and processes this data through the intelligent platform management interface protocol, stores it in the local directory, and further processes and distributes it through the message bus system, which not only ensures that the data can be transmitted to the BMC in a timely and accurate manner, but also improves the fault tolerance and response speed of the entire system.

[0058] In some embodiments, the process of fixed asset information collection and transmission is as follows: First, configure the device_monitor.conf file to set the devices for which information needs to be collected (such as CPU, memory, hard disk), specify to collect once per hour (collect_interval = 3600), and at the same time set whether to send the data to the BMC and the sending frequency (also once per hour). The data collection module uses the dmidecode command to obtain relevant information about the CPU and memory, uses the smartctl command to obtain the serial number of the hard disk, and stores this structured data in the / var / cache / device_info / asset / directory. Finally, the data sending module periodically calls the IPMI command (such as ipmitool raw 0x30 0x01) according to the configuration to send the collected data to the BMC, ensuring that the asset information can be transmitted to the management system on time and accurately.

[0059] The data processing system in this embodiment consists of a data collection module, a data caching module, a data assembly module, and a data sending module. This system is installed on the server system and obtains the fixed asset information and real-time performance data of the server device through the interfaces provided by the operating system kernel. The system configuration file allows users to set the device items to be read and the reading frequency. The data collection module collects data according to the configuration, and the data caching module stores the data in the corresponding directory files according to the device category. The data transmission command is implemented in the BMC. The data assembly module reads the data from the cache and assembles it into a legal IPMI command, and the data sending module transmits the data to the BMC through the IPMI protocol. After obtaining the data, the BMC performs persistent storage and places the data on the DBUS for other processes to use. In addition, this system also supports obtaining the real-time performance data of some devices, such as CPU utilization, memory utilization, disk utilization, temperature, rate, array card battery temperature, and charging status, and these data are also transmitted in the same way.

[0060] Compared with the related technology, this embodiment first obtains the operation and maintenance data of the server and the device type of the server; then determines the target data type according to the device type; then dynamically adjusts the transmission period and interface channel parameters according to the target data type; based on the dynamically adjusted transmission period and interface channel parameters, sends the operation and maintenance data to the target controller. By accurately obtaining the operation and maintenance data of the server and the device type, and dynamically adjusting the transmission period and interface channel parameters according to the device type, this embodiment can improve the operation and maintenance efficiency, accurately collect the target data and optimize the transmission process, reduce unnecessary data transmission, and ensure the timeliness and accuracy of the data at the same time. It can also adapt to different types of server devices, dynamically adjust the data transmission configuration according to actual needs, adapt to diverse hardware environments and business scenarios, and then timely discover potential problems in the server operation, take measures in advance to solve them, so as to improve the stability and business continuity of the system.

[0061] As a refinement of this embodiment, this embodiment provides a data processing method, which is applied to the target controller side, such as Figure 4 shown, and this method includes the following steps:

[0062] Step 201, receive the operation and maintenance data sent by the server side.

[0063] Among them, the operation and maintenance data is sent based on the dynamically adjusted transmission period and interface channel parameters, and the transmission period and interface channel parameters are dynamically adjusted according to the target data type determined according to the device type of the server.

[0064] In some examples, the user freely sets the device items and frequencies for data acquisition and forwarding through a configuration file to meet the requirements of diverse application scenarios. The system can automatically collect the fixed asset information and real-time performance data of server devices and cache and store them in a specified directory to ensure the integrity and consistency of the data. Subsequently, the system directly reads the data from the cache using the IPMI protocol according to the configuration and transmits it to the BMC, reducing the number of data transfers and parsing times and improving the reliability of data transmission. After receiving these data, the BMC parses and processes them, saves the data to a local directory, and publishes it on the DBUS for other processes to use, achieving persistent storage and sharing of the data. In addition, the BMC obtains data from the DBUS using the Redfish interface and displays it on the front end. By monitoring changes in DBUS attributes, real-time performance data is updated, and the device performance data can be synchronously changed in real time without actively refreshing the front-end page, improving the user experience and the system's response speed, thereby enhancing the user experience. The entire process directly transfers data to the BMC in an in-band manner, avoiding errors that may be caused by secondary parsing and ensuring the reliability and accuracy of data transmission. The data processing system in this embodiment not only simplifies the data flow but also enhances the flexibility and real-time performance of the system.

[0065] Step 202: Process the operation and maintenance data.

[0066] Optionally, step 202 may specifically include: parsing the operation and maintenance data into structured data according to the device type of the server; processing the structured data.

[0067] Exemplarily, after receiving a data packet transmitted through the IPMI protocol, it can be parsed into structured data according to the device type, such as distinguishing information such as the CPU serial number and real-time temperature. This module supports multi-format parsing, including formats such as JSON, XML, and Protobuf, to ensure compatibility with different data sources. It not only makes data processing more flexible but also enhances the scalability and adaptability of the system, ensuring that information from various devices and data sources can be efficiently processed.

[0068] In some examples, by parsing the operation and maintenance data into structured data, the key data required for hardware monitoring can be accurately obtained and processed, ensuring the stable operation of the system.

[0069] Optionally, the above processing of the structured data may specifically include at least one of the following: using the write-ahead logging mechanism to persistently store the structured data to a target location, where the target location is a local database and / or a file system; publishing the structured data to a message bus system and providing an access interface externally; updating the front-end page data corresponding to the structured data by listening to the attribute change events of the message bus system.

[0070] Exemplarily, the storage of structured data can be achieved by persistently storing the data in a local database (such as SQLite) or the file system. The file system organizes and stores data in directories according to the device identifier (ID). To ensure atomicity and consistency during data writing, the Write-Ahead Logging (WAL) mechanism can be adopted. This mechanism first records data changes in the log and then actually writes to the database or file, thus effectively preventing data corruption or loss caused by abnormal situations and improving the reliability of data storage.

[0071] Exemplarily, the method of this embodiment further includes making the parsed data easily accessible to other processes and systems. By publishing this data to the DBUS bus, for example, using the com.cpu.DeviceInfo interface, other processes can subscribe to and obtain this information. In addition, a RESTful access interface is provided through the Redfish API, such as / redfish / v1 / Chassis / 1 / Thermal, so that a remote monitoring and management system can query the status information of the device, including key parameters such as temperature, in the form of a standard HyperText Transfer Protocol (HTTP) request. By saving the data in a local directory and placing the data on the DBUS for use by other processes, the persistence and sharing of data are ensured, improving the availability and reliability of the data.

[0072] Exemplarily, as Figure 5 shown, the real-time synchronization mechanism realizes real-time communication between the front end and the DBUS through WebSocket. Specifically, the Web front end listens for DBUS property change events (such as the PropertiesChanged signal) through WebSocket, thereby dynamically updating the interface data without actively calling the Redfish interface for refreshing. In addition, this mechanism supports Delta Update, that is, only the changed part of the data is transmitted to reduce network load. Combining with the illustrated process, the baseboard management controller sends device asset information and real-time performance data to the Web page through the message bus system. The Web page receives these changes in real time through WebSocket and dynamically adjusts the display content according to the received differential update, ensuring that the user interface always presents the latest device status information.

[0073] In some embodiments, the process of real-time performance data monitoring includes configuring the device_monitor.conf file, specifying the devices for which information needs to be collected (such as CPU, memory, network), setting the collection frequency to 5 times per second (collect_interval = 5), and setting whether to send the data to the BMC and the sending frequency to once per second (send_interval = 1). The data collection module obtains the CPU utilization rate by reading / proc / stat, obtains the memory usage rate using the free - m command, and obtains the network card speed using the ethtool command, and then writes this real-time data to the cache directory. Subsequently, the data sending module periodically sends this data to the BMC according to the configuration. After receiving the data, the BMC parses it and updates the property values on the DBUS. The web front - end listens for the PropertiesChanged event of the DBUS to refresh the display chart in real time, enabling users to immediately view the latest performance status of the system.

[0074] The method of this embodiment transmits device asset information and performance data through a unified channel, reducing the number of data transfers and parsing times, effectively reducing the probability of data loss and transmission errors, and improving the reliability and accuracy of data transmission. After installing the operating system, it is only necessary to ensure that the IPMI channel is normal to easily achieve data transmission. The operation is simple and less affected by other factors, enhancing the usability and maintainability of the system. In addition, the device performance data can be synchronized and updated to the front - end page in real time without active refreshing, greatly improving the user experience and the response speed of the system. The system also has high flexibility. Users can flexibly adjust the device items and frequencies of data collection and forwarding through the configuration file to meet the requirements of different application scenarios, further enhancing the adaptability and scalability of the system.

[0075] Compared with the current related technologies, the present embodiment receives the operation and maintenance data sent by the server side; wherein, the operation and maintenance data is sent based on the dynamically adjusted transmission period and interface channel parameters, and the transmission period and interface channel parameters are dynamically adjusted according to the target data type determined by the device type of the server; then the operation and maintenance data is processed. By receiving the operation and maintenance data sent based on the dynamically adjusted transmission period and interface channel parameters, it can be ensured that the received data is optimized, thereby improving the efficiency and accuracy of data transmission. Since the transmission period and interface channel parameters are dynamically adjusted according to the target data type determined by the server device type, the system can accurately collect and transmit the target data, reduce unnecessary data transmission, and reduce resource waste. At the same time, this dynamic adjustment mechanism can better adapt to different types of server devices, enhance the flexibility and adaptability of the system, and ensure that the operation and maintenance data can be efficiently and stably transmitted to the receiving end. Processing the received operation and maintenance data can further explore the value of the data, provide a more accurate basis for subsequent operation and maintenance decisions, and thus improve the operation and maintenance efficiency and stability of the entire system.

[0076] An embodiment of the present application also provides a data processing device, as Figure 1 a specific implementation of the method shown in Figure 6 shown, the device includes: an acquisition module 31, a determination module 32, an adjustment module 33, and a sending module 34.

[0077] The acquisition module 31 is configured to acquire the operation and maintenance data of the server and the device type of the server;

[0078] The determination module 32 is configured to determine the target data type according to the device type;

[0079] The adjustment module 33 is configured to dynamically adjust the transmission period and interface channel parameters according to the target data type;

[0080] The sending module 34 is configured to send the operation and maintenance data to the target controller based on the dynamically adjusted transmission period and interface channel parameters.

[0081] In some examples of the present embodiment, the acquisition module 31 is specifically configured to acquire the encapsulated operation and maintenance data from the directory file corresponding to the device type.

[0082] In some examples of the present embodiment, the acquisition module 31 is further specifically configured to collect the operation and maintenance data of the server; classify and encapsulate the collected operation and maintenance data according to the device type of the server; and store the encapsulated operation and maintenance data in the directory file corresponding to the device type.

[0083] In some examples of this embodiment, the acquisition module 31 is specifically further configured to define a data acquisition policy through a configuration file, where the data acquisition policy includes at least one of a target server list, a data acquisition frequency, and a data filtering rule; based on the data acquisition policy, collect operation and maintenance data of the server through an operating system kernel interface, and the operation and maintenance data includes fixed asset information and real-time performance data.

[0084] An embodiment of the present application further provides a data processing device, as Figure 4 a specific implementation of the method shown in Figure 7 shown, the device includes: a receiving module 41 and a processing module 42.

[0085] The receiving module 41 is configured to receive operation and maintenance data sent by the server side, and the operation and maintenance data is sent based on a dynamically adjusted transmission cycle and interface channel parameters, and the transmission cycle and interface channel parameters are dynamically adjusted according to a target data type determined by the device type of the server;

[0086] The processing module 42 is configured to process the operation and maintenance data.

[0087] In some examples of this embodiment, the processing module 42 is specifically further configured to parse the operation and maintenance data into structured data according to the device type of the server;

[0088] Process the structured data.

[0089] In some examples of this embodiment, the processing module 42 is specifically further configured to use a write-ahead logging mechanism to persistently store the structured data in a target location, and the target location is a local database and / or a file system; publish the structured data to a message bus system, and provide an access interface externally; update at least one of the front-end page data corresponding to the structured data by listening to property change events of the message bus system.

[0090] It should be noted that other corresponding descriptions of each functional unit involved in the data processing device provided in this embodiment can be referred to Figure 1 and Figure 4 for the corresponding descriptions therein, and will not be elaborated here.

[0091] Based on the above methods as Figure 1 and Figure 4 shown, correspondingly, this embodiment further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the methods shown in the above Figure 1 and Figure 4 are implemented.

[0092] Based on the above asFigure 1 and Figure 4 Accordingly, this embodiment also provides a computer program product with a computer program stored thereon. When the computer program is executed by a processor, it implements the methods as described above, such as Figure 1 and Figure 4 shown.

[0093] Based on such an understanding, the technical solution of this application can be embodied in the form of a software product. The software product can be stored in a non-volatile storage medium (which can be a CD-ROM, USB flash drive, mobile hard disk, etc.), and includes several instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of various implementation scenarios of this application.

[0094] Based on the methods as described above, such as Figure 1 and Figure 4 shown, and Figure 6 and Figure 7 shown in the virtual device embodiments, in order to achieve the above object, this embodiment of the application also provides an electronic device, such as a personal computer or a server. The device includes a storage medium and a processor; the storage medium is used to store a computer program; the processor is used to execute the computer program to implement the methods as described above, such as Figure 1 and Figure 4 shown.

[0095] In some embodiments, the above-mentioned physical device may further include a user interface, a network interface, a camera, a radio frequency (RF) circuit, sensors, an audio circuit, a WI-FI module, etc. The user interface may include a display screen (Display), an input unit such as a keyboard (Keyboard), etc. Optionally, the user interface may further include a USB interface, a card reader interface, etc. The network interface may include a standard wired interface, a wireless interface (such as a WI-FI interface), etc. in some embodiments.

[0096] Those skilled in the art can understand that the above-mentioned physical device structure provided in this embodiment does not limit the physical device, and it may include more or fewer components, or combine certain components, or arrange different components.

[0097] The storage medium may further include an operating system and a network communication module. The operating system is a program for managing the hardware and software resources of the above-mentioned physical device, and supports the operation of information processing programs and other software and / or programs. The network communication module is used to implement the communication between the components inside the storage medium, as well as the communication between other hardware and software in the information processing physical device.

[0098] Through the description of the above embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform, or can also be implemented by hardware. By applying the solution of this embodiment, the solution of this embodiment aims to eliminate the multi-channel dependence on BIOS and ME by unifying the data acquisition channels, thereby reducing the complexity of the data link and the parsing error rate. At the same time, it supports highly configurable, allowing dynamic definition of the acquisition device type, data frequency, and transmission strategy to adapt to diverse hardware environments and business requirements. In addition, the use of DBUS property change events and WebSocket technology realizes real-time data synchronization without refreshing the Web interface, ensuring the instant update of monitoring information and improving the operation and maintenance efficiency. In summary, this improvement not only simplifies the data acquisition process, but also enhances the flexibility and real-time performance of the system, providing users with a more efficient and reliable monitoring solution. Compared with the current related technologies, the solution of this embodiment can accurately collect target data and optimize the transmission process, reduce unnecessary data transmission, ensure the timeliness and accuracy of data, and can also dynamically adjust the data transmission configuration according to actual needs, adapt to diverse hardware environments and business scenarios, and then timely discover potential problems in the server operation, take measures in advance to solve them, thereby improving the stability and business continuity of the system.

[0099] It should be noted that in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article or device including the element.

[0100] The above are only specific embodiments of the present application, enabling those skilled in the art to understand or implement the present application. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to these embodiments herein, but will conform to the broadest scope consistent with the principles and novel features claimed herein.

Claims

1. A data processing method, characterized in that, including: Obtain the operation and maintenance data of the server and the device type of the server; Determine the target data type according to the device type; Dynamically adjust the transmission period and interface channel parameters according to the target data type; Based on the dynamically adjusted transmission period and interface channel parameters, send the operation and maintenance data to the target controller.

2. The method according to claim 1, wherein The obtaining the operation and maintenance data of the server includes: Obtain the encapsulated operation and maintenance data from the directory file corresponding to the device type.

3. The method according to claim 2, characterized in that, The method further includes: Collect the operation and maintenance data of the server; Classify and encapsulate the collected operation and maintenance data according to the device type of the server; Store the encapsulated operation and maintenance data in the directory file corresponding to the device type.

4. The method according to claim 3, wherein The collecting the operation and maintenance data of the server includes: Define a data collection policy through a configuration file, where the data collection policy includes at least one of a target server list, a data collection frequency, and a data filtering rule; Based on the data collection policy, collect the operation and maintenance data of the server through the operating system kernel interface, and the operation and maintenance data includes fixed asset information and real-time performance data.

5. A data processing method, characterized in that, including: Receive the operation and maintenance data sent by the server side, where the operation and maintenance data is sent based on the dynamically adjusted transmission period and interface channel parameters, and the transmission period and interface channel parameters are dynamically adjusted according to the target data type determined according to the device type of the server; Process the operation and maintenance data.

6. The method according to claim 5, characterized in that, The processing the operation and maintenance data includes: Parse the operation and maintenance data into structured data according to the device type of the server; Process the structured data.

7. The method according to claim 6, wherein The processing the structured data includes at least one of the following: Adopt a write-ahead logging mechanism to persistently store the structured data in a target location, and the target location is a local database and / or a file system; Publish the structured data to a message bus system and provide an access interface externally; Update the front-end page data corresponding to the structured data by listening to the attribute change event of the message bus system.

8. A data processing device, characterized in that, including: An obtaining module, configured to obtain the operation and maintenance data of the server and the device type of the server; A determining module, configured to determine the target data type according to the device type; An adjusting module, configured to dynamically adjust the transmission period and interface channel parameters according to the target data type; A sending module, configured to send the operation and maintenance data to the target controller based on the dynamically adjusted transmission period and interface channel parameters.

9. A data processing device, characterized in that, including: A receiving module, configured to receive the operation and maintenance data sent by the server side, where the operation and maintenance data is sent based on the dynamically adjusted transmission period and interface channel parameters, and the transmission period and interface channel parameters are dynamically adjusted according to the target data type determined according to the device type of the server; A processing module, configured to process the operation and maintenance data.

10. An electronic device, comprising a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, characterized in that, When the processor executes the computer program, it implements the method according to any one of claims 1-7.

Images