Data processing method and device, electronic equipment and storage medium
By adjusting the call chain frequency during cloud service monitoring, the problem of excessive load on the monitoring server was resolved, the data processing flow was optimized, and monitoring efficiency was improved.
Patent Information
- Application Number
- CN202411724577.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-28
- Publication Date
- 2025-11-11
- Estimated Expiration
- 2044-11-28
AI Technical Summary
During cloud service monitoring, the monitoring server faces a huge burden, and existing technologies are unable to effectively alleviate the monitoring performance pressure.
By acquiring server resource usage, monitoring data resource consumption, display loading time, user category information, and indicator category information, the frequency of the call chain is adjusted to optimize the data processing flow. This includes determining the primary target call frequency, display loading frequency, and secondary target call frequency to achieve frequency adjustment of data calls.
While meeting monitoring requirements, it alleviated monitoring performance pressure, optimized the data call frequency of multiple stages in the data processing process, and improved the processing efficiency of the monitoring server.
Smart Images

Figure CN119718818B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of data processing technology, and in particular to a data processing method, apparatus, electronic device, and storage medium. Background Technology
[0002] As the cloud service market expands, more and more enterprises are adopting cloud services, leading to a growing demand for cloud service monitoring. Cloud service monitoring enables real-time monitoring of cloud resource usage and performance, helping enterprises identify and resolve issues promptly and ensure stable business operations. However, the backend servers used for cloud service monitoring need to collect, store, and process large amounts of monitoring data, placing a significant burden on these servers. Summary of the Invention
[0003] To address the aforementioned problems in the prior art, this invention discloses a data processing method, apparatus, electronic device, and storage medium, which can alleviate monitoring performance pressure while meeting the monitoring requirements of the monitored system. The technical solution disclosed in this invention is as follows:
[0004] According to one aspect of the disclosed embodiments of the present invention, a data processing method is provided, comprising:
[0005] The server acquires the resource quantity corresponding to the server, the resource consumption of the monitoring data, the display loading time of the monitoring indicators corresponding to the target monitoring data, user category information, and indicator category information. The monitoring data includes initial monitoring data and the target monitoring data. The server is used to acquire the initial monitoring data from the monitored system and process it to obtain the target monitoring data. The display loading time is the loading time for the terminal to display the monitoring indicators corresponding to the target monitoring data.
[0006] Based on the resource quantity corresponding to the server and the resource consumption of the monitoring data, a first target call frequency corresponding to the first call link is determined, so that the server obtains the initial monitoring data based on the first call link at the first target call frequency;
[0007] Based on the display loading time, the display loading frequency of the monitoring indicators corresponding to the target monitoring data displayed by the terminal is determined;
[0008] Based on the first target call frequency and the display loading frequency, determine the second initial call frequency corresponding to the second call chain;
[0009] Based on the user category information and / or the indicator category information, the second initial call frequency is adjusted to obtain the second target call frequency corresponding to the second call link, so that the terminal can obtain the target monitoring data from the server based on the second call link.
[0010] Optionally, the server includes a first data processing unit and a second data processing unit, the first call chain includes a first sub-call chain and a second sub-call chain, the first target call frequency includes a first target sub-call frequency and a second target sub-call frequency, the monitoring data further includes updated monitoring data, and determining the first target call frequency corresponding to the first call chain based on the resource quantity corresponding to the server and the resource consumption of the monitoring data includes:
[0011] Based on the first resource quantity of the first data processing unit, the resource occupancy of the initial monitoring data, and the resource occupancy of the updated monitoring data, the first target sub-call frequency corresponding to the first sub-call link is determined; the first data processing unit is used to obtain the initial monitoring data from the monitored system at the first target sub-call frequency, and to process the initial monitoring data to obtain the updated monitoring data.
[0012] Based on the second resource quantity of the second data processing unit and the resource occupancy of the target monitoring data, the second target sub-call frequency corresponding to the second sub-call link is determined; the second data processing unit is used to obtain the updated monitoring data from the first data processing unit at the second target sub-call frequency, and to process the updated monitoring data to obtain the target monitoring data.
[0013] Optionally, determining the first target sub-call frequency corresponding to the first sub-call chain based on the first resource quantity of the first data processing unit, the resource occupancy of the initial monitoring data, and the resource occupancy of the updated monitoring data includes:
[0014] Obtain the upper limit call frequency of the initial monitoring data corresponding to the monitored system;
[0015] Based on the first resource quantity, the resource consumption of the initial monitoring data, and the resource consumption of the updated monitoring data, the first initial sub-call frequency corresponding to the first sub-call chain is determined;
[0016] The first target sub-call frequency is determined based on the upper limit call frequency and the first initial sub-call frequency.
[0017] Optionally, determining the first initial sub-call frequency corresponding to the first sub-call chain based on the first resource quantity, the resource occupancy of the initial monitoring data, and the resource occupancy of the updated monitoring data includes:
[0018] The first resource quantity is divided by the initial resource occupancy to obtain the first resource occupancy information; the initial resource occupancy is the sum of the resource occupancy of the initial monitoring data and the resource occupancy of the updated monitoring data.
[0019] If the first resource occupancy information is greater than or equal to the first preset occupancy threshold, the first preset call frequency is determined as the first initial sub-call frequency;
[0020] If the first resource occupancy information is less than the first preset occupancy threshold, the second preset call frequency is determined as the first initial sub-call frequency.
[0021] Optionally, determining the second target sub-call frequency corresponding to the second sub-call chain based on the second resource quantity of the second data processing unit and the resource occupancy of the target monitoring data includes:
[0022] Based on the second resource quantity and the resource consumption of the target monitoring data, determine the second initial sub-call frequency corresponding to the second sub-call chain;
[0023] If the display loading frequency is greater than the second initial sub-call frequency, the second target sub-call frequency is determined based on the second initial sub-call frequency and the first target sub-call frequency.
[0024] Optionally, the method further includes:
[0025] If the display loading frequency is less than or equal to the second initial sub-call frequency, the display loading frequency is determined as the second target sub-call frequency, and the display loading frequency is determined as the first target sub-call frequency.
[0026] Optionally, adjusting the second initial call frequency based on the user category information and / or the indicator category information to obtain the second target call frequency corresponding to the second call chain includes:
[0027] Based on the user category information, a first frequency adjustment coefficient is determined;
[0028] Based on the aforementioned indicator category information, a second frequency adjustment coefficient is determined;
[0029] Based on the first frequency adjustment coefficient and / or the second frequency adjustment coefficient, the second initial call frequency is adjusted to obtain the second target call frequency.
[0030] According to another aspect of the disclosed embodiments of the present invention, a data processing and detection apparatus is provided, comprising:
[0031] The acquisition module is used to acquire the resource quantity corresponding to the server, the resource consumption of the monitoring data, the display loading time of the monitoring indicators corresponding to the target monitoring data, user category information, and indicator category information; the monitoring data includes initial monitoring data and the target monitoring data; the server is used to acquire the initial monitoring data from the monitored system and process it to obtain the target monitoring data; the display loading time is the loading time for the terminal to display the monitoring indicators corresponding to the target monitoring data.
[0032] The display loading frequency determination module is used to determine the display loading frequency of the monitoring indicators corresponding to the target monitoring data displayed by the terminal based on the display loading duration.
[0033] The first target call frequency determination module is used to determine the first target call frequency corresponding to the first call link based on the resource quantity corresponding to the server and the resource consumption of the monitoring data, so that the server can obtain the initial monitoring data based on the first call link at the first target call frequency;
[0034] The second initial call frequency determination module is used to determine the second initial call frequency corresponding to the second call chain based on the first target call frequency and the display loading frequency;
[0035] The second target call frequency determination module is used to adjust the second initial call frequency based on the user category information and / or the indicator category information to obtain the second target call frequency corresponding to the second call link, so that the terminal can obtain the target monitoring data from the server based on the second call link.
[0036] According to another aspect of the disclosed embodiments of the present invention, an electronic device for data processing is provided, including a processor and a memory, wherein the memory stores at least one instruction, the at least one instruction being loaded and executed by the processor to implement the data processing method described in any of the preceding claims.
[0037] According to another aspect of the embodiments disclosed in this invention, a computer-readable storage medium is provided, wherein at least one instruction is stored in the computer storage medium, the at least one instruction being loaded and executed by a processor to implement the data processing method described in any of the preceding claims.
[0038] According to another aspect of the disclosed embodiments of the present invention, a computer program product containing instructions is provided, which, when run on a computer, causes the computer to perform the data processing method described in any of the above embodiments of the present invention.
[0039] The data processing method provided by this invention has the following technical effects:
[0040] This invention acquires the resource quantity of the server, the resource consumption of the monitoring data, the display loading time of the monitoring indicators corresponding to the target monitoring data, user category information, and indicator category information. The monitoring data includes initial monitoring data and target monitoring data. The server acquires the initial monitoring data from the monitored system and processes it to obtain the target monitoring data. The display loading time is the loading time for the terminal to display the monitoring indicators corresponding to the target monitoring data. Then, based on the server's resource quantity and the resource consumption of the monitoring data, a first target call frequency corresponding to the first call link is determined, so that the server acquires the initial monitoring data at the first target call frequency based on the first call link. Next, based on the display loading time, the display loading frequency of the monitoring indicators corresponding to the target monitoring data is determined, and based on the first target call frequency and the display loading frequency, a second initial call frequency corresponding to the second call link is determined. Then, based on the user category information and / or indicator category information, the second initial call frequency is adjusted to obtain the second target call frequency corresponding to the second call link, so that the terminal acquires the target monitoring data from the server based on the second call link. Thus, while meeting the monitoring requirements of the monitored system, the frequency of data calls in multiple stages of the data processing is adjusted, thereby alleviating monitoring performance pressure.
[0041] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0042] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0043] Figure 1 This is a schematic diagram illustrating an application environment of a data processing method according to an exemplary embodiment;
[0044] Figure 2 This is a flowchart illustrating a data processing method according to an exemplary embodiment;
[0045] Figure 3 This is a schematic diagram of a process for determining the frequency of a first target sub-call corresponding to a first sub-call chain, according to an exemplary embodiment.
[0046] Figure 4 This is a schematic diagram illustrating a process for determining a second target call frequency corresponding to a second call chain, according to an exemplary embodiment.
[0047] Figure 5 This is a block diagram illustrating a data processing apparatus according to an exemplary embodiment;
[0048] Figure 6 This is a block diagram illustrating a terminal electronic device for data processing according to an exemplary embodiment;
[0049] Figure 7 This is a block diagram illustrating a server electronic device for data processing according to an exemplary embodiment. Detailed Implementation
[0050] To enable those skilled in the art to better understand the technical solutions disclosed in this invention, the technical solutions in the disclosed embodiments will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of this invention, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.
[0051] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention disclosed herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or server that comprises a series of steps or units is not necessarily limited to those explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or devices.
[0052] Please see Figure 1 , Figure 1 This is a schematic diagram of an application environment for a data processing method according to an exemplary embodiment. The application environment may include at least a monitored system 100, a server 200, and a terminal 300.
[0053] The monitored system 100 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud computing services.
[0054] Server 200 can be used to monitor the monitored system 100, collect data corresponding to monitoring indicators from the monitored system 100, and perform corresponding analysis and processing. Server 200 can be a standalone physical server, or a server cluster or distributed system composed of multiple physical servers. Specifically, server 200 may include a first data processing unit 210 and a second data processing unit 220, wherein the first data processing unit 210 is used to collect initial monitoring data corresponding to monitoring indicators from the monitored system 100 and analyze it to obtain updated monitoring data, and the second data processing unit 220 is used to collect the updated monitoring data from the first data processing unit 210 and process it to obtain target monitoring data.
[0055] Terminal 300 can be a terminal used to display a monitoring interface to users. Terminal 300 collects target monitoring data corresponding to monitoring indicators from the second data processing unit 220, and renders display components for each monitoring indicator to display the monitoring interface, allowing users to understand the relevant situation of cloud services (such as cloud resource usage and performance) based on the monitoring interface. Terminal 300 can be, but is not limited to, electronic devices such as smartphones, desktop computers, tablets, laptops, smart speakers, digital assistants, augmented reality (AR) / virtual reality (VR) devices, smart wearable devices, in-vehicle terminals, and smart TVs; it can also be software running on the aforementioned electronic devices, such as applications and mini-programs. In this embodiment, the operating system running on the electronic device can include, but is not limited to, Android, iOS, Linux, and Windows systems.
[0056] In addition, it should be noted that, Figure 1 The examples shown are merely one application environment for a data processing method, and the embodiments in this specification are not limited to the above. In the embodiments of this specification, the monitored system 100 and the server 200, and the server 200 and the terminal 300 can be directly or indirectly connected through wired or wireless communication, and this application does not impose any restrictions.
[0057] The following describes a data processing method according to this application. Figure 2This is a flowchart illustrating a data processing method according to an exemplary embodiment. This specification provides the operational steps of the method as described in the embodiments or flowcharts, but based on conventional or non-inventive labor, more or fewer operational steps may be included. The order of steps listed in the embodiments is merely one possible execution order among many and does not represent the only execution order. In actual system or server products, the method can be executed sequentially or in parallel (e.g., in a parallel processor or multi-threaded processing environment) as shown in the embodiments or drawings. Specifically, as... Figure 2 As shown, the above method may include:
[0058] S201: Obtain the resource quantity corresponding to the server, the resource consumption of the monitoring data, the display loading time of the monitoring indicators corresponding to the target monitoring data, user category information, and indicator category information.
[0059] In one specific embodiment, the resource quantity corresponding to the server can be the available resource quantity of the server. The server can store the acquired monitoring data, and this resource quantity can be the size of the available storage space. Correspondingly, the resource consumption of the monitoring data can be the size of the storage space required by the acquired monitoring data. Each data can correspond to a preset resource consumption. Specifically, the monitoring data can include initial monitoring data and target monitoring data. The server can be used to acquire initial monitoring data from the monitored system and process it to obtain target monitoring data. The initial monitoring data can be data directly acquired from the monitored system without analysis or processing.
[0060] In one specific embodiment, the aforementioned display loading time can be the loading time of the monitoring indicators corresponding to the target monitoring data displayed on the terminal. Specifically, the display loading time can be the loading time required for the terminal to render the display component corresponding to the monitoring indicator. This loading time can also be related to the attribute information of the terminal display, such as the display's performance parameters. The loading time of the display component corresponding to each monitoring indicator can be obtained from multiple rendering tests on a certain terminal display.
[0061] In one specific embodiment, user category information can include user permission category, level category, etc.; the user can be an access user of the terminal, who can determine whether the cloud service is operating normally and stably through the indicator data displayed on the terminal. The user can independently select the monitoring indicators and time periods to be displayed through the terminal's display interface. Indicator category information can include indicator level category, etc.
[0062] S203: Based on the resource quantity of the server and the resource consumption of the monitoring data, determine the first target call frequency corresponding to the first call link, so that the server can obtain the initial monitoring data based on the first call link at the first target call frequency.
[0063] In one specific embodiment, the first call link can be the link through which the server obtains initial monitoring data from the monitored system. Specifically, it can be the link through which the first data acquisition unit obtains initial monitoring data from the monitored system.
[0064] In an optional embodiment, determining the first target call frequency corresponding to the first call chain based on the resource quantity of the server and the resource consumption of the monitoring data may include:
[0065] Based on the first resource quantity of the first data processing unit, the resource consumption of the initial monitoring data, and the resource consumption of the updated monitoring data, the first target sub-call frequency corresponding to the first sub-call chain is determined;
[0066] Based on the second resource quantity of the second data processing unit and the resource occupancy of the target monitoring data, the second target sub-call frequency corresponding to the second sub-call link is determined.
[0067] In one specific embodiment, the server may include a first data processing unit and a second data processing unit. The first call chain may include a first sub-call chain and a second sub-call chain. The first target call frequency may include a first target sub-call frequency and a second target sub-call frequency. The monitoring data may also include updated monitoring data. Specifically, the first data processing unit may be used to obtain initial monitoring data from the monitored system based on the first sub-call chain at the first target sub-call frequency, and to process the initial monitoring data to obtain updated monitoring data. The second data processing unit may be used to obtain updated monitoring data from the first data processing unit based on the second sub-call chain at the second target sub-call frequency, and to process the updated monitoring data to obtain target monitoring data. The first resource quantity may be the size of the storage space corresponding to the first data processing unit, and the second resource quantity may be the size of the storage space corresponding to the second data processing unit.
[0068] Specifically, the first data processing unit can analyze and preliminarily process the initial monitoring data of the initial monitoring indicators obtained from the monitored system to obtain updated monitoring data, and store the initial monitoring data and the updated monitoring data at the same time; the second data processing unit can perform corresponding processing (such as calculation processing) on the updated monitoring data obtained from the first data processing unit to obtain the processed monitoring data (i.e., target monitoring data), which can correspond to the initial monitoring indicators or to the newly added monitoring indicators after calculation processing.
[0069] In an optional embodiment, such as Figure 3As shown, determining the first target sub-call frequency corresponding to the first sub-call chain based on the first resource quantity of the first data processing unit, the resource consumption of the initial monitoring data, and the resource consumption of the updated monitoring data may include:
[0070] S301: Get the upper limit of the call frequency for the initial monitoring data corresponding to the monitored system.
[0071] In one specific embodiment, the aforementioned upper limit call frequency can be the maximum data acquisition frequency supported by the monitored system.
[0072] S303: Based on the first resource quantity, the resource consumption of the initial monitoring data, and the resource consumption of the updated monitoring data, determine the first initial sub-call frequency corresponding to the first sub-call chain.
[0073] In one specific embodiment, the first initial sub-call frequency can be the call frequency of the first sub-call chain determined according to the storage space size corresponding to the first data processing unit.
[0074] In an optional embodiment, determining the first initial sub-call frequency corresponding to the first sub-call chain based on the first resource quantity, the resource consumption of the initial monitoring data, and the resource consumption of the updated monitoring data may include:
[0075] Divide the first resource quantity by the initial resource occupancy to obtain the first resource occupancy information;
[0076] If the first resource occupancy information is greater than or equal to the first preset occupancy threshold, the first preset call frequency is determined as the first initial sub-call frequency;
[0077] If the first resource usage information is less than the first preset usage threshold, the second preset call frequency is determined as the first initial sub-call frequency.
[0078] In one specific embodiment, the initial resource usage can be the sum of the resource usage of the initial monitoring data and the resource usage of the updated monitoring data. The first resource usage information can be the first resource quantity divided by the initial resource usage. The first resource usage information can be used to characterize the amount of resources required based on the initial monitoring data and the updated monitoring data, and whether the available resources corresponding to the first data processing unit are sufficient. Specifically, if the first resource usage information is greater than or equal to a first preset usage threshold, it can be used to characterize that the available resources corresponding to the first data processing unit are sufficient; if the first resource usage information is less than the first preset usage threshold, it can be used to characterize that the available resources corresponding to the first data processing unit are insufficient.
[0079] Specifically, the first preset occupancy threshold, the first preset call frequency, and the second preset call frequency can be set according to actual application needs, with the first preset call frequency being greater than the second preset call frequency. When the available storage space corresponding to the first data processing unit is sufficient, the frequency at which the first data processing unit collects data from the monitored system can be increased; conversely, when the available storage space corresponding to the first data processing unit is insufficient, the frequency at which the first data processing unit collects data from the monitored system can be decreased.
[0080] Optionally, when the first resource occupancy information is greater than or equal to the first preset occupancy threshold, determining the first preset call frequency as the first initial sub-call frequency may include:
[0081] Obtain the upper limit call frequency corresponding to the first data processing unit;
[0082] If the first resource occupancy information is greater than or equal to the first preset occupancy threshold, the first preset call frequency is determined based on the first preset frequency adjustment coefficient and the upper limit call frequency;
[0083] The first preset call frequency is determined as the first initial sub-call frequency.
[0084] In one specific embodiment, the upper limit call frequency corresponding to the first data processing unit can be the maximum data call frequency supported by the first data processing unit. When the first resource occupancy information is greater than or equal to the first preset occupancy threshold, the first preset frequency adjustment coefficient and the upper limit call frequency can be multiplied to obtain the first preset call frequency. Correspondingly, when the first resource occupancy information is less than the first preset occupancy threshold, the second preset frequency adjustment coefficient and the upper limit call frequency can be multiplied to obtain the second preset call frequency. Then, the first preset call frequency / the second preset call frequency is determined as the first initial sub-call frequency under the corresponding condition.
[0085] Specifically, the first preset frequency adjustment coefficient and the second preset frequency adjustment coefficient can be set according to actual application requirements. The first preset frequency adjustment coefficient is greater than the second preset frequency adjustment coefficient. For example, the first preset frequency adjustment coefficient can be 1, and the value range of the second preset frequency adjustment coefficient can be (0, 1).
[0086] S305: Determine the first target sub-call frequency based on the upper limit call frequency and the first initial sub-call frequency.
[0087] In one specific embodiment, the value of the first target sub-call frequency can be the smaller of the upper limit call frequency and the first initial sub-call frequency.
[0088] In an optional embodiment, determining the second target sub-call frequency corresponding to the second sub-call chain based on the second resource quantity of the second data processing unit and the resource occupancy of the target monitoring data may include:
[0089] Based on the second resource quantity and the resource consumption of the target monitoring data, determine the second initial sub-call frequency corresponding to the second sub-call chain;
[0090] If the displayed loading frequency is greater than the second initial sub-call frequency, the second target sub-call frequency is determined based on the second initial sub-call frequency and the first target sub-call frequency.
[0091] In one specific embodiment, the value of the second target sub-call frequency can be the smaller of the second initial sub-call frequency and the first target sub-call frequency.
[0092] In an optional embodiment, the above method may further include:
[0093] If the displayed load frequency is less than or equal to the second initial sub-call frequency, the displayed load frequency will be determined as the second target sub-call frequency, and the displayed load frequency will be determined as the first target sub-call frequency.
[0094] In one specific embodiment, when the terminal's display loading cannot support the second data processing unit to acquire and update data at the current calling frequency, the smaller display loading frequency is used as the data calling frequency corresponding to the first and second data processing units, respectively.
[0095] Optionally, determining the second initial sub-call frequency corresponding to the second sub-call chain based on the second target resource quantity and the resource occupancy of the target monitoring data may include:
[0096] Divide the second target resource quantity by the resource usage of the target monitoring data to obtain the second resource usage information;
[0097] If the second resource occupancy information is greater than or equal to the second preset occupancy threshold, the third preset call frequency is determined as the second initial sub-call frequency;
[0098] If the second resource occupancy information is less than the second preset occupancy threshold, the fourth preset call frequency is determined as the second initial sub-call frequency.
[0099] In one specific embodiment, the second resource occupancy information can be the second resource quantity / the resource occupancy of the target monitoring data. The second resource occupancy information can be used to characterize the amount of resources required based on the target monitoring data and whether the available resources corresponding to the second data processing unit are sufficient. Specifically, if the second resource occupancy information is greater than or equal to a second preset occupancy threshold, it can be used to characterize that the available resources corresponding to the second data processing unit are sufficient; if the second resource occupancy information is less than the second preset occupancy threshold, it can be used to characterize that the available resources corresponding to the second data processing unit are insufficient.
[0100] Specifically, the second preset occupancy threshold, the third preset call frequency, and the fourth preset call frequency can be set according to actual application needs, with the third preset call frequency being greater than the fourth preset call frequency. When the available storage space corresponding to the second data processing unit is sufficient, the frequency at which the second data processing unit collects data from the first data processing unit can be increased; conversely, when the available storage space corresponding to the second data processing unit is insufficient, the frequency at which the second data processing unit collects data from the first data processing unit can be decreased.
[0101] Specifically, the detailed steps for determining the second initial sub-call frequency can be found in the detailed steps for determining the first initial sub-call frequency described above, and will not be repeated here.
[0102] S205: Based on the display loading time, determine the display loading frequency of the monitoring indicators corresponding to the target monitoring data displayed on the terminal.
[0103] In one specific embodiment, the display loading frequency can be the reciprocal of the display loading duration. Specifically, the display loading frequency can be the reciprocal of the upper limit display loading duration, which is the maximum loading duration required when the terminal renders the display component corresponding to the monitoring metric.
[0104] S207: Based on the first target call frequency and the display loading frequency, determine the second initial call frequency corresponding to the second call chain.
[0105] In one specific embodiment, the value of the second initial call frequency can be the smaller of the first target call frequency and the display loading frequency. Specifically, the value of the second initial call frequency can be the smaller of the second target sub-call frequency and the display loading frequency.
[0106] S209: Based on user category information and / or indicator category information, adjust the second initial call frequency to obtain the second target call frequency corresponding to the second call link, so that the terminal can obtain target monitoring data from the server based on the second call link.
[0107] In one specific embodiment, the terminal can obtain target monitoring data from the second data processing unit based on the second call link at the second target call frequency.
[0108] In an optional embodiment, such as Figure 4 As shown, the adjustment of the second initial call frequency based on user category information and / or indicator category information to obtain the second target call frequency corresponding to the second call chain may include:
[0109] S401: Determine the first frequency adjustment coefficient based on user category information.
[0110] In one specific embodiment, the first frequency adjustment coefficient can be used to characterize the importance of the terminal's user. The larger the first frequency adjustment coefficient, the higher the importance of the terminal's user. For example, user category information can include advanced, intermediate, and basic levels; correspondingly, when the user category information is advanced, the first frequency adjustment coefficient can be 1; when the user category information is intermediate, the value range of the first frequency adjustment coefficient can be (0.5, 1); and when the user category information is basic, the value range of the first frequency adjustment coefficient can be (0.1, 0.5).
[0111] S403: Determine the second frequency adjustment coefficient based on the indicator category information.
[0112] In one specific embodiment, the second frequency adjustment coefficient can be used to characterize the importance of the monitoring indicator corresponding to the target monitoring data. The larger the second frequency adjustment coefficient, the higher the importance of the monitoring indicator. For example, the indicator category information can include high-level, medium-level, and low-level; correspondingly, when the indicator category information is high-level, the second frequency adjustment coefficient can be 1; when the indicator category information is medium-level, the value range of the second frequency adjustment coefficient can be (0.5, 1); and when the indicator category information is low-level, the value range of the second frequency adjustment coefficient can be (0.1, 0.5).
[0113] S405: Adjust the second initial call frequency based on the first frequency adjustment coefficient and / or the second frequency adjustment coefficient to obtain the second target call frequency.
[0114] In one specific embodiment, the first frequency adjustment coefficient and / or the second frequency adjustment coefficient can be multiplied by the second initial call frequency to obtain the second target call frequency.
[0115] As can be seen from the technical solutions provided in the embodiments of this specification above, this specification obtains the resource quantity corresponding to the server, the resource consumption of the monitoring data, the display loading time of the monitoring indicators corresponding to the target monitoring data, user category information, and indicator category information. The monitoring data includes initial monitoring data and target monitoring data. The server is used to obtain the initial monitoring data from the monitored system and process it to obtain the target monitoring data. The display loading time is the loading time for the terminal to display the monitoring indicators corresponding to the target monitoring data. Furthermore, based on the resource quantity corresponding to the server and the resource consumption of the monitoring data, a first target call frequency corresponding to the first call link is determined, so that the server obtains the initial monitoring data based on the first call link at the first target call frequency. Then, based on the display loading time, the display loading frequency of the monitoring indicators corresponding to the target monitoring data displayed by the terminal is determined, and based on the first target call frequency and the display loading frequency, a second initial call frequency corresponding to the second call link is determined. Finally, based on the user category information and / or indicator category information, the second initial call frequency is adjusted to obtain the second target call frequency corresponding to the second call link, so that the terminal obtains the target monitoring data from the server based on the second call link. Therefore, based on meeting the monitoring requirements of the monitored system, the frequency of data calls in multiple stages of the data processing can be adjusted according to available storage space, the order of data calls in the data call chain, the terminal display loading time, the importance of the terminal access user, and the importance of the monitored indicators, thereby alleviating the monitoring performance pressure.
[0116] This invention also provides a data processing apparatus, such as... Figure 5 As shown, the device includes:
[0117] The acquisition module 510 is used to acquire the resource quantity corresponding to the server, the resource consumption of the monitoring data, the display loading time of the monitoring indicators corresponding to the target monitoring data, user category information, and indicator category information; the monitoring data includes initial monitoring data and the target monitoring data, the server is used to acquire the initial monitoring data from the monitored system and process it to obtain the target monitoring data, and the display loading time is the loading time for the terminal to display the monitoring indicators corresponding to the target monitoring data;
[0118] The first target call frequency determination module 520 is used to determine the first target call frequency corresponding to the first call link based on the resource quantity corresponding to the server and the resource consumption of the monitoring data, so that the server can obtain the initial monitoring data based on the first call link at the first target call frequency;
[0119] The display loading frequency determination module 530 is used to determine the display loading frequency of the monitoring indicators corresponding to the target monitoring data displayed by the terminal based on the display loading duration.
[0120] The second initial call frequency determination module 540 is used to determine the second initial call frequency corresponding to the second call chain based on the first target call frequency and the display loading frequency;
[0121] The second target call frequency determination module 550 is used to adjust the second initial call frequency based on the user category information and / or the indicator category information to obtain the second target call frequency corresponding to the second call link, so that the terminal can obtain the target monitoring data from the server based on the second call link.
[0122] Optionally, the server includes a first data processing unit and a second data processing unit, the first call chain includes a first sub-call chain and a second sub-call chain, the first target call frequency includes a first target sub-call frequency and a second target sub-call frequency, the monitoring data further includes updated monitoring data, and the first target call frequency determination module 520 includes:
[0123] The first target sub-call frequency determination unit is used to determine the first target sub-call frequency corresponding to the first sub-call link based on the first resource quantity of the first data processing unit, the resource occupancy of the initial monitoring data, and the resource occupancy of the updated monitoring data; the first data processing unit is used to obtain the initial monitoring data from the monitored system at the first target sub-call frequency, and to process the initial monitoring data to obtain the updated monitoring data.
[0124] The second target sub-call frequency determination unit is used to determine the second target sub-call frequency corresponding to the second sub-call link based on the second resource quantity of the second data processing unit and the resource occupancy of the target monitoring data; the second data processing unit is used to obtain the updated monitoring data from the first data processing unit at the second target sub-call frequency, and to process the updated monitoring data to obtain the target monitoring data.
[0125] Optionally, the first target sub-call frequency determination unit includes:
[0126] The acquisition unit is used to acquire the upper limit call frequency of the initial monitoring data corresponding to the monitored system;
[0127] The first initial sub-call frequency determination unit is used to determine the first initial sub-call frequency corresponding to the first sub-call link based on the first resource quantity, the resource occupancy of the initial monitoring data, and the resource occupancy of the updated monitoring data.
[0128] The third target sub-call frequency determination unit is used to determine the first target sub-call frequency based on the upper limit call frequency and the first initial sub-call frequency.
[0129] Optionally, the first initial sub-call frequency determination unit includes:
[0130] The first resource occupancy information determination unit is used to divide the first resource quantity by the initial resource occupancy quantity to obtain the first resource occupancy information; the initial resource occupancy quantity is the sum of the resource occupancy quantity of the initial monitoring data and the resource occupancy quantity of the updated monitoring data;
[0131] The second initial sub-call frequency determination unit is used to determine the first preset call frequency as the first initial sub-call frequency when the first resource occupancy information is greater than or equal to the first preset occupancy threshold.
[0132] The third initial sub-call frequency determination unit is used to determine the second preset call frequency as the first initial sub-call frequency when the first resource occupancy information is less than the first preset occupancy threshold.
[0133] Optionally, the second target sub-call frequency determination unit includes:
[0134] The fourth initial sub-call frequency determination unit is used to determine the second initial sub-call frequency corresponding to the second sub-call link based on the second resource quantity and the resource occupancy of the target monitoring data;
[0135] The fourth target sub-call frequency determination unit is used to determine the second target sub-call frequency based on the second initial sub-call frequency and the first target sub-call frequency when the display loading frequency is greater than the second initial sub-call frequency.
[0136] Optionally, the device further includes:
[0137] The target sub-call frequency determination module is used to determine the display loading frequency as the second target sub-call frequency when the display loading frequency is less than or equal to the second initial sub-call frequency, and to determine the display loading frequency as the first target sub-call frequency.
[0138] Optionally, the second target call frequency determination module 550 includes:
[0139] The first frequency adjustment coefficient determining unit is used to determine the first frequency adjustment coefficient based on the user category information;
[0140] The second frequency adjustment coefficient determination unit is used to determine the second frequency adjustment coefficient based on the index category information.
[0141] The second target call frequency determination unit is used to adjust the second initial call frequency based on the first frequency adjustment coefficient and / or the second frequency adjustment coefficient to obtain the second target call frequency.
[0142] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.
[0143] Figure 6 This is a block diagram illustrating a terminal electronic device for data processing according to an exemplary embodiment. The electronic device may be a terminal, and its internal structure diagram may be as follows: Figure 6 As shown, the electronic device includes a processor, memory, network interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage medium. The network interface is used to communicate with external terminals via a network connection. When the computer program is executed by the processor, it implements a data processing method. The display screen can be a liquid crystal display (LCD) or an e-ink display. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the device's casing, or an external keyboard, touchpad, or mouse.
[0144] Figure 7 This is a block diagram illustrating a server electronic device for data processing according to an exemplary embodiment. The electronic device may be a server, and its internal structure diagram may be as follows: Figure 7 As shown, this electronic device includes a processor, memory, and a network interface connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage medium. The network interface is used to communicate with external terminals via a network connection. When the computer program is executed by the processor, it implements a data processing method.
[0145] Those skilled in the art will understand that Figure 6 or Figure 7The structures shown are merely block diagrams of some structures related to the disclosed solutions of this invention, and do not constitute a limitation on the electronic devices to which the disclosed solutions of this invention are applied. Specific electronic devices may include more or fewer components than those shown in the figures, or combine certain components, or have different component arrangements.
[0146] In an exemplary embodiment, an electronic device for data processing is also provided, including a processor and a memory storing at least one instruction, which is loaded and executed by the processor to implement the data processing method as disclosed in the present invention.
[0147] In an exemplary embodiment, a computer-readable storage medium is also provided, which stores at least one instruction, which is loaded and executed by a processor to implement the data processing method in the embodiments disclosed herein.
[0148] In an exemplary embodiment, a computer program product containing instructions is also provided, which, when run on a computer, causes the computer to perform the data processing method disclosed in this invention.
[0149] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided by this invention can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), and double data rate RAM.
[0150] SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), Rambus Direct RAM (RDRAM), Direct Memory Bus Dynamic RAM (DRDRAM), and Memory Bus Dynamic RAM (RDRAM), etc.
[0151] Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention that follow the general principles disclosed herein and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of the invention are indicated by the following claims.
[0152] It should be understood that the present invention is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the present invention is limited only by the appended claims.
Claims
1. A data processing method, characterized in that, The method includes: The server acquires the resource quantity corresponding to the server, the resource consumption of the monitoring data, the display loading time of the monitoring indicators corresponding to the target monitoring data, user category information, and indicator category information. The monitoring data includes initial monitoring data and the target monitoring data. The server is used to acquire the initial monitoring data from the monitored system and process it to obtain the target monitoring data. The display loading time is the loading time for the terminal to display the monitoring indicators corresponding to the target monitoring data. Based on the resource quantity corresponding to the server and the resource consumption of the monitoring data, a first target call frequency corresponding to the first call link is determined, so that the server obtains the initial monitoring data based on the first call link at the first target call frequency; Based on the display loading time, the display loading frequency of the monitoring indicators corresponding to the target monitoring data displayed by the terminal is determined; Based on the first target call frequency and the display loading frequency, determine the second initial call frequency corresponding to the second call chain; Based on the user category information and / or the indicator category information, the second initial call frequency is adjusted to obtain the second target call frequency corresponding to the second call link, so that the terminal can obtain the target monitoring data from the server based on the second call link.
2. The method according to claim 1, characterized in that, The server includes a first data processing unit and a second data processing unit. The first call chain includes a first sub-call chain and a second sub-call chain. The first target call frequency includes a first target sub-call frequency and a second target sub-call frequency. The monitoring data also includes updated monitoring data. Determining the first target call frequency corresponding to the first call chain based on the resource quantity of the server and the resource occupancy of the monitoring data includes: Based on the first resource quantity of the first data processing unit, the resource occupancy of the initial monitoring data, and the resource occupancy of the updated monitoring data, the first target sub-call frequency corresponding to the first sub-call link is determined; the first data processing unit is used to obtain the initial monitoring data from the monitored system at the first target sub-call frequency, and to process the initial monitoring data to obtain the updated monitoring data. Based on the second resource quantity of the second data processing unit and the resource occupancy of the target monitoring data, the second target sub-call frequency corresponding to the second sub-call link is determined; the second data processing unit is used to obtain the updated monitoring data from the first data processing unit at the second target sub-call frequency, and to process the updated monitoring data to obtain the target monitoring data.
3. The method according to claim 2, characterized in that, The step of determining the first target sub-call frequency corresponding to the first sub-call chain based on the first resource quantity of the first data processing unit, the resource occupancy of the initial monitoring data, and the resource occupancy of the updated monitoring data includes: Obtain the upper limit call frequency of the initial monitoring data corresponding to the monitored system; Based on the first resource quantity, the resource consumption of the initial monitoring data, and the resource consumption of the updated monitoring data, the first initial sub-call frequency corresponding to the first sub-call chain is determined; The first target sub-call frequency is determined based on the upper limit call frequency and the first initial sub-call frequency.
4. The method according to claim 3, characterized in that, The step of determining the first initial sub-call frequency corresponding to the first sub-call chain based on the first resource quantity, the resource occupancy of the initial monitoring data, and the resource occupancy of the updated monitoring data includes: The first resource quantity is divided by the initial resource occupancy to obtain the first resource occupancy information; the initial resource occupancy is the sum of the resource occupancy of the initial monitoring data and the resource occupancy of the updated monitoring data. If the first resource occupancy information is greater than or equal to the first preset occupancy threshold, the first preset call frequency is determined as the first initial sub-call frequency; If the first resource occupancy information is less than the first preset occupancy threshold, the second preset call frequency is determined as the first initial sub-call frequency.
5. The method according to claim 2, characterized in that, The determination of the second target sub-call frequency corresponding to the second sub-call link based on the second resource quantity of the second data processing unit and the resource occupancy of the target monitoring data includes: Based on the second resource quantity and the resource consumption of the target monitoring data, determine the second initial sub-call frequency corresponding to the second sub-call chain; If the display loading frequency is greater than the second initial sub-call frequency, the second target sub-call frequency is determined based on the second initial sub-call frequency and the first target sub-call frequency.
6. The method according to claim 5, characterized in that, The method further includes: If the display loading frequency is less than or equal to the second initial sub-call frequency, the display loading frequency is determined as the second target sub-call frequency, and the display loading frequency is determined as the first target sub-call frequency.
7. The method according to claim 1, characterized in that, The step of adjusting the second initial call frequency based on the user category information and / or the indicator category information to obtain the second target call frequency corresponding to the second call chain includes: Based on the user category information, a first frequency adjustment coefficient is determined; Based on the aforementioned indicator category information, a second frequency adjustment coefficient is determined; Based on the first frequency adjustment coefficient and / or the second frequency adjustment coefficient, the second initial call frequency is adjusted to obtain the second target call frequency.
8. A data processing apparatus, characterized in that, The device includes: The acquisition module is used to acquire the resource quantity corresponding to the server, the resource consumption of the monitoring data, the display loading time of the monitoring indicators corresponding to the target monitoring data, user category information, and indicator category information; the monitoring data includes initial monitoring data and the target monitoring data; the server is used to acquire the initial monitoring data from the monitored system and process it to obtain the target monitoring data; the display loading time is the loading time for the terminal to display the monitoring indicators corresponding to the target monitoring data. The first target call frequency determination module is used to determine the first target call frequency corresponding to the first call link based on the resource quantity corresponding to the server and the resource consumption of the monitoring data, so that the server can obtain the initial monitoring data based on the first call link at the first target call frequency; The display loading frequency determination module is used to determine the display loading frequency of the monitoring indicators corresponding to the target monitoring data displayed by the terminal based on the display loading duration. The second initial call frequency determination module is used to determine the second initial call frequency corresponding to the second call chain based on the first target call frequency and the display loading frequency; The second target call frequency determination module is used to adjust the second initial call frequency based on the user category information and / or the indicator category information to obtain the second target call frequency corresponding to the second call link, so that the terminal can obtain the target monitoring data from the server based on the second call link.
9. An electronic device for data processing, characterized in that, The electronic device includes a processor and a memory, the memory storing at least one instruction, which is loaded and executed by the processor to implement the data processing method as described in any one of claims 1 to 7.
10. A computer storage medium, characterized in that, The computer storage medium stores at least one instruction, which is loaded and executed by a processor to implement the data processing method as described in any one of claims 1 to 7.
Citation Information
Patent Citations
Animation frame display method and device, equipment and storage medium
CN114299201A
Multi-baseband carrier unified regulation and control system and method, and storage medium
CN116094576A