Data processing method and device, electronic equipment and storage medium

Abstract

The invention discloses a data processing method and device, electronic equipment and a storage medium, and the method comprises the steps: determining a first target call frequency corresponding to a first call link based on the resource amount of a server and the resource occupation amount of monitoring data, so as to enable the server to obtain initial monitoring data at the first target call frequency based on the first call link; based on the display loading duration of the monitoring index corresponding to the target monitoring data, determining the display loading frequency of displaying the monitoring index by the terminal; determining a second initial calling frequency corresponding to the second calling link based on the first target calling frequency and the display loading frequency; and adjusting the second initial calling frequency based on the user category information and / or the index category information to obtain a second target calling frequency, so that the terminal obtains the target monitoring data from the server based on the second calling link. According to the embodiment of the invention, the monitoring performance pressure can be relieved on the basis of meeting the monitoring requirements of the monitored system.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a data processing method, device, electronic equipment and storage medium. Background Art

[0002] As the cloud service market expands, more and more companies are beginning to adopt cloud services, and the demand for cloud service monitoring is also increasing. Cloud service monitoring can monitor the usage and performance of cloud resources in real time, helping companies to discover and solve problems in a timely manner and ensure the stable operation of the business. In the process of cloud service monitoring, the backend server used for monitoring needs to collect a large amount of monitoring data, store it, and process it accordingly, which puts a great burden on the monitoring server. Summary of the invention

[0003] In view of the above problems in the prior art, the present invention discloses a data processing method, device, electronic device and storage medium, which can alleviate the monitoring performance pressure on the basis of meeting the monitoring requirements of the monitored system. The technical solution disclosed in the present invention is as follows:

[0004] According to one aspect of the disclosed embodiment of the present invention, there is provided a data processing method, comprising:

[0005] Obtain the resource amount corresponding to the server, the resource usage of the monitoring data, the display loading time of the monitoring indicator corresponding to the target monitoring data, the user category information and the indicator category information; the monitoring data includes the initial monitoring data and the target monitoring data, the server is used to obtain the initial monitoring data from the monitored system and process it to obtain the target monitoring data, and the display loading time is the loading time of the monitoring indicator corresponding to the target monitoring data displayed by the terminal;

[0006] Determine, based on the amount of resources corresponding to the server and the amount of resources occupied by the monitoring data, a first target call frequency corresponding to the first call link, so that the server acquires the initial monitoring data at the first target call frequency based on the first call link;

[0007] Based on the display loading duration, determining a display loading frequency at which the terminal displays the monitoring indicator corresponding to the target monitoring data;

[0008] Determining a second initial call frequency corresponding to a second call link based on the first target call frequency and the display loading frequency;

[0009] Based on the user category information and / or the indicator category information, the second initial call frequency is adjusted to obtain a second target call frequency corresponding to the second call link, so that the terminal obtains the target monitoring data from the server based on the second call link.

[0010] Optionally, the server includes a first data processing unit and a second data processing unit, the first call link includes a first sub-call link and a second sub-call link, the first target call frequency includes a first target sub-call frequency and a second target sub-call frequency, the monitoring data also includes updated monitoring data, and determining the first target call frequency corresponding to the first call link based on the amount of resources corresponding to the server and the amount of resource usage of the monitoring data includes:

[0011] Determine the first target sub-call frequency corresponding to the first sub-call link based on the first resource amount of the first data processing unit, the resource occupation amount of the initial monitoring data, and the resource occupation amount of the updated monitoring data; the first data processing unit is used to obtain the initial monitoring data from the monitored system at the first target sub-call frequency, and process the initial monitoring data to obtain the updated monitoring data;

[0012] Based on the second resource amount of the second data processing unit and the resource occupancy of the target monitoring data, the second target sub-call frequency corresponding to the second sub-call link is determined; the second data processing unit is used to obtain the updated monitoring data from the first data processing unit at the second target sub-call frequency, and process the updated monitoring data to obtain the target monitoring data.

[0013] Optionally, determining the first target sub-call frequency corresponding to the first sub-call link based on the first resource amount of the first data processing unit, the resource occupation amount of the initial monitoring data, and the resource occupation amount of the updated monitoring data includes:

[0014] Obtaining an upper limit calling frequency of the initial monitoring data corresponding to the monitored system;

[0015] Determining a first initial sub-call frequency corresponding to the first sub-call link based on the first resource amount, the resource occupation amount of the initial monitoring data, and the resource occupation amount of the updated monitoring data;

[0016] The first target sub-call frequency is determined based on the upper limit call frequency and the first initial sub-call frequency.

[0017] Optionally, the determining, based on the first resource amount, the resource occupation amount of the initial monitoring data, and the resource occupation amount of the updated monitoring data, a first initial sub-call frequency corresponding to the first sub-call link includes:

[0018] Dividing the first resource amount by the initial resource occupancy amount to obtain first resource occupancy information; the initial resource occupancy amount is the sum of the resource occupancy amount of the initial monitoring data and the resource occupancy amount of the updated monitoring data;

[0019] In a case where the first resource occupancy information is greater than or equal to a first preset occupancy threshold, determining a first preset calling frequency as the first initial sub-calling frequency;

[0020] When the first resource occupancy information is less than the first preset occupancy threshold, a second preset calling frequency is determined as the first initial sub-calling frequency.

[0021] Optionally, determining the second target sub-call frequency corresponding to the second sub-call link based on the second resource amount of the second data processing unit and the resource occupation amount of the target monitoring data includes:

[0022] Determining a second initial sub-call frequency corresponding to the second sub-call link based on the second resource amount and the resource occupation amount of the target monitoring data;

[0023] In a case where the display loading frequency is greater than the second initial sub-call frequency, the second target sub-call frequency is determined based on the second initial sub-call frequency and the first target sub-call frequency.

[0024] Optionally, the method further includes:

[0025] In a case where the display loading frequency is less than or equal to the second initial sub-call frequency, the display loading frequency is determined as the second target sub-call frequency, and the display loading frequency is determined as the first target sub-call frequency.

[0026] Optionally, the adjusting the second initial call frequency based on the user category information and / or the indicator category information to obtain a second target call frequency corresponding to the second call link includes:

[0027] Based on the user category information, determining a first frequency adjustment coefficient;

[0028] Based on the indicator category information, determining a second frequency adjustment coefficient;

[0029] Based on the first frequency adjustment coefficient and / or the second frequency adjustment coefficient, the second initial calling frequency is adjusted to obtain the second target calling frequency.

[0030] According to another aspect of the disclosed embodiment of the present invention, there is provided a data processing detection device, comprising:

[0031] An acquisition module is used to acquire the resource amount corresponding to the server, the resource usage of the monitoring data, the display loading time of the monitoring indicator corresponding to the target monitoring data, user category information and indicator category information; the monitoring data includes initial monitoring data and the target monitoring data, the server is used to acquire the initial monitoring data from the monitored system and process it to obtain the target monitoring data, and the display loading time is the loading time of the monitoring indicator corresponding to the target monitoring data displayed by the terminal;

[0032] A display loading frequency determination module, used to determine the display loading frequency of the monitoring indicator corresponding to the target monitoring data displayed by the terminal based on the display loading duration;

[0033] A first target call frequency determination module, configured to determine a first target call frequency corresponding to a first call link based on the amount of resources corresponding to the server and the amount of resources occupied by the monitoring data, so that the server acquires the initial monitoring data at the first target call frequency based on the first call link;

[0034] A second initial call frequency determination module, configured to determine a second initial call frequency corresponding to a second call link based on the first target call frequency and the display loading frequency;

[0035] A second target call frequency determination module is used to adjust the second initial call frequency based on the user category information and / or the indicator category information to obtain the second target call frequency corresponding to the second call link, so that the terminal obtains the target monitoring data from the server based on the second call link.

[0036] According to another aspect of the disclosed embodiment of the present invention, there is provided an electronic device for data processing, comprising a processor and a memory, wherein the memory stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement any of the above-mentioned data processing methods.

[0037] According to another aspect of the disclosed embodiment of the present invention, a computer-readable storage medium is provided, wherein at least one instruction is stored in the computer storage medium, and the at least one instruction is loaded and executed by a processor to implement any of the above-mentioned data processing methods.

[0038] According to another aspect of the embodiments disclosed in the present invention, there is provided a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute any of the data processing methods described above in the embodiments disclosed in the present invention.

[0039] The data processing method provided by the present invention has the following technical effects:

[0040] The present invention obtains the resource amount corresponding to the server, the resource occupation amount of the monitoring data, the display loading time of the monitoring index corresponding to the target monitoring data, the user category information and the indicator category information; wherein the monitoring data includes the initial monitoring data and the target monitoring data, the server is used to obtain the initial monitoring data from the monitored system and process it to obtain the target monitoring data, and the display loading time is the loading time of the monitoring index corresponding to the target monitoring data displayed by the terminal; further, based on the resource amount corresponding to the server and the resource occupation amount of the monitoring data, the first target call frequency corresponding to the first call link is determined, so that the server obtains the initial monitoring data with the first target call frequency based on the first call link; thereafter, based on the display loading time, the display loading frequency of the monitoring index corresponding to the target monitoring data displayed by the terminal is determined, and based on the first target call frequency and the display loading frequency, the second initial call frequency corresponding to the second call link is determined; further, based on the user category information and / or the indicator category information, the second initial call frequency is adjusted to obtain the second target call frequency corresponding to the second call link, so that the terminal obtains the target monitoring data from the server based on the second call link. Thus, on the basis of meeting the monitoring requirements of the monitored system, the frequency of data calls in multiple links in the data processing process is adjusted, thereby alleviating the pressure of monitoring performance.

[0041] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0043] Figure 1 is a schematic diagram of an application environment of a data processing method according to an exemplary embodiment;

[0044] Figure 2 is a flowchart of a data processing method according to an exemplary embodiment;

[0045] Figure 3 is a schematic diagram of a process of determining a first target sub-call frequency corresponding to a first sub-call link according to an exemplary embodiment;

[0046] Figure 4 is a schematic diagram of a process of determining a second target call frequency corresponding to a second call link according to an exemplary embodiment;

[0047] Figure 5 is a block diagram of a data processing device according to an exemplary embodiment;

[0048] Figure 6 is a block diagram of a terminal electronic device for data processing according to an exemplary embodiment;

[0049] Figure 7 The invention is a block diagram of a server electronic device for data processing according to an exemplary embodiment. DETAILED DESCRIPTION

[0050] In order to enable ordinary persons in the art to better understand the technical solutions disclosed in the present invention, the technical solutions in the embodiments disclosed in the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary persons in the art without making creative work are within the scope of protection of the present invention.

[0051] It should be noted that the terms "first", "second", etc. in the specification and claims disclosed in the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments disclosed in the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

[0052] See also Figure 1 , Figure 1 It is a schematic diagram of an application environment of a data processing method according to an exemplary embodiment. The application environment may at least include a monitored system 100, a server 200 and a terminal 300.

[0053] The monitored system 100 may be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server that provides cloud computing services.

[0054] The server 200 can be used to monitor the above-mentioned monitored system 100, collect data corresponding to the monitoring indicators from the monitored system 100, and perform corresponding analysis and processing. The server 200 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. Specifically, the server 200 may include a first data processing unit 210 and a second data processing unit 220, wherein the first data processing unit 210 is used to collect initial monitoring data corresponding to the monitoring indicators from the monitored system 100, and analyze to obtain updated monitoring data, and the second data processing unit 220 is used to collect the above-mentioned updated monitoring data from the first data processing unit 210, and process to obtain target monitoring data.

[0055] The terminal 300 may be a terminal for displaying a monitoring interface to the user. The terminal 300 collects target monitoring data corresponding to the monitoring indicators from the second data processing unit 220, and renders display components of each monitoring indicator, thereby displaying the monitoring interface, so that the user can understand the relevant situation of the cloud service based on the monitoring interface (such as the usage and performance of cloud resources, etc.). The terminal 300 may include but is not limited to smart phones, desktop computers, tablet computers, laptops, smart speakers, digital assistants, augmented reality (AR) / virtual reality (VR) devices, smart wearable devices, vehicle terminals, smart TVs and other types of electronic devices; it may also be software running on the above electronic devices, such as applications, applets, etc. The operating system running on the electronic device in the embodiment of the present application may include but is not limited to Android system, iOS system, Linux, Windows, etc.

[0056] In addition, it should be noted that Figure 1 The above-mentioned monitored system 100 and server 200, server 200 and terminal 300 can be directly or indirectly connected via wired or wireless communication, and this application does not limit this.

[0057] A data processing method of the present application is introduced below. Figure 2It is a flowchart of a data processing method according to an exemplary embodiment. This specification provides method operation steps as described in the embodiment or flowchart, but may include more or fewer operation steps based on conventional or non-creative labor. The order of steps listed in the embodiment is only one way of executing the steps among many orders, and does not represent the only order of execution. When the actual system or server product is executed, it can be executed in sequence or in parallel (for example, in a parallel processor or multi-threaded processing environment) according to the method shown in the embodiment or the drawings. Specifically, Figure 2 As shown, the above method may include:

[0058] S201: Obtain the amount of resources corresponding to the server, the amount of resource usage of the monitoring data, the display loading time of the monitoring indicators corresponding to the target monitoring data, user category information and indicator category information.

[0059] In a specific embodiment, the resource amount corresponding to the server may be the available resource amount of the server, and the server may store the acquired monitoring data. The resource amount may be the size of the available storage space. Accordingly, the resource usage of the monitoring data may be the size of the storage space required to occupy the acquired monitoring data. Each data may correspond to a preset resource usage. Specifically, the monitoring data may include initial monitoring data and target monitoring data. The server may be used to acquire the initial monitoring data from the monitored system and process it to obtain the target monitoring data. The initial monitoring data may be data directly acquired from the monitored system without being analyzed and processed.

[0060] In a specific embodiment, the display loading time may be the loading time of the monitoring indicator corresponding to the target monitoring data displayed by the terminal. Specifically, the display loading time may be the loading time required for the terminal to render the display component corresponding to the monitoring indicator. The loading time may also be related to the attribute information of the terminal display, such as the performance parameters of the display. The loading time of the display component corresponding to each monitoring indicator may be obtained based on statistics of multiple rendering tests under a certain terminal display.

[0061] In a specific embodiment, the user category information may be the user's authority category, level category, etc.; the user may be an access person of the terminal, and through the indicator data displayed by the terminal, determine whether the cloud service is running normally and stably, and the user may independently select the monitoring indicators and time periods to be displayed through the display interface of the terminal. The indicator category information may be the level category of the indicator, etc.

[0062] S203: Determine a first target call frequency corresponding to the first call link based on the resource amount corresponding to the server and the resource occupation amount of the monitoring data, so that the server obtains initial monitoring data at the first target call frequency based on the first call link.

[0063] In a specific embodiment, the first calling link may be a link for the server to obtain initial monitoring data from the monitored system, and specifically, may be a link for the first data acquisition unit to obtain initial monitoring data from the monitored system.

[0064] In an optional embodiment, the determining the first target call frequency corresponding to the first call link based on the resource amount corresponding to the server and the resource occupation amount of the monitoring data may include:

[0065] Determine a first target sub-call frequency corresponding to the first sub-call link based on a first resource amount of the first data processing unit, a resource occupancy amount of the initial monitoring data, and a resource occupancy amount of the updated monitoring data;

[0066] A second target sub-call frequency corresponding to the second sub-call link is determined based on the second resource amount of the second data processing unit and the resource occupation amount of the target monitoring data.

[0067] In a specific embodiment, the server may include a first data processing unit and a second data processing unit, the first call link may include a first sub-call link and a second sub-call link, the first target call frequency may include a first target sub-call frequency and a second target sub-call frequency, and the monitoring data may further include updated monitoring data. Specifically, the first data processing unit may be used to obtain initial monitoring data from the monitored system based on the first sub-call link with the first target sub-call frequency, and process the initial monitoring data to obtain updated monitoring data; the second data processing unit may be used to obtain updated monitoring data from the first data processing unit based on the second sub-call link with the second target sub-call frequency, and process the updated monitoring data to obtain target monitoring data. The first resource amount may be the size of the storage space corresponding to the first data processing unit, and the second resource amount may be the size of the storage space corresponding to the second data processing unit.

[0068] Specifically, the first data processing unit can analyze and preliminarily process the initial monitoring data of the initial monitoring indicators obtained from the monitored system to obtain updated monitoring data, and store the initial monitoring data and the updated monitoring data at the same time; the second data processing unit can perform corresponding processing (such as calculation processing, etc.) on the updated monitoring data obtained from the first data processing unit to obtain processed monitoring data (i.e., target monitoring data), which can correspond to the initial monitoring indicators or to the newly added monitoring indicators after calculation processing.

[0069] In an optional embodiment, if Figure 3As shown, the determining of the first target sub-call frequency corresponding to the first sub-call link based on the first resource amount of the first data processing unit, the resource occupancy amount of the initial monitoring data, and the resource occupancy amount of the updated monitoring data may include:

[0070] S301: Obtain the upper limit calling frequency of the initial monitoring data corresponding to the monitored system.

[0071] In a specific embodiment, the upper limit calling frequency may be the maximum data collection frequency supported by the monitored system.

[0072] S303: Determine a first initial sub-call frequency corresponding to the first sub-call link based on the first resource amount, the resource occupancy amount of the initial monitoring data, and the resource occupancy amount of the updated monitoring data.

[0073] In a specific embodiment, the first initial sub-call frequency may be a call frequency of the first sub-call link determined according to the size of the storage space corresponding to the first data processing unit.

[0074] In an optional embodiment, determining the first initial sub-call frequency corresponding to the first sub-call link based on the first resource amount, the resource occupancy amount of the initial monitoring data, and the resource occupancy amount of the updated monitoring data may include:

[0075] Dividing the first resource amount by the initial resource occupancy amount to obtain first resource occupancy information;

[0076] In a case where the first resource occupancy information is greater than or equal to a first preset occupancy threshold, determining the first preset calling frequency as the first initial sub-calling frequency;

[0077] When the first resource occupancy information is less than the first preset occupancy threshold, the second preset calling frequency is determined as the first initial sub-calling frequency.

[0078] In a specific embodiment, the initial resource occupancy may be the sum of the resource occupancy of the initial monitoring data and the resource occupancy of the updated monitoring data, the first resource occupancy information may be the first resource amount / initial resource occupancy, and the first resource occupancy information may be used to characterize whether the available resource amount corresponding to the first data processing unit is sufficient based on the amount of resources required to be occupied by the initial monitoring data and the updated monitoring data. Specifically, the first resource occupancy information being greater than or equal to the first preset occupancy threshold may be used to characterize that the available resource amount corresponding to the first data processing unit is sufficient, and the first resource occupancy information being less than the first preset occupancy threshold may be used to characterize that the available resource amount corresponding to the first data processing unit is insufficient.

[0079] Specifically, the first preset occupancy threshold, the first preset call frequency, and the second preset call frequency can be set according to actual application requirements, and the first preset call frequency is greater than the second preset call frequency. When the available storage space corresponding to the first data processing unit is sufficient, the frequency of the first data processing unit collecting data from the monitored system can be increased, and when the available storage space corresponding to the first data processing unit is insufficient, the frequency of the first data processing unit collecting data from the monitored system can be reduced.

[0080] Optionally, when the first resource occupancy information is greater than or equal to a first preset occupancy threshold, determining the first preset calling frequency as the first initial sub-calling frequency may include:

[0081] Obtaining an upper limit calling frequency corresponding to the first data processing unit;

[0082] When the first resource occupancy information is greater than or equal to a first preset occupancy threshold, determining a first preset calling frequency based on a first preset frequency adjustment coefficient and an upper limit calling frequency;

[0083] The first preset calling frequency is determined as the first initial sub-calling frequency.

[0084] In a specific embodiment, the upper limit call frequency corresponding to the first data processing unit may be the maximum data call frequency supported by the first data processing unit. When the first resource occupancy information is greater than or equal to the first preset occupancy threshold, the first preset frequency adjustment coefficient and the upper limit call frequency may be multiplied to obtain the first preset call frequency. Correspondingly, when the first resource occupancy information is less than the first preset occupancy threshold, the second preset frequency adjustment coefficient and the upper limit call frequency may be multiplied to obtain the second preset call frequency, and then the first preset call frequency / the second preset call frequency may be determined as the first initial sub-call frequency in the corresponding case.

[0085] Specifically, the first preset frequency adjustment coefficient and the second preset frequency adjustment coefficient can be set according to actual application requirements. The first preset frequency adjustment coefficient is greater than the second preset frequency adjustment coefficient. For example, the first preset frequency adjustment coefficient can be 1, and the value range of the second preset frequency adjustment coefficient can be (0, 1).

[0086] S305: Determine a first target sub-call frequency based on the upper limit call frequency and the first initial sub-call frequency.

[0087] In a specific embodiment, the value of the first target sub-call frequency may be a smaller value of the upper limit call frequency and the first initial sub-call frequency.

[0088] In an optional embodiment, the determining of the second target sub-call frequency corresponding to the second sub-call link based on the second resource amount of the second data processing unit and the resource occupation amount of the target monitoring data may include:

[0089] Determine a second initial sub-call frequency corresponding to the second sub-call link based on the second resource amount and the resource occupation amount of the target monitoring data;

[0090] In a case where the display loading frequency is greater than the second initial sub-call frequency, a second target sub-call frequency is determined based on the second initial sub-call frequency and the first target sub-call frequency.

[0091] In a specific embodiment, the value of the second target sub-call frequency may be a smaller value of the second initial sub-call frequency and the first target sub-call frequency.

[0092] In an optional embodiment, the above method may further include:

[0093] In a case where the display loading frequency is less than or equal to the second initial sub-call frequency, the display loading frequency is determined as the second target sub-call frequency, and the display loading frequency is determined as the first target sub-call frequency.

[0094] In a specific embodiment, when the display loading of the terminal cannot support the second data processing unit to obtain and update data at the current calling frequency, a smaller display loading frequency is used as the data calling frequency corresponding to the first data processing unit and the second data processing unit respectively.

[0095] Optionally, the determining, based on the second target resource amount and the resource occupation amount of the target monitoring data, the second initial sub-call frequency corresponding to the second sub-call link may include:

[0096] Dividing the second target resource amount by the resource occupation amount of the target monitoring data to obtain second resource occupation information;

[0097] In a case where the second resource occupancy information is greater than or equal to a second preset occupancy threshold, determining a third preset calling frequency as the second initial sub-calling frequency;

[0098] When the second resource occupancy information is less than the second preset occupancy threshold, a fourth preset calling frequency is determined as the second initial sub-calling frequency.

[0099] In a specific embodiment, the second resource occupancy information may be the second resource amount / the resource occupancy amount of the target monitoring data, and the second resource occupancy information may be used to characterize whether the available resource amount corresponding to the second data processing unit is sufficient based on the resource amount required to be occupied by the target monitoring data. Specifically, the second resource occupancy information being greater than or equal to the second preset occupancy threshold may be used to characterize that the available resource amount corresponding to the second data processing unit is sufficient, and the second resource occupancy information being less than the second preset occupancy threshold may be used to characterize that the available resource amount corresponding to the second data processing unit is insufficient.

[0100] Specifically, the second preset occupancy threshold, the third preset call frequency, and the fourth preset call frequency can be set according to actual application requirements, and the third preset call frequency is greater than the fourth preset call frequency. When the available storage space corresponding to the second data processing unit is sufficient, the frequency of the second data processing unit collecting data from the first data processing unit can be increased, and when the available storage space corresponding to the second data processing unit is insufficient, the frequency of the second data processing unit collecting data from the first data processing unit can be reduced.

[0101] Specifically, the specific steps for determining the second initial sub-call frequency may refer to the detailed steps for determining the first initial sub-call frequency, which will not be described in detail here.

[0102] S205: Based on the display loading duration, determine the display loading frequency of the monitoring indicator corresponding to the target monitoring data displayed on the terminal.

[0103] In a specific embodiment, the display loading frequency can be the reciprocal of the display loading time. Specifically, the display loading frequency can be the reciprocal of the upper limit display loading time, and the upper limit display loading time is the maximum loading time required for the terminal to render the display component corresponding to the monitoring indicator.

[0104] S207: Determine a second initial call frequency corresponding to the second call link based on the first target call frequency and the display loading frequency.

[0105] In a specific embodiment, the value of the second initial call frequency can be the value of the smaller call frequency between the above-mentioned first target call frequency and the display loading frequency. Specifically, the value of the second initial call frequency can be the value of the smaller call frequency between the above-mentioned second target sub-call frequency and the display loading frequency.

[0106] S209: Based on the user category information and / or the indicator category information, the second initial call frequency is adjusted to obtain a second target call frequency corresponding to the second call link, so that the terminal obtains target monitoring data from the server based on the second call link.

[0107] In a specific embodiment, the terminal may obtain target monitoring data from the second data processing unit at a second target calling frequency based on the second calling link.

[0108] In an optional embodiment, if Figure 4 As shown, the second initial call frequency is adjusted based on the user category information and / or the indicator category information to obtain the second target call frequency corresponding to the second call link, which may include:

[0109] S401: Determine a first frequency adjustment coefficient based on user category information.

[0110] In a specific embodiment, the first frequency adjustment coefficient can be used to characterize the importance of the user of the terminal. The larger the first frequency adjustment coefficient is, the more important the access user of the terminal is. For example, the user category information may include advanced, intermediate and elementary; accordingly, when the user category information is advanced, the first frequency adjustment coefficient may be 1, when the user category information is intermediate, the value range of the first frequency adjustment coefficient may be (0.5, 1), and when the user category information is elementary, the value range of the first frequency adjustment coefficient may be (0.1, 0.5).

[0111] S403: Determine a second frequency adjustment coefficient based on the indicator category information.

[0112] In a specific embodiment, the second frequency adjustment coefficient can be used to characterize the importance of the monitoring indicator corresponding to the target monitoring data. The larger the second frequency adjustment coefficient, the higher the importance of the monitoring indicator. For example, the indicator category information may include advanced, intermediate and elementary; accordingly, when the indicator category information is advanced, the second frequency adjustment coefficient may be 1, when the indicator category information is intermediate, the value range of the second frequency adjustment coefficient may be (0.5, 1), and when the indicator category information is elementary, the value range of the second frequency adjustment coefficient may be (0.1, 0.5).

[0113] S405: Based on the first frequency adjustment coefficient and / or the second frequency adjustment coefficient, adjust the second initial calling frequency to obtain a second target calling frequency.

[0114] In a specific embodiment, the first frequency adjustment coefficient and / or the second frequency adjustment coefficient may be multiplied by the second initial calling frequency to obtain the second target calling frequency.

[0115] It can be seen from the technical solutions provided in the above embodiments of this specification that the resource amount corresponding to the server, the resource occupancy of the monitoring data, the display loading time of the monitoring indicator corresponding to the target monitoring data, the user category information and the indicator category information are obtained in this specification; wherein the monitoring data includes initial monitoring data and target monitoring data, the server is used to obtain the initial monitoring data from the monitored system and process it to obtain the target monitoring data, and the display loading time is the loading time of the monitoring indicator corresponding to the target monitoring data displayed by the terminal; further, based on the resource amount corresponding to the server and the resource occupancy of the monitoring data, the first target call frequency corresponding to the first call link is determined, so that the server obtains the initial monitoring data at the first target call frequency based on the first call link; thereafter, based on the display loading time, the display loading frequency of the monitoring indicator corresponding to the target monitoring data displayed by the terminal is determined, and based on the first target call frequency and the display loading frequency, the second initial call frequency corresponding to the second call link is determined; further, based on the user category information and / or the indicator category information, the second initial call frequency is adjusted to obtain the second target call frequency corresponding to the second call link, so that the terminal obtains the target monitoring data from the server based on the second call link. Therefore, on the basis of meeting the monitoring needs of the monitored system, the frequency of data calls in multiple links of the data processing process is adjusted accordingly according to the available storage space, the order of calls in the data call link, the terminal display loading time, the importance of the terminal access user, and the importance of the monitored indicators, thereby alleviating the pressure on monitoring performance.

[0116] The embodiment of the present invention also provides a data processing device, such as Figure 5 As shown, the device comprises:

[0117] The acquisition module 510 is used to acquire the resource amount corresponding to the server, the resource occupation amount of the monitoring data, the display loading time of the monitoring indicator corresponding to the target monitoring data, the user category information and the indicator category information; the monitoring data includes the initial monitoring data and the target monitoring data, the server is used to obtain the initial monitoring data from the monitored system and process it to obtain the target monitoring data, and the display loading time is the loading time of the monitoring indicator corresponding to the target monitoring data displayed by the terminal;

[0118] A first target call frequency determination module 520, configured to determine a first target call frequency corresponding to a first call link based on the amount of resources corresponding to the server and the amount of resources occupied by the monitoring data, so that the server acquires the initial monitoring data at the first target call frequency based on the first call link;

[0119] A display loading frequency determination module 530, configured to determine, based on the display loading duration, a display loading frequency at which the terminal displays the monitoring indicator corresponding to the target monitoring data;

[0120] A second initial call frequency determination module 540, configured to determine a second initial call frequency corresponding to a second call link based on the first target call frequency and the display loading frequency;

[0121] The second target call frequency determination module 550 is used to adjust the second initial call frequency based on the user category information and / or the indicator category information to obtain the second target call frequency corresponding to the second call link, so that the terminal obtains the target monitoring data from the server based on the second call link.

[0122] Optionally, the server includes a first data processing unit and a second data processing unit, the first call link includes a first sub-call link and a second sub-call link, the first target call frequency includes a first target sub-call frequency and a second target sub-call frequency, the monitoring data also includes updated monitoring data, and the first target call frequency determination module 520 includes:

[0123] a first target sub-call frequency determination unit, configured to determine the first target sub-call frequency corresponding to the first sub-call link based on the first resource amount of the first data processing unit, the resource occupation amount of the initial monitoring data, and the resource occupation amount of the updated monitoring data; the first data processing unit is configured to obtain the initial monitoring data from the monitored system at the first target sub-call frequency, and to process the initial monitoring data to obtain the updated monitoring data;

[0124] The second target sub-call frequency determination unit is used to determine the second target sub-call frequency corresponding to the second sub-call link based on the second resource amount of the second data processing unit and the resource occupancy of the target monitoring data; the second data processing unit is used to obtain the updated monitoring data from the first data processing unit at the second target sub-call frequency, and process the updated monitoring data to obtain the target monitoring data.

[0125] Optionally, the first target sub-call frequency determination unit includes:

[0126] An acquisition unit, configured to acquire an upper limit calling frequency of the initial monitoring data corresponding to the monitored system;

[0127] A first initial sub-call frequency determining unit, configured to determine a first initial sub-call frequency corresponding to the first sub-call link based on the first resource amount, the resource occupancy amount of the initial monitoring data, and the resource occupancy amount of the updated monitoring data;

[0128] The third target sub-call frequency determination unit is configured to determine the first target sub-call frequency based on the upper limit call frequency and the first initial sub-call frequency.

[0129] Optionally, the first initial subcall frequency determining unit includes:

[0130] A first resource occupancy information determining unit, configured to divide the first resource amount by an initial resource occupancy amount to obtain first resource occupancy information; the initial resource occupancy amount is the sum of the resource occupancy amount of the initial monitoring data and the resource occupancy amount of the updated monitoring data;

[0131] a second initial sub-call frequency determining unit, configured to determine a first preset call frequency as the first initial sub-call frequency when the first resource occupancy information is greater than or equal to a first preset occupancy threshold;

[0132] The third initial sub-call frequency determining unit is configured to determine a second preset call frequency as the first initial sub-call frequency when the first resource occupancy information is less than the first preset occupancy threshold.

[0133] Optionally, the second target sub-call frequency determining unit includes:

[0134] a fourth initial sub-call frequency determining unit, configured to determine a second initial sub-call frequency corresponding to the second sub-call link based on the second resource amount and the resource occupation amount of the target monitoring data;

[0135] The fourth target sub-call frequency determining unit is configured to determine the second target sub-call frequency based on the second initial sub-call frequency and the first target sub-call frequency when the display loading frequency is greater than the second initial sub-call frequency.

[0136] Optionally, the device further comprises:

[0137] The target sub-call frequency determination module is used to determine the display loading frequency as the second target sub-call frequency when the display loading frequency is less than or equal to the second initial sub-call frequency, and to determine the display loading frequency as the first target sub-call frequency.

[0138] Optionally, the second target call frequency determination module 550 includes:

[0139] a first frequency adjustment coefficient determining unit, configured to determine a first frequency adjustment coefficient based on the user category information;

[0140] A second frequency adjustment coefficient determining unit, configured to determine a second frequency adjustment coefficient based on the indicator category information;

[0141] The second target calling frequency determining unit is used to adjust the second initial calling frequency based on the first frequency adjustment coefficient and / or the second frequency adjustment coefficient to obtain the second target calling frequency.

[0142] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0143] Figure 6 is a block diagram of a terminal electronic device for data processing according to an exemplary embodiment. The electronic device may be a terminal, and its internal structure diagram may be as shown in FIG. Figure 6 As shown. The electronic device includes a processor, a memory, a network interface, a display screen and an input device connected via a system bus. Among them, the processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the electronic device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, a data processing method is implemented. The display screen of the electronic device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic device can be a touch layer covering the display screen, or a key, trackball or touchpad provided on the housing of the electronic device, or an external keyboard, touchpad or mouse, etc.

[0144] Figure 7 is a block diagram of a server electronic device for data processing according to an exemplary embodiment. The electronic device may be a server, and its internal structure diagram may be as shown in FIG. Figure 7 As shown. The electronic device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the electronic device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a data processing method is implemented.

[0145] Those skilled in the art will understand that Figure 6 or Figure 7The structure shown in the figure is merely a block diagram of a partial structure related to the disclosed solution of the present invention, and does not constitute a limitation on the electronic device to which the disclosed solution of the present invention is applied. The specific electronic device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0146] In an exemplary embodiment, an electronic device for data processing is also provided, including a processor and a memory, wherein at least one instruction is stored in the memory, and the at least one instruction is loaded and executed by the processor to implement the data processing method in the embodiment disclosed in the present invention.

[0147] In an exemplary embodiment, a computer-readable storage medium is also provided, in which at least one instruction is stored. The at least one instruction is loaded and executed by a processor to implement the data processing method in the disclosed embodiment of the present invention.

[0148] In an exemplary embodiment, a computer program product containing instructions is also provided. When the computer program product is run on a computer, the computer is enabled to execute the data processing method in the disclosed embodiment of the present invention.

[0149] Those of ordinary skill in the art will appreciate that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided by the present invention may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate (DDR), and the like.

[0150] SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct RAM bus dynamic RAM (DRDRAM), and RAM bus dynamic RAM (RDRAM), etc.

[0151] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present invention is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0152] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A data processing method, characterized in that: The method comprises: Obtain the resource amount corresponding to the server, the resource usage of the monitoring data, the display loading time of the monitoring indicator corresponding to the target monitoring data, the user category information and the indicator category information; the monitoring data includes the initial monitoring data and the target monitoring data, the server is used to obtain the initial monitoring data from the monitored system and process it to obtain the target monitoring data, and the display loading time is the loading time of the monitoring indicator corresponding to the target monitoring data displayed by the terminal; Determine, based on the amount of resources corresponding to the server and the amount of resources occupied by the monitoring data, a first target call frequency corresponding to the first call link, so that the server acquires the initial monitoring data at the first target call frequency based on the first call link; Based on the display loading duration, determining a display loading frequency at which the terminal displays the monitoring indicator corresponding to the target monitoring data; Determining a second initial call frequency corresponding to a second call link based on the first target call frequency and the display loading frequency; Based on the user category information and / or the indicator category information, the second initial call frequency is adjusted to obtain a second target call frequency corresponding to the second call link, so that the terminal obtains the target monitoring data from the server based on the second call link.

2. The method according to claim 1, characterized in that The server includes a first data processing unit and a second data processing unit, the first call link includes a first sub-call link and a second sub-call link, the first target call frequency includes a first target sub-call frequency and a second target sub-call frequency, the monitoring data also includes updated monitoring data, and determining the first target call frequency corresponding to the first call link based on the amount of resources corresponding to the server and the amount of resources occupied by the monitoring data includes: Determine the first target sub-call frequency corresponding to the first sub-call link based on the first resource amount of the first data processing unit, the resource occupation amount of the initial monitoring data, and the resource occupation amount of the updated monitoring data; the first data processing unit is used to obtain the initial monitoring data from the monitored system at the first target sub-call frequency, and process the initial monitoring data to obtain the updated monitoring data; Based on the second resource amount of the second data processing unit and the resource occupancy of the target monitoring data, the second target sub-call frequency corresponding to the second sub-call link is determined; the second data processing unit is used to obtain the updated monitoring data from the first data processing unit at the second target sub-call frequency, and process the updated monitoring data to obtain the target monitoring data.

3. The method according to claim 2, characterized in that The determining, based on the first resource amount of the first data processing unit, the resource occupation amount of the initial monitoring data, and the resource occupation amount of the updated monitoring data, the first target sub-call frequency corresponding to the first sub-call link comprises: Obtaining an upper limit calling frequency of the initial monitoring data corresponding to the monitored system; Determining a first initial sub-call frequency corresponding to the first sub-call link based on the first resource amount, the resource occupation amount of the initial monitoring data, and the resource occupation amount of the updated monitoring data; The first target sub-call frequency is determined based on the upper limit call frequency and the first initial sub-call frequency.

4. The method according to claim 3, characterized in that The determining, based on the first resource amount, the resource occupation amount of the initial monitoring data, and the resource occupation amount of the updated monitoring data, of a first initial sub-call frequency corresponding to the first sub-call link includes: Dividing the first resource amount by the initial resource occupancy amount to obtain first resource occupancy information; the initial resource occupancy amount is the sum of the resource occupancy amount of the initial monitoring data and the resource occupancy amount of the updated monitoring data; In a case where the first resource occupancy information is greater than or equal to a first preset occupancy threshold, determining a first preset calling frequency as the first initial sub-calling frequency; When the first resource occupancy information is less than the first preset occupancy threshold, a second preset calling frequency is determined as the first initial sub-calling frequency.

5. The method according to claim 2, characterized in that: The determining, based on the second resource amount of the second data processing unit and the resource occupation amount of the target monitoring data, the second target sub-call frequency corresponding to the second sub-call link comprises: Determining a second initial sub-call frequency corresponding to the second sub-call link based on the second resource amount and the resource occupation amount of the target monitoring data; In a case where the display loading frequency is greater than the second initial sub-call frequency, the second target sub-call frequency is determined based on the second initial sub-call frequency and the first target sub-call frequency.

6. The method according to claim 5, characterized in that The method further comprises: In a case where the display loading frequency is less than or equal to the second initial sub-call frequency, the display loading frequency is determined as the second target sub-call frequency, and the display loading frequency is determined as the first target sub-call frequency.

7. The method according to claim 1, characterized in that The adjusting the second initial call frequency based on the user category information and / or the indicator category information to obtain the second target call frequency corresponding to the second call link includes: Based on the user category information, determining a first frequency adjustment coefficient; Based on the indicator category information, determining a second frequency adjustment coefficient; Based on the first frequency adjustment coefficient and / or the second frequency adjustment coefficient, the second initial calling frequency is adjusted to obtain the second target calling frequency.

8. A data processing device, characterized in that: The device comprises: An acquisition module is used to acquire the resource amount corresponding to the server, the resource usage of the monitoring data, the display loading time of the monitoring indicator corresponding to the target monitoring data, user category information and indicator category information; the monitoring data includes initial monitoring data and the target monitoring data, the server is used to acquire the initial monitoring data from the monitored system and process it to obtain the target monitoring data, and the display loading time is the loading time of the monitoring indicator corresponding to the target monitoring data displayed by the terminal; A first target call frequency determination module, configured to determine a first target call frequency corresponding to a first call link based on the amount of resources corresponding to the server and the amount of resources occupied by the monitoring data, so that the server acquires the initial monitoring data at the first target call frequency based on the first call link; A display loading frequency determination module, used to determine the display loading frequency of the monitoring indicator corresponding to the target monitoring data displayed by the terminal based on the display loading duration; A second initial call frequency determination module, configured to determine a second initial call frequency corresponding to a second call link based on the first target call frequency and the display loading frequency; A second target call frequency determination module is used to adjust the second initial call frequency based on the user category information and / or the indicator category information to obtain the second target call frequency corresponding to the second call link, so that the terminal obtains the target monitoring data from the server based on the second call link.

9. An electronic device for data processing, characterized in that: The electronic device comprises a processor and a memory, wherein the memory stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the data processing method according to any one of claims 1 to 7.

10. A computer storage medium, characterized in that: The computer storage medium stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the data processing method according to any one of claims 1 to 7.

Images