Collection component management method and system

Abstract

The embodiment of the present application provides a collection component management method, the method comprising: obtaining a collection component list, the collection component list including multiple collection component information of multiple collection components, each collection component information including one or more dimension information of the corresponding collection component; determining multiple collection components to be selected from the collection component list according to preset dimensions; selecting multiple collection components to be upgraded from the multiple collection components to be selected according to a preset release ratio; and upgrading the multiple collection components to be upgraded to obtain multiple upgraded collection components. The technical solution provided by the embodiment of the present application can manage multiple collection components through the collection component list, and select multiple collection components to be upgraded from the multiple collection component information according to the dimension information and the release ratio for grayscale upgrade, thereby improving the collection component management capability and upgrade efficiency.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, and in particular, to a collection component management method, system, device, and computer-readable storage medium. Background Art

[0002] With the rapid development of computer technology and network technology, user data has also grown rapidly. In order to process massive user data, it is necessary to deploy a server cluster consisting of a large number of servers. Each server is deployed with a data acquisition component for data acquisition, parsing and sending. At present, each acquisition component in the server is deployed as an independent individual, and after the deployment is completed, there is no effective management method for the running status and subsequent upgrades of the acquisition component. Therefore, how to solve the management problem of a large number of acquisition components in a server cluster and improve the upgrade efficiency of the acquisition components has become one of the technical problems to be solved at present. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide a collection component management method, system, computer device and computer-readable storage medium, which are used to solve the technical problems of managing a large number of collection components and low efficiency in upgrading the collection components.

[0004] One aspect of an embodiment of the present application provides a collection component management method, comprising: obtaining a collection component list, the collection component list including multiple collection component information of multiple collection components, each collection component information including one or more dimension information of the corresponding collection component; determining multiple collection components to be selected from the collection component list according to preset dimensions; selecting multiple collection components to be upgraded from the multiple collection components to be selected according to a preset release ratio; and upgrading the multiple collection components to be upgraded to obtain multiple upgraded collection components.

[0005] Optionally, it also includes: generating the collection component list according to the collection component information of the registration center, and the registration center is used for collection component registration and collection component information storage.

[0006] Optionally, the method further includes: acquiring acquisition component information corresponding to the multiple upgraded acquisition components; and updating the acquisition component information corresponding to each upgraded acquisition component to the acquisition component list.

[0007] Optionally, the method further includes: performing a survival anomaly detection on each collection component to determine whether there is an abnormal collection component; and if there is an abnormal collection component, generating corresponding abnormal alarm information according to the abnormal collection component.

[0008] Optionally, the performing of survival anomaly detection on each collection component to determine whether there is an abnormal collection component includes: the performing of survival anomaly detection on each collection component to determine whether there is an abnormal collection component includes: obtaining the process startup time, the corresponding operating system startup time and the corresponding collection file deployment time of each collection component; judging whether the first time interval between the process startup time of each collection component and the corresponding operating system startup time is greater than a first preset threshold, to obtain a first judgment result; judging whether the second time interval between the process startup time of each collection component and the corresponding collection file deployment is greater than a second preset threshold, to obtain a second judgment result; and determining the collection component with survival anomaly based on the first judgment result and / or the second judgment result, wherein the first judgment result is that the first time interval is greater than the first preset threshold, and the second judgment result is that the second time interval is greater than the second preset threshold.

[0009] Optionally, it also includes: monitoring the operation process of each acquisition component; if it is monitored that an operation error occurs in one of the acquisition components during the operation process, determining the error code corresponding to this acquisition component according to the operation error; and reporting the error code to the monitoring system, so that the monitoring system performs an alarm operation according to the error code.

[0010] Optionally, the method further includes the steps of pre-configuring multiple error codes: pre-acquiring multiple operating errors that occur during the operation of the multiple acquisition components; classifying the multiple operating errors to obtain multiple error classifications; and configuring a corresponding error code for each error classification to obtain the multiple error codes.

[0011] One aspect of an embodiment of the present application provides a collection component management system, including: an acquisition module, used to acquire a collection component list, the collection component list including multiple collection component information of multiple collection components, each collection component information including one or more dimension information of the corresponding collection component; a determination module, used to determine multiple collection components to be selected from the collection component list according to preset dimensions; a selection module, used to select multiple collection components to be upgraded from the multiple collection components to be selected according to a preset release ratio; and an upgrade module, used to upgrade the multiple collection components to be upgraded to obtain multiple upgraded collection components.

[0012] One aspect of an embodiment of the present application provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor is used to implement the steps of the above-mentioned acquisition component management method when executing the computer program.

[0013] One aspect of an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. The computer program can be executed by at least one processor to enable the at least one processor to perform the steps of the acquisition component management method as described above.

[0014] The collection component management method, system, device and computer-readable storage medium provided in the embodiments of the present application manage multiple collection components through a collection component list, and select multiple collection components to be upgraded from multiple collection component information for grayscale upgrade based on dimension information and release ratio, thereby improving the collection component management capability and upgrade efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 A schematic diagram of an environmental application according to an embodiment of the present application is schematically shown;

[0016] Figure 2 The flowchart of the acquisition component management method according to the first embodiment of the present application is schematically shown;

[0017] Figure 3 The flowchart of the acquisition component management method according to the second embodiment of the present application is schematically shown;

[0018] Figure 4 Another flow chart of the acquisition component management method according to the second embodiment of the present application is schematically shown;

[0019] Figure 5 Another flow chart of the acquisition component management method according to the second embodiment of the present application is schematically shown;

[0020] Figure 6 Another flow chart of the acquisition component management method according to the second embodiment of the present application is schematically shown;

[0021] Figure 7 Another flow chart of the acquisition component management method according to the second embodiment of the present application is schematically shown;

[0022] Figure 8 The overall flow chart of the acquisition component management method according to the second embodiment of the present application is schematically shown;

[0023] Fig. 9 A block diagram schematically shows a collection component management system according to Embodiment 3 of the present application; and

[0024] Fig.10 The schematic diagram shows a hardware architecture of a computer device suitable for implementing the acquisition component management method according to the fourth embodiment of the present application. DETAILED DESCRIPTION

[0025] In order to make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the embodiments of the present application are further described in detail in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the embodiments of the present application and are not intended to limit the embodiments of the present application. Based on the embodiments in the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the embodiments of the present application.

[0026] It should be noted that the descriptions of "first", "second", etc. in the present invention are only used for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0027] The following are some explanations of terms involved in this application:

[0028] Collection component: runs as an independent process in the server and is used to collect, parse and send data on this server, such as Agent.

[0029] Collection component management: management of the running status of collection component nodes, including version management, grayscale release, collection component survival and error monitoring, etc.

[0030] Grayscale upgrade: that is, partial upgrade, which can minimize the consequences caused by program bugs after the upgrade.

[0031] Figure 1 The environment diagram of the acquisition component management method according to the present application is schematically shown. The environment diagram includes a computer device 20 and multiple servers 40.

[0032] The computer device 20 is used to manage the collection components in the server 40, for example: (1) management of the collection component list, real-time knowledge of which servers are deployed with the collection components and the collection component versions; (2) collection component upgrades (such as grayscale upgrades); (3) collection component running status management: whether errors occur during the collection component operation and whether the process is alive. The computer device 20 can be a single server or a server cluster.

[0033] The server 40 is used to install one or more collection components, and is used to collect and process user data through the one or more collection components.

[0034] Computer device 20 and server 40 may establish a network connection via network 60. Computer device 20 may be located in a data center such as a single location, or distributed in different physical locations (e.g., in multiple locations). Network 60 includes various network devices, such as routers, switches, multiplexers, hubs, modems, bridges, repeaters, firewalls, proxy devices, and / or the like. Network 60 may include physical links, such as coaxial cable links, twisted pair cable links, fiber optic links, combinations thereof, and the like. Network 60 may include wireless links, such as cellular links, satellite links, Wi-Fi links, and the like.

[0035] The management function of the computer device 20 will be described below through several embodiments.

[0036] Embodiment 1

[0037] Figure 2 The flowchart of the acquisition component management method according to the first embodiment of the present application is schematically shown. This embodiment can be executed in the computer device 20. It can be understood that the flowchart in the embodiment of the method is not used to limit the order of executing the steps.

[0038] like Figure 2 As shown, the acquisition component management method may include steps S200 to S204, wherein:

[0039] Step S200, obtaining a collection component list, wherein the collection component list includes multiple collection component information of multiple collection components, and each collection component information includes one or more dimension information of the corresponding collection component.

[0040] The computer device 20 can obtain the collection component list from the registration center. The registration center can receive multiple registration requests sent by multiple collection components. Each collection component (Agent) corresponds to a registration request, and each registration request carries corresponding collection component information. When the registration center receives the multiple registration requests, it can parse a corresponding collection component information from each registration request to obtain multiple collection component information, and can generate the collection component list based on the multiple collection component information. It should be understood that the registration center can be located in the computer device 20, or in other devices outside the computer device 20.

[0041] Each acquisition component information may include: IP address information, host name information, version information, and process number information of the physical machine (server 40) where the corresponding acquisition component is located. Each acquisition component information includes one or more dimension information of the corresponding acquisition component; taking IP address information as an example, each acquisition component corresponds to an IP address, that is, the IP address can be used as a dimension information.

[0042] Step S202: determining a plurality of collection components to be selected from the collection component list according to a preset dimension.

[0043] The preset dimension may be one or more dimensions. The one or more dimensions may be a dimension based on an IP address, a dimension based on a version number, a dimension based on a computer room, and / or a dimension based on other information. Taking the dimension based on an IP address as an example, the computer device 2 may predetermine an IP address segment and filter out all the collection components of the IP addresses belonging to the IP address segment from the collection component list.

[0044] Step S204: selecting a plurality of collection components to be upgraded from the plurality of collection components to be selected according to a preset release ratio.

[0045] After obtaining the plurality of collection components to be selected, the computer device 20 can select a plurality of collection components to be upgraded from the plurality of collection components to be selected according to the preset release ratio. The preset release ratio can be a preset fixed value, such as 0.1, 0.2, 0.3, etc., which is not limited in this embodiment. For example, when the number of collection components to be selected is N, the number of collection components to be upgraded is M, and the preset release ratio is 0.1, when the preset release ratio is 0.1, then M=0.1*N.

[0046] In some embodiments, the preset release ratio can also be dynamically adjusted according to the number of the collection components to be selected. For example, when the number of the collection components to be selected is greater than the preset value, the preset release ratio can be dynamically adjusted to 0.1, and when the number of the collection components to be selected is less than or equal to the preset value, the preset release ratio can be dynamically adjusted to 0.2.

[0047] It should be noted that N is a positive integer > 1, N > M > 1, and M is a positive integer.

[0048] Step S206: Upgrade the multiple acquisition components to be upgraded to obtain multiple upgraded acquisition components.

[0049] The computer device 20 can obtain the acquisition component information corresponding to the multiple upgraded acquisition components, so as to update the acquisition component information corresponding to each upgraded acquisition component to the acquisition component list, and delete the acquisition component information before the upgrade of each upgraded acquisition component. After a collection component is upgraded, the version information corresponding to the collection component will inevitably change; if the collection component information corresponding to the collection component in the collection component list is not updated after the collection component is upgraded, then the collection component may be repeatedly updated in the next update, increasing unnecessary resource consumption. Therefore, in order to avoid the problem of repeated updates, the computer device 20 can update the collection component information corresponding to the upgraded collection component to the collection component list after a collection component is upgraded.

[0050] In this embodiment, the computer device 20 implements the management capability of multiple collection components through the collection component list, and selects multiple collection components to be upgraded from multiple collection component information for grayscale upgrade according to dimension information and release ratio, thereby improving the management capability of collection components and upgrade efficiency.

[0051] Embodiment 2

[0052] Figure 3 The flowchart of the collection component management method according to the second embodiment of the present application is schematically shown.

[0053] like Figure 3 As shown, the acquisition component management method may include steps S300 to S312, wherein:

[0054] Step S300, generating the collection component list according to the collection component information of the registration center, wherein the registration center is used for collection component registration and collection component information storage.

[0055] The computer device 20 can generate the collection component list in advance according to the collection component information of the registration center. The collection component information includes IP address information, host name information, version information and process number information. The registration center can store the collection component information according to the collection component registration and collection component information.

[0056] After each server 40 starts a collection component, it can generate a corresponding registration request according to the collection component started by each server 40 to register with the registration center. The registration request can carry the collection component information corresponding to the collection component. The registration center manages the multiple collection components by generating the collection component list according to the multiple collection component information corresponding to the multiple collection components.

[0057] The registration center may receive multiple registration requests corresponding to multiple collection components. After receiving multiple registration requests, the registration center may parse each registration request to obtain the collection component information corresponding to each registration request, and generate the collection component list according to the obtained multiple collection component information. The registration center may also store the multiple collection component information in the collection component list so that the computer device 20 obtains the multiple collection component information corresponding to the multiple collection components from the collection component list.

[0058] In this embodiment, the collection component can register the collection component information into the collection component list when it is started, so as to manage the multiple collection components through the collection component list, thereby improving the management capability of the computer device 20 for the multiple collection components.

[0059] Step S302: Obtain a collection component list, wherein the collection component list includes multiple collection component information of multiple collection components, and each collection component information includes one or more dimension information of the corresponding collection component.

[0060] The computer device 20 may obtain the collection component list from the registration center, and obtain the collection component information of the multiple collection components from the collection component list.

[0061] Step S304: determining a plurality of collection components to be selected from the collection component list according to a preset dimension.

[0062] Step S306: selecting multiple collection components to be upgraded from the multiple collection components to be selected according to a preset release ratio.

[0063] Step S308: Upgrade the multiple acquisition components to be upgraded to obtain multiple upgraded acquisition components.

[0064] Step S310, obtaining acquisition component information corresponding to the multiple upgraded acquisition components.

[0065] Step S312: updating the acquisition component information corresponding to each upgraded acquisition component to the acquisition component list.

[0066] Updating the acquisition component information corresponding to each upgraded acquisition component to the acquisition component list can avoid the problem of repeated updates and improve the upgrade efficiency of the acquisition components.

[0067] like Figure 4As shown, the collection component management method may also include steps S400 to S402, wherein: step S400, performing survival anomaly detection on each collection component to determine whether there is an abnormal collection component; step S402, if there is an abnormal collection component, generating corresponding abnormal alarm information according to the abnormal collection component. The computer device 20 may detect whether there is an abnormality in the survival of the collection component. If there is an abnormality in the survival of the collection component, an alarm may be issued through the monitoring system, so that the collection component with abnormal problems can be processed in a timely manner, thereby improving the safety and work efficiency of the collection component.

[0068] like Figure 5 As shown, the step S400 may further include steps S500 to S508, wherein:

[0069] Step S500, obtaining the process startup time of each acquisition component, the corresponding operating system startup time and the corresponding acquisition file deployment time.

[0070] The computer device 20 can monitor multiple collection components and obtain the process startup time, the corresponding operating system startup time and the corresponding collection file deployment time of each collection component. The process startup time is the time when the process of the collection component is started; the operating system startup time is the startup time of the operating system corresponding to the collection component; the collection file deployment time is the generation time of the executable binary file corresponding to the collection component, wherein the collection file deployment time can be the last modification time of the executable binary file.

[0071] As a component for data collection, the collection component can execute corresponding data collection tasks after being started. It should be understood that when the operating system corresponding to the collection component is started, the collection component deployed in the operating system will start accordingly.

[0072] The inventors have found that the first time interval between the start of the operating system corresponding to the collection component and the start of the process of the collection component, and the time interval between the completion of the modification of the executable binary file of the collection component and the start of the process of the collection component, which do not pose a safety hazard, generally do not exceed a corresponding threshold. If the time interval between the start of the operating system corresponding to the collection component and the start of the process of the collection component exceeds the corresponding threshold, the collection component may be abnormal; if the time interval between the completion of the modification of the executable binary file of the collection component and the start of the process of the collection component exceeds the corresponding threshold, the collection component may be abnormal.

[0073] Step S502, determining whether a first time interval between the process startup time of each acquisition component and the corresponding operating system startup time is greater than a first preset threshold, and obtaining a first determination result;

[0074] In an exemplary embodiment, the computer device 20 may pre-set the first preset threshold, which may be obtained from the time interval between the startup of the operating system corresponding to the collection component without potential safety hazards and the startup of the process of the collection component.

[0075] After obtaining the process start time of each acquisition component and the corresponding operating system start time, the computer device 20 may determine whether a first time interval between the process start time of each acquisition component and the corresponding operating system start time is greater than a first preset threshold.

[0076] If the first time interval corresponding to one of the multiple collection components is not greater than the first preset threshold, it can be determined that the collection component does not have a survivability abnormality problem.

[0077] If the first time interval corresponding to one of the multiple collection components is greater than the first preset threshold, a corresponding first judgment result is generated, and it can be determined that the collection component may have a survivability anomaly problem, and for such a collection component that may have a survivability anomaly, the computer device 20 needs to perform further survivability anomaly detection to determine whether the collection component is really abnormal.

[0078] Step S504, determining whether a second time interval between the process start time of each acquisition component and the corresponding acquisition file deployment is greater than a second preset threshold, and obtaining a second determination result.

[0079] In an exemplary embodiment, the computer device 20 may pre-set the second preset threshold, which may be obtained from the time interval between the deployment time of the collection file corresponding to the collection component without potential safety hazards and the start of the process of the collection component.

[0080] When the executable binary file of the acquisition component is modified, the acquisition component will be restarted. If the time interval between the completion of the modification of the executable binary file of the acquisition component and the start of the process of the acquisition component exceeds the threshold, a corresponding second judgment result can be generated, and it can be determined that the acquisition component may be abnormal.

[0081] It should be noted that the second time interval between the acquisition file deployment time of the acquisition component and the process startup time of the acquisition component is greater than the second preset threshold, which may be caused by the excessively long generation time of the executable file corresponding to the acquisition component. Under normal circumstances, the second time interval will not be greater than the second preset threshold.

[0082] Step S506, determining the collection component with abnormal survivability according to the first judgment result and the second judgment result, wherein the first judgment result is that the first time interval is greater than the first preset threshold, and the second judgment result is that the second time interval is greater than the second preset threshold.

[0083] If the first time interval corresponding to a collection component is greater than the first preset threshold and the second time interval is greater than the second preset threshold, it can be determined that the collection component has a survivability abnormality problem. If it is determined that the survivability of the collection component has an abnormality problem, the computer device 20 can generate corresponding abnormal information according to the collection component and report the abnormal information to the monitoring system so that the monitoring system performs an alarm operation.

[0084] In this embodiment, the computer device 20 can determine which collection components may have security risks by detecting whether there are abnormalities in the survivability of each collection component, and process the collection components that may have security risks to improve the security and work efficiency of the collection components.

[0085] like Figure 6 As shown, the acquisition component management method may further include steps S600 to S604, wherein: step S600, monitoring the operation process of each acquisition component; step S602, if it is monitored that one of the acquisition components has an operation error during operation, then determining the error code corresponding to the acquisition component according to the operation error; and step S604, reporting the error code to the monitoring system so that the monitoring system performs an alarm operation according to the error code. The error code may be pre-configured to instruct the monitoring system to perform a corresponding alarm operation.

[0086] In some embodiments, the computer device 20 may also record the obtained operation error in a log file. For example, in the code implementation, the computer device 20 may perform an error code embedding at the location where the operation error occurs, and record the operation error information to the log file through the error log, wherein the operation error information includes the error code embedding information. This embodiment may also be responsible for a unified error code status summary according to the acquisition component error code library, and report the error code to the monitoring system for alarm.

[0087] The computer device 20 can monitor the operation process of the acquisition component, handle operation errors in a timely manner and issue an alarm, thereby improving safety and work efficiency.

[0088] like Figure 7 As shown, the acquisition component management method may also include steps S700 to S704 for pre-configuring multiple error codes, wherein: step S700, pre-acquiring multiple operating errors that occur during the operation of the multiple acquisition components; step S702, classifying the multiple operating errors to obtain multiple error classifications; and step S704, configuring a corresponding error code for each error classification to obtain the multiple error codes.

[0089] The computer device 20 may be pre-configured with a plurality of error codes so as to notify the corresponding monitoring system to perform corresponding alarm operations through the error codes.

[0090] For ease of understanding, Figure 8 As shown, this embodiment also provides an overall flow chart of embodiment 2. The specific steps are as follows.

[0091] Step S1, the server 40 starts the collection component;

[0092] Step S2, the server 40 obtains the collection component information of the collection component, and sends the collection component information to the registration center;

[0093] Step S3, the computer device 20 receives a plurality of acquisition component information, and generates a collection component list according to the plurality of acquisition component information;

[0094] Step S4, the computer device 20 obtains a collection component list;

[0095] Step S5, the computer device 20 determines a plurality of to-be-selected collection components from the collection component list according to the preset dimension information;

[0096] Step S6, the computer device 20 selects a plurality of acquisition components to be upgraded from the plurality of acquisition components to be selected according to a preset release ratio;

[0097] Step S7, the computer device 20 upgrades the multiple acquisition components to be upgraded to obtain multiple upgraded acquisition components;

[0098] Step S8, the computer device 20 obtains the acquisition component information corresponding to the multiple upgraded acquisition components;

[0099] Step S9, the computer device 20 obtains the acquisition component information corresponding to the multiple upgraded acquisition components;

[0100] Step S10, the computer device 20 detects the viability of the acquisition component;

[0101] Step S11, determining whether a first time interval between the process startup time of each acquisition component and the corresponding operating system startup time is greater than a first preset threshold, and obtaining a first determination result; and determining whether a second time interval between the process startup time of each acquisition component and the corresponding acquisition file deployment is greater than a second preset threshold, and obtaining a second determination result;

[0102] Step S12: if the first time interval is greater than the first preset threshold and the second time interval is greater than the second preset threshold, generating abnormal information;

[0103] Step S13, uploading the abnormal information to the monitoring system, so that the monitoring system performs an alarm operation according to the abnormal information or error code;

[0104] Step S14, the computer device 20 monitors the operation process of the acquisition component;

[0105] Step S15, determining whether the operation process of the acquisition component has an operation error;

[0106] Step S16, if an operation error occurs during the operation of the acquisition component, the error code is written into the log file and a corresponding error code is generated;

[0107] Step S17, uploading the error code to the monitoring system;

[0108] Step S18 is to enable the monitoring system to perform an alarm operation according to the abnormal information or error code.

[0109] Embodiment 3

[0110] Fig. 9 The block diagram of the collection component management system according to the third embodiment of the present application is schematically shown. The collection component management system can be divided into one or more program modules, one or more program modules are stored in a storage medium, and are executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module of this embodiment.

[0111] like Fig. 9 As shown, the acquisition component management system 200 may include an acquisition module 910, a determination module 920, a selection module 930, and an upgrade module 940, wherein:

[0112] The acquisition module 910 is used to acquire a collection component list, where the collection component list includes multiple collection component information of multiple collection components, and each collection component information includes one or more dimension information of the corresponding collection component.

[0113] The determination module 920 is used to determine a plurality of collection components to be selected from the collection component list according to a preset dimension.

[0114] The selection module 930 is used to select multiple collection components to be upgraded from the multiple collection components to be selected according to a preset release ratio.

[0115] The upgrading module 940 is used to upgrade the multiple acquisition components to be upgraded to obtain multiple upgraded acquisition components.

[0116] In an exemplary embodiment, the collection component management system 200 may further include a generation module, wherein the generation module is used to generate the collection component list according to the collection component information of a registration center, wherein the registration center is used for collection component registration and collection component information storage.

[0117] In an exemplary embodiment, the collection component management system 200 may further include an update module, which is used to: obtain the collection component information corresponding to the multiple upgraded collection components; and update the collection component information corresponding to each upgraded collection component to the collection component list.

[0118] In an exemplary embodiment, the collection component management system 200 may also include a detection module, which is used to: perform survival anomaly detection on each collection component to determine whether there is an abnormal collection component; and if there is an abnormal collection component, generate corresponding abnormal alarm information based on the abnormal collection component.

[0119] In an exemplary embodiment, the detection module is also used to: obtain the process startup time of each acquisition component, the corresponding operating system startup time and the corresponding acquisition file deployment time; determine whether the first time interval between the process startup time of each acquisition component and the corresponding operating system startup time is greater than a first preset threshold, to obtain a first judgment result; determine whether the second time interval between the process startup time of each acquisition component and the corresponding acquisition file deployment is greater than a second preset threshold, to obtain a second judgment result; and determine the acquisition component with abnormal survivability based on the first judgment result and / or the second judgment result, wherein the first judgment result is that the first time interval is greater than the first preset threshold, and the second judgment result is that the second time interval is greater than the second preset threshold.

[0120] In an exemplary embodiment, the collection component management system 200 may also include a monitoring module, which is used to: monitor the operation process of each collection component; if it is monitored that an operation error occurs in one of the collection components during the operation process, determine the error code corresponding to this collection component according to the operation error; and report the error code to the monitoring system so that the monitoring system performs an alarm operation according to the error code.

[0121] In an exemplary embodiment, the acquisition component management system 200 may also include a configuration module, which is used to: pre-acquire multiple operating errors that occur during the operation of the multiple acquisition components; classify the multiple operating errors to obtain multiple error classifications; and configure a corresponding error code for each error classification to obtain the multiple error codes.

[0122] Embodiment 4

[0123] Fig.10 The schematic diagram of the hardware architecture of a computer device suitable for implementing the acquisition component management method according to the fourth embodiment of the present application is shown. In this embodiment, the computer device 20 is a device that can automatically perform numerical calculations and / or information processing according to pre-set or stored instructions. For example, it can be a workstation, a rack server, a blade server, a tower server or a cabinet server (including an independent server, or a server cluster composed of multiple servers). Fig.10 As shown, the computer device 20 includes at least but is not limited to: a memory 1010, a processor 1020, and a network interface 1030 which can communicate with each other through a system bus. Among them:

[0124] The memory 1010 includes at least one type of computer-readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the memory 1010 can be an internal storage module of the computer device 20, such as a hard disk or memory of the computer device 20. In other embodiments, the memory 1010 can also be an external storage device of the computer device 20, such as a plug-in hard disk equipped on the computer device 20, a smart memory card (Smart Media Card, referred to as SMC), a secure digital (Secure Digital, referred to as SD) card, a flash card, etc. Of course, the memory 1010 can also include both the internal storage module of the computer device 20 and its external storage device. In this embodiment, the memory 1010 is generally used to store the operating system and various application software installed on the computer device 20, such as the program code of the acquisition component management method, etc. In addition, the memory 1010 can also be used to temporarily store various types of data that have been output or are to be output.

[0125] In some embodiments, the processor 1020 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chip. The processor 1020 is generally used to control the overall operation of the computer device 20, such as performing control and processing related to data interaction or communication with the computer device 20. In this embodiment, the processor 1020 is used to run the program code stored in the memory 1010 or process data.

[0126] The network interface 1030 may include a wireless network interface or a wired network interface, and the network interface 1030 is generally used to establish a communication link between the computer device 20 and other computer devices. For example, the network interface 1030 is used to connect the computer device 20 to an external terminal through a network, and to establish a data transmission channel and a communication link between the computer device 20 and the external terminal. The network may be a wireless or wired network such as an intranet, the Internet, the Global System of Mobile communication (GSM), Wideband Code Division Multiple Access (WCDMA), 4G network, 5G network, Bluetooth, Wi-Fi, etc.

[0127] It should be pointed out that Fig.10 Only a computer device having components 1010 - 1030 is shown, but it should be understood that implementing all of the components shown is not a requirement, and more or fewer components may alternatively be implemented.

[0128] In this embodiment, the acquisition component management method stored in the memory 1010 may also be divided into one or more program modules and executed by one or more processors (processor 1020 in this embodiment) to complete the present invention.

[0129] Embodiment 5

[0130] This embodiment further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the acquisition component management method in the embodiment are implemented.

[0131] In this embodiment, the computer-readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the computer-readable storage medium can be an internal storage unit of a computer device, such as a hard disk or memory of the computer device. In other embodiments, the computer-readable storage medium can also be an external storage device of a computer device, such as a plug-in hard disk equipped on the computer device, a smart memory card (Smart Media Card, referred to as SMC), a secure digital (Secure Digital, referred to as SD) card, a flash card, etc. Of course, the computer-readable storage medium can also include both the internal storage unit of the computer device and its external storage device. In this embodiment, the computer-readable storage medium is generally used to store the operating system and various application software installed on the computer device, such as the program code of the acquisition component management method in the embodiment. In addition, the computer-readable storage medium can also be used to temporarily store various types of data that have been output or are to be output.

[0132] Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of the present invention can be implemented by a general-purpose computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, and optionally, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order from that here, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. In this way, the embodiments of the present invention are not limited to any specific combination of hardware and software.

[0133] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A collection component management method, characterized in that: The method comprises: Acquire a collection component list, wherein the collection component list includes multiple collection component information of multiple collection components, and each collection component information includes one or more dimension information of the corresponding collection component; According to the preset dimension, determining a plurality of collection components to be selected from the collection component list; According to a preset release ratio, selecting a plurality of acquisition components to be upgraded from the plurality of acquisition components to be selected; and Upgrading the multiple acquisition components to be upgraded to obtain multiple upgraded acquisition components; Wherein, the method further comprises: Perform survivability anomaly detection on each collection component to determine whether there is an abnormal collection component; The process of performing a survival anomaly detection on each collection component to determine whether there is an abnormal collection component includes: Obtain the process startup time of each collection component, the corresponding operating system startup time, and the corresponding collection file deployment time; Determine whether a first time interval between a process startup time of each acquisition component and a corresponding operating system startup time is greater than a first preset threshold, and obtain a first determination result; Determine whether a second time interval between the process start time of each acquisition component and the corresponding acquisition file deployment is greater than a second preset threshold, and obtain a second determination result; and Determine the collection component with abnormal survivability according to the first judgment result and / or the second judgment result, wherein the first judgment result is that the first time interval is greater than the first preset threshold, and the second judgment result is that the second time interval is greater than the second preset threshold.

2. The acquisition component management method according to claim 1, characterized in that: Also includes: The collection component list is generated according to the collection component information of the registration center, and the registration center is used for collection component registration and collection component information storage.

3. The acquisition component management method according to claim 1, characterized in that: Also includes: Acquire acquisition component information corresponding to the multiple upgraded acquisition components; and The acquisition component information corresponding to each upgraded acquisition component is updated to the acquisition component list.

4. The acquisition component management method according to claim 1, characterized in that: Also includes: If there is the abnormal collection component, corresponding abnormal alarm information is generated according to the abnormal collection component.

5. The acquisition component management method according to any one of claims 1 to 4, characterized in that: Also includes: Monitor the operation process of each acquisition component; If it is monitored that one of the acquisition components has an operation error during operation, then the error code corresponding to the acquisition component is determined according to the operation error; and The error code is reported to the monitoring system so that the monitoring system performs an alarm operation according to the error code.

6. The acquisition component management method according to claim 5, characterized in that: It also includes steps for pre-configuring multiple error codes: Pre-acquire multiple running errors that occur during the running of the multiple acquisition components; Classifying the plurality of operating errors to obtain a plurality of error classifications; and A corresponding error code is configured for each error category to obtain the multiple error codes.

7. A collection component management system, characterized in that: include: An acquisition module, used to acquire a collection component list, wherein the collection component list includes multiple collection component information of multiple collection components, and each collection component information includes one or more dimension information of the corresponding collection component; A determination module, used to determine a plurality of to-be-selected acquisition components from the acquisition component list according to a preset dimension; A selection module, configured to select a plurality of acquisition components to be upgraded from the plurality of acquisition components to be selected according to a preset release ratio; and An upgrading module, used for upgrading the plurality of acquisition components to be upgraded to obtain a plurality of upgraded acquisition components; Wherein, the system further comprises: Perform survivability anomaly detection on each collection component to determine whether there is an abnormal collection component; The process of performing a survival anomaly detection on each collection component to determine whether there is an abnormal collection component includes: Obtain the process startup time of each collection component, the corresponding operating system startup time, and the corresponding collection file deployment time; Determine whether a first time interval between a process startup time of each acquisition component and a corresponding operating system startup time is greater than a first preset threshold, and obtain a first determination result; Determine whether a second time interval between the process start time of each acquisition component and the corresponding acquisition file deployment is greater than a second preset threshold, and obtain a second determination result; and Determine the collection component with abnormal survivability according to the first judgment result and / or the second judgment result, wherein the first judgment result is that the first time interval is greater than the first preset threshold, and the second judgment result is that the second time interval is greater than the second preset threshold.

8. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, it is used to implement the steps of the acquisition component management method described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program can be executed by at least one processor to enable the at least one processor to perform the steps of the acquisition component management method according to any one of claims 1 to 6.

Images