An information collection control method, device, equipment and storage medium

Abstract

Embodiments of the present application disclose an information collection control method, device and equipment and a storage medium. The method comprises: detecting whether a collection node and a cache instance in an information collection scene change, the information collection scene comprising a collection cluster and a cache cluster, the collection cluster being used for deploying the collection node, the cache cluster being used for deploying the cache instance, and each collection node being used for collecting information of an allocated cache instance; determining a target allocation strategy based on a current detection result, the target allocation strategy comprising at least one of a polling allocation strategy, a computer room nearest allocation strategy, an average allocation strategy and a suspension allocation strategy; and updating an allocation relationship between the collection node and the cache instance in the information collection scene based on the target allocation strategy, so that the collection node collects information based on the updated target allocation relationship. Through the technical solution of the embodiments of the present application, automatic load balancing of information collection can be realized, high availability can be ensured, and information collection efficiency can be improved.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the Internet technology, and in particular, to an information collection control method, device, equipment and storage medium. BACKGROUND

[0002] With the rapid development of Internet technology, the performance of a business system can be improved by deploying a large number of cache instances in a cache cluster. In order to ensure the high performance and stability of the business system, the information of the cache instances needs to be collected by a collection node.

[0003] At present, the collection is usually allocated based on the IP address range of the cache instance, that is, each collection node is responsible for collecting the information of the cache instances in a certain IP address range.

[0004] However, in the process of implementing the present application, the inventors found that at least the following problems exist in the prior art:

[0005] The allocation relationship between the cache instances and the collection nodes is fixed and unchangeable, so that when the cache instances or the collection nodes change, the collection information may be lost, for example, when a collection node fails, the information of the cache instances responsible for collection by the collection node cannot be obtained, resulting in a loss of collection information and reducing the availability. Moreover, since the number of cache instances in different IP address ranges may be uneven, allocation and collection according to the IP address range will also result in uneven allocation and cross-machine room access, greatly reducing the information collection efficiency. SUMMARY

[0006] Embodiments of the present application provide an information collection control method, device, equipment and storage medium to realize automatic load balancing of information collection, ensure high availability and improve information collection efficiency.

[0007] In a first aspect, embodiments of the present application provide an information collection control method, comprising:

[0008] detecting whether the collection nodes and the cache instances in an information collection scenario change, wherein the information collection scenario includes a collection cluster and a cache cluster, the collection cluster is used to deploy collection nodes, and the cache cluster is used to deploy cache instances, each collection node is used to collect the information of the allocated cache instances;

[0009] determining a target allocation strategy based on the current detection result, wherein the target allocation strategy includes at least one of a round robin allocation strategy, a machine room nearest allocation strategy, an average allocation strategy and a suspension allocation strategy;

[0010] Based on the target allocation strategy, an allocation relationship between the collection node and the cache instance in the information collection scene is updated, so that the collection node collects information based on the updated target allocation relationship.

[0011] In a second aspect, an embodiment of the present application further provides an information collection control device, comprising:

[0012] An information detection module is configured to detect whether a collection node and a cache instance in an information collection scene change, wherein the information collection scene comprises a collection cluster and a cache cluster, the collection cluster is configured to deploy the collection node, and the cache cluster is configured to deploy the cache instance, and each collection node is configured to collect information of an allocated cache instance.

[0013] A target allocation strategy determination module is configured to determine a target allocation strategy based on a current detection result, wherein the target allocation strategy comprises at least one of a polling allocation strategy, a computer room nearest allocation strategy, an average allocation strategy and a suspension allocation strategy.

[0014] An allocation relationship updating module is configured to update an allocation relationship between the collection node and the cache instance in the information collection scene based on the target allocation strategy, so that the collection node collects information based on the updated target allocation relationship.

[0015] In a third aspect, an embodiment of the present application further provides an electronic device, comprising:

[0016] One or more processors;

[0017] A memory is configured to store one or more programs;

[0018] When the one or more programs are executed by the one or more processors, the one or more processors implement the information collection control method provided by any embodiment of the present application.

[0019] In a fourth aspect, an embodiment of the present application further provides a computer readable storage medium, which stores a computer program, and the program is executed by a processor to implement the information collection control method provided by any embodiment of the present application.

[0020] An embodiment of the above application has the following advantages or beneficial effects:

[0021] The information acquisition control method comprises the following steps: detecting whether the acquisition node and the cache instance in the information acquisition scene change, determining a target allocation strategy based on the current detection result, the target allocation strategy comprising at least one of a polling allocation strategy, a machine room nearest allocation strategy, an average allocation strategy and a suspension allocation strategy, updating the allocation relationship between the acquisition node and the cache instance in the information acquisition scene based on the target allocation strategy, and enabling the acquisition node to acquire information based on the updated target allocation relationship, so that the allocation relationship between the acquisition node and the cache instance is dynamically updated, the situation of missing acquisition information is avoided, and the automatic load balancing of information acquisition can be realized by combining the allocation control of multiple allocation strategies, high availability is ensured, and the information acquisition efficiency is improved. BRIEF DESCRIPTION OF DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0023] Figure 1 is a flowchart of an information acquisition control method provided by an embodiment of the present application;

[0024] Figure 2 is a flowchart of another information acquisition control method provided by an embodiment of the present application;

[0025] Figure 3 is an example of increasing a new acquisition node and a new cache instance related to an embodiment of the present application;

[0026] Figure 4 is an example of no change of the acquisition node and the cache instance related to an embodiment of the present application;

[0027] Figure 5 is an example of reducing the existing acquisition node and keeping the cache instance unchanged related to an embodiment of the present application;

[0028] Figure 6 is an example of increasing a new acquisition node and keeping the cache instance unchanged related to an embodiment of the present application;

[0029] Figure 7 is an example of no change of the acquisition node and change of the cache instance related to an embodiment of the present application;

[0030] Figure 8 is a structural schematic diagram of an information acquisition control device provided by an embodiment of the present application;

[0031] Figure 9 is a structural schematic diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0032] The present application will be further described below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely intended for the purpose of interpretation of the present application and are not limiting of the present application. In addition, it should be noted that only the parts related to the present application are shown in the accompanying drawings for the purpose of description.

[0033] In the technical solutions of the present disclosure, the collection, collection, updating, analysis, processing, use, transmission, storage, etc. of user personal information are in line with the relevant legal regulations, are used for legal purposes, and do not violate public order and good customs. Necessary measures are taken to prevent illegal access to user personal information data, and the security of user personal information, network security and national security are maintained.

[0034] Figure 1 A flowchart of an information collection control method provided by an embodiment of the present application, the present embodiment can be applied to the case of dynamically updating the allocation relationship between the collection nodes and the cache instances in the information collection scene. The method can be executed by an information collection control device, which can be realized by software and / or hardware and integrated in an electronic device. As shown in the figure, the method specifically includes the following steps: Figure 1

[0035] S110, detecting whether the collection nodes and the cache instances in the information collection scene change, wherein the information collection scene includes a collection cluster and a cache cluster, the collection cluster is used to deploy collection nodes, and the cache cluster is used to deploy cache instances, and each collection node is used to collect information of the allocated cache instance.

[0036] Among them, the collection cluster can be a cluster composed of one or more collection servers. One or more collection nodes can be deployed on each collection server. The collection node can be a process started on the collection server for collecting cache instance information. The collection cluster can include multiple collection nodes. Different collection nodes can be located in the same machine room or different machine rooms. For example, the collection cluster includes three collection nodes, namely collection node 1, collection node 2 and collection node 3, and collection node 1 is located in machine room 1, and collection node 2 and collection node 3 are located in machine room 2, that is, the collection server where collection node 1 is located is deployed in machine room 1, and the collection server where collection node 2 and collection node 3 are located is located in machine room 2.

[0037] ​The cache cluster can cache information as a cache middleware. The cache middleware can include one or more cache clusters. The cache cluster can be a cluster composed of one or more cache servers. One or more cache instances can be deployed on each cache server. The cache instance can be a process started on the cache server for caching information. The cache cluster can include a plurality of cache shards, and each cache shard can include a plurality of cache instances. For example, a cache cluster includes 1024 cache shards, and each shard is one master and one slave, that is, each shard includes 2 cache instances, and at this time, the cache cluster can include 2048 cache instances. In order to fully utilize resources, a plurality of cache instances can be deployed to the same cache server. Different cache instances can be located in the same machine room or different machine rooms. For example, the cache cluster includes 3 cache instances, namely cache instance 1, cache instance 2 and cache instance 3, and cache instance 1 and cache instance 2 are located in machine room 1, and cache instance 3 is located in machine room 2, that is, the cache server on which cache instance 1 and cache instance 2 are located is deployed in machine room 1, and the cache server on which cache instance 3 is located is located in machine room 2.

[0038] The collection nodes in the collection cluster and the cache instances in the cache cluster have an allocation relationship, so as to determine the cache instances responsible for collection by each collection node based on the allocation relationship. The information collection scenario can refer to an application scenario in which the collection nodes collect corresponding cache instance information based on the allocation relationship. The cache instance information collected by the collection nodes can include running information of the cache instances, such as CPU usage, memory usage, instantaneous traffic, and the like. It should be noted that before the information collection starts, the initial allocation relationship between the collection nodes and the cache instances can be obtained by random allocation, or can be obtained by pre-allocation according to a preset allocation strategy, such as an average allocation strategy or an IP address range of the cache instances. After the information collection starts, the allocation relationship between the collection nodes and the cache instances is dynamically updated to ensure load balancing and high availability.

[0039] Specifically, the collection nodes and the cache instances in the information collection scenario can be periodically detected in a timing manner. For example, all collection nodes and all cache instances existing in the information collection scenario in the current detection period are compared with all collection nodes and all cache instances existing in the information collection scenario in the last detection period, to determine whether there is a change in the collection nodes and the cache instances in the current detection period relative to the last detection period, such as adding a new collection node or reducing an existing collection node, adding a new cache instance or reducing an existing cache instance, and the like.

[0040] It should be noted that the cache instances in the information collection scene can be dynamically changed according to business needs. For example, when the access traffic of the cache cluster increases, new cache instances need to be added to undertake. When an existing cache instance appears abnormal, or other cache instances undertake the functions of the existing cache instance, the existing cache instance is destroyed, which is equivalent to reducing the existing cache instances. The collection nodes in the information collection scene can also be dynamically changed according to business needs. For example, when the collection pressure is large, new collection nodes need to be added. When an existing collection node appears abnormal and cannot normally run, the existing collection node is destroyed, which is equivalent to reducing the existing collection nodes.

[0041] S120, determining a target allocation strategy based on the current detection result, wherein the target allocation strategy comprises at least one of a polling allocation strategy, a machine room proximity allocation strategy, an average allocation strategy, and a suspension allocation strategy.

[0042] The current detection result can refer to the detection result obtained in the current detection period, that is, whether there is a change result of the collection node and the cache instance between the current detection period and the previous detection period. The target allocation strategy can refer to an allocation strategy matched with the current detection result, to ensure high availability and high performance of the information collection scene. The allocation strategy can be a way for adjusting the allocation relationship between the collection node and the cache instance. The polling allocation strategy can be a strategy of binding the allocation relationship in a certain order. The machine room proximity allocation strategy can be a strategy of adjusting the allocation relationship according to the machine room proximity. The average allocation strategy can be a strategy of adjusting the allocation relationship according to the load condition of the collection node. The suspension allocation strategy can be a strategy of stopping adjusting the allocation relationship.

[0043] Specifically, by the mapping relationship between the pre-set detection result and the allocation strategy, the target allocation strategy matched with the current detection result is determined, so that a more suitable allocation strategy can be adopted for different detection results, to achieve the technical effects of rapid allocation, balanced allocation, efficient collection, high availability, etc.

[0044] S130, updating the allocation relationship between the collection node and the cache instance in the information collection scene based on the target allocation strategy, so that the collection node collects information based on the updated target allocation relationship.

[0045] Specifically, according to the target allocation strategy, the allocation relationship between the collection nodes and the cache instances in the information collection scene is adjusted and updated, so that a high-performance target allocation relationship can be obtained, and the collection nodes collect information based on the target allocation relationship. By dynamically updating the allocation relationship between the collection nodes and the cache instances, the loss of collected information caused by changes in the cache instances or the collection nodes can be avoided, high availability is ensured, and by means of average allocation or room nearby allocation, the uneven allocation and cross-room access situation can also be avoided, so that the information collection efficiency is greatly improved.

[0046] The technical scheme of the embodiment detects whether the collection nodes and the cache instances in the information collection scene change, determines a target allocation strategy based on the current detection result, the target allocation strategy can include at least one of a polling allocation strategy, a room nearby allocation strategy, an average allocation strategy and a suspension allocation strategy, and the allocation relationship between the collection nodes and the cache instances in the information collection scene is updated based on the target allocation strategy, so that the collection nodes collect information based on the updated target allocation relationship, so as to realize dynamic updating of the allocation relationship between the collection nodes and the cache instances, avoid the loss of collected information, and realize automatic load balancing of information collection by combining multiple allocation strategies for collection allocation control, ensure high availability, and further improve the information collection efficiency.

[0047] Figure 2 The flowchart of another information collection control method provided by the embodiment is provided, the embodiment is based on the above-mentioned embodiments, and the step of "determining a target allocation strategy based on the current detection result" is optimized, and the step of "updating the allocation relationship between the collection nodes and the cache instances in the information collection scene based on the target allocation strategy, so that the collection nodes collect information based on the updated target allocation relationship" is further optimized. The explanations of the same or corresponding terms in the above-mentioned embodiments are not repeated here.

[0048] Referring to Figure 2 The another information collection control method provided by the embodiment specifically includes the following steps:

[0049] S210, detecting whether the collection nodes and the cache instances in the information collection scene change.

[0050] Specifically, whether the collection node in the information collection scene in the current detection period changes and whether the cache instance changes relative to the last detection period is detected, so as to obtain the current detection result. Based on different current detection results, different subsequent steps are executed. For example, when the current detection result is that a new collection node is added and a new cache instance is added, step S220 is executed; when the current detection result is that the collection node and the cache instance are unchanged, step S240 is executed; when the current detection result is the first preset result, step S260 is executed; and when the current detection result is the second preset result, step S290 is executed.

[0051] S220, if the current detection result is that a new collection node is added and a new cache instance is added, determining that the target allocation strategy is a round robin allocation strategy, and executing S230.

[0052] Specifically, when the current detection result is that a new collection node and a new cache instance are added at the same time, there may be a large number of cache instances to be allocated, and at this time, the target allocation strategy can be determined as a round robin allocation strategy, so as to quickly complete the allocation, ensure the normal operation of information collection, and improve the availability.

[0053] S230, based on the first allocation order corresponding to the added new collection node and the second allocation order corresponding to the added new cache instance, the new cache instance is round robin allocated to the new collection node, and the target allocation relationship between the new collection node and the new collection node is obtained, so that the new collection node collects information based on the target allocation relationship.

[0054] Specifically, when the current detection result is that a new collection node and a new cache instance are added at the same time, a round robin allocation strategy is used for fast allocation, and the allocation process is: sorting all added new collection nodes to obtain the first allocation order corresponding to the new collection node. All added new cache instances are sorted to obtain the second allocation order corresponding to the new cache instance. According to the second allocation order, each new cache instance is round robin allocated to a new collection node according to the first allocation order, so that the target allocation relationship between the new collection node and the new collection node can be quickly obtained, so that the new collection node collects the information of the allocated new cache instance based on the target allocation relationship, and the high availability is ensured.

[0055] For example, Figure 3 An example of adding a new collection node and adding a new cache instance is given. As shown in FIG. 2, the information collection system 100 includes a collection node 110, a cache instance 120, and a cache instance 130. Figure 3As shown, the current detection result is that 3 collection nodes, i.e., collection node 1, collection node 2 and collection node 3, are added. 2 cache clusters, i.e., cache cluster 1 and cache cluster 2, are added, and each of cache cluster 1 and cache cluster 2 includes 3 cache instances, i.e., cache instance 1, cache instance 2 and cache instance 3. According to the round robin allocation strategy, cache instance 1, cache instance 2 and cache instance 3 in cache cluster 1 are allocated to collection node 1, collection node 2 and collection node 3 respectively, and cache instance 1, cache instance 2 and cache instance 3 in cache cluster 2 are also allocated to collection node 1, collection node 2 and collection node 3 respectively, so that the allocation can be quickly completed through the round robin allocation strategy, and the effect of average allocation is ensured, load balancing is achieved, and information collection efficiency is improved.

[0056] S240, if the current detection result is that the collection nodes and the cache instances are not changed, determining that the target allocation strategy is the machine room nearest allocation strategy and the average allocation strategy, and performing S250.

[0057] Specifically, when the current detection result is that the collection nodes and the cache instances are not changed, that is, the collection nodes and the cache instances in the current detection period are not changed relative to the last detection period, at this time, the machine room nearest allocation strategy and the average allocation strategy can be used as the target allocation strategy for allocation optimization, further ensuring load balancing and improving information collection efficiency.

[0058] S250, based on the machine room nearest allocation strategy and the average allocation strategy, the allocation relationship between the collection nodes and the cache instances in the collection scene is optimized and updated, so that the updated target allocation relationship is the machine room nearest average allocation relationship.

[0059] Specifically, the allocation relationship between the collection nodes and the cache instances in the collection scene can be first optimized and updated based on the machine room nearest allocation strategy, to ensure that the optimized allocation relationship is the machine room nearest allocation relationship, and to avoid the situation that the collection nodes access the cache instances across the machine rooms, further improving the information collection effect. At the same time of or after the machine room nearest allocation, the allocation relationship between the collection nodes and the cache instances in the same machine room can be optimized and updated based on the load of the collection nodes in each machine room, to ensure that the finally optimized target allocation relationship is the machine room nearest average allocation relationship, so as to realize automatic load balancing and efficient information collection.

[0060] For example, Figure 4 An example in which the collection nodes and the cache instances are not changed is given. As shown in FIG. 4, the current detection result is that the collection nodes and the cache instances are not changed, that is, the collection nodes and the cache instances in the current detection period are not changed relative to the last detection period. Figure 4As shown, the allocation relationship updated in the last detection cycle is that cache instance 1, cache instance 2 and cache instance 3 in cache cluster 1 are respectively allocated to collection node 1, collection node 2 and collection node 3, and cache instance 1, cache instance 2 and cache instance 3 in cache cluster 2 are also respectively allocated to collection node 1, collection node 2 and collection node 3. The current detection result obtained in the current detection cycle is that neither the collection node nor the cache instance has changed, and still includes cache instance 1, cache instance 2 and cache instance 3 in collection node 1, collection node 2 and collection node 3 and cache cluster 1 and cache instance 2. The room nearest allocation strategy and the average allocation strategy can be used to optimize and average optimize the allocation relationship. Since cache instance 2 in cache cluster 1 is located in room 1, the collection node 2 to which the cache instance 2 is allocated is located in room 2, and there is a cross-room situation, at this time, the cache instance 2 in the cache cluster 1 can be adjusted to be allocated to the collection node 1 located in the room 1, so that the cache instance 2 in the cache cluster 1 and the collection node 1 are located in the same room 1, thereby avoiding cross-room access and improving information collection efficiency. Similarly, the cache instance 1 in the cache cluster 2 can be adjusted to be allocated to the collection node 2 located in the room 2 and having a smaller load, so that the cache instance 1 in the cache cluster 2 and the collection node 2 are located in the same room 2. The optimized allocation relationship is the room nearest average allocation relationship, thereby realizing load balancing and improving information collection efficiency.

[0061] S260, if the current detection result is the first preset result, determining that the target allocation strategy is the room nearest allocation strategy and / or the average allocation strategy, and performing S270.

[0062] The first preset result refers to the detection result corresponding to the cache instance to be allocated. For example, the first preset result can include that the collection node does not change and a new cache instance is added, the collection node is reduced and the cache instance does not change, the collection node is reduced and a new cache instance is added, or the collection node is reduced and the existing cache instance is reduced.

[0063] Specifically, when the current detection result is the detection result that there is a cache instance to be allocated, it indicates that allocation needs to be performed immediately in order to ensure that all cache instances are collected and the availability is improved. At this time, only the room nearest allocation strategy or only the average allocation strategy can be used as the target allocation strategy in order to complete the allocation as soon as possible first and then adjust and optimize the allocation relationship in the subsequent cycle detection to further ensure the availability of information collection. The room nearest allocation strategy and the average allocation strategy can also be used as the target allocation strategy in order to complete the optimal allocation at one time and realize efficient information collection.

[0064] S270, determine a target cache instance to be allocated in the current information collection scenario, and perform S280.

[0065] Specifically, when the current detection result is that the collection node is unchanged and new cache instances are added, all the added new cache instances are taken as the target cache instance to be allocated.

[0066] When the current detection result is that the existing collection node is reduced and the cache instance is unchanged, since the existing collection node is destroyed, the cache instance allocated to the existing collection node needs to be re-allocated, so the existing cache instance allocated to the reduced existing collection node can be taken as the target cache instance to be allocated.

[0067] When the current detection result is that the existing collection node is reduced and new cache instances are added, all the added new cache instances and the existing cache instance allocated to the reduced existing collection node are taken as the target cache instance to be allocated.

[0068] When the current detection result is that the existing collection node is reduced and the existing cache instance is reduced, if the reduced existing cache instance is not allocated to the reduced existing collection node, the existing cache instance allocated to the reduced existing collection node can be taken as the target cache instance to be allocated. It should be noted that if the reduced existing cache instance is allocated to the reduced existing collection node, it indicates that there is no target cache instance to be allocated at present, at this time, it can be determined that the target allocation strategy is the pause allocation strategy, and S291 is performed.

[0069] S280, based on the machine room nearest allocation strategy and / or the average allocation strategy, determine a target collection node to which the target cache instance is allocated, so that the target collection node collects the information of the allocated target cache instance.

[0070] Specifically, according to the machine room nearest allocation strategy and / or the average allocation strategy, each target cache instance can be determined to be allocated to a target collection node from all the collection nodes currently existing in the information collection scenario.

[0071] Exemplarily, in S280, "determining the target collection node to which the target cache instance is allocated based on the machine room nearest allocation strategy", can include: determining a first machine room in which the target cache instance is located and a second machine room in which each collection node in the information collection scenario is located; determining a target machine room closest to the first machine room from the second machine room; and taking a collection node located in the target machine room as the target collection node to which the target cache instance is allocated.

[0072] Specifically, the first machine room where each target cache instance is located can be obtained based on an IP address query of each target cache instance, and the second machine room where each collection node is located can be obtained based on an IP address query of each collection node in the information collection scene. The first machine room is compared with the second machine room, the second machine room closest to the first machine room is determined as the target machine room. A collection node of the target machine room can be randomly selected as a target collection node to which the target cache instance is allocated, so as to realize the machine room near allocation and improve the information collection efficiency.

[0073] For example, determining the target machine room closest to the first machine room from the second machine room can include: determining the second machine room same as the first machine room as the target machine room closest to the first machine room; or determining the access hop number between the first machine room and each second machine room, and determining the second machine room with the minimum access hop number as the target machine room closest to the first machine room.

[0074] Specifically, if there is a second machine room same as the first machine room, that is, belonging to the same machine room, the second machine room can be determined as the target machine room closest to the first machine room. If there is no second machine room same as the first machine room, the access hop number of the collection node in the first machine room accessing the cache instance in each second machine room can be determined through the network, and the second machine room with the minimum access hop number is determined as the target machine room closest to the first machine room, so as to minimize the traffic on the collection link and improve the collection efficiency.

[0075] For example, in S280, "determining the target collection node to which the target cache instance is allocated based on the average allocation strategy" can include: obtaining the number of cache instances that each collection node in the information collection scene has allocated, and taking the collection node with the minimum number of cache instances as the target collection node to which the target cache instance is allocated.

[0076] Specifically, for each target cache instance, the number of cache instances that each collection node in the information collection scene has currently allocated can be obtained, and the collection node with the minimum number of cache instances is taken as the target collection node to which the target cache instance is allocated, and the number of cache instances that the target collection node has currently allocated is increased by 1, and the number of allocated cache instances is updated synchronously, so as to realize the load balancing of the collection node.

[0077] Exemplarily, the "determining a target collection node to which the target cache instance is allocated based on the nearest allocation strategy and the average allocation strategy of the machine room" in S280 can include: determining a first machine room in which the target cache instance is located and a second machine room in which each collection node in the information collection scene is located; determining a target machine room closest to the first machine room from the second machine room; and determining a collection node with the smallest number of allocated cache instances from the collection nodes located in the target machine room, and taking the collection node as the target collection node to which the target cache instance is allocated.

[0078] Specifically, the collection can be allocated based on the nearest allocation strategy and the average allocation strategy of the machine room at the same time. For example, after the target machine room is determined, the number of currently allocated cache instances of each collection node located in the target machine room can be obtained, and the collection node with the smallest number of cache instances is taken as the target collection node to which the target cache instance is allocated, so as to ensure the load balancing of the collection nodes in the same machine room while allocating in the nearest manner, and further improve the information collection efficiency.

[0079] For example, Figure 5 An example of reducing the existing collection nodes and keeping the cache instances unchanged is given. As shown in Figure 5 The current detection result is that the collection node 2 in the collection cluster fails, the collection node 2 is reduced, and the cache instances are unchanged. It can be seen that the cache instance 3 in the cache cluster 1 and the cache instance 1 in the cache cluster 2 allocated to the reduced collection node 2 are target cache instances that need to be reallocated, and at this time, the cache instance 3 in the cache cluster 1 is located in the machine room 2, and the cache instance 1 in the cache cluster 2 is also located in the machine room 2. There is only one collection node 3 located in the machine room 2 in the information collection scene, so the collection node 3 can be directly taken as the collection node to which the cache instance 3 in the cache cluster 1 and the cache instance 1 in the cache cluster 2 are allocated, so that in the same machine room 2, the information of the cache instance 3 in the cache cluster 1 and the information of the cache instance 1 in the cache cluster 2 are collected through the collection node 3, and the high efficiency of information collection is realized.

[0080] S290, if the current detection result is a second preset result, determining that the target allocation strategy is a suspension allocation strategy, and performing S291.

[0081] The second preset result refers to the fact that there is no detection result corresponding to the cache instance to be allocated. For example, the second preset result can include: increasing a new collection node and reducing an existing cache instance, increasing a new collection node and keeping the cache instances unchanged, or keeping the collection nodes unchanged and reducing the existing cache instances.

[0082] It should be noted that after adding a new collection node, even if the new collection node does not allocate a cache instance for collection, the normal collection of all cache instances can be ensured, so when there is no cache instance to be allocated at present, the newly added collection node does not need to be allocated with the allocated cache instance immediately. The optimization adjustment of the allocation relationship is performed again when the collection node and the cache instance are unchanged, such as optimization based on steps S240 and S250, so as to further realize high availability and high performance of information collection.

[0083] S291, stop updating the allocation relationship between the collection node and the cache instance in the information collection scene, so that the collection node collects information based on the original allocation relationship.

[0084] Specifically, when the current detection result is the second preset result that there is no cache instance to be allocated at present, the optimization update of the allocation relationship can be stopped based on the pause allocation strategy, so that the collection node continues to collect information based on the original allocation relationship, and the optimization adjustment of the allocation relationship is performed again when the collection node and the cache instance are unchanged, so as to further realize high availability and high performance of information collection.

[0085] For example, Figure 6 An example of adding a new collection node and keeping the cache instance unchanged is given. As shown in Figure 6 , the current detection result is that the collection node 4 is added and the cache instance remains unchanged, at which time the allocation can be paused, and the collection node continues to collect information of the allocated cache instance based on the original allocation relationship, ensuring normal collection of all cache instance information, and further realizing high availability and high performance of information collection.

[0086] For example, Figure 7 An example of keeping the collection node unchanged and changing the cache instance is given. As shown in Figure 7 , the current detection result is that the collection node remains unchanged, the existing cache instance 2 in the cache cluster 1 is reduced, and the cache instance 4 in the cache cluster 2 is added at the same time. For this change, the existing cache instance 2 in the cache cluster 1 does not need to be allocated after being reduced, which is equivalent to pausing the allocation, and only the allocation of the added cache instance 4 is needed, at which time the allocation can be performed through the manner of steps S260-S280, such as, based on the room nearest allocation strategy and the average allocation strategy, the cache instance 4 is allocated to the collection node 2 located in the same room 2, so as to realize balanced allocation and improve information collection efficiency.

[0087] The technical scheme of the embodiment is that, when the current detection result is that a new collection node is added and a new cache instance is added, the optimization update of the allocation relationship is performed based on a polling allocation strategy. When the current detection result is that the collection node and the cache instance are not changed, the optimization update of the allocation relationship is performed based on a machine room nearest allocation strategy and an average allocation strategy. When the current detection result is a first preset result that there is a cache instance to be allocated at present, the optimization update of the allocation relationship is performed based on the machine room nearest allocation strategy and / or the average allocation strategy. When the current detection result is a second preset result that there is no cache instance to be allocated at present, the optimization update of the allocation relationship is performed based on a suspension allocation strategy. Therefore, the high availability, the fast allocation and the balanced allocation can be realized by using the multiple different allocation strategies, and the information collection efficiency is further improved.

[0088] The following is an embodiment of an information collection control device provided by the embodiment of the application. The device and the information collection control method of each of the above embodiments belong to the same inventive concept. Details not described in the embodiment of the information collection control device can be referred to the embodiment of the information collection control method.

[0089] Figure 8 The following is a structural schematic diagram of an information collection control device provided by the embodiment of the application. The embodiment can be applied to the case that the allocation relationship between the collection nodes and the cache instances in the information collection scene is dynamically updated. As shown in the figure, the device specifically includes an information detection module 310, a target allocation strategy determination module 320 and an allocation relationship update module 330. Figure 8

[0090] The information detection module 310 is configured to detect whether the collection nodes and the cache instances in the information collection scene are changed, wherein the information collection scene includes a collection cluster and a cache cluster, the collection cluster is configured to deploy the collection nodes, the cache cluster is configured to deploy the cache instances, and each collection node is configured to collect the information of the allocated cache instance. The target allocation strategy determination module 320 is configured to determine a target allocation strategy based on a current detection result, wherein the target allocation strategy includes at least one of a polling allocation strategy, a machine room nearest allocation strategy, an average allocation strategy and a suspension allocation strategy. The allocation relationship update module 330 is configured to update the allocation relationship between the collection nodes and the cache instances in the information collection scene based on the target allocation strategy, so that the collection nodes perform information collection based on the updated target allocation relationship.

[0091] ​The technical scheme of the embodiment detects whether the collection node and the cache instance in the information collection scene change, determines a target allocation strategy based on the current detection result, the target allocation strategy can include at least one of a polling allocation strategy, a machine room nearest allocation strategy, an average allocation strategy, and a suspension allocation strategy, and based on the target allocation strategy, the allocation relationship between the collection node and the cache instance in the information collection scene is updated, so that the collection node collects information based on the updated target allocation relationship, thereby realizing dynamic updating of the allocation relationship between the collection node and the cache instance, avoiding the loss of collected information, and combining multiple allocation strategies for collection allocation control, automatic load balancing of information collection can be realized, high availability is ensured, and thus the information collection efficiency is improved.

[0092] Optionally, the target allocation strategy determination module 320 is specifically configured to:

[0093] If the current detection result is that a new collection node is added and a new cache instance is added, the target allocation strategy is determined to be the polling allocation strategy.

[0094] If the current detection result is that neither the collection node nor the cache instance changes, the target allocation strategy is determined to be the machine room nearest allocation strategy and the average allocation strategy.

[0095] If the current detection result is a first preset result, the target allocation strategy is determined to be the machine room nearest allocation strategy and / or the average allocation strategy, wherein the first preset result refers to a detection result corresponding to a to-be-allocated cache instance currently existing.

[0096] If the current detection result is a second preset result, the target allocation strategy is determined to be the suspension allocation strategy, wherein the second preset result refers to a detection result corresponding to a to-be-allocated cache instance currently not existing.

[0097] Optionally, the first preset result includes that the collection node does not change and a new cache instance is added, that the existing collection node is reduced and the cache instance does not change, that the existing collection node is reduced and a new cache instance is added, or that the existing collection node is reduced and the existing cache instance is reduced.

[0098] The second preset result includes that a new collection node is added and the existing cache instance is reduced, that a new collection node is added and the cache instance does not change, or that the collection node does not change and the existing cache instance is reduced.

[0099] Optionally, the allocation relationship updating module 330 is specifically configured to:

[0100] If the target allocation strategy is a round robin allocation strategy, the new cache instance is round robin allocated to the new collection node based on a first allocation sequence corresponding to the new collection node and a second allocation sequence corresponding to the new cache instance, to obtain a target allocation relationship between the new collection node and the new collection node, so that the new collection node collects information based on the target allocation relationship.

[0101] Optionally, the allocation relationship updating module 330 is further configured to:

[0102] When the current detection result is that neither the collection node nor the cache instance is changed, the allocation relationship between the collection node and the cache instance in the collection scene is updated based on the room nearest allocation strategy and the average allocation strategy, so that the updated target allocation relationship is a room nearest average allocation relationship.

[0103] Optionally, the allocation relationship updating module 330 comprises:

[0104] The target cache instance determination unit is configured to, when the current detection result is the first preset result, determine a target cache instance to be allocated in the information collection scene;

[0105] The target cache instance allocation unit is configured to determine a target collection node to which the target cache instance is allocated based on the room nearest allocation strategy and / or the average allocation strategy, so that the target collection node collects information of the allocated target cache instance.

[0106] Optionally, the target cache instance allocation unit comprises:

[0107] The second room determination sub-unit is configured to determine a first room in which the target cache instance is located and a second room in which each collection node in the information collection scene is located.

[0108] The target room determination sub-unit is configured to determine a target room closest to the first room from the second rooms.

[0109] The target collection node determination sub-unit is configured to determine a collection node with the smallest number of allocated cache instances from collection nodes located in the target room, and take the collection node as a target collection node to which the target cache instance is allocated.

[0110] Optionally, the target room determination sub-unit is configured to:

[0111] The second room same as the first room is determined as the target room closest to the first room, or the access hop number between the first room and each second room is determined, and the second room with the smallest access hop number is determined as the target room closest to the first room.

[0112] Optionally, the allocation relationship updating module 330 is further configured to:

[0113] If the target allocation strategy is the suspension allocation strategy, the allocation relationship between the collection node and the cache instance in the information collection scenario is stopped from being updated, so that the collection node collects information based on the original allocation relationship.

[0114] The information collection control device provided by the embodiments of the present application can execute the information collection control method provided by any of the embodiments of the present application, and has the corresponding function modules and beneficial effects of executing the information collection control method.

[0115] It is worth noting that in the embodiments of the above information collection control device, each unit and module included is only divided according to the function logic, but is not limited to the above division, as long as the corresponding function can be realized; in addition, the specific name of each functional unit is only for the convenience of mutual differentiation, and does not serve to limit the protection scope of the present application.

[0116] Figure 9 A structural schematic diagram of an electronic device provided by the embodiments of the present application. Figure 9 A block diagram of an exemplary electronic device 12 suitable for implementing embodiments of the present application is shown. Figure 9 The electronic device 12 shown is merely an example and should not limit the function and use range of the embodiments of the present application.

[0117] As shown in Figure 9 The electronic device 12 is shown in the form of a general computing device. Components of the electronic device 12 can include, but are not limited to, one or more processors or processing units 16, system memory 28, and a bus 18 that couples various system components including system memory 28 and processing unit 16.

[0118] The bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration bus, a processor or local bus using any of a variety of bus architectures. By way of example, these architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

[0119] The electronic device 12 typically includes a variety of computer system readable media. These media can be any available media that is accessible by the electronic device 12 and includes both volatile and non-volatile media, removable and non-removable media.

[0120] System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. Electronic device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 may be used to read and write non-removable, non-volatile magnetic media (… Figure 9 Not shown; usually referred to as a "hard drive"). Although Figure 9 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk") and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. System memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of the present invention.

[0121] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in system memory 28. Such program modules 42 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 42 typically perform the functions and / or methods described in the embodiments of the present invention.

[0122] Electronic device 12 can also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), and with one or more devices that enable a user to interact with electronic device 12, and / or with any device that enables electronic device 12 to communicate with one or more other computing devices (e.g., network card, modem, etc.). This communication can be performed via input / output (I / O) interface 22. Furthermore, electronic device 12 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 20. As shown, network adapter 20 communicates with other modules of electronic device 12 via bus 18. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with electronic device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0123] The processing unit 16 performs various function applications and data processing by running programs stored in the system memory 28, such as implementing steps of an information collection control method provided by embodiments of the present application, which includes:

[0124] detecting whether a change occurs in a collection node and a cache instance in an information collection scenario, wherein the information collection scenario includes a collection cluster and a cache cluster, the collection cluster is used to deploy the collection node, and the cache cluster is used to deploy the cache instance, and each collection node is used to collect information of an allocated cache instance;

[0125] determining a target allocation strategy based on a current detection result, wherein the target allocation strategy includes at least one of a round-robin allocation strategy, a room-close allocation strategy, an average allocation strategy, and a suspension allocation strategy;

[0126] updating an allocation relationship between the collection node and the cache instance in the information collection scenario based on the target allocation strategy, so that the collection node collects information based on the updated target allocation relationship.

[0127] Of course, those skilled in the art can understand that the processor can also implement the technical solutions of the information collection control method provided by any embodiment of the present application.

[0128] The embodiment provides a computer readable storage medium, which stores a computer program, and the program is executed by a processor to implement steps of an information collection control method provided by any embodiment of the present application, which includes:

[0129] detecting whether a change occurs in a collection node and a cache instance in an information collection scenario, wherein the information collection scenario includes a collection cluster and a cache cluster, the collection cluster is used to deploy the collection node, and the cache cluster is used to deploy the cache instance, and each collection node is used to collect information of an allocated cache instance;

[0130] determining a target allocation strategy based on a current detection result, wherein the target allocation strategy includes at least one of a round-robin allocation strategy, a room-close allocation strategy, an average allocation strategy, and a suspension allocation strategy;

[0131] updating an allocation relationship between the collection node and the cache instance in the information collection scenario based on the target allocation strategy, so that the collection node collects information based on the updated target allocation relationship.

[0132] The computer storage medium of the embodiments of the present application can adopt any combination of one or more computer readable media. The computer readable medium can be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium may, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or apparatus, or any combination thereof. More specific examples (non-exhaustive list) of the computer readable storage medium include an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, the computer readable storage medium can be any tangible medium that contains or stores a program that can be used by or in connection with an instruction execution system, apparatus or device.

[0133] The computer readable signal medium can include a data signal propagated in baseband or propagated as a carrier wave, in which computer readable program code is embodied. Such propagated data signals can take a wide variety of forms, including but not limited to electro-magnetic signals, optical signals, or any suitable combination thereof. The computer readable signal medium can also be any computer readable medium that is not a storage medium, that is capable of storing the program for use by or in connection with the instruction execution system, apparatus or device.

[0134] The program code embodied on the computer readable medium can be transmitted using any appropriate medium, including but not limited to wireless, wire line, optical fiber cable, RF, etc., or any suitable combination of the above.

[0135] The computer program code for carrying out operations of the present application can be written in one or more programming languages or combinations of languages including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0136] Those skilled in the art should understand that the modules or steps of the present application described above can be realized by general computing devices, which can be centralized on a single computing device or distributed on a network composed of multiple computing devices, and optionally, they can be realized by program codes executable by the computing devices, so that they can be stored in storage devices and executed by the computing devices, or they can be respectively manufactured into individual integrated circuit modules, or multiple modules or steps among them can be manufactured into a single integrated circuit module to realize. Thus, the present application is not limited to any specific combination of hardware and software.

[0137] It is noted that the above merely describes the preferred embodiments of the present application and the principles of the applied technology. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and various obvious changes, re-adjustments and substitutions can be made by those skilled in the art without departing from the scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments, and more other equivalent embodiments can be included without departing from the concept of the present application, and the scope of the present application is determined by the appended claims.

Claims

1. An information acquisition and control method, characterized in that, include: The detection method checks whether the collection nodes and cache instances in the information collection scenario have changed. The information collection scenario includes a collection cluster and a cache cluster. The collection cluster includes at least one collection server. The collection node is a process started on the collection server for collecting cache instance information. The cache cluster includes at least one cache server. The cache instance is a process started on the cache server for caching information. Each collection node is used to collect information of the assigned cache instance. If the current detection result indicates the addition of a new collection node and a new cache instance, the target allocation strategy is determined to be a round-robin allocation strategy. If the current detection result indicates that neither the collection node nor the cache instance remains unchanged, the target allocation strategy is determined to be a data center proximity allocation strategy or an average allocation strategy. If the current detection result is a first preset result, the target allocation strategy is determined to be a data center proximity allocation strategy and / or an average allocation strategy, wherein the first preset result refers to the detection result corresponding to a cache instance currently awaiting allocation. If the current detection result is a second preset result, the target allocation strategy is determined to be a pause allocation strategy, wherein the second preset result refers to the detection result corresponding to a cache instance currently awaiting allocation. Based on the target allocation strategy, the allocation relationship between the collection nodes and cache instances in the information collection scenario is updated so that the collection nodes can collect information based on the updated target allocation relationship. The first preset result includes: keeping the collection nodes unchanged and adding new cache instances, reducing existing collection nodes and keeping the cache instances unchanged, reducing existing collection nodes and adding new cache instances, or reducing existing collection nodes and reducing existing cache instances. The second preset result includes: adding a new collection node and reducing existing cache instances, adding a new collection node and keeping the cache instances unchanged, or keeping the collection nodes unchanged and reducing existing cache instances.

2. The method according to claim 1, characterized in that, The step of updating the allocation relationship between collection nodes and cache instances in the information collection scenario based on the target allocation strategy, so that the collection nodes perform information collection based on the updated target allocation relationship, includes: If the target allocation strategy is a round-robin allocation strategy, then based on the first allocation order corresponding to the newly added collection node and the second allocation order corresponding to the newly added cache instance, the new cache instance is allocated to the new collection node in a round-robin manner to obtain the target allocation relationship between the new collection nodes, so that the new collection node can collect information based on the target allocation relationship.

3. The method according to claim 1, characterized in that, The step of updating the allocation relationship between collection nodes and cache instances in the information collection scenario based on the target allocation strategy also includes: When the current detection result shows that the number of data collection nodes and cache instances remain unchanged, the allocation relationship between data collection nodes and cache instances in the data collection scenario is optimized and updated based on the data center proximity allocation strategy and the average allocation strategy, so that the updated target allocation relationship is the data center proximity average allocation relationship.

4. The method according to claim 1, characterized in that, The step of updating the allocation relationship between collection nodes and cache instances in the information collection scenario based on the target allocation strategy, so that the collection nodes perform information collection based on the updated target allocation relationship, further includes: When the current detection result is the first preset result, determine the target cache instance to be allocated in the information collection scenario; Based on the data center proximity allocation strategy and / or average allocation strategy, the target collection node to which the target cache instance is allocated is determined, so that the target collection node collects the information of the allocated target cache instance.

5. The method according to claim 4, characterized in that, The determination of the target collection node to which the target cache instance is allocated, based on the data center proximity allocation strategy and the average allocation strategy, includes: Determine the first data center where the target cache instance is located and the second data center where each collection node in the information collection scenario is located; Determine the target computer room that is closest to the first computer room from the second computer room; The collection node with the smallest number of allocated cache instances is determined from the collection nodes located in the target data center, and this collection node is used as the target collection node to which the target cache instance is allocated.

6. The method according to claim 5, characterized in that, Determining the target computer room closest to the first computer room from the second computer room includes: The second computer room, which is identical to the first computer room, is identified as the target computer room closest to the first computer room; or... Determine the number of access hops between the first data center and each of the second data centers, and determine the second data center with the smallest number of access hops as the target data center closest to the first data center.

7. The method according to claim 1, characterized in that, The step of updating the allocation relationship between collection nodes and cache instances in the information collection scenario based on the target allocation strategy, so that the collection nodes perform information collection based on the updated target allocation relationship, further includes: If the target allocation strategy is a pause allocation strategy, then the allocation relationship between the collection nodes and cache instances in the information collection scenario will be stopped from being updated, so that the collection nodes can collect information based on the original allocation relationship.

8. An information acquisition and control device, characterized in that, include: An information detection module is used to detect whether the collection nodes and cache instances in the information collection scenario have changed. The information collection scenario includes a collection cluster and a cache cluster. The collection cluster includes at least one collection server. The collection node is a process started on the collection server for collecting cache instance information. The cache cluster includes at least one cache server. The cache instance is a process started on the cache server for caching information. Each collection node is used to collect information of the assigned cache instance. The target allocation strategy determination module is used to determine the target allocation strategy as a round-robin allocation strategy if the current detection result indicates that a new collection node and a new cache instance have been added; if the current detection result indicates that both the collection node and the cache instance remain unchanged, the target allocation strategy is determined to be either a data center proximity allocation strategy or an average allocation strategy; if the current detection result is a first preset result, the target allocation strategy is determined to be either a data center proximity allocation strategy or an average allocation strategy, wherein the first preset result refers to a detection result corresponding to a cache instance currently awaiting allocation; if the current detection result is a second preset result, the target allocation strategy is determined to be a pause allocation strategy, wherein the second preset result refers to a detection result corresponding to a cache instance currently awaiting allocation. The allocation relationship update module is used to update the allocation relationship between the collection nodes and cache instances in the information collection scenario based on the target allocation strategy, so that the collection nodes can collect information based on the updated target allocation relationship. The first preset result includes: keeping the collection nodes unchanged and adding new cache instances, reducing existing collection nodes and keeping the cache instances unchanged, reducing existing collection nodes and adding new cache instances, or reducing existing collection nodes and reducing existing cache instances. The second preset result includes: adding a new collection node and reducing existing cache instances, adding a new collection node and keeping the cache instances unchanged, or keeping the collection nodes unchanged and reducing existing cache instances.

9. An electronic device, characterized in that, The electronic device includes: One or more processors; Memory, used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the information acquisition and control method as described in any one of claims 1-7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the information acquisition and control method as described in any one of claims 1-7.

Images