Data subscription method and device, electronic equipment, storage medium and program product
By introducing multiple business channels into the data subscription system and isolating and resource allocation, the performance bottlenecks and delay problems caused by full subscription are solved, the system stability and response speed are improved, and data sharing and integration are realized.
Patent Information
- Application Number
- CN202510116268.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-23
- Publication Date
- 2025-04-25
AI Technical Summary
When existing data subscription systems face massive data, especially in scenarios where business data traffic is too large, full subscription leads to a decrease in subscription service processing speed, service lag, and may even trigger a service avalanche effect. It is difficult to dynamically adjust resource allocation based on real-time traffic, resulting in performance bottlenecks and request response delays.
By introducing multiple business channels into the resource allocation pipeline, isolating and allocating resources, obtaining subscription requests sent by the subscription system, determining the target service channel, and sending the data subscription service to the subscription system through the target service channel to complete the data subscription.
It improves the stability and response speed of subscription services, optimizes the data processing process, reduces data synchronization delay, and realizes the sharing and integration of business master data.
Smart Images

Figure CN119892755A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data subscription, and in particular to a data subscription method, device, electronic device, storage medium and program product. Background Art
[0002] With the development of digital and intelligent technologies, enterprises and organizations are facing a large number of real-time data processing needs. The publish-subscribe model is widely used due to its flexibility and scalability, but problems such as data synchronization delays, sharing difficulties and performance bottlenecks limit system stability.
[0003] Enterprise Service Bus (ESB) data bus technology is a common solution that integrates multiple services and provides a unified data exchange platform to achieve data flow between different systems. In particular, ESB generally adopts full data subscription technology, that is, no matter what changes occur in the data, it will be sent to all downstream services that subscribe to the data in real time. Although this method ensures instant synchronization of data, when faced with massive data, especially in scenarios with extremely large business data traffic, full subscription often leads to a decrease in the processing speed of the subscription service, service jams, and even a service avalanche effect caused by a single business exception. In addition, in order to cope with traffic peaks, related technologies often rely on increasing hardware resources or optimizing software architecture to improve processing capabilities, but these measures often lack flexibility and cannot dynamically adjust resource allocation according to real-time traffic, which can easily lead to performance bottlenecks and request response delays during peak traffic periods. Summary of the invention
[0004] The present invention aims to solve at least one of the technical problems in the related art to a certain extent. To this end, the first purpose of the present invention is to propose a data subscription method, which can improve the stability and response speed of the subscription service by isolating the business channels and allocating resources, thereby optimizing the data processing process, reducing the data synchronization delay, and realizing the sharing and integration of business master data.
[0005] A second objective of the present invention is to provide a data subscription device.
[0006] A third objective of the present invention is to provide an electronic device.
[0007] A fourth object of the present invention is to provide a computer-readable storage medium.
[0008] A fifth object of the present invention is to provide a computer program product.
[0009] In order to achieve the above-mentioned purpose, the first aspect of the embodiment of the present invention proposes a data subscription method, which is characterized in that it is applied to a resource allocation pipeline, the resource allocation pipeline includes multiple business channels, resources are shared between the multiple business channels, the data input end of the resource allocation pipeline is connected to the publishing system, and the data output end of the resource allocation pipeline is connected to the subscription system. The data subscription method includes: obtaining a subscription request sent by the subscription system; when receiving the subscription request, determining a target business channel from multiple business channels; sending the data subscription service to the subscription system through the target business channel to complete the data subscription, wherein the data subscription service is published through the publishing system.
[0010] According to the data subscription method of the embodiment of the present invention, a subscription request sent by a subscription system is obtained, and when the subscription request is received, a target business channel is determined from multiple business channels, so that the data subscription service is sent to the subscription system through the target business channel to complete the data subscription, wherein the data subscription service is published through a publishing system, thereby, through the isolation of business channels and resource allocation, the stability and response speed of the subscription service can be improved, thereby optimizing the data processing process, reducing data synchronization delays, and realizing the sharing and integration of business master data.
[0011] In addition, the data subscription method according to the above embodiment of the present invention may also include the following additional technical features:
[0012] According to one embodiment of the present invention, the resources of each of the business channels include a data processing cluster and an application service group, and the data subscription service is sent to the subscription system through the target business channel, including: using the data processing cluster corresponding to the target business channel to perform peak shaving and valley filling processing on the data subscription service; using the application service group corresponding to the target business channel to perform storage processing, comparison processing and outbound subscription processing on the data subscription service.
[0013] According to an embodiment of the present invention, fault isolation settings are performed between different service channels, between different data processing clusters, and between different application service groups.
[0014] According to one embodiment of the present invention, different data subscription services are respectively bound to different service channels, and a target service channel is determined from the multiple service channels, including: determining the service channel bound to the data subscription service as the target service channel; when a failure occurs in the service channel bound to the data subscription service, obtaining the idleness of each service channel in other service channels; and determining the target service channel from the other service channels according to the idleness.
[0015] According to an embodiment of the present invention, the method further includes: when it is acquired that a new service channel exists in the resource allocation pipeline, setting resource sharing between the new service channel and the multiple service channels.
[0016] According to one embodiment of the present invention, the method further includes: when the congestion degree of the multiple service channels is greater than a preset congestion degree, or the number of the data subscription services is greater than the total capacity upper limit of the multiple service channels, setting the new service channel in the resource allocation pipeline.
[0017] In order to achieve the above-mentioned purpose, the second aspect of the embodiment of the present invention proposes a data subscription device, which is applied to a resource allocation pipeline, the resource allocation pipeline includes multiple business channels, resources are shared between the multiple business channels, the data input end of the resource allocation pipeline is connected to the publishing system, and the data output end of the resource allocation pipeline is connected to the subscription system. The data subscription device includes: an acquisition module, which is used to obtain a subscription request sent by the subscription system; a selection module, which is used to determine a target business channel from the multiple business channels when receiving the subscription request; and a processing module, which is used to send the data subscription service to the subscription system through the target business channel to complete the data subscription, wherein the data subscription service is published through the publishing system.
[0018] According to the data subscription device of the embodiment of the present invention, the subscription request sent by the subscription system is obtained by the acquisition module, and the target business channel is determined from multiple business channels by the selection module when the subscription request is received, so as to send the data subscription service to the subscription system through the target business channel according to the processing module to complete the data subscription, wherein the data subscription service is published through the publishing system, thereby, through the isolation of the business channel and the allocation of resources, the stability and response speed of the subscription service can be improved, thereby optimizing the data processing process, reducing the data synchronization delay, and realizing the sharing and integration of business master data.
[0019] In order to achieve the above-mentioned purpose, an embodiment of the third aspect of the present invention proposes an electronic device, including a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the data subscription method of the aforementioned embodiment of the present invention when executing the computer program.
[0020] According to the electronic device of the embodiment of the present invention, the processor executes the computer program, isolates the business channels and allocates resources, thereby improving the stability and response speed of the subscription service, thereby optimizing the data processing flow, reducing data synchronization delays, and realizing the sharing and integration of business master data.
[0021] In order to achieve the above-mentioned purpose, the fourth aspect of the present invention proposes a computer-readable storage medium on which a data subscription program is stored. When the data subscription program is executed by a processor, the data subscription method of the aforementioned embodiment of the present invention is implemented.
[0022] According to the computer-readable storage medium of the embodiment of the present invention, by adopting the data subscription program of the above-mentioned embodiment of the present invention, the isolation and resource allocation of business channels can improve the stability and response speed of the subscription service, thereby optimizing the data processing flow, reducing data synchronization delays, and realizing the sharing and integration of business master data.
[0023] In order to achieve the above-mentioned objective, a fifth aspect of the present invention provides a computer program product, which is used to execute the data subscription method of the aforementioned embodiment of the present invention.
[0024] According to the computer program product of the embodiment of the present invention, by executing the data subscription method of the above embodiment, the business channel is isolated and resources are allocated, which can improve the stability and response speed of the subscription service, thereby optimizing the data processing flow, reducing data synchronization delays, and realizing the sharing and integration of business master data.
[0025] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] Figure 1 is a block diagram of a data subscription model according to an embodiment of the present invention;
[0027] Figure 2 is a flow chart of a data subscription method according to an embodiment of the present invention;
[0028] Figure 3 is a schematic diagram of switching of service channels according to an embodiment of the present invention;
[0029] Figure 4 is a schematic diagram of capacity expansion of a data subscription model according to an embodiment of the present invention;
[0030] Figure 5 is a block diagram of a data subscription device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0031] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and should not be construed as limiting the present invention.
[0032] The following describes a data subscription method, a computer-readable storage medium, a computer program product, an electronic device, a data subscription apparatus, and a data subscription system according to embodiments of the present invention with reference to the accompanying drawings.
[0033] Before introducing the data subscription method and device of the present invention, the data subscription of the present invention is first explained accordingly. Specifically, the data subscription method and device are applied to a resource allocation pipeline, and the resource allocation pipeline includes multiple service channels. Resources are shared between multiple service channels, so that when a service channel fails, the resources on the failed service channel can be allocated to other service channels, and when the number of data subscription services of multiple service channels is greater than the upper limit of the total capacity of the multiple service channels, a new resource allocation pipeline can be set to allocate part of the data subscription services to the new resource allocation pipeline, thereby enhancing the flexibility and reliability of the system and improving the utilization of resources. The data input end of the resource allocation pipeline is connected to the publishing system, and the data output end of the resource allocation pipeline is connected to the subscription system. For example, Figure 1 As shown, the resource allocation pipeline can be preferably an SDP (Service Data Plane) data pipeline, and a data subscription model 100 is provided. The data subscription model 100 includes an SDP data pipeline, and the SDP data pipeline includes multiple business channels, such as business channel 1, business channel 2 and business channel 3. Business channel 1, business channel 2 and business channel 3 all include MQ clusters and application service groups. The data input end of the resource allocation pipeline is connected to a publishing system, such as a first publishing system, a second publishing system, a third publishing system and a fourth publishing system, and the data output end of the resource allocation pipeline is connected to a subscription system, such as a first subscription system, a second subscription system, a third subscription system and a fourth subscription system.
[0034] Figure 2 It is a flowchart of a data subscription method according to an embodiment of the present invention.
[0035] Specifically, in some embodiments of the present invention, Figure 2 As shown, the data subscription method includes:
[0036] S101, obtaining a subscription request sent by a subscription system.
[0037] Specifically, in this embodiment, Figure 1 As shown, the subscription system includes a first subscription system, a second subscription system, a third subscription system and a fourth subscription system, etc., and the subscription request sent by the subscription system can be obtained through a preset interface or protocol. The subscription request includes the number and type of data subscription services.
[0038] S102: upon receiving a subscription request, determining a target service channel from a plurality of service channels.
[0039] Specifically, in this embodiment, Figure 1 As shown, if the received service request is to subscribe to the first data subscription service and the second data subscription service, service channel 1 can be determined as the target service channel; if the received service request is to subscribe to the fourth data subscription service and the fifth data subscription service, service channel 2 can be determined as the target service channel.
[0040] S103, sending the data subscription service to the subscription system through the target service channel to complete the data subscription, wherein the data subscription service is published through the publishing system.
[0041] Specifically, in this embodiment, Figure 1 As shown, the subscription system includes a first subscription system, a second subscription system, a third subscription system and a fourth subscription system, etc. If the first subscription system sends a subscription request to subscribe to a first data subscription service, service channel 1 can be determined as the target service channel, and then the first data subscription service can be sent to the first subscription system through service channel 1 to complete the data subscription, wherein the data subscription service is published through a publishing system, and the publishing system includes a first publishing system, a second publishing system, a third publishing system and a fourth publishing system, etc. The first data subscription service can be published by the first publishing system, which is not specifically limited here.
[0042] Furthermore, in some embodiments of the present invention, the resources of each service channel include a data processing cluster and an application service group, and the data subscription service is sent to the subscription system through the target service channel, including: using the data processing cluster corresponding to the target service channel to perform peak shaving and valley filling processing on the data subscription service; using the application service group corresponding to the target service channel to perform storage processing, comparison processing and outbound subscription processing on the data subscription service.
[0043] Specifically, in this embodiment, the data processing cluster may preferably be an MQ (Message Queue) cluster, such as Figure 1As shown, the MQ cluster includes an MQ1 cluster and an MQ2 cluster. When the target business channel is business channel 1, after the first publishing system publishes the first data subscription service to business channel 1, the MQ1 cluster in business channel 1 performs peak shaving and valley filling processing on the first data subscription service, and adopts an application service group to save, compare and send out subscription processing on the first data subscription service after the peak shaving and valley filling processing. It should be noted that the application service group includes a first application service group, a second application service group and a third application service group, and then the first data subscription service can be sequentially saved through the first application service group, compared through the second application service group, and sent out subscription processing through the third application service group.
[0044] It should be noted that the MQ cluster receives data subscription services from the publishing system and performs peak shaving and valley filling processing according to the system load, thereby avoiding performance bottlenecks under high concurrency conditions. The data subscription services after peak shaving and valley filling processing are passed to the application service group for preservation processing. This step ensures that the data is safely stored in the system for subsequent use. Secondly, the application service group compares the saved data to check the integrity and consistency of the data, which helps to ensure the accuracy and reliability of the data. Finally, the application service group sends the processed data to the subscription system to complete the data subscription business process.
[0045] Furthermore, in some embodiments of the present invention, fault isolation settings are performed between different service channels, between different data processing clusters, and between different application service groups.
[0046] Specifically, in this embodiment, Figure 1 As shown, business channel 1, business channel 2 and business channel 3 are isolated from each other, and the MQ clusters and application service groups in business channel 1, business channel 2 and business channel 3 are also isolated, which can improve the security and stability of the system, thereby providing users with more efficient and reliable data subscription services.
[0047] Furthermore, in some embodiments of the present invention, different data subscription services are respectively bound to different service channels, and a target service channel is determined from multiple service channels, including: determining the service channel bound to the data subscription service as the target service channel; when a service channel bound to the data subscription service fails, obtaining the idleness of each service channel in other service channels; and determining the target service channel from other service channels based on the idleness.
[0048] Specifically, in this embodiment, Figure 1As shown, the first data subscription service, the second data subscription service and the third data subscription service are bound to service channel 1, the fourth data subscription service, the fifth data subscription service and the sixth data subscription service are bound to service channel 2, and service channel 3 can be bound to one or more of the other data subscription services, thereby improving the flexibility and scalability of the system and providing users with more efficient and reliable data subscription services. Figure 3 As shown, service channel 3 can be bound to one or more services in other data subscription services. If service channel 3 fails, the idleness of service channel 1 and service channel 2 can be obtained. If the idleness of service channel 2 is greater than that of service channel 1, service channel 2 can be determined as the target service channel, thereby improving the reliability and stability of the system and enhancing the fault tolerance of the system. The idleness refers to the proportion of resources that are currently not used in the service channel.
[0049] Furthermore, in some embodiments of the present invention, when it is obtained that a new service channel exists in the resource allocation pipeline, resource sharing between the new service channel and multiple service channels is set.
[0050] Specifically, in this embodiment, when the congestion degree of multiple service channels is greater than the preset congestion degree, or the number of data subscription services is greater than the total capacity upper limit of multiple service channels, a new service channel is set in the resource allocation pipeline, for example, Figure 4 As shown, when business channel 1, business channel 2 and business channel 3 cannot complete the resource allocation processing for the data subscription service, a new application service group and a new MQ cluster are added to construct business channel 4, and then business channel 4 assists business channel 1, business channel 2 and business channel 3 in resource allocation processing for the data subscription service. At this time, resources are shared between business channel 4 and business channel 1, business channel 2 and business channel 3. The congestion degree refers to the congestion condition or the degree of reduced efficiency of the business channel when processing the data subscription service. The congestion degree can be measured by the average processing time of a single data subscription service of the business channel and / or the number of data subscription services backlogged in the waiting queue. For example, if the number of data subscription services backlogged in the waiting queue is greater than 100, it means that the congestion degree of multiple business channels is greater than the preset congestion degree.
[0051] It should be noted that if Figure 4As shown in the figure, when business channel 1, business channel 2 and business channel 3 cannot complete the resource allocation processing for the data subscription business, the new MQ cluster in the expanded business channel 4 is the MQ3 cluster, which is different from the MQ clusters in business channel 1, business channel 2 and business channel 3. The MQ cluster in business channel 1 is the MQ1 cluster, and the MQ clusters in business channel 2 and business channel 3 are the MQ2 cluster. It should be noted that business channel 2 and business channel 3 share the MQ2 cluster to save costs. By introducing a new business channel and its supporting MQ cluster, the existing MQ cluster is effectively supplemented and optimized, the overall performance and scalability of the system are improved, and the long-term operating costs are reduced.
[0052] Furthermore, in some embodiments of the present invention, the service channel is determined according to the characteristics of the data subscription service, wherein the characteristics of the data subscription service include at least one parameter of the number, change frequency, message size and importance of the data subscription service.
[0053] Specifically, in this embodiment, the service channel is determined according to the characteristics of the data subscription service. For example, the service channel can be divided into at least one core service channel and at least one ordinary service channel according to the importance of the data subscription service. The service channel can be divided into at least one large message channel and at least one small message channel according to the message size of the data subscription service, wherein a small message is a message less than or equal to one hundred bytes, and a large message is a message greater than one hundred bytes. It should be noted that this definition is not absolute and fixed, and it is only used as a reference standard in the embodiment of the present invention. In addition, the service channel can also be determined according to at least one parameter among the number, change frequency, message size and importance of the data subscription service.
[0054] In summary, according to the data subscription method of an embodiment of the present invention, a subscription request sent by a subscription system is obtained, and when the subscription request is received, a target business channel is determined from multiple business channels, so as to send the data subscription service to the subscription system through the target business channel to complete the data subscription, wherein the data subscription service is published through the publishing system. Therefore, through the isolation and resource allocation of business channels, the stability and response speed of the subscription service can be improved, thereby optimizing the data processing process, reducing data synchronization delays, and realizing the sharing and integration of business master data.
[0055] Figure 5 is a block diagram of a data subscription device according to an embodiment of the present invention.
[0056] Specifically, the data subscription device is applied to a resource allocation pipeline, which includes multiple business channels. Resources are shared between the multiple business channels. The data input end of the resource allocation pipeline is connected to the publishing system, and the data output end of the resource allocation pipeline is connected to the subscription system. The data subscription device 200 includes an acquisition module 10, a selection module 20 and a processing module 30.
[0057] Among them, the acquisition module 10 is used to obtain the subscription request sent by the subscription system; the selection module 20 is used to determine the target business channel from multiple business channels when the subscription request is received; the processing module 30 is used to send the data subscription service to the subscription system through the target business channel to complete the data subscription, wherein the data subscription service is published through the publishing system.
[0058] In some embodiments of the present invention, the resources of each service channel include a data processing cluster and an application service group. The data subscription service is sent to the subscription system through the target service channel. The processing module 30 is also used to use the data processing cluster corresponding to the target service channel to perform peak shaving and valley filling processing on the data subscription service; and use the application service group corresponding to the target service channel to perform storage processing, comparison processing and outbound subscription processing on the data subscription service.
[0059] In some embodiments of the present invention, fault isolation settings are performed between different service channels, between different data processing clusters, and between different application service groups.
[0060] In some embodiments of the present invention, different data subscription services are respectively bound to different service channels, and a target service channel is determined from multiple service channels. The processing module 30 is also used to determine the service channel bound to the data subscription service as the target service channel; when a service channel bound to the data subscription service fails, the idleness of each service channel in other service channels is obtained; and the target service channel is determined from other service channels based on the idleness.
[0061] In some embodiments of the present invention, the processing module 30 is further configured to set resource sharing between the newly added service channel and multiple service channels when it is obtained that a newly added service channel exists in the resource allocation pipeline.
[0062] In some embodiments of the present invention, the processing module 30 is further used to set a new service channel in the resource allocation pipeline when the congestion degree of multiple service channels is greater than a preset congestion degree, or the number of data subscription services is greater than the total capacity upper limit of multiple service channels.
[0063] It should be noted that, for other specific implementations of the data subscription device proposed in the embodiment of the present invention, reference can be made to the specific implementations of the data subscription method in the aforementioned embodiment of the present invention, which will not be described again here to reduce redundancy.
[0064] In summary, according to the data subscription device of the embodiment of the present invention, the subscription request sent by the subscription system is obtained through the acquisition module, and the target business channel is determined from multiple business channels through the selection module when the subscription request is received, so as to send the data subscription service to the subscription system through the target business channel according to the processing module to complete the data subscription, wherein the data subscription service is published through the publishing system, thereby, through the isolation of business channels and resource allocation, the stability and response speed of the subscription service can be improved, thereby optimizing the data processing process, reducing data synchronization delays, and realizing the sharing and integration of business master data.
[0065] Based on the data subscription method proposed in the aforementioned embodiment of the present invention, the embodiment of the present invention further proposes an electronic device, including a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the data subscription method of the aforementioned embodiment of the present invention is implemented when the processor executes the computer program.
[0066] According to the electronic device of the embodiment of the present invention, the processor executes the computer program, isolates the business channels and allocates resources, thereby improving the stability and response speed of the subscription service, thereby optimizing the data processing flow, reducing data synchronization delays, and realizing the sharing and integration of business master data.
[0067] Based on the data subscription method proposed in the aforementioned embodiment of the present invention, the embodiment of the present invention further proposes a computer-readable storage medium, on which a data subscription program is stored. When the data subscription program is executed by a processor, the data subscription method of the aforementioned embodiment of the present invention is implemented.
[0068] According to the computer-readable storage medium of the embodiment of the present invention, by adopting the data subscription program of the above-mentioned embodiment of the present invention, the isolation and resource allocation of business channels can improve the stability and response speed of the subscription service, thereby optimizing the data processing flow, reducing data synchronization delays, and realizing the sharing and integration of business master data.
[0069] Based on the data subscription method proposed in the above embodiment of the present invention, the embodiment of the present invention further proposes a computer program product, which is used to execute the data subscription method in the above embodiment of the present invention.
[0070] According to the computer program product of the embodiment of the present invention, by executing the data subscription method of the above embodiment, the business channel is isolated and resources are allocated, which can improve the stability and response speed of the subscription service, thereby optimizing the data processing flow, reducing data synchronization delays, and realizing the sharing and integration of business master data.
[0071] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.
[0072] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.
[0073] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.
[0074] In the description of the present invention, it is to be understood that the terms “center”, “longitudinal”, “lateral”, “length”, “width”, “thickness”, “up”, “down”, “front”, “back”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, “clockwise”, “counterclockwise”, “axial”, “radial”, “circumferential”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.
[0075] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.
[0076] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0077] In the present invention, unless otherwise clearly specified and limited, a first feature being "above" or "below" a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being "above", "above" or "above" a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being "below", "below" or "below" a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.
[0078] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.
Claims
1. A data subscription method, characterized in that: Applied to a resource allocation pipeline, the resource allocation pipeline includes multiple business channels, resources are shared between the multiple business channels, the data input end of the resource allocation pipeline is connected to a publishing system, and the data output end of the resource allocation pipeline is connected to a subscription system. The data subscription method includes: Obtaining a subscription request sent by the subscription system; Upon receiving the subscription request, determining a target service channel from the multiple service channels; The data subscription service is sent to the subscription system through the target service channel to complete the data subscription, wherein the data subscription service is published through the publishing system.
2. The data subscription method according to claim 1, characterized in that: The resources of each of the service channels include a data processing cluster and an application service group, and sending the data subscription service to the subscription system through the target service channel includes: Using the data processing cluster corresponding to the target service channel to perform peak shaving and valley filling processing on the data subscription service; The application service group corresponding to the target service channel is used to perform storage processing, comparison processing and outbound subscription processing on the data subscription service.
3. The data subscription method according to claim 2, characterized in that: Fault isolation is set up between different business channels, between different data processing clusters, and between different application service groups.
4. The data subscription method according to claim 1, characterized in that: Different data subscription services are respectively bound to different service channels, and a target service channel is determined from the multiple service channels, including: Determine the service channel bound to the data subscription service as the target service channel; When a service channel bound to the data subscription service fails, obtaining the idleness of each service channel in other service channels; The target service channel is determined from the other service channels according to the idleness.
5. The data subscription method according to claim 1, characterized in that: The method further comprises: When it is obtained that a new service channel exists in the resource allocation pipeline, resource sharing between the new service channel and the multiple service channels is set.
6. The data subscription method according to claim 5, characterized in that: The method further comprises: When the congestion degree of the multiple service channels is greater than a preset congestion degree, or the number of the data subscription services is greater than the total capacity upper limit of the multiple service channels, the newly added service channel is set in the resource allocation pipeline.
7. A data subscription device, characterized in that: Applied to a resource allocation pipeline, the resource allocation pipeline includes multiple business channels, resources are shared between the multiple business channels, the data input end of the resource allocation pipeline is connected to a publishing system, the data output end of the resource allocation pipeline is connected to a subscription system, and the data subscription device includes: An acquisition module, used to acquire a subscription request sent by the subscription system; A selection module, configured to determine a target service channel from the multiple service channels upon receiving the subscription request; The processing module is used to send the data subscription service to the subscription system through the target service channel to complete the data subscription, wherein the data subscription service is published through the publishing system.
8. An electronic device, characterized in that: The method comprises a processor, a memory and a computer program stored in the memory and executable on the processor, wherein the processor implements the data subscription method as described in any one of claims 1 to 6 when executing the computer program.
9. A computer-readable storage medium, characterized in that: A data subscription program is stored thereon, and when the data subscription program is executed by a processor, the data subscription method described in any one of claims 1-6 is implemented.
10. A computer program product, characterized in that The computer program product is used to execute the data subscription method according to any one of claims 1 to 6.