Service signal queue filtering method and system based on cache

By using a cache -based business signal queue filtering method in the business system, the signal cache and synchronization lock mechanism are used to filter and generate a restructuring signal to solve the problem of low efficiency when the business system processs a large number of operating signals, and achieve more efficient signal filtering Effect.

CN119342003APending Publication Date: 2025-01-21欧冶工业品股份有限公司
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202411446324.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-16
Publication Date
2025-01-21

Smart Images

  • Figure CN119342003A_ABST
    Figure CN119342003A_ABST
Patent Text Reader

Abstract

The invention provides a cache-based service signal queue filtering method and system. The system comprises a signal cache module for recording a signal cache and managing a signal synchronization lock; after receiving the service signal queue, the signal screening module judges whether the service signal queue is a recombination signal which is re-put into the service signal queue by a filtering system; the signal locking module is used for filtering the service signal and generating a recombination signal; the signal relocking module is used for filtering the recombined signal and determining whether the recombined signal needs to be subjected to bottom processing or not; and the signal bottom-carrying processing module is used for carrying out bottom-carrying on the recombined signal. According to the method, repeated service signals can be filtered through a method for caching and comparing the signals, so that the number of the signals output to a service system is greatly reduced, and the processing efficiency of the service system is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of wireless data, and in particular to a service signal queue filtering method and system based on buffering. Background Art

[0002] When the business system processes the business signal queue, a large number of operation signals for the same business object will appear in a short period of time, but the business system only needs to process the final state of the business object after a series of operations. If the business system processes every business signal, the processing efficiency will be reduced.

[0003] Patent document CN108156093A discloses a multi-application data transmission method suitable for low-bandwidth weak connection environment, including: setting at least two priority queues, the priority queue with the highest data transmission priority is defined as a high priority queue; receiving one or more application data packets, marking the received application data packets with priority according to the set priority classification rules, and assigning them to the priority queue corresponding to their priority; real-time monitoring of the current network bandwidth, and setting a bandwidth threshold, comparing the monitoring result with the bandwidth threshold, and in response to the network bandwidth being less than the bandwidth threshold, according to the pre-set data packet filtering strategy, discarding the application data packets in the priority queues other than the high priority queue, and only sending the application data packets in the high priority queue. However, this invention is limited by the size of the buffer. Summary of the invention

[0004] In view of the defects in the prior art, an object of the present invention is to provide a service signal queue filtering method and system based on cache.

[0005] A service signal queue filtering method based on cache provided by the present invention includes:

[0006] Step S1: record signal cache and manage signal synchronization lock;

[0007] Step S2: filtering the service signal and generating a recombined signal;

[0008] Step S3: after receiving the service signal queue, determine whether it is a reorganized signal that the filtering system re-enters the service signal queue;

[0009] Step S4: Filter the recombination signal to determine whether the recombination signal needs to be processed;

[0010] Step S5: If a backup is required, the recombinant signal is used as a backup.

[0011] Preferably, in step S1:

[0012] Record signal cache, store business objects, corresponding version numbers, and corresponding reorganized signal ids in the form of Key-Value;

[0013] The signal synchronization lock is used to record whether the business object in the business signal has been processed; when a business signal attempts to obtain the synchronization lock, it determines whether the business object of this signal already exists in the signal cache module. If the business object already exists, the acquisition fails; if the business object does not exist, the acquisition succeeds, and this business object is recorded in the signal cache module, and a preset expiration time is set, and the version number is set to 0. After the expiration, the synchronization lock of this business object is automatically deleted from the signal cache module.

[0014] Preferably, in step S2:

[0015] Filter the business signal and generate a reorganized signal, parse the business object of the business signal, and obtain the synchronization lock from the signal cache module. If the synchronization lock is successfully obtained, create a new signal cache in the signal cache module, and send the signal to the business system for processing. At the same time, generate a reorganized signal with the business signal and version number, add it to the business signal queue for backup processing, and generate a reorganized signal id and record it in the signal cache; if the synchronization lock is not obtained, increase the version number of this signal in the signal cache module by 1, and discard the signal.

[0016] Preferably, in step S4:

[0017] Filter the recombination signal to determine whether the recombination signal needs to be processed;

[0018] Get the synchronization lock from the signal buffer module. If the synchronization lock is successfully obtained, the synchronization lock of the source signal corresponding to the reorganized signal has expired, and no new service signal enters. At this time, the reorganized signal should be input into the signal backup module for backup processing;

[0019] If the reorganization signal fails to obtain the synchronization lock, it is determined whether the business object is locked by the current reorganization signal based on the reorganization signal ID recorded in the signal cache. If the business object is locked by the current reorganization signal, the reorganization signal is input into the signal backup processing module; if the business object is not locked by the current reorganization signal, the current reorganization signal is discarded.

[0020] Preferably, in step S5:

[0021] Delete the business object cache of the reorganized signal in the signal cache module and retrieve the version number, determine whether the version number of the reorganized signal is consistent with the version number of the business object in the signal cache, and if they are inconsistent, transmit the signal to the business system for processing;

[0022] When the same business signal exists in the business signal queue, the first signal of each business object enters the business system for processing, and generates a reorganized signal to re-enter the business signal queue. After that, the signal of this business object within the preset time is discarded until the reorganized signal obtains the lock of the original signal for a backup process. When the number of signals in the business signal queue exceeds the preset standard, the lock of the original signal has expired before the reorganized signal re-enters the filtering system, and other signals of the same business object obtain the lock and generate a new reorganized signal. The current reorganized signal is not processed as a backup.

[0023] According to a cache-based service signal queue filtering system provided by the present invention, the cache-based service signal queue filtering method is executed, including:

[0024] Signal cache module: records signal cache and manages signal synchronization lock;

[0025] Signal screening module: after receiving the service signal queue, it determines whether it is a reorganized signal that is re-entered into the service signal queue by the filtering system;

[0026] Signal locking module: filters business signals and generates reorganized signals;

[0027] Signal re-locking module: filters the recombinant signal and determines whether the recombinant signal needs to be processed as a backup;

[0028] Signal backup processing module: provides backup for reorganized signals.

[0029] Preferably, in the signal buffer module:

[0030] Record signal cache, store business objects, corresponding version numbers, and corresponding reorganized signal ids in the form of Key-Value;

[0031] The signal synchronization lock is used to record whether the business object in the business signal has been processed; when a business signal attempts to obtain the synchronization lock, it determines whether the business object of this signal already exists in the signal cache module. If the business object already exists, the acquisition fails; if the business object does not exist, the acquisition succeeds, and this business object is recorded in the signal cache module, and a preset expiration time is set, and the version number is set to 0. After the expiration, the synchronization lock of this business object is automatically deleted from the signal cache module.

[0032] Preferably, in the signal screening module:

[0033] After receiving the service signal queue, determine whether it is a reorganized signal that the filtering system re-enters the service signal queue; transmit the service signal to the signal locking module for processing; and transmit the regenerated signal to the signal re-locking module for processing;

[0034] In the signal locking module:

[0035] Filter the business signal and generate a reorganized signal, parse the business object of the business signal, and obtain the synchronization lock from the signal cache module. If the synchronization lock is successfully obtained, create a new signal cache in the signal cache module, and send the signal to the business system for processing. At the same time, generate a reorganized signal with the business signal and version number, add it to the business signal queue for backup processing, and generate a reorganized signal id and record it in the signal cache; if the synchronization lock is not obtained, increase the version number of this signal in the signal cache module by 1, and discard the signal.

[0036] Preferably, in the signal relocking module:

[0037] Filter the recombination signal to determine whether the recombination signal needs to be processed;

[0038] Get the synchronization lock from the signal buffer module. If the synchronization lock is successfully obtained, the synchronization lock of the source signal corresponding to the reorganized signal has expired, and no new service signal enters. At this time, the reorganized signal should be input into the signal backup module for backup processing;

[0039] If the reorganization signal fails to obtain the synchronization lock, it is determined whether the business object is locked by the current reorganization signal based on the reorganization signal ID recorded in the signal cache. If the business object is locked by the current reorganization signal, the reorganization signal is input into the signal backup processing module; if the business object is not locked by the current reorganization signal, the current reorganization signal is discarded.

[0040] Preferably, in the signal backup processing module:

[0041] Delete the business object cache of the reorganized signal in the signal cache module and retrieve the version number, determine whether the version number of the reorganized signal is consistent with the version number of the business object in the signal cache, and if they are inconsistent, transmit the signal to the business system for processing;

[0042] When the same business signal exists in the business signal queue, the first signal of each business object enters the business system for processing, and generates a reorganized signal to re-enter the business signal queue. After that, the signal of this business object within the preset time is discarded until the reorganized signal obtains the lock of the original signal for a backup process. When the number of signals in the business signal queue exceeds the preset standard, the lock of the original signal has expired before the reorganized signal re-enters the filtering system, and other signals of the same business object obtain the lock and generate a new reorganized signal. The current reorganized signal is not processed as a backup.

[0043] Compared with the prior art, the present invention has the following beneficial effects:

[0044] 1. The present invention can filter duplicate business signals by using the signal caching and comparison method, thereby greatly reducing the number of signals output to the business system and improving the processing efficiency of the business system.

[0045] 2. The present invention can process multiple threads simultaneously, and the efficiency of filtering signals is higher;

[0046] 3. The filtering effect of the traditional method is limited by the size of the buffer. When the amount of business signals is large and the buffer is small, there will still be a large number of repeated business signals after filtering, and the filtering effect is poor. The filtering effect of the present invention will not be limited by the size of the buffer, and will have a better filtering effect. The traditional method will store a large amount of business signal information in the buffer, and the present invention only stores the information of the reorganized signal in the buffer, and the required buffer is smaller. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:

[0048] Figure 1 It is a schematic diagram of the process of the present invention. DETAILED DESCRIPTION

[0049] The present invention is described in detail below in conjunction with specific embodiments. The following embodiments will help those skilled in the art to further understand the present invention, but are not intended to limit the present invention in any form. It should be noted that, for those of ordinary skill in the art, several changes and improvements can also be made without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0050] Embodiment 1:

[0051] According to a cache-based service signal queue filtering method provided by the present invention, Figure 1 As shown, including:

[0052] Step S1: The signal buffer module records the signal buffer and manages the signal synchronization lock;

[0053] Specifically, in the signal buffer module:

[0054] Record signal cache, store business objects, corresponding version numbers, and corresponding reorganized signal ids in the form of Key-Value;

[0055] The signal synchronization lock is used to record whether the business object in the business signal has been processed; when a business signal tries to obtain the synchronization lock, it is determined whether the business object of this signal already exists in the signal cache module. If the business object already exists, the acquisition fails; if the business object does not exist, the acquisition succeeds, and the business object is recorded in the signal cache module, and the preset expiration time is set, and the version number is set to 0. After the expiration, the synchronization lock of this business object is automatically deleted from the signal cache module;

[0056] Step S2: signal locking module: filtering the service signal and generating a recombined signal;

[0057] Specifically, in the signal locking module:

[0058] Filter the business signal and generate a reorganized signal, parse the business object of the business signal, and obtain the synchronization lock from the signal cache module. If the synchronization lock is successfully obtained, a new signal cache is created in the signal cache module, and the signal is sent to the business system for processing. At the same time, the business signal and the version number are generated into a reorganized signal, added to the business signal queue for backup processing, and the reorganized signal id is generated and recorded in the signal cache; if the synchronization lock is not obtained, the version number of this signal in the signal cache module is increased by 1, and the signal is discarded;

[0059] Step S3: After receiving the service signal queue, the signal screening module determines whether it is a reorganized signal that is re-entered into the service signal queue by the filtering system;

[0060] In the signal screening module:

[0061] After receiving the service signal queue, it is determined whether it is a reorganized signal that is re-entered into the service signal queue by the filtering system; the service signal is transmitted to the signal locking module for processing; and the regenerated signal is transmitted to the signal re-locking module for processing.

[0062] Step S4: The signal re-locking module filters the recombinant signal to determine whether the recombinant signal needs to be processed as a backup;

[0063] In the signal relocking module:

[0064] Filter the recombination signal to determine whether the recombination signal needs to be processed;

[0065] Get the synchronization lock from the signal buffer module. If the synchronization lock is successfully obtained, the synchronization lock of the source signal corresponding to the reorganized signal has expired, and no new service signal enters. At this time, the reorganized signal should be input into the signal backup module for backup processing;

[0066] If the reorganization signal fails to obtain the synchronization lock, it is determined whether the business object is locked by the current reorganization signal based on the reorganization signal ID recorded in the signal cache. If the business object is locked by the current reorganization signal, the reorganization signal is input into the signal backup processing module; if the business object is not locked by the current reorganization signal, the current reorganization signal is discarded.

[0067] Step S5: The signal backup processing module backs up the recombined signal.

[0068] Specifically, in the signal back-end processing module:

[0069] Delete the business object cache of the reorganized signal in the signal cache module and retrieve the version number, determine whether the version number of the reorganized signal is consistent with the version number of the business object in the signal cache, and if they are inconsistent, transmit the signal to the business system for processing;

[0070] When the same business signal exists in the business signal queue, the first signal of each business object enters the business system for processing, and generates a reorganized signal to re-enter the business signal queue. After that, the signal of this business object within the preset time is discarded until the reorganized signal obtains the lock of the original signal for a backup process. When the number of signals in the business signal queue exceeds the preset standard, the lock of the original signal has expired before the reorganized signal re-enters the filtering system, and other signals of the same business object obtain the lock and generate a new reorganized signal. The current reorganized signal is not processed as a backup.

[0071] Embodiment 2:

[0072] Embodiment 2 is a preferred example of Embodiment 1, and is used to illustrate the present invention in more detail.

[0073] The present invention also provides a cache-based service signal queue filtering system, which can be implemented by executing the process steps of the cache-based service signal queue filtering method, that is, those skilled in the art can understand the cache-based service signal queue filtering method as a preferred implementation of the cache-based service signal queue filtering system.

[0074] A service signal queue filtering system based on cache is provided according to the present invention, comprising:

[0075] Signal cache module: records signal cache and manages signal synchronization lock;

[0076] Specifically, in the signal buffer module:

[0077] Record signal cache, store business objects, corresponding version numbers, and corresponding reorganized signal ids in the form of Key-Value;

[0078] The signal synchronization lock is used to record whether the business object in the business signal has been processed; when a business signal attempts to obtain the synchronization lock, it determines whether the business object of this signal already exists in the signal cache module. If the business object already exists, the acquisition fails; if the business object does not exist, the acquisition succeeds, and this business object is recorded in the signal cache module, and a preset expiration time is set, and the version number is set to 0. After the expiration, the synchronization lock of this business object is automatically deleted from the signal cache module.

[0079] Signal screening module: after receiving the service signal queue, it determines whether it is a reorganized signal that is re-entered into the service signal queue by the filtering system;

[0080] Specifically, in the signal screening module:

[0081] After receiving the service signal queue, it is determined whether it is a reorganized signal that is re-entered into the service signal queue by the filtering system; the service signal is transmitted to the signal locking module for processing; and the regenerated signal is transmitted to the signal re-locking module for processing.

[0082] Signal locking module: filters business signals and generates reorganized signals;

[0083] Specifically, in the signal locking module:

[0084] Filter the business signal and generate a reorganized signal, parse the business object of the business signal, and obtain the synchronization lock from the signal cache module. If the synchronization lock is successfully obtained, create a new signal cache in the signal cache module, and send the signal to the business system for processing. At the same time, generate a reorganized signal with the business signal and version number, add it to the business signal queue for backup processing, and generate a reorganized signal id and record it in the signal cache; if the synchronization lock is not obtained, increase the version number of this signal in the signal cache module by 1, and discard the signal.

[0085] Signal re-locking module: filters the recombinant signal and determines whether the recombinant signal needs to be processed as a backup;

[0086] Specifically, in the signal relocking module:

[0087] Filter the recombination signal to determine whether the recombination signal needs to be processed;

[0088] Get the synchronization lock from the signal buffer module. If the synchronization lock is successfully obtained, the synchronization lock of the source signal corresponding to the reorganized signal has expired, and no new service signal enters. At this time, the reorganized signal should be input into the signal backup module for backup processing;

[0089] If the reorganization signal fails to obtain the synchronization lock, it is determined whether the business object is locked by the current reorganization signal based on the reorganization signal ID recorded in the signal cache. If the business object is locked by the current reorganization signal, the reorganization signal is input into the signal backup processing module; if the business object is not locked by the current reorganization signal, the current reorganization signal is discarded.

[0090] Signal backup processing module: provides backup for reorganized signals.

[0091] Specifically, in the signal back-end processing module:

[0092] Delete the business object cache of the reorganized signal in the signal cache module and retrieve the version number, determine whether the version number of the reorganized signal is consistent with the version number of the business object in the signal cache, and if they are inconsistent, transmit the signal to the business system for processing;

[0093] When the same business signal exists in the business signal queue, the first signal of each business object enters the business system for processing, and generates a reorganized signal to re-enter the business signal queue. After that, the signal of this business object within the preset time is discarded until the reorganized signal obtains the lock of the original signal for a backup process. When the number of signals in the business signal queue exceeds the preset standard, the lock of the original signal has expired before the reorganized signal re-enters the filtering system, and other signals of the same business object obtain the lock and generate a new reorganized signal. The current reorganized signal is not processed as a backup.

[0094] Embodiment 3:

[0095] Embodiment 3 is a preferred example of Embodiment 1, and is used to illustrate the present invention in more detail.

[0096] The present invention establishes a filtering system based on signal caching to filter signals for the same business object and improve the processing efficiency of the business system.

[0097] The cache-based service signal queue filtering system includes the following modules:

[0098] Signal cache module, this module has two functions: recording signal cache and managing signal synchronization lock.

[0099] Record the signal cache, store the business object, the corresponding version number, and the corresponding reorganized signal id in the form of Key-Value. The signal synchronization lock is used to record whether the business object in the business signal has been processed. When a business signal attempts to obtain the synchronization lock, it determines whether the business object of this signal already exists in the signal cache module. If the business object already exists, the acquisition fails; if the business object does not exist, the acquisition succeeds, and the business object is recorded in the signal cache module, and a certain expiration time is set. The version number is set to 0. After the expiration, the synchronization lock of this business object is automatically deleted from the signal cache module.

[0100] The signal screening module is used to determine whether the signal is a reorganized signal that is re-entered into the service signal queue by the filtering system after receiving the service signal queue. The service signal is transmitted to the signal locking module for processing; the regenerated signal is transmitted to the signal re-locking module for processing.

[0101] Signal locking module, this module is used to filter business signals and generate reorganization signals. Parse the business object of the business signal and try to obtain the synchronization lock from the signal cache module. If the synchronization lock is successfully obtained, it means that this is the first operation of this business object in a short period of time. A new cache of this signal is created in the signal cache module, and the signal is sent to the business system for processing. At the same time, the business signal and the version number are used to generate a reorganization signal, which is added to the business signal queue for backup processing, and the reorganization signal id is generated and recorded in the signal cache. If the synchronization lock is not obtained, it means that this business object has been operated in a short period of time. The version number of this signal in the signal cache module is increased by 1, and the signal is discarded.

[0102] Signal re-locking module, this module is used to filter the recombination signal to determine whether the recombination signal needs to be processed as a backup.

[0103] First, try to obtain the synchronization lock from the signal cache module. If the synchronization lock is successfully obtained, it means that the synchronization lock of the source signal corresponding to the reorganized signal has expired and no new business signal has entered. At this time, the reorganized signal should be input into the signal backup module for backup processing.

[0104] If the reorganization signal fails to obtain the synchronization lock, it is necessary to determine whether the business object is locked by the current reorganization signal based on the reorganization signal ID recorded in the signal cache. If the current reorganization signal locks the business object, the reorganization signal should be input into the signal backup processing module. If the current reorganization signal does not lock the business object, it means that after the synchronization lock of the source signal of this reorganization signal expires, other business signals have locked the business object and generated a new reorganization signal for backup. The current reorganization signal can be discarded directly.

[0105] Signal back-up processing module, this module is used to make the reorganized signal play a back-up role. First, delete the business object cache of the reorganized signal in the signal cache module and take out the version number, and determine whether the version number of the reorganized signal is consistent with the version number of this business object in the signal cache. If they are inconsistent, it means that there are other signals of the same business object between the source signal corresponding to the reorganized signal and the reorganized signal. At this time, the signal should be transmitted to the business system for processing.

[0106] When there are a large number of identical business signals in the business signal queue, the first signal of each business object will enter the business system for processing, and generate a reorganized signal to re-enter the business signal queue. After that, the signals of this business object within a period of time will be discarded until the reorganized signal obtains the lock of the original signal for backup processing. When the number of signals in the business signal queue is too large, the lock of the original signal has expired before the reorganized signal re-enters the filtering system. At this time, other signals of the same business object will obtain the lock and generate a new reorganized signal. The current reorganized signal does not need to be processed. In summary, this system can automatically adjust the delay caused by the signal passing through the filtering system according to the number of signals in the current business signal queue.

[0107] At the same time, the service signal filtering system can support distributed deployment. As long as the signal cache module is deployed as a central cache, other modules can support distributed deployment.

[0108] Those skilled in the art know that, in addition to realizing the system and its various devices, modules, and units provided by the present invention in a purely computer-readable program code, it is entirely possible to realize the same functions in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, and embedded microcontrollers by logically programming the method steps. Therefore, the system and its various devices, modules, and units provided by the present invention can be considered as a hardware component, and the devices, modules, and units included therein for realizing various functions can also be regarded as structures within the hardware component; the devices, modules, and units for realizing various functions can also be regarded as both software modules for realizing the method and structures within the hardware component.

[0109] The above describes the specific embodiments of the present invention. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art can make various changes or modifications within the scope of the claims, which does not affect the essence of the present invention. In the absence of conflict, the embodiments of the present application and the features in the embodiments can be combined with each other arbitrarily.

Claims

1. A method for filtering a service signal queue based on a cache, comprising: Step S1: record signal cache and manage signal synchronization lock; Step S2: filtering the service signal and generating a recombined signal; Step S3: after receiving the service signal queue, determine whether it is a reorganized signal that the filtering system re-enters the service signal queue; Step S4: Filter the recombination signal to determine whether the recombination signal needs to be processed; Step S5: If a backup is required, the recombinant signal is used as a backup.

2. The method for filtering service signal queues based on cache according to claim 1, characterized in that: In step S1: Record signal cache, store business objects, corresponding version numbers, and corresponding reorganized signal ids in the form of Key-Value; The signal synchronization lock is used to record whether the business object in the business signal has been processed; when a business signal attempts to obtain the synchronization lock, it determines whether the business object of this signal already exists in the signal cache module. If the business object already exists, the acquisition fails; if the business object does not exist, the acquisition succeeds, and this business object is recorded in the signal cache module, and a preset expiration time is set, and the version number is set to 0. After the expiration, the synchronization lock of this business object is automatically deleted from the signal cache module.

3. The method for filtering service signal queues based on cache according to claim 1, characterized in that: In step S2: Filter the business signal and generate a reorganized signal, parse the business object of the business signal, and obtain the synchronization lock from the signal cache module. If the synchronization lock is successfully obtained, create a new signal cache in the signal cache module, and send the signal to the business system for processing. At the same time, generate a reorganized signal with the business signal and version number, add it to the business signal queue for backup processing, and generate a reorganized signal id and record it in the signal cache; if the synchronization lock is not obtained, increase the version number of this signal in the signal cache module by 1, and discard the signal.

4. The method for filtering service signal queues based on cache according to claim 1, characterized in that: In step S4: Filter the recombination signal to determine whether the recombination signal needs to be processed; Get the synchronization lock from the signal buffer module. If the synchronization lock is successfully obtained, the synchronization lock of the source signal corresponding to the reorganized signal has expired, and no new service signal enters. At this time, the reorganized signal should be input into the signal backup module for backup processing; If the reorganized signal does not obtain the synchronization lock, it is determined whether the business object is locked by the current reorganized signal according to the reorganized signal ID recorded in the signal cache. If the business object is locked by the current reorganized signal, the reorganized signal is input into the signal backup processing module; If the business object is not locked by the current reorganization signal, the current reorganization signal is discarded.

5. The method for filtering service signal queues based on cache according to claim 1, characterized in that: In step S5: Delete the business object cache of the reorganized signal in the signal cache module and retrieve the version number, determine whether the version number of the reorganized signal is consistent with the version number of the business object in the signal cache, and if they are inconsistent, transmit the signal to the business system for processing; When the same business signal exists in the business signal queue, the first signal of each business object enters the business system for processing, and generates a reorganized signal to re-enter the business signal queue. After that, the signal of this business object within the preset time is discarded until the reorganized signal obtains the lock of the original signal for a backup process. When the number of signals in the business signal queue exceeds the preset standard, the lock of the original signal has expired before the reorganized signal re-enters the filtering system, and other signals of the same business object obtain the lock and generate a new reorganized signal. The current reorganized signal is not processed as a backup.

6. A cache-based service signal queue filtering system, characterized in that: The method for filtering a service signal queue based on a cache according to any one of claims 1 to 5 comprises: Signal cache module: records signal cache and manages signal synchronization lock; Signal screening module: after receiving the service signal queue, it determines whether it is a reorganized signal that is re-entered into the service signal queue by the filtering system; Signal locking module: filters business signals and generates reorganized signals; Signal re-locking module: filters the recombinant signal and determines whether the recombinant signal needs to be processed as a backup; Signal backup processing module: provides backup for reorganized signals.

7. The cache-based service signal queue filtering system according to claim 6, characterized in that: In the signal buffer module: Record signal cache, store business objects, corresponding version numbers, and corresponding reorganized signal ids in the form of Key-Value; The signal synchronization lock is used to record whether the business object in the business signal has been processed; when a business signal attempts to obtain the synchronization lock, it determines whether the business object of this signal already exists in the signal cache module. If the business object already exists, the acquisition fails; if the business object does not exist, the acquisition succeeds, and this business object is recorded in the signal cache module, and a preset expiration time is set, and the version number is set to 0. After the expiration, the synchronization lock of this business object is automatically deleted from the signal cache module.

8. The cache-based service signal queue filtering system according to claim 6, characterized in that: In the signal screening module: After receiving the service signal queue, determine whether it is a reorganized signal that the filtering system re-enters the service signal queue; transmit the service signal to the signal locking module for processing; and transmit the regenerated signal to the signal re-locking module for processing; In the signal locking module: Filter the business signal and generate a reorganized signal, parse the business object of the business signal, and obtain the synchronization lock from the signal cache module. If the synchronization lock is successfully obtained, create a new signal cache in the signal cache module, and send the signal to the business system for processing. At the same time, generate a reorganized signal with the business signal and version number, add it to the business signal queue for backup processing, and generate a reorganized signal id and record it in the signal cache; if the synchronization lock is not obtained, increase the version number of this signal in the signal cache module by 1, and discard the signal.

9. The cache-based service signal queue filtering system according to claim 6, characterized in that: In the signal relocking module: Filter the recombination signal to determine whether the recombination signal needs to be processed; Get the synchronization lock from the signal buffer module. If the synchronization lock is successfully obtained, the synchronization lock of the source signal corresponding to the reorganized signal has expired, and no new service signal enters. At this time, the reorganized signal should be input into the signal backup module for backup processing; If the reorganized signal does not obtain the synchronization lock, it is determined whether the business object is locked by the current reorganized signal according to the reorganized signal ID recorded in the signal cache. If the business object is locked by the current reorganized signal, the reorganized signal is input into the signal backup processing module; If the business object is not locked by the current reorganization signal, the current reorganization signal is discarded.

10. The cache-based service signal queue filtering system according to claim 5, characterized in that: In the signal back-end processing module: Delete the business object cache of the reorganized signal in the signal cache module and retrieve the version number, determine whether the version number of the reorganized signal is consistent with the version number of the business object in the signal cache, and if they are inconsistent, transmit the signal to the business system for processing; When the same business signal exists in the business signal queue, the first signal of each business object enters the business system for processing, and generates a reorganized signal to re-enter the business signal queue. After that, the signal of this business object within the preset time is discarded until the reorganized signal obtains the lock of the original signal for a backup process. When the number of signals in the business signal queue exceeds the preset standard, the lock of the original signal has expired before the reorganized signal re-enters the filtering system, and other signals of the same business object obtain the lock and generate a new reorganized signal. The current reorganized signal is not processed as a backup.

Citation Information

Patent Citations

  • Multi-application data transmission method and system applicable to low-bandwidth weak-connection environment

    CN108156093A