Bloom Filter Querying for Accurate User Operation Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in accurately determining user operations on entities with limited storage resources, leading to high misjudgment rates due to cache ejection and increased access traffic, which puts pressure on storage services.
Innovation Solution
Utilizing a Bloom filter to process entity identifiers and store data in a bit array, reducing resource occupation and improving query efficiency by combining bit array data with cache and source storage data to enhance accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If cache query combined with back-to-source query is used to determine user operations, then service availability and accuracy are improved, but storage resource consumption increases
Solution Approach 1:
The patent creates a simplified copy of the cache data structure using a Bloom filter bit array. Instead of storing complete cache entries, only essential operation records are stored in the bit array, consuming significantly less storage resources while maintaining the ability to query user operations on entities.
Solution Approach 2:
The patent extracts only the critical components needed for operation determination from the full cache system. By using a Bloom filter to store just the essential operation records in a compact bit array format, it separates the core query function from the complete cache structure, reducing storage requirements.
2Measurement precision
If more storage resources are allocated to ensure high availability, then service accuracy is improved, but resource occupation increases
Solution Approach 1:
The patent changes the data structure parameters from storing complete cache entries to storing only essential operation records in a Bloom filter bit array. This parameter change maintains judgment accuracy for user operations while significantly reducing resource occupation by using a more compact representation.
3Measurement precision
If cache size is increased to reduce misjudgment, then query accuracy is improved, but storage pressure increases
Solution Approach 1:
The patent creates a simplified copy of the cache data structure using a Bloom filter bit array. Instead of storing complete cache entries, only essential operation records are stored in the bit array, consuming significantly less storage resources while maintaining the ability to query user operations on entities.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
Disclosed in the embodiments of the present disclosure are a data processing method and apparatus, and an electronic device and a storage medium. The data processing method comprises: acquiring a first identifier of a target object entity; processing the first identifier by means of a preset function in a preset bloom filter, so as to obtain first data; and on the basis of a storage condition of the first data in a preset digit array, determining whether a subject entity executes a preset operation on the target object entity, wherein data in the preset bit array comprises: second data which is obtained by means of processing, in response to the subject entity executing the preset operation on an object entity, a second identifier of the object entity by means of the preset function.