Cloud storage similar data detection method and system based on meta-semantic embedding
A data detection and cloud storage technology, applied in file metadata retrieval, digital data information retrieval, file system and other directions, can solve the problems of unstable feature value extraction, large amount of calculation, low detection efficiency, etc. User experience, improved accuracy, and reduced computational overhead
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0041] Embodiment 1, the similar data detection and deduplication method of this method includes feature extraction and similarity search, and also performs differential compression after the similarity search is completed.
[0042] In order to simplify the processing and improve the effect of semantic embedding, this method combines the neural network, and makes full use of the contextual semantic information of the data block for the two stages of feature extraction and similarity search to improve the effect of similar data detection.
[0043] The specific workflow is as follows:
[0044] Generation of meta-semantic model:
[0045] (1) All the data in the data domain stored in the server is subjected to CDC partitioning (CDC partitioning is a partitioning technology that partitions data according to data content).
[0046] (2) Generate a feature vector for the CDC block obtained in step (1):
[0047] Step 1: divide the data block into K blocks of fixed size;
[0048] Ste...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com