Neighbor storage method based on data mapping algorithm

A data mapping and algorithm technology, applied in the input/output process of data processing, electrical digital data processing, calculation, etc., can solve the problem of high query overhead, achieve the effect of improving accuracy, reducing switching overhead, and improving query efficiency

Inactive Publication Date: 2016-10-12
NANJING UNIV OF POSTS & TELECOMM
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved by the present invention is to overcome the deficiencies of the prior art and provide a neighbor storage method based on the data mapping algorithm, which combines the spectral hash algorithm with the data mapping algorithm to map the data into the distributed storage network , which solves the problem of excessive system query overhead during correlation query when distributed storage in large-scale data scenarios, and improves data query efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neighbor storage method based on data mapping algorithm
  • Neighbor storage method based on data mapping algorithm
  • Neighbor storage method based on data mapping algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Embodiments of the present invention will be described below in conjunction with the accompanying drawings.

[0026] As attached to the manual figure 1 As shown, the present invention provides a neighbor storage method based on a data mapping algorithm. This scheme is mainly divided into three levels, which are: using spectral hash for hash mapping, data mapping algorithm, and construction of Chord. The specific implementation steps include the following:

[0027] Step 1. Using spectral hashing algorithm to hash map the high-dimensional data samples to obtain the k-dimensional binary hash code of each high-dimensional data item. The specific process is as follows:

[0028] The spectral hashing algorithm is to integrate the spectral analysis technology into the hash function, and use the constructed new hash function to process high-dimensional data. Spectral hashing needs to perform spectral analysis on high-dimensional data samples first, and then generate a hash fu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for storing neighbors based on a data mapping algorithm. It is converted to obtain the Z-Value value of each high-dimensional data item; the Chord method is used to construct a distributed node network, and the distributed node network is composed of the Chord ring and m node servers distributed in the Chord ring; Map and store the Z-Value value of the high-dimensional data item to the node server, and update the node server routing table to obtain the stored node; perform a correlation query according to the high-dimensional data item to be queried, and determine the Z-Value of the high-dimensional data item to be queried value, and search the node server routing table of each node clockwise to find the node server where the high-dimensional data item is located. The invention can realize the storage of neighbors, and when the correlation query is performed, the switching overhead of the node server is reduced, the query accuracy rate is improved, the operation efficiency of the whole system is improved, and the network bandwidth is reduced.

Description

technical field [0001] The invention relates to a neighbor storage method based on a data mapping algorithm, and belongs to the technical field of data mining and machine learning. Background technique [0002] With the rapid development of the Internet, the era of exponential growth of massive data has arrived. The explosive growth of massive resources is a great test for the existing storage system. In the face of high-dimensional and massive data, how to effectively store massive data and efficiently query effective data information is a problem worth studying. [0003] In order to more efficiently solve the storage problem of massive data, distributed storage came into being. The mainstream distributed storage technology is the P2P system. According to the point-to-point and distributed characteristics of P2P technology, it is added to the cloud storage system to effectively solve the bottleneck problem of the central server of the centralized cloud storage system. D...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0608G06F3/0638G06F3/067
Inventor 成际镇李姗姗
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap