Big data multidimensional data indexing method based on space-filling curve

A space-filling curve and multi-dimensional data technology, applied in electrical digital data processing, special data processing applications, instruments, etc., to achieve the effect of reducing size, retaining continuity, and supporting range query

Active Publication Date: 2018-09-07
NORTHEASTERN UNIV
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the limitation of the Z-order space-filling curve is that it requires the expansion of all dimensions to be synchronized.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data multidimensional data indexing method based on space-filling curve
  • Big data multidimensional data indexing method based on space-filling curve
  • Big data multidimensional data indexing method based on space-filling curve

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.

[0043] There is a large amount of data related to auto parts in the automobile industry, and due to the characteristics of the automobile industry, the data related to these parts can be processed as multi-dimensional data.

[0044] In this embodiment, the relevant data of an automobile part is taken as an example, and an index is created for the relevant data of the automobile part using the big data multidimensional data indexing method based on a space-filling curve of the present invention.

[0045] A big data multidimensional data indexing method based on space-filling curves, including index creation, data retrieval, and index update and maintenance:

[0046] The sp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a big data multidimensional data indexing method based on a space-filling curve and relates to the field of data indexing technology in the big data environment. According to the method, first, a new space-filling curve Flat-zorder is utilized to perform linearization on each record in a file, and then index creation, data retrieval and index update and maintenance are realized according to the corresponding relation between the linearization result and a file name. The Flat-zorder space-filling curve only requires that dimensions are expanded according to an integer ratio, therefore, the continuity of a linear id value on each dimension is reserved, and acceptable complexity and time complexity are achieved. Through the big data multidimensional data indexing methodbased on the space-filling curve, compared with traditional multidimensional data indexing, index creation and update efficiency is improved, data retrieval speed is increased, the size of an index file is reduced, and meanwhile precise matching query and range query are supported.

Description

technical field [0001] The invention relates to the technical field of data indexing in a big data environment, in particular to a big data multi-dimensional data indexing method based on a space-filling curve. Background technique [0002] Today, with the continuous development of information technology, various applications generate massive amounts of data every day, followed by a series of problems such as data storage, query, extraction, and mining in the big data environment. With the development of various applications, there are more and more demands for the retrieval and analysis of multi-dimensional data in the big data environment. In the big data environment, there is such a type of multidimensional data, which is the background data generated by a specific application, and its important feature is that the multidimensional data is relatively concentrated in a data file. How to establish an efficient index mechanism for such multidimensional data, how to improve ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 宋杰徐超张丽何虹燕崔培楠
Owner NORTHEASTERN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap