A preference space Skyline query processing method based on a Spark environment

A processing method and processing algorithm technology, applied in the Internet field, can solve problems such as not being suitable for multi-user preference query, centralized processing method performance is difficult to meet user needs, etc.

Inactive Publication Date: 2019-06-28
NORTHEASTERN UNIV
View PDF3 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The present invention provides a preference space Skyline query processing method based on the Spark environment, which can effectively solve the problem that the existing preference space Skyline query algorithm proposed in the above-mentioned background technology is...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A preference space Skyline query processing method based on a Spark environment
  • A preference space Skyline query processing method based on a Spark environment
  • A preference space Skyline query processing method based on a Spark environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0058] Example: such as Figure 1-4 As shown, the present invention provides a technical solution, a preferred spatial Skyline query processing method based on the Spark environment, and the Skyline query processing method based on the Spark environment includes a spatial Skyline query processing algorithm based on a preference function and a spatial Skyline query based on preference priority Processing algorithm

[0059] The specific steps of the spatial Skyline query processing algorithm based on the preference function are as follows:

[0060] S1. Attribute integration: use preference function to integrate spatial attributes and non-spatial attributes of spatial data objects in the dataset into a new attribute;

[0061] S2, data division and preprocessing: divide and preprocess the integrated data set;

[0062] S3. Local Skyline calculation: parallel calculation of local Skyline results on the divided sub-data sets;

[0063] S4. Global Skyline calculation: combine the local Skyline...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a preference space Skyline query processing method based on a Spark environment. The method comprises a space Skyline query processing algorithm based on a preference functionand a space Skyline query processing algorithm based on preference priority. The method is scientific and reasonable;use is safe and convenient, the method comprises the following steps: through the effect of a space Skyline query processing algorithm based on a preference function; the spatial attributes and the non-spatial attributes of the data are integrated, and the data which does not meet the preference of any query point is filtered by utilizing the correlation, so that the size of a data set is reduced, the processing task amount is further reduced by utilizing the grid dominant relationship, and the query processing speed is increased; skyline query processing algorithm based on preference priority is used for clustering spatial data, keywords with high occurrence frequency in the class are used as text feature information of the whole class, and meanwhile, an extended R-tree index is established for spatial objects in the class; efficient space searching and filtering capabilities of the extened R-tree index are dominated and judged, so that Skyline query processing is accelerated.

Description

Technical field [0001] The invention relates to the technical field of the Internet, in particular to a method for processing Skyline in a preference space based on a Spark environment. Background technique [0002] Skyline query is a relatively common query method in the database field. It has important advantages in solving multi-objective decision-making problems. Preference query is mainly used in service recommendation systems. Preference space Skyline query is the basis of spatial Skyline query and preference query. Developed from above, it is mainly used to return a collection of spatial objects that meet the user's query location requirements and user preferences, and then provide support for further decision-making. The existing preference space Skyline query algorithm is mainly for queries that share a single preference, so it is not suitable for multi-user preference query processing. At the same time, when the number of spatial objects to be queried is very large, the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/33G06F16/35
Inventor 乔百友郑宇杰乔曦宇韩东红吴刚刘辉林王波涛
Owner NORTHEASTERN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap