Skyline inquiring system based on space timing sequence dataflow application

A query system and data flow technology, applied in the field of Skyline's query system, can solve the problems of poor universality and poor scalability

Active Publication Date: 2017-05-31
DALIAN UNIV
View PDF8 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, some Skyline algorithms based on MapReduce have modified the Hadoop framework, but there are still problems of poor scalability and poor universality
The MapReduce-based dynamic Skyline query method that we researched and designed before can only perform offline batch processing of non-real-time data, and cannot be well used for real-time data query

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Skyline inquiring system based on space timing sequence dataflow application
  • Skyline inquiring system based on space timing sequence dataflow application
  • Skyline inquiring system based on space timing sequence dataflow application

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0029] A skyline query method based on space-time series data stream applications. Invention steps are as follows:

[0030] S1: Based on space timing division:

[0031] We will split the continuous time series into time slices by time windows. Such as figure 1 As shown, the method is as follows: Given a set of objects P, each data point p k The time attribute value (t) in a bounded interval [T min , T max ], construct a uniform partition {t 0 ,...,t B},t i Definition:

[0032] t i =T min +l×i, l=(T max -T min ) / B,i=0,...,B;

[0033] to form a set of time slices {b 0 ,...,b B-1}, each time slice b i =[t i ,t i+1 ), with a fixed length l. The time attribute value of each point is mapped to time slice b s(t) ∈{b 0 ,...,b B-1}, where s(t) is defined as B is the number of evenly divided bounded intervals.

[0034] The value of the interval fixed length (l) of different granularities depends on the actual application situation. In order to reduce the amount...

Embodiment 2

[0067] This embodiment relates to the specific application of the Skyline query method based on the spatial time series data stream application described in Embodiment 1:

[0068] The skyline query system based on the space time series data flow application is used for mobile medical calls. The cloud center service system provides spatial grid pruning strategies and continuous network medical data monitoring to execute dynamic Skyline and global Skyline algorithms, and input the thresholds of each attribute And the query result is sent according to the end of the execution time to improve the attributes of the hospital. That is, the system performs the following steps:

[0069] S1. The cloud center service system provides module index data structures with distributed dynamic Skyline and global Skyline algorithms. At the same time, we use the Spark streaming system to start multiple Maps to read time stream data, and each Map reads different HDFS data. Fragments generate data ...

Embodiment 3

[0072] The skyline query method based on the space time series data stream application in Example 1 is used for epidemic detection. First, we will divide the time series of epidemic monitoring into several time segments according to the time window, and then perform Skyline query on the data of each time segment. Static query. For the time object set P when the epidemic occurs, each data point p k The time attribute value (t) in a bounded interval [T min , T max ], construct a uniform partition {t 0 ,...,t B},t i The definition of t i =T min +l×i, l=(T max -T min ) / B, i=0, . . . , B. Form a collection of time slices {b 0 ,...,b B-1}, each time slice b i =[t i ,t i+1 ), with a fixed length l. The time attribute value of each point is mapped to time slice b s(t) ∈{b 0 ,...,b B-1}, where s(t) is as Among them, the value of interval (l) of different particle sizes depends on the actual monitoring time. At the same time, in order to reduce the amount of calcula...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a Skyline inquiring system based on space timing sequence dataflow application, belongs to the application field of dynamic Skyline inquiry in a dataflow, and is used for solving the real-time inquiring processing problem of mass data. Through the technical key points, the Skyline inquiring system comprises a cloud center service system; the cloud center service system comprises a partitioning module, an inverted gridding index generation module and a calculation module, wherein the partitioning module is used for partitioning continuous time timing sequences into a plurality of time slices according to time windows based on space timing sequence partitioning; the inverted gridding index generation module is used for generating gridding inverted indexes for each time slice; and the calculation module is used for mapping moment inquiring points into corresponding Skyline griddings, then using a global Skyline gridding calculation method to obtain global Skyline griddings as a candidate set, then carrying out dynamic Skyline inquiring according to time sequence on network node data in the candidate set, and calculating to obtain an effective global Skyline result. The system has the effects that result inquiring is carried out at the moment that the execution time is ended, so that the system accords with the practical situation more accurately.

Description

technical field [0001] The invention relates to the application field of dynamic skyline query in data flow, and is a skyline query system based on space time series data flow application. The system involves large-scale data analysis, space time series massive data processing, and global skyline calculation. Background technique [0002] With the rapid development of the Internet and the Internet of Things and the wide application of technologies such as social networks and cloud computing, massive data technology has developed rapidly. Massive amounts of data are collected and recorded for research and analysis in science, engineering and business. According to the latest research, data sources such as the global Internet, mobile Internet, and GPS networks generate more than 2.5×10 18 Bytes of massive data, and these massive data come from a wide range of sources. The data on the Internet doubles every two years, and the Internet of Things, mobile Internet, Internet of V...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F19/00
CPCG06F19/32G06F16/2264G06F16/2457G06F16/9537
Inventor 季长清王宝凤谢雨婧李媛媛
Owner DALIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap