Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Internet of Things big data approximate aggregation method based on sampling

A technology of big data and Internet of Things, which is applied in the field of approximate aggregation of big data of Internet of Things based on sampling, can solve problems such as inability to guarantee performance, and achieve the effect of improving efficiency and improving scalability

Pending Publication Date: 2022-04-08
腾云悦智科技深圳有限责任公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

They do not guarantee the performance of the one example multiple queries discussed in this disclosure

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] The present invention will be described in detail below with reference to the specific embodiments.

[0016] The present invention provides a sample based on sample-based Internet of-connected large data, including the following steps:

[0017] Step 1: Suppose the network organization is a flat model, where each node communicates with the base station;

[0018] Step 2: After collecting the sample from the underlying node, if the accuracy required can be met, the sample is used to answer the future range count aggregation;

[0019] Step 3: If you can't meet the accuracy of the need, the base station will notify the underlying node to collect more samples from the network;

[0020] Step 4: Use the bit of smoking data elements to represent the RankCounting estimator; specifically: set S i Sample set for node i collection, D i Data sets collected for node i, i = 1, ..., k;

[0021] Assume The global set of samples and data, respectively. Set Ni as the number of data collected ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an Internet of Things big data approximate aggregation method based on sampling. The invention provides an approximate overall aggregation algorithm based on sampling, unbiased estimation of an overall aggregation result is successfully realized, and a compact upper bound of a query result variance is given and proved. Compared with a traditional query algorithm, the algorithm provided by the invention only requires that the average number of transmission samples of each node is greater than 16, and the variance of a query result is lower than that of a traditional aggregation algorithm. In this case, the node can package the sample into a common heartbeat message to be sent to the center, and no more communication cost is generated. According to the algorithm provided by the invention, the ductility of a traditional algorithm is improved, and a relatively low compact upper bound, including quantiles, medians, frequency, order and the like, can be ensured to be provided for a series of overall aggregation queries. The algorithm improves the efficiency of big data processing in the Internet of Things.

Description

Technical field [0001] The present invention relates to the field of Internet of Thining Bad Data, and more particularly to a sample based on sample-based Internet data approximate aggregation method. Background technique [0002] The overall aggregation query is a common query that obtains the summary information from the data collected from the Internet of Things, such as query pose, frequency, and rank. Since the overall aggregation cannot be distributed in the Internet of Things, all collected data needs to be sent to the data center to obtain accurate query results. The above process consumes a lot of energy. [0003] Approximate range counts aggregate in many fields such as data flow, traditional database systems. Sampling-based data aggregation algorithms have been proposed and widely used in approximate data aggregation. However, these tasks are not designed for the range of the Internet of Things, which means that such queries do not provide performance assurance. [000...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2458H04L67/12
Inventor 张泽赟张现宝
Owner 腾云悦智科技深圳有限责任公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com