A streaming data processing method and apparatus

A processing device and processing method technology, applied in the computer field, can solve the problems of destroying the integrity of out-of-order data and low accuracy of statistical analysis results, and achieve the effects of prolonging the opening time, improving the accuracy and improving the integrity

Active Publication Date: 2019-07-16
CHINA MOBILE COMM LTD RES INST +1
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present invention provides a stream data processing method and device, which is used to solve the technical problem in the prior art that

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A streaming data processing method and apparatus
  • A streaming data processing method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0044] In order to make the objectives, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are the present invention. Part of the embodiments of the technical solution, but not all of the embodiments. Based on the embodiments recorded in the documents of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the technical solution of the present invention.

[0045] In the embodiment of the present invention, the streaming data processing device may be a computer device with streaming data processing capability, such as a terminal device or a server.

[0046] Generally speaking, streaming data is a set of sequential, large, fast, and...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a streaming data processing method and apparatus, which are used for solving the technical problem that the accuracy of a statistical result is relatively lowwhen statistical analysis is performed on streaming data. The method comprises the following steps: receiving to-be-processed data in a current data time window, and determining the generation time ofthe to-be-processed data; if the generation time is greater than the end time of the current data time window, caching the current data time window into a next data time window behind the current data time window, closing the current data time window when it is determined that the generation time is not within the time range corresponding to the delay duration of the current data time window, andprocessing the to-be-processed cached data when it is determined that the next data time window is closed; and if the generation time is smaller than the starting time of the current data time windowand it is determined that the historical data time window corresponding to the generation time in the plurality of data time windows is closed, performing time grouping processing on the to-be-processed data according to the generation time and the preset interval time.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a stream data processing method and device. Background technique [0002] Stream computing is a new data processing method, which can process, analyze and present large-scale streaming data in real time, and provide real-time data value for the system. It is widely used in financial services, network monitoring, telecommunications data management, Web applications, production manufacturing, sensor testing and other fields. Among them, a common operation in stream computing is to count data within a certain time interval. [0003] At present, in stream computing, when counting data within a certain time interval, statistical analysis can be performed on the data within the data time window, that is, the data is processed according to the time window of the data generating end. However, due to the different environments of the data generation end and the influence of the speed ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/2458G06F16/2457
CPCG06F16/24573G06F16/2462
Inventor 王凤
Owner CHINA MOBILE COMM LTD RES INST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap