Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Window data processing method and device, server and storage medium

A data processing and processing method technology, applied in the computer field, can solve the problems of data not being processed in time, occupying system resources, etc., and achieve the effect of improving data processing efficiency and timeliness

Active Publication Date: 2020-05-12
ENVISION DIGITAL INT PTE LTD +1
View PDF19 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the threshold of the counter in the related art is a fixed value. When the threshold is set unreasonably, the data cannot be processed in time, which will occupy system resources.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Window data processing method and device, server and storage medium
  • Window data processing method and device, server and storage medium
  • Window data processing method and device, server and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0028] The "plurality" mentioned herein means two or more. "And / or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and / or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently. The character " / " generally indicates that the contextual objects are an "or" relationship.

[0029] In the Internet of Things system, a large number of acquisition devices are connected to the network and the generated data is uploaded to the cloud. Therefore, the cloud needs to have the ability to process large amounts of data in real time. In some application scenarios, the collection device generates streaming data, that is, sequ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a window data processing method and device, a server and a storage medium, and belongs to the field of computers. The method comprises the steps of when the target data enter a window, enabling a window counter to add one, wherein the window counter is used for counting the number of data in the window; obtaining a counter numerical value of the window counter, and obtaining a timestamp of the target data; and if the numerical value of the counter reaches a first quantity threshold value or it is determined that the target data is overtime according tothe timestamp of the target data, processing the data in the window. In the embodiment of the invention, by arranging the window counter, the batch processing of the streaming data is realized; moreover, an overtime mechanism is additionally arranged for the window, and when the waiting time of the window reaches the preset time, the data in the window is processed, so that the problem that the data in the window cannot be processed for a long time due to the unreasonable setting of the threshold value of the counter and other factors, is avoided, and the data processing efficiency and timeliness are improved.

Description

technical field [0001] The embodiments of the present application relate to the field of computers, and in particular to a method, device, server, and storage medium for processing window data. Background technique [0002] Streaming data is a collection of dynamic data that grows infinitely over time and needs to be processed in chronological order. Flink is an open source stream processing engine for data processing of batch data and stream data. [0003] In the related technology, by defining a window in the data processing engine, the stream data is aggregated. The window is equipped with a trigger mechanism. The commonly used trigger mechanism is a counter. The data is processed. [0004] However, the threshold of the counter in the related art is a fixed value, and when the threshold is set unreasonably, the data cannot be processed in time, and system resources will be occupied. Contents of the invention [0005] Embodiments of the present application provide a wi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/38
CPCG06F9/3851Y02D10/00
Inventor 彭成寒周晓敏
Owner ENVISION DIGITAL INT PTE LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com