Window data processing method and device, server and storage medium

A data processing and processing method technology, applied in the computer field, can solve the problems of data not being processed in time, occupying system resources, etc., and achieve the effect of improving data processing efficiency and timeliness
CN111142942AActive Publication Date: 2020-05-12ENVISION DIGITAL INT PTE LTD +1
19 Cites 5 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
ENVISION DIGITAL INT PTE LTD
Publication Date
2020-05-12

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The embodiment of the invention discloses a window data processing method and device, a server and a storage medium, and belongs to the field of computers. The method comprises the steps of when the target data enter a window, enabling a window counter to add one, wherein the window counter is used for counting the number of data in the window; obtaining a counter numerical value of the window counter, and obtaining a timestamp of the target data; and if the numerical value of the counter reaches a first quantity threshold value or it is determined that the target data is overtime according tothe timestamp of the target data, processing the data in the window. In the embodiment of the invention, by arranging the window counter, the batch processing of the streaming data is realized; moreover, an overtime mechanism is additionally arranged for the window, and when the waiting time of the window reaches the preset time, the data in the window is processed, so that the problem that the data in the window cannot be processed for a long time due to the unreasonable setting of the threshold value of the counter and other factors, is avoided, and the data processing efficiency and timeliness are improved.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The embodiments of the present application relate to the field of computers, and in particular to a method, device, server, and storage medium for processing window data. Background technique

[0002] Streaming data is a collection of dynamic data that grows infinitely over time and needs to be processed in chronological order. Flink is an open source stream processing engine for data processing of batch data and stream data.

[0003] In the related technology, by defining a window in the data processing engine, the stream data is aggregated. The window is equipped with a trigger mechanism. The commonly used trigger mechanism is a counter. The data is processed.

[0004] However, the threshold of the counter in the related art is a fixed value, and when the threshold is set unreasonably, the data cannot be processed in time, and system resources will be occupied. Contents of the invention

[0005] Embodiments of the present application provide a wi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More