Real-time streaming data processing method and device based on streaming window
A data processing and real-time streaming technology, applied in the field of data processing, can solve problems such as capacity pressure, surge in peak orders, and insufficient capacity, and achieve the effect of reasonable dispatch of waybills
Active Publication Date: 2020-05-29
RAJAX NETWORK &TECHNOLOGY (SHANGHAI) CO LTD
View PDF9 Cites 1 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0002] During the delivery process of the waybill, there may be an imbalance between supply and demand due to various reasons, for example, slow delivery due to weather, insufficient transportation capacity due to surge in peak order volume, and pressure on transportation capacity caused by online promotions, etc.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0053] Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the drawings, it should be understood that the invention may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present invention and to fully convey the scope of the present invention to those skilled in the art.
[0054] figure 1 A flow chart of a method for processing real-time streaming data based on a streaming window provided by an embodiment of the present invention is shown. Such as figure 1 As shown, the method includes the following steps:
[0055] Step S101, acquiring real-time streaming data from at least one data source, the real-time streaming data includes waybill streaming data and distribution facility streaming data.
[0056] Specifica...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a real-time stream data processing method and device based on a stream window, and the method comprises the steps: obtaining real-time stream data from at least one data source, the real-time stream data comprising waybill stream data and distribution facility stream data; performing data connection processing on the waybill flow data and the distribution facility flow datato obtain a data wide table; and receiving a calculation task of the single-quantity index data used for representing the pressure balance state, calling a processing process of the corresponding flow window according to data characteristics of the single-quantity index data, and performing aggregation calculation on the data in the data wide table by the processing process of the flow window toobtain the corresponding single-quantity index data. According to the scheme provided by the embodiment of the invention, for the single-quantity index data defined at different time, personalized aggregation calculation of the single-quantity index data can be realized by calling the processing process of the corresponding flow window, so that pressure balance can be conveniently carried out according to the calculated single-quantity index data, and the requirement of reasonable dispatch of waybills is met.
Description
technical field [0001] The invention relates to the technical field of data processing, in particular to a real-time stream data processing method and device based on a stream window. Background technique [0002] During the delivery process of waybills, various reasons may lead to an imbalance between supply and demand, for example, slow delivery due to weather, insufficient shipping capacity due to surge in peak order volume, and pressure on shipping capacity caused by online promotions, etc. Therefore, there is a need for an automatic pressure balance control method, which can reduce the distribution scope of the waybill and increase the delivery time of the distribution facilities, so as to ensure the timely performance of the waybill and reduce the economic loss of merchants and transportation capacity. The data that characterizes the balance of pressure is called order volume index data, such as: order volume under different waybill statuses, number of rejected orders ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/06G06Q10/08
CPCG06Q10/0633G06Q10/06393G06Q10/083
Inventor 夏志富许巧生孔垂建
Owner RAJAX NETWORK &TECHNOLOGY (SHANGHAI) CO LTD