Method, device and storage medium for data loading and distribution
A data loading and data source technology, applied in the field of data processing, can solve problems such as high learning costs, unfavorable reuse, excessive coupling between devices and project details, and achieve the effect of reducing learning costs and difficulty of use, and flexible deployment
Active Publication Date: 2022-06-17
广州大气候农业科技有限公司
View PDF10 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] Self-developed data and distribution device for a specific project requirement, it is easy to over-couple the device with the specific details of the project, which is not conducive to reuse
The use of existing third-party data integration tools, on the one hand, increases the learning cost of the team; The method provided by the tool cannot meet some details of the current needs. At this time, either compromise the requirements to adapt to the method provided by the tool, or spend high learning costs for secondary development based on the tool
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0066] The present invention will be further explained and illustrated below in conjunction with the accompanying drawings and specific embodiments of the description. The step numbers in the embodiments of the present invention are set only for the convenience of elaboration, and the sequence between the steps is not limited, and the execution sequence of the steps in the embodiments can be performed according to the understanding of those skilled in the art Adaptive adjustment.
[0067] The present invention provides a data loading and distribution method and device to solve the problems of learning cost, operation suggestion and flexibility of the data loading and distribution method and device. The specific implementation manner of the method and device of the present invention will be described in detail below.
[0068] like figure 1 As shown, as a whole, the device includes three component units: a control unit 101 , a loading unit 102 and a distribution unit 103 . Am...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a data loading and distribution method, device and storage medium. The device includes a control unit, a loading unit and a distribution unit. The invention realizes the data loading and distribution operation through the control unit, the loading unit and the distribution unit, and loads and distributes specific data The method is encapsulated inside the device, and each unit of the present invention has a clear division of labor, which reduces the learning cost and difficulty of use; in addition, compared with the prior art, the present invention reduces the pre-steps of data processing, so that relevant personnel can use most Energy is spent on subsequent data processing, and data loading and distribution can be completed quickly; the lightweight device of the present invention can be flexibly deployed. As a data loading and distributing method, device and storage medium, the present invention can be widely used in the technical field of data processing.
Description
technical field [0001] The present invention relates to the technical field of data processing, in particular to a method, a device and a storage medium for data loading and distribution. Background technique [0002] Generally, the first step in the data processing flow is to load the data to be processed from the data source, and then distribute the loaded data to processing units for processing. There are usually three modes of data loading: one-time loading mode, cyclic loading mode, and continuous incremental loading mode; data distribution distributes data to different destinations in different ways, such as through HTTP protocol to HTTP server or Distributed to the message queue through the TCP protocol. [0003] At present, there are roughly two ways to solve the above data loading and distribution requirements, one is to develop a data loading and distribution device by itself, and the other is to use an existing third-party data integration tool. [0004] In actu...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/25
CPCG06F16/25
Inventor 易丙洪陈威
Owner 广州大气候农业科技有限公司