Urgent data processing method, device and apparatus and storage medium
A data processing and data technology, applied in the field of data processing, can solve the problems of poor collection data processing effectiveness
Pending Publication Date: 2019-04-19
ONE CONNECT SMART TECH CO LTD SHENZHEN
View PDF0 Cites 3 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] For example, in the financial industry, it is necessary to perform data accounting on the collection data every day to determine the collection strategy of the collection amount, etc. In order to achieve efficient analysis and processing of the collection data, when the collection data is analyzed and processed, the computer is usually used for batch processing of the collection data ( Batch processing refers to the method of batch processing a certain data object or others); however, since the collection data comes from various financial institutions, the collection data is relatively scattered, if the current collection data batch processing method is adopted, the collection data processing will be more effective poor sex
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0050] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.
[0051] Such as figure 1 as shown, figure 1 It is the server of the hardware operating environment involved in the solution of the embodiment of the present invention (also called collection data processing equipment, wherein the collection data processing equipment can be composed of a separate collection data processing device, or can be composed of other devices combined with the collection data processing device Formation) Schematic diagram of the structure.
[0052] The server in this embodiment of the present invention refers to a computer that manages resources and provides services for users, and is generally divided into file servers, database servers, and application program servers. A computer or computer system running the above software is also called a server. Compared with ordinary PC (personal comput...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses an urgent data processing method based on big data, which comprises the following steps of: receiving a collection data batch processing request, and obtaining a collection data set to be processed corresponding to the collection data batch processing request; Judging whether the collection data set meets a batch loading condition or not according to the data information ofthe collection data set; If the collection data set meets the batch loading condition, loading target collection data from the collection data set in batches; And sequentially inputting each batch ofthe target collection data into a preset thread pool, and processing the target collection data through corresponding multiple threads in the preset thread pool to obtain a processing result. The invention further discloses a collection data processing device and equipment and a storage medium. According to the invention, the processing process of the collection data is optimized, so that the timeliness of collection data processing is improved.
Description
technical field [0001] The invention relates to the field of data processing, in particular to a collection data processing method, device, equipment and storage medium. Background technique [0002] With the development of social informatization at any time, the amount of data in all walks of life is relatively large, and the amount of data analysis and processing is also increasing day by day. [0003] For example, in the financial industry, it is necessary to perform data accounting on the collection data every day to determine the collection strategy of the collection amount, etc. In order to achieve efficient analysis and processing of the collection data, when the collection data is analyzed and processed, the computer is usually used for batch processing of the collection data ( Batch processing refers to the method of batch processing a certain data object or others); however, since the collection data comes from various financial institutions, the collection data is...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/10G06Q40/00
CPCG06Q10/10G06Q40/00
Inventor 孙建波叶松贺碧威林小蒽
Owner ONE CONNECT SMART TECH CO LTD SHENZHEN