Method and device for realizing high-speed data dimension compensation processing based on dynamic priority, processor and computer readable storage medium thereof
A dynamic priority, high-speed data technology, applied in the direction of electrical digital data processing, special data processing applications, calculations, etc., can solve problems such as inaccurate data itself, problems with the cache mechanism, and changes, so as to improve the efficiency of maintenance, The effect of ensuring the accuracy of supplementary dimension
Pending Publication Date: 2022-08-02
GUOTAI JUNAN SECURITIES
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
A defect of this solution is that if the external data itself is dynamic and will change, the original caching mechanism will have problems because the data itself is not accurate
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0026] In order to describe the technical content of the present invention more clearly, further description will be given below with reference to specific embodiments.
[0027] The method for realizing high-speed data supplementary dimension processing based on dynamic priority of the present invention comprises the following steps:
[0028] (1) Building a dynamic supplementary system, the dynamic supplementary system includes an original data source, a supplementary data cache, a supplementary operation module and a real-time processing data stream, and the supplementary data cache includes supplementary related cache data, Pollution identification module and pollution time;
[0029] (2) Carry out dimension supplementation according to the dynamic supplementary dimension system, and the supplementary dimension operation module obtains the data in the real-time processing data stream, and searches the supplementary dimension data cache according to the acquired data. If the s...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to a method for realizing high-speed data maintenance compensation processing based on a dynamic priority. The method comprises the following steps: establishing a dynamic maintenance compensation system; performing maintenance supplementation according to the dynamic maintenance supplementation system, acquiring data in the real-time processing data stream by a maintenance supplementation operation module, searching a maintenance supplementation data cache according to the acquired data, and if the maintenance supplementation data cache is hit and is not polluted, completing maintenance supplementation operation by the maintenance supplementation operation module according to maintenance supplementation related data and putting a result into the real-time processing data stream; if the cache is not hit, putting the data into a to-be-repaired queue, and setting a to-be-repaired processing module to monitor the to-be-repaired queue; and if the cache is hit and the pollution identification module indicates that the data is polluted, searching a maintenance supplementing strategy, and carrying out maintenance supplementing processing according to the maintenance supplementing strategy. According to the method and the device for realizing high-speed data maintenance supplementation processing based on the dynamic priority, the processor and the computer readable storage medium, the cache is refreshed in real time through the independent queue to be subjected to maintenance supplementation, so that the maintenance supplementation efficiency is improved, and the maintenance supplementation accuracy is ensured.
Description
technical field [0001] The invention relates to the field of data processing, in particular to the field of dynamic dimension supplementation, and in particular to a method, device, processor and computer-readable storage medium for realizing high-speed data supplementary dimension processing based on dynamic priority. Background technique [0002] Real-time processing refers to a processing model that can process and output results quickly (seconds or milliseconds) during the flow of external data into the system. In the process of real-time data processing, some information will be missing from the original incoming data. This information is actually obtained by querying external related data tables or external files, so there is a supplementary dimension operation. This dimension supplement operation is based on the information provided by the original data, by looking up other data sources to obtain the missing information, after the acquisition is completed, these cont...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F16/215G06F16/23G06F16/2455
CPCG06F16/215G06F16/24552G06F16/24568G06F16/2365
Inventor 俞枫曾宏祥毛梦非王厦冯一欣吴康叶璞钰朱晓云
Owner GUOTAI JUNAN SECURITIES