Index flow real-time calculation method and device based on big data, equipment and medium

Abstract

The invention relates to the technical field of big data, and discloses an index flow real-time calculation method and device based on big data, equipment and a medium. The method comprises the steps: calling a client to obtain a configuration change parameter from Redis according to a batch calculation request, wherein the configuration change parameter is a changed preset value; obtaining to-be-updated index flow configuration data from the relational database to update the index flow configuration data of the client and the index flow configuration data of the batch of the operation end, and updating the configuration change parameter to be an unchanged preset value; calling the operation end to perform data acquisition and index calculation according to the index flow configuration data of the batch and the target data source to obtain a single-batch index calculation result, and storing the single-batch index calculation result in the client; and calling the client to perform index result statistics according to the single-batch index calculation result to obtain a real-time calculation result corresponding to each index identifier. Therefore, detailed data does not need to be written into a database, and consumption of storage resources is reduced.

Description

technical field [0001] This application relates to the technical field of big data, in particular to a method, device, equipment and medium for real-time calculation of index streams based on big data. Background technique [0002] The real-time calculation module of the existing technology first writes the detailed data into the database, and the back-end program further aggregates and filters the detailed data in the database according to many dimensions, and then calculates the index results for display. Many fields of the detailed data stored in the database are not used, resulting in a waste of storage resources. The entire calculation process is quite cumbersome, there are a lot of calculations, and powerful hardware and a strong enough database are required to support it. The calculation process takes a long time, increases the response time of the client, and affects customer satisfaction. Contents of the invention [0003] The main purpose of this application is ...

AI Technical Summary

Problems solved by technology

[0003] The main purpose of this application is to provide a real-time calculation method, device, equipment and medium based on big data, aiming at solving the problem that the real-time calculation module in the prior art first writes the detailed data into the database, and then according to the data in the database The detailed data calculates the indicator results, which leads to a waste of storage resources, a large number of calculations, and technical problems that require powerful hardware and a strong enough database to support

Images