Financial data storage and query system
By introducing an evaluation module in the financial data storage and query system, the update delay, accessibility and security of financial data is evaluated and adjusted, and the problem of low timeliness of financial data storage and query in the existing technology is solved, and timely update and high reliability of data are achieved.
Patent Information
- Application Number
- CN202411634844.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-15
- Publication Date
- 2025-02-25
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In the prior art, the timeliness of financial data storage and query process are low, resulting in delayed data updates and affecting the timeliness of decision-making.
By introducing delay impact assessment module, data accessibility assessment module and data transmission security assessment module in the financial data storage and query system, the delay, accessibility and security of financial data are evaluated, and timely adjustments are made based on the evaluation results to improve timeliness.
It has achieved the improvement of timeliness in the financial data storage and query process, ensured timely updates and accessibility of data, and improved the reliability and security of data.
Smart Images

Figure BDA0005136891900000031 
Figure BDA0005136891900000041 
Figure BDA0005136891900000101
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of electronic digital data processing, and in particular to a financial data storage and query system. Background Art
[0002] With the continuous development of digital technology, the financial industry is undergoing digital transformation. Financial institutions optimize their business processes and improve service efficiency by adopting advanced technologies such as cloud computing, big data, and artificial intelligence. As an important part of the financial industry, financial data storage and query are also constantly innovating and upgrading. Financial data involves a large amount of sensitive information such as customer information and transaction records, so data security and privacy protection are crucial. Financial institutions need to take a series of measures to ensure the security and privacy of data, such as data encryption, access control, backup and recovery, etc. Therefore, data integration and analysis have become an important part of financial data storage and query.
[0003] The existing system mainly stores various financial business data, such as transaction data, customer data, market data, etc., in a centralized data warehouse to facilitate centralized management and maintenance of data, improve data sharing and query efficiency, and enhance data security and reliability.
[0004] For example, the invention patent with announcement number: CN117009353B announces a financial big data information storage method and device based on a cloud platform, including: collecting and classifying financial big data, generating financial classification data, establishing a cloud financial database tree, and generating node financial data; processing the node financial data, generating a virtual financial database tree, setting up a virtual storage platform, generating a virtual access identification database according to the virtual financial database tree, logging in to access the virtual storage platform according to the virtual access identification database, if the login is successful, obtaining the latest virtual access account data set, judging whether to obtain the virtual administrator data of the virtual five-level storage node according to the latest virtual access account data set, if the virtual administrator data is obtained, obtaining the actual access account data set, obtaining access rights according to the actual access account data set, and querying the financial big data according to the access rights.
[0005] For example, the invention patent with announcement number: CN111522890B announces a financial data processing method, device, system and storage medium, including: obtaining financial data transmitted by the Storm data processing platform; storing financial data according to the data granularity configuration preset by the Druid connection pool; and when it is determined that the financial data is new data, controlling the computing nodes of the Druid connection pool to actively pull the financial data for caching.
[0006] However, in the process of implementing the technical solution of the invention in the embodiments of the present application, the present application found that the above technology has at least the following technical problems:
[0007] In the prior art, since financial data needs to be securely protected, the security protection process may affect data updates, resulting in low timeliness in the storage and query of financial data. Summary of the invention
[0008] The embodiments of the present application provide a financial data storage and query system, thereby solving the problem of low timeliness in the financial data storage and query process in the prior art and improving the timeliness in the financial data storage and query process.
[0009] An embodiment of the present application provides a financial data storage and query system, including a delay impact assessment module, a data accessibility assessment module and a data transmission security assessment module: wherein the delay impact assessment module is used to obtain a delay impact value by acquiring update delay financial data within a first preset time period and a preset data transmission delay time threshold, and judge whether to perform data accessibility assessment based on the delay impact value, and the delay impact value is used to evaluate the impact of financial data update delay during financial data storage and query; the data accessibility assessment module is used to obtain a financial data accessibility assessment value by acquiring a delay impact value, financial access data and reference access data corresponding to the data accessibility assessment within a second preset time period, and judge whether to perform access adjustment based on the financial data accessibility assessment value, and the financial data accessibility assessment value is used to evaluate the system's ability to acquire financial data; the data transmission security assessment module is used to obtain a financial data security transmission assessment value by acquiring a financial data accessibility assessment value, security transmission data and reference security transmission data that are not less than a preset access threshold within a third preset time period, and judge whether to perform security transmission adjustment based on the financial data security transmission assessment value, and the financial data security transmission assessment value is used to evaluate the security of financial data transmission.
[0010] Furthermore, the updated delayed financial data includes data propagation distance, average propagation speed, encrypted financial data volume, and average encryption speed; the updated delayed financial data is used to describe the delay of financial data within a first preset time period; the data propagation distance represents the distance of financial data from a preset sender to a preset receiver within the first preset time period; the first preset time period represents a preset time period during the storage and query process of financial data.
[0011] Further, the specific process of obtaining the delay impact value by obtaining the updated delayed financial data and the preset data transmission delay time threshold within the first preset time period is as follows: SS1, obtaining the initial propagation delay time, the initial propagation delay time is represented by the result of the ratio operation between the data propagation distance and the average propagation speed; SS2, obtaining the initial propagation delay deviation, the initial propagation delay deviation is represented by the result of the ratio operation between the difference between the initial propagation delay time average value and the initial propagation delay time and the preset data transmission delay time threshold; SS3, obtaining the initial encryption delay time, the initial encryption delay time is represented by the result of the ratio calculation between the encrypted financial data volume and the average encryption speed; SS4, obtaining the initial encryption delay deviation, the initial encryption delay deviation is represented by the result of the ratio operation between the difference between the initial encryption delay time average value and the initial encryption delay time and the preset data transmission delay time threshold; SS5, judging whether the initial propagation delay deviation and the initial encryption delay deviation are greater than 0, when the initial propagation delay deviation and the initial encryption delay deviation are not greater than 0, the initial propagation delay deviation and the initial encryption delay deviation are recorded as 0 and then SS6 is executed, otherwise SS6 is directly executed; SS6, obtaining the delay impact value through the obtained initial propagation delay deviation and the initial encryption delay deviation.
[0012] Furthermore, the limiting expression of the delay impact value is as follows:
[0013]
[0014]
[0015] In the formula, YC x represents the delay impact value of the financial data in the xth first preset time period, x=1,2,...,y, x represents the number of the first preset time period, y represents the total number of the first preset time periods, y≥2, CB x represents the initial propagation delay deviation of the financial data in the first preset time period x, JM x represents the initial encryption delay deviation of the financial data in the xth first preset time period, represents the initial propagation delay time of the financial data in the first preset time period x, represents the initial encryption delay time of the financial data in the xth first preset time period, L x Indicates the data propagation distance of the financial data in the xth first preset time period, LV x represents the average propagation speed of financial data in the first preset time period of x, K x represents the encrypted financial data volume of the financial data in the xth first preset time period, R xrepresents the average encryption speed of financial data in the xth first preset time period, and R0 represents the preset data transmission delay time threshold.
[0016] Furthermore, the financial access data includes the number of access requests, the number of successful accesses and the system response time; the number of access requests indicates the total number of access requests from the preset access party within a second preset time period; the system response time indicates the time for the system to respond to the access request from the preset access party within the second preset time period; the reference access data includes a preset data access rate threshold and a preset response speed threshold; the second preset time period indicates the preset time period corresponding to the delay impact value that is not higher than the preset time delay threshold within the first preset time period.
[0017] Furthermore, the specific process of obtaining the delay impact value, financial access data, and reference access data corresponding to the data accessibility evaluation within the second preset time period to obtain the financial data accessibility evaluation value is as follows: RM1, obtaining an initial financial data access rate value, and the initial financial data access rate value is represented by the result of a ratio operation between the number of requested accesses and the number of successful accesses; RM2, obtaining an initial financial data access rate deviation, and the initial financial data access rate deviation is represented by the result of a ratio operation between the sum of the initial financial data access rate value and 2 times the preset data access rate threshold and the preset data access rate threshold; RM3, obtaining an initial response speed value, and the initial response speed value is represented by the result of a ratio operation between the number of requested accesses and the system response time; RM4, obtaining an initial response speed deviation, and the initial response speed deviation is represented by the result of a ratio operation between the sum of the initial response speed value and the preset response speed threshold and 2 times the preset response speed threshold; RM5, obtaining the financial data accessibility evaluation value by combining the obtained initial financial data access rate deviation, the initial response speed deviation, and a delay impact value not higher than a preset time delay threshold.
[0018] Furthermore, the secure transmission data includes the amount of encrypted financial data, encrypted data transmission time and reading time; the encrypted data transmission time represents the longest time for the financial data to be transmitted to a preset recipient within a third preset time period; the reading time represents the time required for the financial data to be read by the system within the third preset time period; the reference secure transmission data includes a preset transmission rate threshold and a preset reading rate threshold; the third preset time period represents a preset time period corresponding to a financial data accessibility evaluation value that is not lower than a preset access threshold within the second time period, and the duration of the preset time period is the same.
[0019] Furthermore, the specific process of obtaining the financial data security transmission evaluation value by obtaining the financial data accessibility evaluation value, security transmission data, and reference security transmission data that are not less than the preset access threshold within the third preset time period is as follows: V1, obtaining the initial financial data transmission rate, the initial financial data transmission rate is represented by the result of a ratio operation between the encrypted financial data volume and the encrypted data transmission time; V2, obtaining the initial financial data transmission rate deviation, the initial financial data transmission rate deviation is represented by the result of a ratio operation between the initial financial data transmission rate and the preset transmission rate threshold and twice the preset transmission rate threshold; V3, obtaining the initial financial data reading rate, the initial financial data reading rate is represented by the result of a ratio operation between the encrypted financial data volume and the encrypted data transmission time; The result of the ratio operation between the data volume and the reading time is represented; V4, obtaining the initial financial data reading rate deviation, the initial financial data reading rate deviation is represented by the result of the ratio operation between the sum of the initial financial data reading rate and the preset reading rate threshold and twice the preset reading rate threshold; V5, obtaining the financial data security transmission assessment value by combining the obtained initial financial data transmission rate deviation, the initial financial data reading rate deviation and the financial data accessibility assessment value not lower than the preset access threshold, the financial data accessibility assessment value not lower than the preset access threshold includes the financial data accessibility assessment value not lower than the preset access threshold before access adjustment and the financial data accessibility assessment value not lower than the preset access threshold after access adjustment.
[0020] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:
[0021] 1. By obtaining the delay impact value within the first preset time period and determining whether to perform data accessibility evaluation, then obtaining the financial data accessibility evaluation value within the second preset time period and determining whether to perform access adjustment, and finally obtaining the financial data security transmission evaluation value within the third preset time period and determining whether to perform security transmission adjustment, timely adjustment in the financial data query and storage process is achieved, thereby achieving improved timeliness in the financial data storage and query process, and effectively solving the problem of low timeliness in the financial data storage and query process in the prior art.
[0022] 2. The delay impact value is obtained through the initial propagation delay deviation and the initial encryption delay deviation, and then the financial data accessibility evaluation value is obtained by combining the initial financial data access rate deviation, the initial response speed deviation and the delay impact value not higher than the preset time delay threshold. Finally, the financial data security transmission evaluation value is obtained by combining the initial financial data transmission rate deviation, the initial financial data reading rate deviation and the financial data accessibility evaluation value not lower than the preset access threshold, thereby achieving accurate quantification of the real-time performance of financial data query and storage-related data, and then achieving the improvement of the reliability of financial data query and storage-related data.
[0023] 3. By judging whether the financial data accessibility evaluation value is not lower than the preset access threshold, when the monitored financial data accessibility evaluation value is not lower than the preset access threshold, no access adjustment is performed, and then judging whether the financial data security transmission evaluation value is not lower than the preset security threshold, when the financial data security transmission evaluation value is not lower than the preset security threshold, no security transmission adjustment is performed, thereby realizing the dynamic adjustment of timeliness, accessibility and security in the process of financial data query and storage, and then realizing the accurate quantification of dynamic adjustment reliability. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1 A schematic diagram of the structure of a financial data storage and query system provided in an embodiment of the present application;
[0025] Figure 2 An overall flow chart of financial data storage and query provided in the embodiment of the present application;
[0026] Figure 3 A statistical diagram of the delay impact value changes provided in an embodiment of the present application;
[0027] Figure 4 A flow chart for obtaining the accessibility evaluation value of financial data provided in an embodiment of the present application;
[0028] Figure 5 A flow chart for obtaining an evaluation value for secure transmission of financial data provided in an embodiment of the present application. DETAILED DESCRIPTION
[0029] The embodiment of the present application solves the problem of low timeliness in the financial data storage and query process in the prior art by providing a financial data storage and query system. A delay impact value is obtained by updating delayed financial data within a first preset time period and a preset data transmission delay time threshold, and it is determined whether to perform data accessibility evaluation. Then, a financial data accessibility evaluation value is obtained by using the delay impact value, financial access data, and reference access data within a second preset time period, and it is determined whether to perform access adjustment. Finally, a financial data security transmission evaluation value is obtained by using the financial data accessibility evaluation value, secure transmission data, and reference secure transmission data within a third preset time period, and it is determined whether to perform security transmission adjustment, thereby improving the timeliness in the financial data storage and query process.
[0030] The technical solution in the embodiment of the present application is to solve the problem of low timeliness in the above-mentioned financial data storage and query process. The overall idea is as follows:
[0031] Whether to perform data accessibility assessment is determined by the delay impact value obtained, and then whether to perform access adjustment is determined by the financial data accessibility assessment value obtained within the second preset time period. Finally, whether to perform security transmission adjustment is determined by the financial data security transmission assessment value obtained within the third preset time period, thereby achieving the effect of improving the timeliness of financial data storage and query process.
[0032] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.
[0033] like Figure 1 As shown, it is a structural schematic diagram of a financial data storage and query system provided in an embodiment of the present application, including a delay impact assessment module, a data accessibility assessment module and a data transmission security assessment module.
[0034] Among them, the delay impact assessment module is used to obtain the update delay financial data within the first preset time period and the preset data transmission delay time threshold to obtain the delay impact value, and determine whether to perform data accessibility assessment based on the delay impact value. When the delay impact value is not higher than the preset time delay threshold, data accessibility assessment is performed. The delay impact value is used to evaluate the impact of financial data update delays during the financial data storage and query process.
[0035] It should be understood that the updated delayed financial data includes data propagation distance, average propagation speed, encrypted financial data volume, and average encryption speed; the updated delayed financial data is used to describe the delay of financial data within the first preset time period; the data propagation distance represents the distance of financial data from a preset sender to a preset receiver within the first preset time period, and a network traffic analysis tool (such as CICFlowMeter, ManageEngine network flow analyzer) is used to capture the traffic data packets in the network within the first preset time period and analyze the source address and destination address of the data packets, and the data propagation distance is obtained by counting the distance between the source address and the destination address; the network traffic is monitored by the ManageEngine network flow analyzer, and the average propagation speed and the average encryption speed are obtained in combination with the transmission time of the data packet; the first preset time period represents a preset time period during the storage and query process of financial data.
[0036] The data accessibility assessment module is used to obtain a financial data accessibility assessment value by obtaining a delay impact value, financial access data, and reference access data corresponding to the data accessibility assessment within a second preset time period, and determine whether to perform access adjustment based on the financial data accessibility assessment value. The access adjustment is used to adjust the financial data accessibility assessment value to no less than a preset access threshold. The financial data accessibility assessment value is used to evaluate the system's ability to acquire financial data.
[0037] Specifically, the financial access data includes the number of access requests, the number of successful accesses and the system response time. The network monitoring tool ManageEngine network flow analyzer is used to monitor the network traffic within the second preset time period to count the number of access requests and the number of successful accesses. The qperf test tool is used to test the network delay between two nodes to obtain the system response time. The financial access data is used to describe the access situation of financial data. The number of access requests indicates the total number of access requests from the preset access party within the second preset time period. The system response time indicates the time for the system to respond to the access request from the preset access party within the second preset time period. The reference access data includes a preset data access rate threshold and a preset response speed threshold. The preset data access rate threshold is represented by the average value of the cryptocurrency data access rate in the historical time period of the cryptocurrency market in the preset database, and the preset response speed threshold is represented by the average value of the response speed of accessing the cryptocurrency in the historical time period of the cryptocurrency market in the preset database. The second preset time period indicates the preset time period corresponding to the delay impact value that is not higher than the preset time delay threshold in the first preset time period, and the interval between the first preset time period and the second preset time period is the same.
[0038] The data transmission security assessment module is used to obtain a financial data security transmission assessment value by obtaining a financial data accessibility assessment value that is not lower than a preset access threshold within a third preset time period, secure transmission data, and reference secure transmission data, and to determine whether to perform a secure transmission adjustment based on the financial data security transmission assessment value. The financial data security transmission assessment value is used to assess the security of the financial data transmission process, and the secure transmission adjustment is used to adjust the financial data security transmission assessment value to not lower than a preset security threshold.
[0039] Specifically, the secure transmission data includes the amount of encrypted financial data, the encrypted data transmission time and the reading time. The encrypted data is tracked through data security tools such as DeFi Llama to obtain the amount of encrypted financial data. The network traffic within the third preset time period is monitored through the ManageEngine network flow analyzer to obtain the reading time and encrypted data transmission time; the secure transmission data is used to describe the transmission security of financial data; the encrypted data transmission time represents the longest time for the financial data to be transmitted to the preset recipient within the third preset time period; the reading time represents the time required for the financial data to be read by the system within the third preset time period; the reference secure transmission data includes a preset transmission rate threshold and a preset reading rate threshold. The preset transmission rate threshold is represented by the average value of the encrypted data transmission rate in the historical time period of the cryptocurrency market in the preset database, and the preset reading rate threshold is represented by the average value of the encrypted data reading rate in the historical time period of the cryptocurrency market in the preset database; the third preset time period represents the preset time period corresponding to the financial data accessibility evaluation value that is not lower than the preset access threshold in the second time period, and the duration of the preset time period is the same, and the interval between the second preset time period and the third preset time period is the same.
[0040] like Figure 2 As shown, it is an overall flow chart of financial data storage and query provided by an embodiment of the present application. During the process of financial data storage and query, if there is a delay in data update, it may affect the timeliness of decision-making, thereby reducing the accessible value of the data. If financial data lacks security protection during transmission, it may cause data leakage or tampering, thereby affecting the quality and credibility of the data, and further affecting the accessibility of the data. For example, in order to improve the accessibility of data, financial institutions may need to simplify the access process, but this may reduce security. On the other hand, security measures may make it difficult for users to access data, affecting the user experience. If there is a significant delay in market data updates, investors may not be able to obtain the latest market conditions, thereby affecting trading decisions; the timeliness of financial data storage and query processes is improved.
[0041] Further, the specific process of obtaining the delay impact value by obtaining the updated delayed financial data and the preset data transmission delay time threshold within the first preset time period is as follows: SS1, obtaining the initial propagation delay time, which is represented by the result of the ratio operation between the data propagation distance and the average propagation speed; SS2, obtaining the initial propagation delay deviation, which is represented by the result of the ratio operation between the difference between the initial propagation delay time average value and the initial propagation delay time and the preset data transmission delay time threshold; SS3, obtaining the initial encryption delay time, which is represented by the result of the ratio calculation between the encrypted financial data volume and the average encryption speed; SS4, obtaining the initial encryption delay deviation, which is represented by the result of the ratio operation between the difference between the initial encryption delay time average value and the initial encryption delay time and the preset data transmission delay time threshold; SS5, judging whether the initial propagation delay deviation and the initial encryption delay deviation are greater than 0, when the initial propagation delay deviation and the initial encryption delay deviation are not greater than 0, the initial propagation delay deviation and the initial encryption delay deviation are recorded as 0 and then SS6 is executed, otherwise SS6 is directly executed; SS6, obtaining the delay impact value through the obtained initial propagation delay deviation and the initial encryption delay deviation.
[0042] The limiting expression of the delay impact value is as follows:
[0043]
[0044]
[0045] In the formula, YC x represents the delay impact value of the financial data in the xth first preset time period, x=1,2,...,y, x represents the number of the first preset time period, y represents the total number of the first preset time periods, y≥2, CB x represents the initial propagation delay deviation of the financial data in the first preset time period x, JM x represents the initial encryption delay deviation of the financial data in the xth first preset time period, represents the initial propagation delay time of the financial data in the first preset time period x, represents the initial encryption delay time of the financial data in the xth first preset time period, L x Indicates the data propagation distance of the financial data in the xth first preset time period, LV x represents the average propagation speed of financial data in the first preset time period of x, K x represents the encrypted financial data volume of the financial data in the xth first preset time period, R x represents the average encryption speed of financial data in the xth first preset time period, and R0 represents the preset data transmission delay time threshold.
[0046] In this embodiment, the preset data transmission delay time threshold is represented by an average value of the cryptocurrency transmission delay time in a historical period of the cryptocurrency market in a preset database.
[0047] The algorithm of this embodiment combines the update delay financial data with comprehensive analysis to obtain the delay impact value. The update delay financial data in the algorithm of this embodiment does not exist independently, but is interrelated. The longer the data propagation distance and the more encrypted financial data, it does not mean that the delay impact value is greater. The influence of the average propagation speed and the average encryption speed should also be considered comprehensively. The data needs to pass through more network nodes during the transmission process, and each node may introduce additional delays. Reducing the distance of data propagation may increase the average propagation speed. The size of the encrypted data and the average encryption speed directly affect the efficiency of data updates. The larger the amount of data encryption, the more computing resources and time are required, which may lead to an increase in update delays. Even if the average encryption speed is very fast, if the data propagation distance is very far, the overall update delay may still be very high. The parameters of the algorithm of this embodiment need to be considered together and at the same time to affect the results.
[0048] Assuming the initial propagation delay deviation CB x The range is 0.1-1, the initial encryption delay deviation JM x The range is 0.1-1, such as Figure 3 As shown, it is a statistical diagram of the change of the delay impact value provided by the embodiment of the present application, Figure 3 It can be seen that the initial encryption delay deviation JM x Fixed to 0.25, with initial propagation delay deviation CB x The delay impact value gradually decreases as the initial propagation delay deviation CB x Fixed to 0.55, with initial encryption delay deviation JM x The delay impact value gradually decreases, which means that the impact of the delay in updating financial data during the storage and query of financial data is reduced; the quantitative evaluation timeliness of the financial data storage and query process is realized.
[0049] Furthermore, the specific process of obtaining the delay impact value, financial access data, and reference access data corresponding to the data accessibility evaluation within the second preset time period to obtain the financial data accessibility evaluation value is as follows: RM1, obtaining the initial financial data access rate value, the initial financial data access rate value is represented by the result of a ratio operation between the number of requested accesses and the number of successful accesses; RM2, obtaining the initial financial data access rate deviation, the initial financial data access rate deviation is represented by the result of a ratio operation between the sum of the initial financial data access rate value and 2 times the preset data access rate threshold and the preset data access rate threshold; RM3, obtaining the initial response speed value, the initial response speed value is represented by the result of a ratio operation between the number of requested accesses and the system response time; RM4, obtaining the initial response speed deviation, the initial response speed deviation is represented by the result of a ratio operation between the sum of the initial response speed value and the preset response speed threshold and 2 times the preset response speed threshold; RM5, obtaining the financial data accessibility evaluation value by combining the obtained initial financial data access rate deviation, the initial response speed deviation, and the delay impact value not higher than the preset time delay threshold.
[0050] The restricted expression of the financial data accessibility evaluation value is as follows:
[0051]
[0052] Where FW z represents the financial data accessibility evaluation value of the financial data in the zth second preset time period, z=1, 2, ..., g, z represents the number of the second preset time period, g represents the total number of the second preset time periods, H z represents the initial financial data access rate deviation of the financial data in the zth second preset time period, XY z represents the initial response speed deviation of the financial data in the zth second preset time period, represents the initial financial data access rate value of the financial data in the zth second preset time period, represents the initial response speed value of the financial data in the second preset time period z, YC z represents the delayed impact value of financial data in the zth second preset time period, QQ z Indicates the number of requests to access financial data in the second preset time period z, CQ z represents the number of successful accesses to financial data in the zth second preset time period, T z represents the system response time of the financial data in the zth second preset time period, H0 represents the preset data access rate threshold, XY0 represents the preset response speed threshold, and e represents a natural constant.
[0053] like Figure 4As shown, it is a flow chart for obtaining the financial data accessibility evaluation value provided by an embodiment of the present application. The algorithm of this embodiment combines the financial access data for comprehensive analysis to obtain the financial data accessibility evaluation value. The financial access data in the algorithm of this embodiment does not exist independently, but is interrelated. The more successful access times does not mean that the financial data accessibility evaluation value is higher. The influence of the number of requested accesses and the system response time should also be comprehensively considered. The more requested accesses, the longer the time required for the system to process these requests may be, which may lead to an increase in the system response time, which may cause delays in data updating and processing, thereby affecting the delay impact value. The more successful accesses, but the slower the system response time, may cause delays in data processing and updating, thereby affecting the delay impact value. The parameters of the algorithm of this embodiment need to be considered together for their impact on the results.
[0054] Specifically, assuming that the initial financial data access rate deviation H z The range is 0.6-1, the initial response speed deviation is XY z The range is 0.6-1, and the delay impact value YC of the financial data in the second preset time period z The range is 1.5-2, as shown in Table 1, which is a statistical table of changes in the financial data accessibility evaluation value provided in the embodiment of the present application:
[0055] Table 1 Statistics of changes in the accessibility evaluation value of financial data
[0056]
[0057] As shown in Table 1, as the initial financial data access rate deviation H z and initial response speed deviation XY z The delay impact value YC of the financial data in the second preset time period increases gradually. z The financial data accessibility evaluation value FW z The gradual increase means that the system's ability to obtain financial data is gradually enhanced, and accessibility is gradually improved; the timeliness of financial data storage and query is improved.
[0058] Furthermore, the specific process of access adjustment is as follows: AA1, judging whether the accessibility evaluation value of financial data is not lower than the preset access threshold, when the monitored accessibility evaluation value of financial data is not lower than the preset access threshold, no access adjustment is performed, otherwise AA2 is executed; AA2, distributing the request to the server, distributing the request to the server means avoiding overload of a single server through a load balancing algorithm, when the monitored accessibility evaluation value of financial data is not lower than the preset access threshold, stop access adjustment, otherwise execute AA3; AA3, sending a prompt to the preset personnel to perform data partitioning, when the monitored accessibility evaluation value of financial data is not lower than the preset access threshold, stop access adjustment, otherwise feedback is given to the preset personnel to stop data storage and query, and data partitioning is used to divide financial data sets into parts of different sizes.
[0059] In this embodiment, the preset accessibility threshold is represented by the variance of the response speed data of the cryptocurrency market in the historical time period in the preset database. The request distribution to the server is to distribute the client's request to multiple server nodes to balance the load and improve the scalability and reliability of the system. The load balancing algorithm includes polling method, random method, minimum connection number method, etc. In this embodiment, the polling method is used to distribute the query request in sequence to different servers or database nodes. Data partitioning is to divide a large financial data set into parts of different sizes, such as real-time transaction data, market data, etc. These data need to be processed and responded quickly, and can be divided into small partitions, such as historical transaction records, customer historical behavior data, etc. These data are mainly used for historical analysis and trend prediction. It can be divided into large partitions, so that data can be managed and accessed more effectively, such as by reducing the amount of data in a single query to improve the query speed; and the accurate quantification of financial data accessibility in the process of financial data storage and query is realized.
[0060] Furthermore, the specific process of obtaining the financial data security transmission evaluation value by obtaining the financial data accessibility evaluation value, security transmission data, and reference security transmission data that are not less than the preset access threshold within the third preset time period is as follows: V1, obtaining the initial financial data transmission rate, the initial financial data transmission rate is represented by the result of a ratio operation between the amount of encrypted financial data and the encrypted data transmission time; V2, obtaining the initial financial data transmission rate deviation, the initial financial data transmission rate deviation is represented by the result of a ratio operation between the sum of the initial financial data transmission rate and the preset transmission rate threshold and twice the preset transmission rate threshold; V3, obtaining the initial financial data reading rate, the initial financial data reading rate is represented by the result of a ratio operation between the encrypted financial data V4, obtaining the initial financial data reading rate deviation, the initial financial data reading rate deviation is represented by the result of a ratio operation between the sum of the initial financial data reading rate and the preset reading rate threshold and twice the preset reading rate threshold; V5, obtaining the financial data security transmission assessment value by combining the obtained initial financial data transmission rate deviation, the initial financial data reading rate deviation and the financial data accessibility assessment value that is not lower than the preset access threshold, the financial data accessibility assessment value that is not lower than the preset access threshold includes the financial data accessibility assessment value that is not lower than the preset access threshold before access adjustment and the financial data accessibility assessment value that is not lower than the preset access threshold after access adjustment.
[0061] Among them, the restricted expression of the evaluation value of financial data security transmission is as follows:
[0062]
[0063] Where AQ h represents the financial data security transmission evaluation value of the financial data in the hth third preset time period, h=1,2,...,s, h represents the number of the third preset time period, s represents the total number of the third preset time periods, CS h represents the initial financial data transmission rate deviation of the financial data in the hth third preset time period, represents the initial financial data transmission rate of the financial data in the hth third preset time period, represents the initial financial data reading rate of the financial data in the hth third preset time period, FW h represents the financial data accessibility evaluation value of the financial data in the hth third preset time period, DS h represents the initial financial data reading rate deviation of the financial data in the hth third preset time period, K h represents the encrypted financial data volume of the financial data in the hth third preset time period, TC h represents the encrypted data transmission time of financial data in the hth third preset time period, DTh represents the reading time of financial data in the hth third preset time period, CS0 represents the preset transmission rate threshold, DS0 represents the preset reading rate threshold, and e represents a natural constant.
[0064] like Figure 5 As shown, it is a flow chart for obtaining the evaluation value of financial data security transmission provided by the embodiment of the present application. The algorithm of this embodiment combines the comprehensive analysis of the secure transmission data to obtain the evaluation value of financial data security transmission. The secure transmission data in the algorithm of this embodiment does not exist independently, but has mutual correlation. The more encrypted financial data, the greater the evaluation value of financial data security transmission. The influence of the encrypted data transmission time and reading time should also be considered comprehensively. The size of the encrypted data directly affects the data transmission time. The larger the amount of encrypted data, the longer it takes to complete the transmission process, and the transmission time of the encrypted data will also affect the reading time of the data. The longer the data transmission time, the data recipient may experience a delay when reading the data. This delay may affect the timeliness of financial decisions, and the amount of encrypted financial data will also affect the reading time of the data. The larger the amount of data, the longer it takes to decrypt and process the data. The parameters of the algorithm of this embodiment need to consider the impact on the results together at the same time; the accurate quantification of security in the process of financial data storage and query is achieved.
[0065] Furthermore, the specific process of judging whether to make a secure transmission adjustment based on the financial data secure transmission evaluation value is as follows: BB1, judging whether the financial data secure transmission evaluation value is not lower than the preset security threshold. When the financial data secure transmission evaluation value is not lower than the preset security threshold, no secure transmission adjustment is made, otherwise BB2 is executed; BB2, sending a prompt to the preset personnel to change the transmission protocol. When the financial data secure transmission evaluation value is not lower than the preset security threshold, the secure transmission adjustment is stopped, otherwise BB3 is executed; BB3, sending a prompt to the preset personnel to check and repair disk errors and bad sectors. When the financial data secure transmission evaluation value is not lower than the preset security threshold, the secure transmission adjustment is stopped, otherwise feedback is given to the preset personnel to re-encrypt the financial data.
[0066] In this embodiment, the preset security threshold is represented by the variance of the cryptocurrency data transmission rate data of the cryptocurrency market in the historical time period in the preset database, the transmission protocols include TCP (Transmission Control Protocol), FTP (File Transfer Protocol), SFTP (SSH File Transfer Protocol), FTPS (FTP Secure), etc., checking and repairing disk errors and bad sectors includes using disk data recovery and management tools (such as DiskGenius) to detect and mark physical bad sectors on the hard disk, and using third-party disk repair software such as DiskGenius to automatically detect and attempt to repair logical errors; the reliability of financial data storage is improved.
[0067] To summarize, the embodiments of the present application achieve timely adjustments in the query and storage process of financial data by obtaining a delay impact value within a first preset time period and determining whether to perform a data accessibility assessment, then obtaining a financial data accessibility assessment value within a second preset time period and determining whether to perform an access adjustment, and finally obtaining a financial data security transmission assessment value within a third preset time period and determining whether to perform a security transmission adjustment, thereby achieving improved timeliness in the financial data storage and query process, and effectively solving the problem of low timeliness in the financial data storage and query process in the prior art.
[0068] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0069] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1A device that provides the functions specified in a block or multiple blocks.
[0070] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0071] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0072] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.
[0073] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims
1. A financial data storage and query system, characterized in that: Including delay impact assessment module, data accessibility assessment module and data transmission security assessment module: The delay impact assessment module is used to obtain the update delay financial data within a first preset time period and the preset data transmission delay time threshold to obtain a delay impact value, and determine whether to perform data accessibility assessment based on the delay impact value, and the delay impact value is used to assess the impact of the delay in updating financial data during the storage and query of financial data; The data accessibility assessment module is used to obtain a delay impact value corresponding to the data accessibility assessment within a second preset time period, financial access data, and reference access data to obtain a financial data accessibility assessment value, and determine whether to perform access adjustment based on the financial data accessibility assessment value, wherein the financial data accessibility assessment value is used to evaluate the system's ability to obtain financial data; The data transmission security assessment module is used to obtain a financial data security transmission assessment value by obtaining a financial data accessibility assessment value that is not lower than a preset access threshold within a third preset time period, secure transmission data, and reference secure transmission data, and to determine whether to perform a secure transmission adjustment based on the financial data security transmission assessment value. The financial data security transmission assessment value is used to assess the security of the financial data transmission process.
2. A financial data storage and query system as claimed in claim 1, characterized in that: The updated delayed financial data includes data propagation distance, average propagation speed, encrypted financial data volume, and average encryption speed; The update delay financial data is used to describe the delay of financial data within a first preset time period; The data propagation distance represents the distance of the financial data from the preset sender to the preset receiver within the first preset time period; The first preset time period represents a preset time period during the financial data storage and query process.
3. A financial data storage and query system as claimed in claim 2, characterized in that: The specific process of obtaining the delay impact value by acquiring the update delay financial data within the first preset time period and setting the data transmission delay time threshold is as follows: SS1, obtaining an initial propagation delay time, wherein the initial propagation delay time is represented by a result of a ratio operation between a data propagation distance and an average propagation speed; SS2, obtaining an initial propagation delay deviation, wherein the initial propagation delay deviation is represented by a result of a ratio operation between a difference between an initial propagation delay time average value and the initial propagation delay time and a preset data transmission delay time threshold; SS3, obtaining an initial encryption delay time, wherein the initial encryption delay time is represented by a result of calculating a ratio between an amount of encrypted financial data and an average encryption speed; SS4, obtaining an initial encryption delay deviation, wherein the initial encryption delay deviation is represented by a result of a ratio operation between a difference between an initial encryption delay time average value and the initial encryption delay time and a preset data transmission delay time threshold; SS5, determine whether the initial propagation delay deviation and the initial encryption delay deviation are greater than 0. When the initial propagation delay deviation and the initial encryption delay deviation are not greater than 0, the initial propagation delay deviation and the initial encryption delay deviation are recorded as 0 and then SS6 is executed, otherwise SS6 is directly executed; For SS6, the delay impact value is obtained by obtaining the initial propagation delay deviation and the initial encryption delay deviation.
4. A financial data storage and query system as claimed in claim 3, characterized in that: The limiting expression of the delay impact value is as follows: In the formula, YC x represents the delay impact value of the financial data in the xth first preset time period, x=1,2,...,y, x represents the number of the first preset time period, y represents the total number of the first preset time periods, y≥2, CB x represents the initial propagation delay deviation of the financial data in the first preset time period x, JM x represents the initial encryption delay deviation of the financial data in the xth first preset time period, represents the initial propagation delay time of the financial data in the first preset time period x, represents the initial encryption delay time of the financial data in the xth first preset time period, L x Indicates the data propagation distance of the financial data in the xth first preset time period, LV x represents the average propagation speed of financial data in the first preset time period of x, K x represents the encrypted financial data volume of the financial data in the x-th first preset time period, R x represents the average encryption speed of financial data in the xth first preset time period, and R0 represents the preset data transmission delay time threshold.
5. A financial data storage and query system as claimed in claim 1, characterized in that: The financial access data includes the number of access requests, the number of successful accesses and the system response time; The number of access requests represents the total number of access requests by the preset access party within the second preset time period; The system response time represents the time for the system to respond to the access request of the preset access party within the second preset time period; The reference access data includes a preset data access rate threshold and a preset response speed threshold; The second preset time period refers to a preset time period corresponding to a delay impact value that is not higher than a preset time delay threshold within the first preset time period.
6. A financial data storage and query system as claimed in claim 5, characterized in that: The specific process of obtaining the financial data accessibility evaluation value by obtaining the delay impact value corresponding to the data accessibility evaluation within the second preset time period, the financial access data, and the reference access data is as follows: RM1, obtaining an initial financial data access rate value, wherein the initial financial data access rate value is represented by a ratio calculation result of the number of access requests and the number of successful accesses; RM2, obtaining an initial financial data access rate deviation, wherein the initial financial data access rate deviation is represented by a ratio operation result of a sum of the initial financial data access rate value and twice a preset data access rate threshold and the preset data access rate threshold; RM3, obtaining an initial response speed value, wherein the initial response speed value is represented by a ratio operation between the number of requested accesses and the system response time; RM4, obtaining an initial response speed deviation, wherein the initial response speed deviation is represented by a ratio operation result of the sum of the initial response speed value and a preset response speed threshold and twice the preset response speed threshold; RM5, obtains the financial data accessibility evaluation value by combining the obtained initial financial data access rate deviation, initial response speed deviation and the delay impact value not higher than the preset time delay threshold.
7. A financial data storage and query system as claimed in claim 6, characterized in that: The specific process of access adjustment is as follows: AA1, when judging whether the accessibility evaluation value of financial data is not lower than the preset access threshold, if the monitored accessibility evaluation value of financial data is not lower than the preset access threshold, no access adjustment is performed, otherwise AA2 is executed; AA2, distribute the request to the server, and stop access adjustment when the monitored financial data accessibility evaluation value is not lower than the preset access threshold, otherwise execute AA3; AA3, sends a prompt to the preset personnel to perform data partitioning. When the monitored financial data accessibility evaluation value is not lower than the preset access threshold, stop access adjustment. Otherwise, feedback is given to the preset personnel to stop data storage and query.
8. A financial data storage and query system as claimed in claim 1, characterized in that: The secure transmission data includes the amount of encrypted financial data, encrypted data transmission time and reading time; The encrypted data transmission time represents the longest time for the financial data to be transmitted to the preset recipient within the third preset time period; The reading time represents the time required for the financial data to be read by the system within the third preset time period; The reference security transmission data includes a preset transmission rate threshold and a preset reading rate threshold; The third preset time period represents a preset time period corresponding to a financial data accessibility evaluation value that is not lower than a preset access threshold within the second time period, and the duration of the preset time periods is the same.
9. A financial data storage and query system as claimed in claim 8, characterized in that: The specific process of obtaining the financial data security transmission evaluation value by obtaining the financial data accessibility evaluation value that is not less than the preset access threshold within the third preset time period, the security transmission data, and referring to the security transmission data is as follows: V1, obtaining an initial financial data transmission rate, wherein the initial financial data transmission rate is represented by a ratio calculation result of the encrypted financial data volume and the encrypted data transmission time; V2, obtaining an initial financial data transmission rate deviation, wherein the initial financial data transmission rate deviation is represented by a ratio calculation result of the sum of the initial financial data transmission rate and a preset transmission rate threshold and twice the preset transmission rate threshold; V3, obtaining an initial financial data reading rate, wherein the initial financial data reading rate is represented by a ratio calculation result of the encrypted financial data volume and the reading time; V4, obtaining an initial financial data reading rate deviation, wherein the initial financial data reading rate deviation is represented by a ratio calculation result of the sum of the initial financial data reading rate and a preset reading rate threshold and twice the preset reading rate threshold; V5, a financial data security transmission assessment value is obtained by combining the obtained initial financial data transmission rate deviation, the initial financial data reading rate deviation and the financial data accessibility assessment value not lower than the preset access threshold, wherein the financial data accessibility assessment value not lower than the preset access threshold includes a financial data accessibility assessment value not lower than the preset access threshold before access adjustment and a financial data accessibility assessment value not lower than the preset access threshold after access adjustment.
10. A financial data storage and query system as claimed in claim 9, characterized in that: The specific process of judging whether to perform security transmission adjustment based on the financial data security transmission evaluation value is as follows: BB1, judging whether the financial data security transmission assessment value is not lower than the preset security threshold. If the financial data security transmission assessment value is not lower than the preset security threshold, no security transmission adjustment is performed. Otherwise, BB2 is executed. BB2, send a reminder to the preset personnel to change the transmission protocol. When the financial data security transmission assessment value is not lower than the preset security threshold, stop the security transmission adjustment, otherwise execute BB3; BB3, sends a prompt to the preset personnel to check and repair disk errors and bad sectors. When the financial data security transmission assessment value is not lower than the preset security threshold, the security transmission adjustment is stopped. Otherwise, feedback is given to the preset personnel to re-encrypt the financial data.
Citation Information
Patent Citations
A financial data processing method, device, system and storage medium
CN111522890B
A financial big data information storage method and device based on cloud platform
CN117009353B
Cited By
Effective weighted density peak clustering analysis method based on rough evidence theory
CN119862434A
Method and system for data storage and retrieval
GB2704229A