A storage optimization method for dynamic heterogeneous adjustment in industrial data cache
By real-time monitoring of industrial data and dynamic adjustment of cache storage structure, the problem of low cache efficiency in massive heterogeneous data storage is solved, and efficient resource utilization and performance optimization are achieved.
Patent Information
- Application Number
- CN202410460147.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-04-17
- Publication Date
- 2025-09-09
- Estimated Expiration
- 2044-04-17
AI Technical Summary
Existing technologies suffer from low cache efficiency and resource waste in the process of storing massive heterogeneous data. Especially in industrial data cache, the diversity of data and changes in access patterns lead to poor storage efficiency.
By monitoring industrial data in real time, determining access patterns and priorities, evaluating cache space usage, and combining access characteristics and optimization goals, the cache storage structure is dynamically adjusted, performance indicators are monitored in real time, and verification and optimization are performed.
It improves the performance and utilization of data cache, reduces resource waste, and ensures performance continuity during the storage process.
Smart Images

Figure CN118349174B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data storage, and in particular to a storage optimization method for performing dynamic heterogeneous adjustment in an industrial data cache. Background Art
[0002] In the information age, with the development of the internet, multimedia, social media, the Internet of Things, and cloud computing, more and more data is being collected. The volume and complexity of this data are increasing, leading to exponential growth. One of its hallmarks is the intensive data explosion, which in turn increases the difficulty of processing data. People are also realizing the enormous commercial value that data brings.
[0003] However, massive data doesn't just mean explosive growth in data volume; it also involves a variety of heterogeneous data types, with structured, semi-structured, and unstructured data coexisting. Unstructured data, such as images, audio, and video, is increasingly appearing on the internet, and its growth rate is even far exceeding that of structured data.
[0004] The invention patent application number CN201410235651.9 discloses a storage method and system for massive heterogeneous data, which can uniformly load big data containing structured data, semi-structured data and unstructured data, realizing the effective combination and unified storage management of massive structured data, semi-structured data and unstructured data; however, due to the diversity of data and changes in access patterns, there are problems of low cache efficiency and resource waste in the data storage process. Summary of the Invention
[0005] The present invention provides a storage optimization method for performing dynamic heterogeneous adjustment in an industrial data cache, so as to solve the problems raised in the background technology.
[0006] A storage optimization method for dynamic heterogeneous adjustment in industrial data cache, comprising:
[0007] S1: Monitor cached industrial data in real time, determine access patterns of the industrial data, and analyze the industrial data based on the access patterns to determine access characteristics and priorities of different industrial data;
[0008] S2: Evaluate the usage of the cache space and determine the optimization direction and optimization target of the cache storage structure of the cache space based on the evaluation results;
[0009] S3: Determines a dynamic adjustment strategy for the cache storage structure based on the access characteristics and priorities of different industrial data, combined with optimization directions and goals;
[0010] S4: Monitor the storage performance indicators of the cache space under the dynamic adjustment strategy in real time, verify the dynamic adjustment effect according to the storage performance indicators, and further optimize the cache storage structure based on the verification results.
[0011] Preferably, in S1, real-time monitoring of the cached industrial data and determining the access pattern of the industrial data include:
[0012] Obtaining an access request for industrial data, obtaining request fields related to the access mode from the access request, and standardizing the access fields to obtain standard access fields;
[0013] Match the standard access fields with the access patterns, and determine the access pattern of the industrial data based on the matching results.
[0014] Preferably, in S1, analyzing the industrial data based on the access pattern to determine the access characteristics and priorities of different industrial data includes:
[0015] Obtaining access frequency, access volume, and access time of the industrial data from the access pattern;
[0016] Determine hot and cold data of industrial data based on access frequency;
[0017] Determine the access characteristics of industrial data based on the number of visits and access time;
[0018] Determine the initial priority of industrial data based on the matching relationship between access characteristics and preset access priorities;
[0019] Based on the hot and cold characteristics of industrial data, the weighted weights of the initial priorities are determined, and the initial priorities are weighted based on the weighted weights to obtain the final priority of the industrial data.
[0020] Preferably, in S2, the usage of the cache space is evaluated, and based on the evaluation result, the optimization direction and optimization target of the cache storage structure of the cache space are determined, including:
[0021] Obtain historical cache hit rate and historical cache throughput, as well as current cache capacity, from cache space usage;
[0022] Determine an overall cache performance of the cache space based on the historical cache hit rate and the historical cache throughput, and determine a local cache performance of a cache storage structure of the cache space;
[0023] Determining an overall cacheable capacity of the cache space based on a current cache amount of the cache space, and determining a local cacheable capacity of a cache storage structure of the cache space;
[0024] Based on the overall cache performance and the local cache performance, as well as the overall cacheable capacity and the local cacheable capacity, an optimization direction and an optimization target for the cache storage structure of the cache space are determined.
[0025] Preferably, determining the optimization direction and optimization target of the cache storage structure of the cache space based on the overall cache performance and the local cache performance, as well as the overall cacheable capacity and the local cacheable capacity, includes:
[0026] Based on the difference between the overall cache performance and the preset standard cache performance, determine the performance optimization target for the cache space. Based on the local cache performance and combined with the performance optimization target, determine the performance optimization direction for the cache storage structure.
[0027] Based on the difference between the overall cacheable capacity and the preset standard cache capacity, the capacity optimization target for the cache space is determined. Based on the local cacheable capacity and the capacity optimization target, the capacity optimization direction for the cache storage structure is determined.
[0028] The performance optimization target and the capacity optimization target serve as optimization targets for the cache storage structure of the cache space, and the performance optimization direction and the capacity optimization direction serve as optimization directions for the cache storage structure of the cache space.
[0029] Preferably, in S3, based on the access characteristics and priorities of different industrial data, combined with the optimization direction and optimization goal, a dynamic adjustment strategy for the cache storage structure is determined, including:
[0030] Determine the resource consumption and efficiency of access to industrial data based on the access characteristics of industrial data, and determine the order of access to industrial data based on the priority of industrial data;
[0031] Determining an adjustment type for the cache storage structure from the optimization direction, and setting an adjustment compliance condition for the adjustment type for the cache storage structure based on the optimization goal;
[0032] Dynamic adjustment parameters for all adjustment types are determined according to the adjustment compliance conditions, and a dynamic adjustment strategy for the cache storage structure is determined based on the dynamic adjustment parameters.
[0033] Preferably, determining dynamic adjustment parameters for all adjustment types according to the adjustment compliance conditions, and determining a dynamic adjustment strategy for the cache storage structure based on the dynamic adjustment parameters, includes:
[0034] Determine the target requirements for cache replacement adjustment, structure layout adjustment, and cache data allocation adjustment based on the adjustment type and adjustment compliance conditions;
[0035] Based on the access sequence of the industrial data, a benchmark cache data allocation result for the industrial data is determined; based on the target requirements for the cache data allocation and in combination with the resource consumption and access efficiency of the industrial data, a result indicator value for the benchmark cache data allocation result is determined; based on the result indicator value, a preset allocation strategy is used to determine a dynamic adjustment parameter for the benchmark cache data allocation result;
[0036] Based on the access frequency of the industrial data, a cache storage weight for the industrial data is determined. Based on the cache storage weight and in combination with the target requirements for cache replacement adjustment, a dynamic adjustment parameter for cache replacement adjustment is determined.
[0037] Obtain fixed structural features and adjustable structural features of the cache storage structure, and determine dynamic adjustment parameters for the adjustable structural features based on target requirements for structural layout adjustment and in combination with the fixed structural features;
[0038] The consistency of the benchmark cache data allocation results, cache replacement adjustment and dynamic adjustment parameters of the adjustable structural characteristics is checked, and according to the check results, a dynamic adjustment strategy for the cache storage structure is obtained.
[0039] Preferably, the consistency check of the benchmark cache data allocation result, cache replacement adjustment and dynamic adjustment parameters of the adjustable structural features is performed, and a dynamic adjustment strategy for the cache storage structure is obtained based on the check result, including:
[0040] Determine the overall target requirements for the cache storage structure based on the target requirements for cache replacement adjustment, structure layout adjustment, and cache data allocation adjustment;
[0041] Based on the overall target requirements, the benchmark cache data allocation results, cache replacement adjustment and dynamic adjustment parameters of adjustable structural features are tested to determine whether the overall target requirements are met;
[0042] If so, generating a dynamic adjustment strategy for the cache storage structure based on the benchmark cache data allocation result, cache replacement adjustment, and dynamic adjustment parameters of the adjustable structural characteristics;
[0043] Otherwise, based on the overall target requirements, the benchmark cache data allocation results, cache replacement adjustment and dynamic adjustment parameters of the adjustable structural features are revised, and a dynamic adjustment strategy for the cache storage structure is generated after the revision.
[0044] Preferably, in S4, real-time monitoring of the storage performance index of the cache space under the dynamic adjustment strategy and verifying the dynamic adjustment effect according to the storage performance index include:
[0045] Based on real-time monitoring of the storage performance indicators of the cache space under the dynamic adjustment strategy, a storage performance curve is established to obtain a standard performance curve corresponding to the standard storage effect;
[0046] The storage performance curve is compared with a standard performance curve. If the storage performance curve satisfies the standard performance curve, the verification result is that the effect meets the standard; otherwise, the verification result is that the effect does not meet the standard.
[0047] Preferably, in S4, further optimizing the cache storage structure based on the verification result includes:
[0048] When the verification result is determined to be satisfactory, it is determined that no further optimization of the cache storage result is required;
[0049] When the verification result is determined to be unsatisfactory, the curve characteristics of the storage performance indicator that fails to meet the standard are obtained, and based on the dynamic adjustment strategy, the curve characteristics are converted into optimization parameters, and the cache storage structure is further optimized based on the optimization parameters.
[0050] Compared with the prior art, the present invention has achieved the following beneficial effects:
[0051] By monitoring the cached industrial data in real time, the access pattern of the industrial data is determined, and based on the access pattern, the industrial data is analyzed to determine the access characteristics and priorities of different industrial data; the usage of the cache space is evaluated, and the optimization direction and optimization target of the cache storage structure of the cache space are determined based on the evaluation results; based on the access characteristics and priorities of different industrial data, combined with the optimization direction and optimization target, a dynamic adjustment strategy for the cache storage structure is determined to achieve dynamic adjustment of the data structure, thereby improving the performance and utilization of the data cache, and monitoring the storage performance indicators of the cache space under the dynamic adjustment strategy in real time, and verifying the dynamic adjustment effect based on the storage performance indicators, and further optimizing the cache storage structure based on the verification results to ensure the continuity of data performance during the storage process and reduce resource waste.
[0052] Other features and advantages of the present invention will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present invention. The purpose and other advantages of the present invention can be achieved and obtained through the structures specifically pointed out in this application document.
[0053] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0054] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:
[0055] Figure 1 This is a flowchart of a storage optimization method for performing dynamic heterogeneous adjustment in an industrial data cache according to an embodiment of the present invention;
[0056] Figure 2 A flowchart of determining an access mode for industrial data in an embodiment of the present invention;
[0057] Figure 3 This is a flow chart of determining a dynamic adjustment strategy for a cache storage structure in an embodiment of the present invention. DETAILED DESCRIPTION
[0058] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.
[0059] Example 1:
[0060] The embodiment of the present invention provides a storage optimization method for dynamic heterogeneous adjustment in industrial data cache, such as Figure 1 Shown, including:
[0061] S1: Monitor cached industrial data in real time, determine access patterns of the industrial data, and analyze the industrial data based on the access patterns to determine access characteristics and priorities of different industrial data;
[0062] S2: Evaluate the usage of the cache space and determine the optimization direction and optimization target of the cache storage structure of the cache space based on the evaluation results;
[0063] S3: Determines a dynamic adjustment strategy for the cache storage structure based on the access characteristics and priorities of different industrial data, combined with optimization directions and goals;
[0064] S4: Monitor the storage performance indicators of the cache space under the dynamic adjustment strategy in real time, verify the dynamic adjustment effect according to the storage performance indicators, and further optimize the cache storage structure based on the verification results.
[0065] In this embodiment, the data access mode includes a transactional access mode, an analytical access mode, a random access mode, a sequential access mode, and the like.
[0066] The beneficial effects of the above design scheme are: by real-time monitoring of cached industrial data, the access pattern of industrial data is determined, and based on the access pattern, the industrial data is analyzed to determine the access characteristics and priorities of different industrial data; the usage of cache space is evaluated, and the optimization direction and optimization target of the cache storage structure of the cache space are determined based on the evaluation results; based on the access characteristics and priorities of different industrial data, combined with the optimization direction and optimization target, a dynamic adjustment strategy for the cache storage structure is determined to achieve dynamic adjustment of the data structure, thereby improving the performance and utilization of the data cache, and monitoring the storage performance indicators of the cache space under the dynamic adjustment strategy in real time, and verifying the dynamic adjustment effect according to the storage performance indicators, and further optimizing the cache storage structure based on the verification results to ensure the continuity of data performance during the storage process and reduce resource waste.
[0067] Example 2:
[0068] Based on Example 1, the embodiment of the present invention provides a storage optimization method for dynamic heterogeneous adjustment in industrial data cache, such as Figure 2 As shown, in S1, real-time monitoring of cached industrial data is performed to determine the access pattern of the industrial data, including:
[0069] Obtaining an access request for industrial data, obtaining request fields related to the access mode from the access request, and standardizing the access fields to obtain standard access fields;
[0070] Match the standard access fields with the access patterns, and determine the access pattern of the industrial data based on the matching results.
[0071] The beneficial effect of the above design scheme is: by matching the standard access field with the access pattern, the access pattern of the industrial data is determined according to the matching result, the access pattern of the industrial data is determined, and a basis for data analysis is provided.
[0072] Example 3:
[0073] Based on Example 1, this embodiment of the present invention provides a storage optimization method for dynamic heterogeneous adjustment in an industrial data cache. In S1, the industrial data is analyzed based on the access pattern to determine the access characteristics and priorities of different industrial data, including:
[0074] Obtaining access frequency, access volume, and access time of the industrial data from the access pattern;
[0075] Determine hot and cold data of industrial data based on access frequency;
[0076] Determine the access characteristics of industrial data based on the number of visits and access time;
[0077] Determine the initial priority of industrial data based on the matching relationship between access characteristics and preset access priorities;
[0078] Based on the hot and cold characteristics of industrial data, the weighted weights of the initial priorities are determined, and the initial priorities are weighted based on the weighted weights to obtain the final priority of the industrial data.
[0079] In this embodiment, the hot and cold characteristics of industrial data are hot data and cold data.
[0080] The beneficial effect of the above design scheme is: by analyzing the industrial data based on the access mode, the access characteristics and priorities of different industrial data are determined, and starting from the industrial data, a storage data feature basis is provided for adjusting the storage structure.
[0081] Example 4:
[0082] Based on Example 1, an embodiment of the present invention provides a storage optimization method for dynamic heterogeneous adjustment in an industrial data cache. In S2, the usage of the cache space is evaluated, and the optimization direction and optimization target of the cache storage structure of the cache space are determined based on the evaluation result, including:
[0083] Obtain historical cache hit rate and historical cache throughput, as well as current cache capacity, from cache space usage;
[0084] Determine an overall cache performance of the cache space based on the historical cache hit rate and the historical cache throughput, and determine a local cache performance of a cache storage structure of the cache space;
[0085] Determining an overall cacheable capacity of the cache space based on a current cache amount of the cache space, and determining a local cacheable capacity of a cache storage structure of the cache space;
[0086] Based on the overall cache performance and the local cache performance, as well as the overall cacheable capacity and the local cacheable capacity, an optimization direction and an optimization target for the cache storage structure of the cache space are determined.
[0087] In this embodiment, the optimization direction is, for example, a performance optimization direction and a capacity optimization direction.
[0088] Example 5:
[0089] Based on Example 4, an embodiment of the present invention provides a storage optimization method for dynamic heterogeneous adjustment in an industrial data cache, wherein the method determines the optimization direction and optimization target of the cache storage structure of the cache space based on the overall cache performance and local cache performance, as well as the overall cacheable capacity and local cacheable capacity, including:
[0090] Based on the difference between the overall cache performance and the preset standard cache performance, determine the performance optimization target for the cache space. Based on the local cache performance and combined with the performance optimization target, determine the performance optimization direction for the cache storage structure.
[0091] Based on the difference between the overall cacheable capacity and the preset standard cache capacity, the capacity optimization target for the cache space is determined. Based on the local cacheable capacity and the capacity optimization target, the capacity optimization direction for the cache storage structure is determined.
[0092] The performance optimization target and the capacity optimization target serve as optimization targets for the cache storage structure of the cache space, and the performance optimization direction and the capacity optimization direction serve as optimization directions for the cache storage structure of the cache space.
[0093] The beneficial effects of the above design scheme are: by determining the capacity optimization target of the cache space based on the difference between the overall cacheable capacity and the preset standard cache capacity, and based on the local cacheable capacity and combined with the capacity optimization target, determining the capacity optimization direction of the cache storage structure, determining the optimization direction and optimization target of the cache storage structure from two aspects, and providing direction and goals for storage optimization of dynamic heterogeneous adjustment.
[0094] Example 6:
[0095] Based on Example 1, the embodiment of the present invention provides a storage optimization method for dynamic heterogeneous adjustment in industrial data cache, such as Figure 3 As shown, in S3, based on the access characteristics and priorities of different industrial data, combined with the optimization direction and optimization goal, a dynamic adjustment strategy for the cache storage structure is determined, including:
[0096] Determine the resource consumption and efficiency of access to industrial data based on the access characteristics of industrial data, and determine the order of access to industrial data based on the priority of industrial data;
[0097] Determining an adjustment type for the cache storage structure from the optimization direction, and setting an adjustment compliance condition for the adjustment type for the cache storage structure based on the optimization goal;
[0098] Dynamic adjustment parameters for all adjustment types are determined according to the adjustment compliance conditions, and a dynamic adjustment strategy for the cache storage structure is determined based on the dynamic adjustment parameters.
[0099] The beneficial effects of the above design scheme are: by determining the dynamic adjustment strategy of the cache storage structure based on the access characteristics and priorities of different industrial data, combined with the optimization direction and optimization goals, and correlating and analyzing the stored industrial data and the storage structure, a dynamic adjustment strategy for the cache storage structure is obtained, and dynamic adjustment of the data structure is achieved, thereby improving the performance and utilization of the data cache.
[0100] Example 7:
[0101] Based on Example 6, an embodiment of the present invention provides a storage optimization method for dynamic heterogeneous adjustment in an industrial data cache, wherein dynamic adjustment parameters for all adjustment types are determined according to adjustment compliance conditions, and a dynamic adjustment strategy for the cache storage structure is determined based on the dynamic adjustment parameters, including:
[0102] Determine the target requirements for cache replacement adjustment, structure layout adjustment, and cache data allocation adjustment based on the adjustment type and adjustment compliance conditions;
[0103] Based on the access sequence of the industrial data, a benchmark cache data allocation result for the industrial data is determined; based on the target requirements for the cache data allocation and in combination with the resource consumption and access efficiency of the industrial data, a result indicator value for the benchmark cache data allocation result is determined; based on the result indicator value, a preset allocation strategy is used to determine a dynamic adjustment parameter for the benchmark cache data allocation result;
[0104] Based on the access frequency of the industrial data, a cache storage weight for the industrial data is determined. Based on the cache storage weight and in combination with the target requirements for cache replacement adjustment, a dynamic adjustment parameter for cache replacement adjustment is determined.
[0105] Obtain fixed structural features and adjustable structural features of the cache storage structure, and determine dynamic adjustment parameters for the adjustable structural features based on target requirements for structural layout adjustment and in combination with the fixed structural features;
[0106] The consistency of the benchmark cache data allocation results, cache replacement adjustment and dynamic adjustment parameters of the adjustable structural characteristics is checked, and according to the check results, a dynamic adjustment strategy for the cache storage structure is obtained.
[0107] The beneficial effects of the above design scheme are: by analyzing and determining the dynamic adjustment parameters from three aspects: cache replacement adjustment, structural layout adjustment and cache data allocation adjustment, all aspects are taken into consideration to ensure the accuracy and effectiveness of the dynamic adjustment strategy obtained, and the baseline cache data allocation results, cache replacement adjustment and dynamic adjustment parameters of adjustable structural characteristics are checked for consistency. Based on the test results, a dynamic adjustment strategy for the cache storage structure is obtained to achieve the feasibility and accuracy of the dynamic adjustment strategy.
[0108] Example 8:
[0109] Based on Example 7, an embodiment of the present invention provides a storage optimization method for dynamic heterogeneous adjustment in an industrial data cache, wherein consistency checks are performed on the benchmark cache data allocation results, cache replacement adjustments, and dynamic adjustment parameters of adjustable structural features, and a dynamic adjustment strategy for the cache storage structure is obtained based on the check results, including:
[0110] Determine the overall target requirements for the cache storage structure based on the target requirements for cache replacement adjustment, structure layout adjustment, and cache data allocation adjustment;
[0111] Based on the overall target requirements, the benchmark cache data allocation results, cache replacement adjustment and dynamic adjustment parameters of adjustable structural features are tested to determine whether the overall target requirements are met;
[0112] If so, generating a dynamic adjustment strategy for the cache storage structure based on the benchmark cache data allocation result, cache replacement adjustment, and dynamic adjustment parameters of the adjustable structural characteristics;
[0113] Otherwise, based on the overall target requirements, the benchmark cache data allocation results, cache replacement adjustment and dynamic adjustment parameters of the adjustable structural features are revised, and a dynamic adjustment strategy for the cache storage structure is generated after the revision.
[0114] The beneficial effect of the above design scheme is: by correcting the benchmark cache data allocation results, cache replacement adjustment and dynamic adjustment parameters of adjustable structural characteristics based on the overall target requirements, a dynamic adjustment strategy for the cache storage structure is generated after correction, thereby achieving the feasibility and accuracy of the dynamic adjustment strategy.
[0115] Example 9:
[0116] Based on Example 1, an embodiment of the present invention provides a storage optimization method for dynamic heterogeneous adjustment in an industrial data cache. In S4, the storage performance index of the cache space under the dynamic adjustment strategy is monitored in real time, and the dynamic adjustment effect is verified based on the storage performance index, including:
[0117] Based on real-time monitoring of the storage performance indicators of the cache space under the dynamic adjustment strategy, a storage performance curve is established to obtain a standard performance curve corresponding to the standard storage effect;
[0118] The storage performance curve is compared with a standard performance curve. If the storage performance curve satisfies the standard performance curve, the verification result is that the effect meets the standard; otherwise, the verification result is that the effect does not meet the standard.
[0119] The beneficial effect of the above design scheme is: by comparing the storage performance curve with the standard performance curve, if the storage performance curve meets the standard performance curve, the effect is taken as the verification result; otherwise, the effect is taken as the verification result that it does not meet the standard, thereby realizing the verification of the dynamic adjustment effect and providing a data basis for further optimization.
[0120] Example 10:
[0121] Based on Example 9, an embodiment of the present invention provides a storage optimization method for performing dynamic heterogeneous adjustment in an industrial data cache. In S4, the cache storage structure is further optimized based on the verification result, including:
[0122] When the verification result is determined to be satisfactory, it is determined that no further optimization of the cache storage result is required;
[0123] When the verification result is determined to be unsatisfactory, the curve characteristics of the storage performance indicator that fails to meet the standard are obtained, and based on the dynamic adjustment strategy, the curve characteristics are converted into optimization parameters, and the cache storage structure is further optimized based on the optimization parameters.
[0124] The beneficial effects of the above design scheme are: when it is determined that the verification result is up to standard, it is determined that there is no need to further optimize the cache storage result; when it is determined that the verification result is not up to standard, the curve characteristics of the storage performance indicators that do not meet the standard are obtained, and based on the dynamic adjustment strategy, the curve characteristics are converted into optimization parameters, and the cache storage structure is further optimized based on the optimization parameters to achieve real-time optimization of the storage structure, ensure the continuity of data performance during the storage process, and reduce resource waste.
[0125] Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of this application document and its equivalents, the present invention is intended to include these modifications and variations.
Claims
1. A storage optimization method for dynamic heterogeneous adjustment in industrial data cache, characterized in that: include: S1: Monitor cached industrial data in real time, determine access patterns of the industrial data, analyze the industrial data based on the access patterns, obtain access frequency, access volume, and access time of the industrial data from the access patterns, and determine access characteristics and priorities of different industrial data; S2: Evaluate the usage of the cache space and determine the optimization direction and optimization target of the cache storage structure of the cache space based on the evaluation results; S3: Based on the access characteristics and priorities of different industrial data, combined with the optimization direction and optimization goals, determine the dynamic adjustment strategy for the cache storage structure, including: Determine the resource consumption and efficiency of access to industrial data based on the access characteristics of industrial data, and determine the order of access to industrial data based on the priority of industrial data; Determining an adjustment type for the cache storage structure from the optimization direction, and setting an adjustment compliance condition for the adjustment type for the cache storage structure based on the optimization goal; Determining dynamic adjustment parameters for all adjustment types according to the adjustment compliance conditions, and determining a dynamic adjustment strategy for the cache storage structure based on the dynamic adjustment parameters, including: Determine the target requirements for cache replacement adjustment, structure layout adjustment, and cache data allocation adjustment based on the adjustment type and adjustment compliance conditions; Based on the access sequence of the industrial data, a benchmark cache data allocation result for the industrial data is determined; based on the target requirements for adjusting the cache data allocation, combined with the resource consumption and access efficiency of the industrial data, a result indicator value for the benchmark cache data allocation result is determined; based on the result indicator value, a preset allocation strategy is used to determine a dynamic adjustment parameter for the benchmark cache data allocation result; Based on the access frequency of the industrial data, a cache storage weight for the industrial data is determined. Based on the cache storage weight and in combination with the target requirements for cache replacement adjustment, a dynamic adjustment parameter for cache replacement adjustment is determined. Obtain fixed structural features and adjustable structural features of the cache storage structure, and determine dynamic adjustment parameters for the adjustable structural features based on target requirements for structural layout adjustment and in combination with the fixed structural features; Perform consistency checks on the benchmark cache data allocation results, cache replacement adjustments, and dynamic adjustment parameters of adjustable structural features, and obtain a dynamic adjustment strategy for the cache storage structure based on the check results; S4: Monitor the storage performance indicators of the cache space under the dynamic adjustment strategy in real time, verify the dynamic adjustment effect according to the storage performance indicators, and further optimize the cache storage structure based on the verification results.
2. The storage optimization method for dynamic heterogeneous adjustment in industrial data cache according to claim 1 is characterized in that: In S1, real-time monitoring of the cached industrial data is performed to determine the access pattern of the industrial data, including: Obtaining an access request for industrial data, obtaining request fields related to the access mode from the access request, and standardizing the access fields to obtain standard access fields; Match the standard access fields with the access patterns, and determine the access pattern of the industrial data based on the matching results.
3. The storage optimization method for dynamic heterogeneous adjustment in industrial data cache according to claim 1 is characterized in that: In S1, the access characteristics and priorities of different industrial data are determined, including: Determine hot and cold data of industrial data based on access frequency; Determine the access characteristics of industrial data based on the number of visits and access time; Determine the initial priority of industrial data based on the matching relationship between access characteristics and preset access priorities; Based on the hot and cold characteristics of industrial data, the weighted weights of the initial priorities are determined, and the initial priorities are weighted based on the weighted weights to obtain the final priority of the industrial data.
4. The storage optimization method for dynamic heterogeneous adjustment in industrial data cache according to claim 1 is characterized in that: In S2, the usage of the cache space is evaluated, and based on the evaluation result, an optimization direction and optimization target for the cache storage structure of the cache space are determined, including: Obtain historical cache hit rate and historical cache throughput, as well as current cache capacity, from cache space usage; Determine an overall cache performance of the cache space based on the historical cache hit rate and the historical cache throughput, and determine a local cache performance of the cache storage structure of the cache space; Determining an overall cacheable capacity of the cache space based on a current cache amount of the cache space, and determining a local cacheable capacity of a cache storage structure of the cache space; Based on the overall cache performance and the local cache performance, as well as the overall cacheable capacity and the local cacheable capacity, an optimization direction and an optimization target for the cache storage structure of the cache space are determined.
5. The storage optimization method for dynamic heterogeneous adjustment in industrial data cache according to claim 4 is characterized in that: Determining the optimization direction and optimization target of the cache storage structure of the cache space based on the overall cache performance and the local cache performance, as well as the overall cacheable capacity and the local cacheable capacity, includes: Based on the difference between the overall cache performance and the preset standard cache performance, determine the performance optimization target for the cache space. Based on the local cache performance and combined with the performance optimization target, determine the performance optimization direction for the cache storage structure. Based on the difference between the overall cacheable capacity and the preset standard cache capacity, the capacity optimization target for the cache space is determined. Based on the local cacheable capacity and the capacity optimization target, the capacity optimization direction for the cache storage structure is determined. The performance optimization target and the capacity optimization target serve as optimization targets for the cache storage structure of the cache space, and the performance optimization direction and the capacity optimization direction serve as optimization directions for the cache storage structure of the cache space.
6. The storage optimization method for dynamic heterogeneous adjustment in industrial data cache according to claim 1, characterized in that: The consistency check of the benchmark cache data allocation result, cache replacement adjustment and dynamic adjustment parameters of the adjustable structural features is performed, and a dynamic adjustment strategy for the cache storage structure is obtained based on the check result, including: Determine the overall target requirements for the cache storage structure based on the target requirements for cache replacement adjustment, structure layout adjustment, and cache data allocation adjustment; Based on the overall target requirements, the benchmark cache data allocation results, cache replacement adjustments, and dynamic adjustment parameters of adjustable structural features are tested to determine whether the overall target requirements are met; If so, generating a dynamic adjustment strategy for the cache storage structure based on the benchmark cache data allocation result, cache replacement adjustment, and dynamic adjustment parameters of the adjustable structural characteristics; Otherwise, based on the overall target requirements, the benchmark cache data allocation results, cache replacement adjustment and dynamic adjustment parameters of the adjustable structural features are revised, and a dynamic adjustment strategy for the cache storage structure is generated after the revision.
7. The storage optimization method for dynamic heterogeneous adjustment in industrial data cache according to claim 1, characterized in that: In S4, the storage performance index of the cache space under the dynamic adjustment policy is monitored in real time, and the dynamic adjustment effect is verified based on the storage performance index, including: Based on real-time monitoring of the storage performance indicators of the cache space under the dynamic adjustment strategy, a storage performance curve is established to obtain a standard performance curve corresponding to the standard storage effect; The storage performance curve is compared with a standard performance curve. If the storage performance curve satisfies the standard performance curve, the verification result is that the effect meets the standard; otherwise, the verification result is that the effect does not meet the standard.
8. The storage optimization method for dynamic heterogeneous adjustment in industrial data cache according to claim 7, characterized in that: In S4, the cache storage structure is further optimized based on the verification result, including: When the verification result is determined to be satisfactory, it is determined that no further optimization of the cache storage result is required; When the verification result is determined to be unsatisfactory, the curve characteristics of the storage performance indicator that fails to meet the standard are obtained, and based on the dynamic adjustment strategy, the curve characteristics are converted into optimization parameters, and the cache storage structure is further optimized based on the optimization parameters.
Citation Information
Patent Citations
Massive isomerous data storage method and system
CN103984761A
GPGPU register cache management system
CN116820773A