Resource information processing method and device, equipment, medium and program product

Abstract

The invention provides a resource information processing method which can be applied to the technical field of software development and financial science and technology. The resource information processing method comprises the steps that resource information of storage resources is obtained, the resource information comprises configuration information and use information, the configuration information comprises hardware configuration information and logic configuration information, the storage resources comprise block type resources, and the use information comprises path use information; a path processing strategy is determined based on the hardware configuration information, the logic configuration information and the path use information, and the path processing strategy comprises at least one of a path updating strategy, a fault processing strategy and a path load strategy; and processing the block resource information by using the path updating strategy, the fault processing strategy and the path load strategy to obtain a path processing result. The invention further provides a resource information processing device and equipment, a storage medium and a program product.

Description

Technical Field

[0001] The present disclosure relates to the fields of software development and financial technology, and specifically to a resource information processing method, device, equipment, medium and program product. Background Art

[0002] The operation and maintenance of storage device resources in data centers involves a variety of technologies and strategies. These methods and practices are crucial to ensuring the reliability, performance and efficiency of the system. The operation and maintenance methods of storage resources in related technologies mainly include using monitoring tools to monitor the performance indicators of various storage devices and make optimization adjustments; or regularly backing up data by formulating a relatively detailed recovery plan or test.

[0003] The inventors have discovered that the operation and maintenance of storage resources in the related art has the following defects: there is a lack of a unified management method for the comprehensive operation and maintenance of heterogeneous storage resources, and the performance differences of different storage resources lead to performance bottlenecks of the overall system; storage devices with different architectures require different management tools and strategies, and the operation and maintenance work is relatively cumbersome; fault diagnosis and troubleshooting in heterogeneous storage devices are more complicated, resulting in low overall operation and maintenance efficiency. Summary of the invention

[0004] In view of the above problems, the present disclosure provides a resource information processing method, apparatus, device, medium and program product.

[0005] According to a first aspect of the present disclosure, a resource information processing method is provided, comprising: obtaining resource information of storage resources, wherein the resource information comprises configuration information and usage information, the configuration information comprises hardware configuration information and logical configuration information, the storage resources comprise multiple types of block type resources, and the usage information comprises path usage information; determining a path processing strategy based on the hardware configuration information, the logical configuration information and the path usage information, wherein the path processing strategy comprises at least one of a path update strategy, a fault handling strategy and a path load strategy; and processing the block resource information using the path update strategy, the fault handling strategy and the path load strategy to obtain a path processing result.

[0006] According to an embodiment of the present disclosure, the above-mentioned hardware configuration information includes hardware device information, the above-mentioned logical configuration information includes path information, and the above-mentioned hardware device information and the above-mentioned path information are both multiple; the path processing strategy is determined based on the hardware configuration information of the above-mentioned block type resources, the above-mentioned logical configuration information and the above-mentioned path usage information, including: determining multiple initial path processing strategies corresponding to the multiple hardware device information and the multiple path information; and updating the multiple initial path processing strategies based on a preset update strategy and the above-mentioned path usage information to obtain the above-mentioned path processing strategy, so that the above-mentioned path processing strategy matches the multiple hardware device information.

[0007] According to an embodiment of the present disclosure, the above-mentioned resource information is processed using the above-mentioned path update strategy, the above-mentioned fault handling strategy and the above-mentioned path load strategy to obtain a path processing result, including: determining multiple storage path information in the above-mentioned block resource information; and in the case where it is detected that at least one storage path information among the multiple storage path information is abnormal information, processing the above-mentioned storage path information based on the above-mentioned fault handling strategy, the above-mentioned path update strategy and the above-mentioned path load strategy to obtain the above-mentioned path processing result.

[0008] According to an embodiment of the present disclosure, the above-mentioned usage information also includes resource usage information, the above-mentioned storage resources also include file type resources, and the above-mentioned method also includes: processing the above-mentioned hardware configuration information, the above-mentioned logical configuration information and the above-mentioned resource usage information within a historical time period to obtain resource usage results; using preset prediction rules and the above-mentioned resource usage results to predict the resource usage information within a future time period to obtain prediction results; determining a resource allocation strategy based on the above-mentioned prediction results; and using the above-mentioned resource allocation strategy to process the above-mentioned resource information to obtain a resource allocation result.

[0009] According to an embodiment of the present disclosure, resource usage information in a future time period is predicted using preset prediction rules and the above-mentioned resource usage results to obtain prediction results, including: extracting feature sequence information and load peaks from the above-mentioned resource usage results; and inputting the above-mentioned feature sequence information and the above-mentioned load peaks into a time series model to output the above-mentioned prediction results.

[0010] According to an embodiment of the present disclosure, the above-mentioned hardware configuration information also includes hardware management information and resource pool information, and the above-mentioned logical configuration information also includes port information and security policy; the above-mentioned method also includes: based on the above-mentioned hardware device information, the above-mentioned hardware management information, the above-mentioned resource pool information, the above-mentioned port information and security policy, determining the mapping relationship between the above-mentioned resource information and the target device; and generating resource architecture information based on the above-mentioned mapping relationship, so that the user can perform corresponding processing on the above-mentioned resource information according to the configuration requirements.

[0011] According to an embodiment of the present disclosure, the method further includes: detecting the storage resource using a detection tool to obtain type information of the storage resource; and determining the configuration information and the usage information based on the type information.

[0012] According to an embodiment of the present disclosure, the method further includes: using a graphics generation tool to process the resource information and the processing results to generate chart information.

[0013] The second aspect of the present disclosure provides a resource information processing device, including: a resource information acquisition module, used to acquire resource information of storage resources, wherein the above resource information includes configuration information and usage information, the above configuration information includes hardware configuration information and logical configuration information, the above storage resources include multiple types of block type resources, and the above usage information includes path usage information; a path processing strategy determination module, used to determine a path processing strategy based on hardware configuration information, the above logical configuration information and the above path usage information, wherein the above path processing strategy includes at least one of a path update strategy, a fault processing strategy and a path load strategy; and a resource information processing module, used to process block resource information using the above path update strategy, the above fault processing strategy and the above path load strategy to obtain a path processing result.

[0014] A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the above method.

[0015] The fourth aspect of the present disclosure further provides a computer-readable storage medium having a computer program or instructions stored thereon, which implements the steps of the above method when the above computer program or instructions are executed by a processor.

[0016] The fifth aspect of the present disclosure further provides a computer program product, including a computer program or instructions, which implement the steps of the above method when the above computer program or instructions are executed by a processor.

[0017] According to the resource information processing method, apparatus, device, medium and program product provided by the present disclosure, by determining the path update strategy, fault handling strategy and path load strategy based on the hardware configuration information, logical configuration information and path usage information of the block type storage resource to process different types of block resource information, and then obtain the path processing result. Since the path processing result is an integrated result obtained by comprehensively using different strategies for block resource information of different architectures, unified management of storage resources of different architectures and types is achieved, the complexity of management is reduced, the complexity of troubleshooting of heterogeneous storage devices is reduced, and the overall operation and maintenance efficiency of storage resources is further improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The above contents and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0019] Figure 1 The application scenario diagram of the resource information processing method, apparatus, device, medium and program product according to the embodiment of the present disclosure is schematically shown;

[0020] Figure 2 A flowchart of a resource information processing method according to an embodiment of the present disclosure is schematically shown;

[0021] Figure 3 A flowchart of a method for implementing path failover, load balancing and monitoring functions in SAN storage using a dynamic multipath strategy according to an embodiment of the present disclosure is schematically shown;

[0022] Figure 4 A flowchart schematically shows another resource information processing method according to an embodiment of the present disclosure;

[0023] Figure 5 A system architecture diagram of a resource information processing method according to an embodiment of the present disclosure is schematically shown;

[0024] Figure 6 The structure block diagram of the resource information processing device according to the embodiment of the present disclosure is schematically shown;

[0025] Figure 7 A block diagram of an electronic device suitable for implementing a resource information processing method according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0026] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0027] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0028] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0029] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0030] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.

[0031] In the technical solution of the present disclosure, the user information (including but not limited to user personal information, user image information, user device information, such as location information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved are all information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data comply with relevant laws, regulations and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0032] In the scenario of using personal information for automated decision-making, the methods, devices, and systems provided by the embodiments of the present disclosure provide users with corresponding operation portals for users to choose to agree or reject the automated decision-making results; if the user chooses to reject, the expert decision-making process will be entered. The expression "automated decision-making" here refers to the activity of automatically analyzing and evaluating a person's behavioral habits, interests and hobbies, or economic, health, credit status, etc. through computer programs, and making decisions. The expression "expert decision-making" here refers to the activity of making decisions by people who specialize in a certain field, have specialized experience, knowledge and skills, and have reached a certain level of professionalism.

[0033] In the process of conceiving the present disclosure, the inventors discovered that in the related art, the operation and maintenance management of storage device resources lacks a unified management method for the comprehensive operation and maintenance of heterogeneous storage resources, and the performance differences of different storage resources lead to performance bottlenecks of the overall system; storage devices with different architectures require different management tools and strategies, and the operation and maintenance work is relatively cumbersome; fault diagnosis and troubleshooting in heterogeneous storage devices are more complicated, resulting in low overall operation and maintenance efficiency.

[0034] In view of this, the present invention can determine the path update strategy, fault handling strategy and path load strategy to process different types of block resource information based on the hardware configuration information, logical configuration information and path usage information of the block type storage resource, and then obtain the path processing result. Since the path processing result is an integrated result obtained by comprehensively using different strategies for block resource information of different architectures, unified management of storage resources of different architectures and types is achieved, the complexity of management is reduced, the complexity of troubleshooting of heterogeneous storage devices is reduced, and the overall operation and maintenance efficiency of storage resources is further improved.

[0035] Embodiments of the present disclosure provide a resource information processing method, apparatus, device, medium and program product, the method comprising: obtaining resource information of storage resources, wherein the resource information comprises configuration information and usage information, the configuration information comprises hardware configuration information and logical configuration information, the storage resources comprise block type resources, and the usage information comprises path usage information; determining a path processing strategy based on the hardware configuration information, the logical configuration information and the path usage information, wherein the path processing strategy comprises at least one of a path update strategy, a fault processing strategy and a path load strategy; and processing the block resource information using the path update strategy, the fault processing strategy and the path load strategy to obtain a path processing result.

[0036] Figure 1 The application scenario diagram of the resource information processing method, apparatus, device, medium and program product according to the embodiments of the present disclosure is schematically shown.

[0037] like Figure 1As shown, the application scenario 100 according to this embodiment may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104, and a server 105. The network 104 is used to provide a medium for a communication link between the first terminal device 101, the second terminal device 102, the third terminal device 103, and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0038] The user can use the first terminal device 101, the second terminal device 102, and the third terminal device 103 to interact with the server 105 through the network 104 to receive or send messages, etc. Various communication client applications can be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only for example).

[0039] The first terminal device 101, the second terminal device 102, and the third terminal device 103 may be various electronic devices having display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

[0040] The server 105 may be a server that provides various services, such as a background management server (only as an example) that provides support for websites browsed by users using the first terminal device 101, the second terminal device 102, and the third terminal device 103. The background management server may analyze and process the received data such as user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to user requests) to the terminal device.

[0041] It should be noted that the resource information processing method provided in the embodiment of the present disclosure can generally be executed by the server 105. Accordingly, the resource information processing device provided in the embodiment of the present disclosure can generally be set in the server 105. The resource information processing method provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105. Accordingly, the resource information processing device provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105.

[0042] It should be understood that Figure 1The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to the implementation requirements.

[0043] Figure 2 The flowchart of the resource information processing method according to the embodiment of the present disclosure is schematically shown.

[0044] like Figure 2 As shown, the resource information processing method of this embodiment includes operations S210 to S230.

[0045] In operation S210, resource information of storage resources is acquired, wherein the resource information includes configuration information and usage information, the configuration information includes hardware configuration information and logical configuration information, the storage resources include multiple types of block type resources, and the usage information includes path usage information.

[0046] According to an embodiment of the present disclosure, storage resources may include storage resources of different architectures, different manufacturers and different types, including but not limited to direct-attached storage (DAS), network attached storage (NAS), storage area network (SAN) and cloud storage. Hardware configuration information may include hardware device information, hardware management information and resource pool information, and logical configuration information may include path information, port information and security policies. Block type resources may include storage area network (SAN), and file type resources may include network attached storage (NAS). It is understandable that the resource information processing method in the present disclosure may be implemented by writing in a compiled language (e.g., python).

[0047] In operation S220, a path processing strategy is determined based on the hardware configuration information, the logic configuration information, and the path usage information, wherein the path processing strategy includes at least one of a path update strategy, a fault processing strategy, and a path load strategy.

[0048] According to the embodiments of the present disclosure, a path can represent a path for a server to access a storage device in a block type resource, and path usage information can represent information about used / occupied paths in multiple access paths, as well as information about remaining available paths. A fault handling strategy can represent the implementation of path switching in a multi-path strategy when a path fails; a path load strategy can represent a strategy for implementing a reasonable allocation of data flows / information flows to different paths using a load balancing strategy algorithm; and a path update strategy can represent a strategy for updating path initial information based on a path load strategy and a fault handling strategy.

[0049] In operation S230, the block resource information is processed using the path update strategy, the fault processing strategy, and the path load strategy to obtain a path processing result.

[0050] According to an embodiment of the present disclosure, the path processing result may be the result of monitoring, processing and updating the block resource information based on the path update strategy, the fault handling strategy and the path load strategy, and may include the path switching result, the path load result and the path update result. The block resource information may include the hardware configuration information, the logical configuration information and the path information of the block type resource.

[0051] According to the embodiments of the present disclosure, by determining the path update strategy, fault handling strategy and path load strategy based on the hardware configuration information, logical configuration information and path usage information of the block type storage resource, different types of block resource information can be processed to obtain the path processing result. Since the path processing result is an integrated result obtained by comprehensively using different strategies for block resource information of different architectures, unified management of storage resources of different architectures and types is achieved, the complexity of management is reduced, the complexity of troubleshooting of heterogeneous storage devices is reduced, and the overall operation and maintenance efficiency of storage resources is further improved.

[0052] According to an embodiment of the present disclosure, the hardware configuration information includes hardware device information, the logical configuration information includes path information, and both the hardware device information and the path information are multiple; the path processing strategy is determined based on the hardware configuration information, the logical configuration information and the path usage information of the block type resource, including: determining multiple initial path processing strategies corresponding to the multiple hardware device information and the multiple path information; and updating the multiple initial path processing strategies based on the preset update strategy and the path usage information to obtain the path processing strategy, so that the path processing strategy matches the multiple hardware device information.

[0053] According to the embodiments of the present disclosure, since the hardware device information and paths of block storage resources (such as SAN) of different manufacturers can be of multiple types, the initial path processing strategy can be the path processing strategy corresponding to each determined based on storage resources of different manufacturers / types, for example, path processing strategy a is adopted for SAN storage devices of manufacturer A, and path processing strategy b is adopted for SAN storage devices of manufacturer B. By combining the initial path processing strategies of different block storage resources, a path processing strategy can be obtained.

[0054] According to an embodiment of the present disclosure, for different types of storage resources, the step of updating the initial path processing strategy based on a preset update strategy may include: defining processing strategies for different paths, including load balancing and failover strategies; selecting supported protocols, such as iSCSI or Fibre Channel, to achieve compatibility between devices of different architectures; selecting a multipath tool that can support heterogeneous environments to ensure compatibility and configuration flexibility; thereby maintaining consistency in configuration and management of path strategies to ensure unified strategies between different devices; and ensuring the effectiveness and reliability of path processing strategies by conducting comprehensive tests on different devices before deployment.

[0055] According to the embodiments of the present disclosure, by updating the initial path processing strategy to obtain the path processing strategy, a consistent path processing strategy can be implemented in a heterogeneous storage resource environment, reducing the complexity of storage devices and path processing, and optimizing system performance and reliability.

[0056] According to an embodiment of the present disclosure, block resource information is processed using a path update strategy, a fault handling strategy, and a path load strategy to obtain a path processing result, including: determining multiple storage path information in the block resource information; and in the case where at least one storage path information among the multiple storage path information is detected as abnormal information, processing the storage path information based on the fault handling strategy, the path update strategy, and the path load strategy to obtain a path processing result.

[0057] According to an embodiment of the present disclosure, the abnormal information indicates that the current path is a faulty path or the path performance does not meet the preset performance requirements. By processing the abnormal path according to the fault handling strategy, path update strategy and path load strategy, the path switching result, path load result and path update result can be obtained.

[0058] In a feasible embodiment, considering that in a storage environment of heterogeneous storage resources, storage devices may come from different manufacturers, use different technologies or protocols, and the path usage environment is complex, leading to compatibility issues, system performance bottlenecks and stability issues. The present disclosure adopts a dynamic multipath strategy to manage and optimize data access paths in a heterogeneous SAN storage environment. The dynamic multipath strategy may include: real-time detection of all path information in the storage and configuration; dynamic selection of the best path based on real-time performance information and path health status information, and automatic switching of data flow / information flow to a backup path when a path failure or performance degradation is detected.

[0059] Figure 3 The flowchart of the method for implementing path failover, load balancing and monitoring functions in SAN storage by using a dynamic multipath strategy according to an embodiment of the present disclosure is schematically shown.

[0060] like Figure 3 As shown, the method of implementing path failover, load balancing and monitoring functions in SAN storage using a dynamic multi-path strategy may include operations S310 to S330.

[0061] In operation S310, path failover is performed by configuring the path information of the storage device in the multipath software and setting a failover strategy; simulating a path failure and verifying whether the software can automatically switch to a backup path to ensure that data transmission is not interrupted.

[0062] In operation S320, a load balancing strategy is set. A load balancing algorithm, such as round-robin or least number of connections, can be selected in the multipath software to distribute data traffic to each path; a monitoring tool is used to monitor the load balancing effect and the strategy can be adjusted as needed.

[0063] In operation S330, monitoring function. By configuring the monitoring function of the multipath software, the health and performance of the path can be tracked in real time; the alarms and reports generated by the software can be checked regularly to deal with potential hidden dangers in a timely manner; ensure that the multipath software is compatible with the storage device, and regularly update and maintain the software to meet new challenges.

[0064] According to an embodiment of the present disclosure, usage information also includes resource usage information, storage resources also include file type resources, and the method also includes: processing hardware configuration information, logical configuration information and resource usage information within a historical time period to obtain resource usage results; using preset prediction rules and resource usage results to predict resource usage information within a future time period to obtain prediction results; determining a resource allocation strategy based on the prediction results; and using the resource allocation strategy to process resource information to obtain resource allocation results.

[0065] According to an embodiment of the present disclosure, resource usage information may include block type resource usage information and file type resource usage information. The historical time period may be selected according to the actual scenario requirements. For example, the peak time period with the largest storage resource usage and demand in the historical time period may be selected, or the valley time period with the smallest storage resource usage and demand may be selected. The specific time period is not limited here. File type resource usage information may include node usage information such as disk, hard disk domain, storage pool, tenant, file system, controller, physical port group, port group, logical port group, etc.; block type resource usage information may include node usage information such as disk, logical unit (LUN), initiator device (IDEV), storage pool, host (Host), host group (HostGroup), etc. The preset prediction rule may be a prediction algorithm, a prediction model, or an experience-based prediction.

[0066] In a feasible embodiment, a random forest algorithm can be used to predict resource usage prediction results for future time periods, including: collecting and organizing storage resource usage data in historical time periods, including timestamps and related features; extracting features from historical information, such as time features (hours, days, weeks, etc.) and load patterns; dividing the data set into a training set and a test set, using the training set data to train a random forest model, adjusting hyperparameters (such as the number of trees, maximum depth) to optimize performance, and using the test set data to evaluate the prediction accuracy of the model and calculate error indicators; using the trained model to predict resource usage in future time periods to obtain prediction results.

[0067] In a feasible embodiment, determining a resource allocation strategy based on prediction results may include: analyzing the prediction results to evaluate the peak and valley values ​​of storage resource demand in future time periods; formulating a resource allocation strategy based on the predicted demand, for example, setting resource reservations during high demand periods and resource releases during low demand periods; setting priorities for different types of storage tasks based on actual business needs to ensure that critical tasks are given priority when resources are tight; implementing an automated adjustment mechanism to dynamically adjust resource allocation based on actual conditions and prediction results; monitoring resource usage and strategy effectiveness, and optimizing allocation strategies based on actual data feedback.

[0068] According to the embodiments of the present disclosure, using prediction results to formulate storage resource allocation strategies for future time periods can more accurately predict resource requirements, ensure that storage resources are efficiently utilized, and avoid waste or shortage of resources; allocating resources in advance can reduce performance bottlenecks caused by resource shortages, thereby improving system stability and response speed; at the same time, optimizing resource allocation can ensure that important businesses and high-priority tasks obtain sufficient resources, thereby improving service quality and user experience.

[0069] According to an embodiment of the present disclosure, resource usage information in a future time period is predicted using preset prediction rules and resource usage results to obtain prediction results, including: extracting feature sequence information and load peak values ​​from the resource usage results; and inputting the feature sequence information and load peak values ​​into a time series model to output prediction results.

[0070] According to an embodiment of the present disclosure, feature sequence information can characterize trends, seasonal patterns, periodicity, outliers, and statistical properties (such as mean and variance) of data in historical resource usage information. Load peaks can characterize that resource usage reaches a maximum value at a certain time point / time period.

[0071] In a feasible embodiment, a method for predicting storage resource usage information in a future time period using a time series model may include: obtaining historical usage data of storage resources, including timestamps and usage, where the historical usage data source may include monitoring tools, log files, or databases; visualizing the data through charts (such as time series charts) to observe resource usage trends, seasonality, and periodicity; calculating basic statistics of the data (such as mean, standard deviation) and correlation analysis; using an ADF test or a KPSS test to check the stationarity of the time series, and if the data is not stationary, it is necessary to perform a difference or transformation to make it stationary; selecting a suitable time series model according to the characteristics of the data, such as ARIMA (AutoRegressiveIntegrated Moving Average); splitting historical data (sample data) into a training set and a test set in chronological order, fitting an ARIMA model on the training set, and evaluating the performance of the model on the test set, using indicators such as mean square error (MSE), root mean square error (RMSE), and mean absolute error (MAE); adjusting hyperparameters (p, d, q parameters) according to the performance of the ARIMA model; and using rolling forecasts (such as rolling averages) to predict the stationarity of the time series. The model is further optimized by performing forecast or time series cross-validation. Finally, the validated model is used to generate forecast results for future time periods. Confidence intervals or prediction intervals are provided to estimate the uncertainty of the forecast results.

[0072] According to an embodiment of the present disclosure, the hardware configuration information also includes hardware management information and resource pool information, and the logical configuration information also includes port information and security policy; the method also includes: determining the mapping relationship between resource information and target device based on hardware device information, hardware management information, resource pool information, port information and security policy; and generating resource architecture information based on the mapping relationship, so that the user can process the resource information accordingly according to the configuration requirements.

[0073] According to an embodiment of the present disclosure, the mapping relationship may represent a mapping relationship between storage resource information and a target device (server), including but not limited to mounting information, data storage location information, and access permission information.

[0074] In a feasible embodiment, constructing a mapping relationship between resource information and target devices may include: establishing a mapping table that can record the relationship between each host and its connected storage device, or record which hosts use each storage device; using a monitoring tool to obtain resource usage and mapping relationships in real time; further, regularly checking and updating the mapping relationship by writing an automated script to maintain data accuracy and timeliness.

[0075] According to the embodiments of the present disclosure, by determining the mapping relationship between resource information and target devices, resource usage and allocation bottlenecks can be identified and resource allocation can be adjusted, thereby improving overall system performance, ensuring load balancing, and reducing overload of a single resource. At the same time, precise mapping helps to utilize resources more efficiently, reduce resource idleness and waste, and help quickly locate resource problems, thereby improving system stability and reliability.

[0076] According to an embodiment of the present disclosure, the method further includes: detecting the storage resource using a detection tool to obtain type information of the storage resource; and determining configuration information and usage information based on the type information.

[0077] According to the embodiments of the present disclosure, in the process of using Python to implement the resource information processing method of the present disclosure, multiple tool libraries can be used, including the pexpect library. The pexpect library can realize automatic interaction of various programs (such as ssh, ftp, passwd and telnet), realize device login, and determine whether the device can be logged in, check the device manufacturer and model, and determine whether it is a storage device; then, according to the storage devices of different manufacturers, storage configuration information of different architectures is collected, which may include storage hardware resources, hard disk domains, storage pools, file systems, logical port groups, data protection, mapping relationships, host groups, multi-path links, etc.

[0078] In a feasible embodiment, in addition to the pexpect library, the tool library may also include a time library, a system (OS) library, a diagrams library, a PyQt library, a NumPy and a SciPy library. Among them, the Time library can run access to various types of clocks to achieve the effect of recording the current time; the OS library can read and write files and directories to achieve file generation and reading and writing; the diagrams library can draw the cloud system architecture through simple Python code to achieve prototyping of the new system architecture; the PyQt library can be used to create graphical user interface (GUI) applications and create a heterogeneous storage device operation and maintenance platform; the NumPy and SciPy libraries can be used for numerical calculations, scientific and technical calculations, including scientific computing, linear algebra, signal processing and optimization problems.

[0079] According to an embodiment of the present disclosure, the method further includes: using a graphic generation tool to process the resource information and the processing results to generate chart information.

[0080] According to an embodiment of the present disclosure, the image generation tool can be a tool for generating resource information in a tool library, including a Matplotlib library and a Networkx library. The Matplotlib library can be used to create an underlying library for two-dimensional graphs and graphics, and to construct icons for different network models; the Networkx library can be used to create and process complex graph network structures and generate network topology diagrams.

[0081] Figure 4 The flowchart schematically shows another resource information processing method according to an embodiment of the present disclosure.

[0082] like Figure 4 As shown, the resource information processing method may include operations S410 to S490.

[0083] In operation S410, a storage management address is acquired.

[0084] In operation S420, device login can be implemented through Pexpect to determine whether the device can be logged in.

[0085] In operation S421, if the device can be logged in, the device is logged in.

[0086] In operation S422, the device type is determined by checking the device manufacturer and model to determine whether it is a storage device.

[0087] In operation S423, when it is not possible to log into the device, a prompt indicating a connection abnormality is given.

[0088] In operation S430, when the login device is a storage device, storage configuration information of different architectures can be collected according to different types of storage devices, including storage hardware resources, hard disk domains, storage pools, file systems, logical port groups, data protection, mapping relationships, host groups, multipath links, etc.

[0089] In operation S440, based on the collected storage configuration information, the storage resource usage may be analyzed, and the disk, network, and processor usage of each business system may be analyzed.

[0090] In operation S450, a future resource usage trend may be predicted based on the resource usage situation.

[0091] In operation S460, node information of different types of resources is obtained. For file type storage resources, node information such as disk, disk domain, storage pool, tenant, file system, controller, physical port group, port group, logical port group, etc. is collected; for block type storage resources, node information such as disk, logical unit, initiator, storage pool, host and host group is collected.

[0092] In operation S470, the mapping relationship between the storage resource and the target device (host) can be confirmed based on the acquired node information. The diagrams library can be used to construct a storage network architecture diagram to implement information query, configuration, monitoring, and access functions for each node.

[0093] In operation S480, a Matplotlib library may be used to construct a storage resource data visualization chart to analyze the resource status of each storage node.

[0094] In operation S490, a storage capacity and performance planning analysis report is generated according to the architecture diagram and the data analysis chart.

[0095] According to the embodiments of the present disclosure, using a graphics generation tool to process resource information and generate charts can greatly improve the visualization effect of data, making complex data easier to understand and analyze. It not only helps with real-time monitoring and performance optimization, but also plays an important role in fault diagnosis and troubleshooting, can quickly locate the fault location, and improve overall operation and maintenance efficiency.

[0096] Figure 5 The system architecture diagram of the resource information processing method according to the embodiment of the present disclosure is schematically shown.

[0097] like Figure 5As shown, resource information 510 of storage resources can be obtained, and the resource information package can include configuration information 511 and usage information 512, the configuration information includes hardware configuration information 5111 and logical configuration information 5112, the storage resources include block type resources, and the usage information 512 may include path usage information 5121; thereby, a path processing strategy 520 is determined based on the hardware configuration information 5111, the logical configuration information 5112 and the path usage information 5121, and the path processing strategy 520 includes at least one of a path update strategy 521, a fault processing strategy 522 and a path load strategy 523; and the block resource information is processed using the path update strategy 521, the fault processing strategy 522 and the path load strategy 523 to obtain a path processing result 530.

[0098] Based on the above resource information processing method, the present disclosure also provides a resource information processing device. Figure 6 The device is described in detail.

[0099] Figure 6 The structure block diagram of the resource information processing device according to the embodiment of the present disclosure is schematically shown.

[0100] like Figure 6 As shown, the resource information processing device of this embodiment includes a resource information acquisition module 610 , a path processing strategy determination module 620 and a resource information processing module 630 .

[0101] The resource information acquisition module 610 is used to acquire resource information of storage resources, wherein the resource information includes configuration information and usage information, the configuration information includes hardware configuration information and logical configuration information, the storage resources include multiple types of block type resources, and the usage information includes path usage information. In one embodiment, the resource information acquisition module 610 can be used to perform the operation S210 described above, which will not be repeated here.

[0102] The path processing strategy determination module 620 is used to determine the path processing strategy based on the hardware configuration information, the logical configuration information and the path usage information, wherein the path processing strategy includes at least one of a path update strategy, a fault handling strategy and a path load strategy. In one embodiment, the path processing strategy determination module 620 can be used to perform the operation S220 described above, which will not be repeated here.

[0103] The resource information processing module 630 is used to process the block resource information using the path update strategy, the fault processing strategy and the path load strategy to obtain the path processing result. In one embodiment, the resource information processing module 630 can be used to perform the operation S230 described above, which will not be described in detail here.

[0104] According to the embodiments of the present disclosure, through the resource information acquisition module 610, the path processing strategy determination module 620 and the resource information processing module 630 in the resource information processing device, by using the hardware configuration information, logical configuration information and path usage information of the block type storage resource, the path update strategy, the fault handling strategy and the path load strategy can be determined to process different types of block resource information, and then the path processing result is obtained. Since the path processing result is an integrated result obtained by comprehensively using different strategies for block resource information of different architectures, unified management of storage resources of different architectures and types is achieved, the complexity of management is reduced, the complexity of troubleshooting of heterogeneous storage devices is reduced, and the overall operation and maintenance efficiency of storage resources is further improved.

[0105] According to an embodiment of the present disclosure, the hardware configuration information includes hardware device information, the logical configuration information includes path information, and both the hardware device information and the path information are multiple; the path processing strategy determination module includes: an initial strategy determination submodule and a strategy update module.

[0106] The initial strategy determination submodule is used to determine multiple initial path processing strategies corresponding to multiple hardware device information and multiple path information.

[0107] The strategy updating module is used to update a plurality of initial path processing strategies based on a preset updating strategy and path usage information to obtain a path processing strategy so that the path processing strategy matches a plurality of hardware device information.

[0108] According to an embodiment of the present disclosure, the resource information processing module includes: a path information determination submodule and a path information processing submodule.

[0109] The path information determination submodule is used to determine multiple storage path information in the block resource information.

[0110] The path information processing submodule is used to process the storage path information based on the fault processing strategy, the path update strategy and the path load strategy to obtain the path processing result when it is detected that at least one storage path information among the multiple storage path information is abnormal information.

[0111] According to an embodiment of the present disclosure, the usage information also includes resource usage information, the storage resources also include file type resources, and the device also includes: a first information processing module, an information prediction module, an allocation strategy determination module and a second information processing module.

[0112] The first information processing module is used to process the hardware configuration information, logic configuration information and resource usage information within a historical time period to obtain resource usage results.

[0113] The information prediction module is used to predict the resource usage information in the future time period by using the preset prediction rules and the resource usage results to obtain the prediction results.

[0114] The allocation strategy determination module is used to determine the resource allocation strategy based on the prediction results.

[0115] The second information processing module is used to process the resource information using the resource allocation strategy to obtain the resource allocation result.

[0116] According to an embodiment of the present disclosure, the information prediction module includes: an extraction submodule and a prediction result output submodule.

[0117] The extraction submodule is used to extract characteristic sequence information and load peak from the resource usage results.

[0118] The prediction result output submodule is used to input feature sequence information and load peak value into the time series model and output the prediction result.

[0119] According to an embodiment of the present disclosure, the hardware configuration information also includes hardware management information and resource pool information, and the logical configuration information also includes port information and security policies; the device also includes: a mapping relationship determination module and an architecture information generation module.

[0120] The mapping relationship determination module is used to determine the mapping relationship between resource information and target devices based on hardware device information, hardware management information, resource pool information, port information and security policy.

[0121] The architecture information generation module is used to generate resource architecture information based on the mapping relationship, so that the user can process the resource information accordingly according to the configuration requirements.

[0122] According to an embodiment of the present disclosure, the device further includes: a resource detection module and a configuration information determination module.

[0123] The resource detection module is used to detect storage resources using detection tools to obtain type information of storage resources.

[0124] The configuration information determination module is used to determine the configuration information and the usage information based on the type information.

[0125] According to an embodiment of the present disclosure, the device further includes: a chart information generation module, which is used to process the resource information and the processing results using a graphic generation tool to generate chart information.

[0126] According to an embodiment of the present disclosure, any multiple modules among the resource information acquisition module 610, the path processing strategy determination module 620 and the resource information processing module 630 can be combined into one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the resource information acquisition module 610, the path processing strategy determination module 620 and the resource information processing module 630 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware and firmware or in a suitable combination of any of them. Alternatively, at least one of the resource information acquisition module 610, the path processing strategy determination module 620 and the resource information processing module 630 may be at least partially implemented as a computer program module, and when the computer program module is executed, the corresponding function may be executed.

[0127] Figure 7 A block diagram of an electronic device suitable for implementing a resource information processing method according to an embodiment of the present disclosure is schematically shown.

[0128] like Figure 7 As shown, the electronic device 700 according to an embodiment of the present disclosure includes a processor 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage part 708 to a random access memory (RAM) 703. The processor 701 may include, for example, a general-purpose microprocessor (such as a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (for example, an application-specific integrated circuit (ASIC)), etc. The processor 701 may also include an onboard memory for caching purposes. The processor 701 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0129] In RAM 703, various programs and data required for the operation of electronic device 700 are stored. Processor 701, ROM 702 and RAM 703 are connected to each other via bus 704. Processor 701 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 702 and / or RAM 703. It should be noted that the program can also be stored in one or more memories other than ROM 702 and RAM 703. Processor 701 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.

[0130] According to an embodiment of the present disclosure, the electronic device 700 may further include an input / output (I / O) interface 705, which is also connected to the bus 704. The electronic device 700 may further include one or more of the following components connected to the input / output (I / O) interface 705: an input portion 706 including a keyboard, a mouse, etc.; an output portion 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 708 including a hard disk, etc.; and a communication portion 709 including a network interface card such as a LAN card, a modem, etc. The communication portion 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the input / output (I / O) interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed, so that a computer program read therefrom is installed into the storage portion 708 as needed.

[0131] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0132] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, it may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus or a device. For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 702 and / or RAM 703 described above and / or one or more memories other than ROM 702 and RAM 703.

[0133] The embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the resource information processing method provided by the embodiment of the present disclosure.

[0134] The above functions defined in the system / device of the embodiment of the present disclosure are performed when the computer program is executed by the processor 701. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0135] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 709, and / or installed from the removable medium 711. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0136] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 709, and / or installed from the removable medium 711. When the computer program is executed by the processor 701, the above functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the system, device, means, module, unit, etc. described above can be implemented by a computer program module.

[0137] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0138] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0139] It will be appreciated by those skilled in the art that the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations or combinations are not explicitly described in the present disclosure. In particular, without departing from the spirit and teachings of the present disclosure, the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0140] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A resource information processing method, characterized in that: The method comprises: Acquire resource information of storage resources, wherein the resource information includes configuration information and usage information, the configuration information includes hardware configuration information and logical configuration information, the storage resources include multiple types of block type resources, and the usage information includes path usage information; Determining a path processing strategy based on the hardware configuration information, the logical configuration information, and the path usage information, wherein the path processing strategy includes at least one of a path update strategy, a fault processing strategy, and a path load strategy; and The block resource information is processed using the path update strategy, the fault processing strategy and the path load strategy to obtain a path processing result.

2. The method according to claim 1, characterized in that: The hardware configuration information includes hardware device information, the logical configuration information includes path information, and both the hardware device information and the path information are multiple; Determining a path processing strategy based on the hardware configuration information of the block type resource, the logical configuration information, and the path usage information includes: Determine a plurality of initial path processing strategies corresponding to the plurality of hardware device information and the plurality of path information; as well as The plurality of initial path processing strategies are updated based on a preset update strategy and the path usage information to obtain the path processing strategy, so that the path processing strategy matches the plurality of hardware device information.

3. The method according to claim 2, characterized in that The block resource information is processed using the path update strategy, the fault processing strategy, and the path load strategy to obtain a path processing result, including: determining a plurality of storage path information in the block resource information; and When it is detected that at least one storage path information among the plurality of storage path information is abnormal information, the storage path information is processed based on the fault processing strategy, the path update strategy and the path load strategy to obtain the path processing result.

4. The method according to claim 2, characterized in that: The usage information further includes resource usage information, the storage resources further include file type resources, and the method further includes: Processing the hardware configuration information, the logic configuration information, and the resource usage information within a historical time period to obtain a resource usage result; Predicting resource usage information in a future time period using a preset prediction rule and the resource usage result to obtain a prediction result; Determining a resource allocation strategy based on the prediction result; and The resource information is processed using the resource allocation strategy to obtain a resource allocation result.

5. The method according to claim 4, characterized in that The resource usage information in the future time period is predicted using the preset prediction rules and the resource usage results to obtain the prediction results, including: Extracting characteristic sequence information and load peak value from the resource usage result; and The characteristic sequence information and the load peak are input into a time series model, and the prediction result is output.

6. The method according to claim 4, characterized in that The hardware configuration information also includes hardware management information and resource pool information, and the logical configuration information also includes port information and security policy; The method further comprises: Determining a mapping relationship between the resource information and a target device based on the hardware device information, the hardware management information, the resource pool information, the port information, and the security policy; and Resource architecture information is generated based on the mapping relationship, so that the user can process the resource information accordingly according to configuration requirements.

7. The method according to claim 1, characterized in that The method further comprises: Using a detection tool to detect the storage resource to obtain type information of the storage resource; and The configuration information and the usage information are determined based on the type information.

8. The method according to claim 1, characterized in that The method further comprises: The resource information and the processing result are processed using a graphic generation tool to generate chart information.

9. A resource information processing device, characterized in that: The device comprises: A resource information acquisition module, used to acquire resource information of storage resources, wherein the resource information includes configuration information and usage information, the configuration information includes hardware configuration information and logical configuration information, the storage resources include multiple types of block type resources, and the usage information includes path usage information; a path processing strategy determination module, configured to determine a path processing strategy based on the hardware configuration information, the logic configuration information, and the path usage information, wherein the path processing strategy includes at least one of a path update strategy, a fault handling strategy, and a path load strategy; and The resource information processing module is used to process the block resource information using the path update strategy, the fault processing strategy and the path load strategy to obtain a path processing result.

10. An electronic device comprising: one or more processors; a memory for storing one or more computer programs, It is characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 1 to 8.

11. A computer-readable storage medium having a computer program or instruction stored thereon, characterized in that: When the computer program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

12. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

Images