Data processing method and device based on distributed storage environment, computer device, readable storage medium and program product

Abstract

The application relates to a data processing method and device based on a distributed storage environment, computer equipment, a computer readable storage medium and a computer program product, relates to the technical field of distributed storage, and can improve the maintenance efficiency of the distributed storage environment. The method comprises the following steps: obtaining an environment object list containing a plurality of environment objects according to a plurality of environment configuration information input into a distributed storage environment management platform; displaying a multi-environment management page, and in response to an environment maintenance operation triggered by a user on the multi-environment management page, determining a first environment object from the environment object list and obtaining environment maintenance data used for updating a first target environment corresponding to the first environment object; determining a distributed storage device corresponding to the first target environment, and performing environment updating on the first target environment in the distributed storage device according to the environment maintenance data, and performing corresponding updating on the environment object list according to the updating result.

Description

Technical Field

[0001] This application relates to the field of distributed storage technology, and in particular to a data processing method, apparatus, computer equipment, computer-readable storage medium, and computer program product based on a distributed storage environment. Background Technology

[0002] Distributed storage, as a data storage technology, integrates disk space from multiple computers or servers into a virtual storage device via a network. Data is distributed across various nodes to improve data reliability, scalability, and performance. For more efficient automated testing, distributed storage can be used across multiple environments; for example, various testing and production environments can be stored on multiple distributed nodes.

[0003] However, with the increasing number of distributed storage environments, the daily maintenance and upgrade work is very cumbersome and labor-intensive when maintaining multiple distributed storage environments. It often requires a lot of manpower and resources, resulting in low efficiency in the maintenance of distributed storage environments. Summary of the Invention

[0004] Therefore, it is necessary to provide a data processing method, apparatus, computer equipment, computer-readable storage medium, and computer program product based on a distributed storage environment to address the aforementioned technical problems.

[0005] Firstly, this application provides a data processing method based on a distributed storage environment, including:

[0006] Based on the multiple environment configuration information entered into the distributed storage environment management platform, a list of environment objects containing multiple environment objects is obtained;

[0007] Display a multi-environment management page and respond to an environment maintenance operation triggered by a user on the multi-environment management page, determine a first environment object from the list of environment objects and obtain environment maintenance data for updating the first target environment corresponding to the first environment object;

[0008] The distributed storage device corresponding to the first target environment is determined, and the first target environment in the distributed storage device is updated according to the environment maintenance data. The environment object list is updated accordingly based on the update result.

[0009] In one embodiment, determining a first environment object from the list of environment objects in response to an environment maintenance operation triggered by a user on the multi-environment management page includes:

[0010] In response to the user's selection of an environment object from the list of environment objects displayed on the multi-environment management page, the first environment object selected by the user is determined from the list of environment objects;

[0011] or,

[0012] In response to the user's input of environment filtering parameters on the multi-environment management page, an environment object whose environment configuration information matches the environment filtering parameters is determined from the list of environment objects and designated as the first environment object.

[0013] In one embodiment, after displaying the multi-environment management page, the method further includes:

[0014] In response to an environment monitoring operation triggered by the user on the multi-environment management page, a second environment object is determined from the list of environment objects;

[0015] Determine the second target environment corresponding to the second environment object, and obtain the resource usage of environmental resources in the second target environment and the performance information of the second target environment;

[0016] Based on the resource usage and performance information, the environmental monitoring results corresponding to the second target environment are displayed on the multi-environment management page.

[0017] In one embodiment, after displaying the multi-environment management page, the method further includes:

[0018] In response to a code test operation triggered by a user on the multi-environment management page, a third environment object is determined from the list of environment objects and test configuration information is obtained. Based on the test configuration information, the test object to be tested in the third target environment corresponding to the third environment object is determined.

[0019] The code corresponding to the test object is obtained from the code repository, the code is built to obtain the executable application data package corresponding to the test object, test cases are determined according to the test configuration information, the executable application data package is tested according to the test cases, and test results are obtained.

[0020] If the test result indicates that the test has passed, the executable application data package is saved to the application storage module; the application storage module is used to store each executable application data package that has passed the test.

[0021] In one embodiment, obtaining environment maintenance data for updating the first target environment corresponding to the first environment object includes:

[0022] Obtain the target executable application data package for updating the first target environment corresponding to the first environment object from the application storage module;

[0023] Environment maintenance data is obtained from the executable application data package.

[0024] In one embodiment, the step of testing the executable application data package according to the test cases to obtain test results includes:

[0025] The executable application data package is tested according to the test cases to determine the total number of test cases executed, the number of test cases executed successfully, and the number of test cases executed unsuccessfully.

[0026] The test results are displayed; the test results include the total number of executed test cases, the number of successfully executed test cases, and the number of failed test cases when the test object is tested in the third target environment.

[0027] Secondly, this application also provides a data processing device based on a distributed storage environment, applied to a distributed storage environment management platform, the device comprising:

[0028] The list generation module is used to generate a list of environment objects containing multiple environment objects based on multiple environment configuration information entered into the distributed storage environment management platform.

[0029] The maintenance data acquisition module is used to display a multi-environment management page and respond to the environment maintenance operation triggered by the user on the multi-environment management page, determine a first environment object from the list of environment objects and acquire environment maintenance data for updating the first target environment corresponding to the first environment object;

[0030] The environment update module is used to determine the distributed storage device corresponding to the first target environment, update the first target environment in the distributed storage device according to the environment maintenance data, and update the environment object list accordingly based on the update result.

[0031] Thirdly, this application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0032] Based on the multiple environment configuration information entered into the distributed storage environment management platform, a list of environment objects containing multiple environment objects is obtained;

[0033] Display a multi-environment management page and respond to an environment maintenance operation triggered by a user on the multi-environment management page, determine a first environment object from the list of environment objects and obtain environment maintenance data for updating the first target environment corresponding to the first environment object;

[0034] The distributed storage device corresponding to the first target environment is determined, and the first target environment in the distributed storage device is updated according to the environment maintenance data. The environment object list is updated accordingly based on the update result.

[0035] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, performs the following steps:

[0036] Based on the multiple environment configuration information entered into the distributed storage environment management platform, a list of environment objects containing multiple environment objects is obtained;

[0037] Display a multi-environment management page and respond to an environment maintenance operation triggered by a user on the multi-environment management page, determine a first environment object from the list of environment objects and obtain environment maintenance data for updating the first target environment corresponding to the first environment object;

[0038] The distributed storage device corresponding to the first target environment is determined, and the first target environment in the distributed storage device is updated according to the environment maintenance data. The environment object list is updated accordingly based on the update result.

[0039] Fifthly, this application also provides a computer program product, including a computer program that, when executed by a processor, performs the following steps:

[0040] Based on the multiple environment configuration information entered into the distributed storage environment management platform, a list of environment objects containing multiple environment objects is obtained;

[0041] Display a multi-environment management page and respond to an environment maintenance operation triggered by a user on the multi-environment management page, determine a first environment object from the list of environment objects and obtain environment maintenance data for updating the first target environment corresponding to the first environment object;

[0042] The distributed storage device corresponding to the first target environment is determined, and the first target environment in the distributed storage device is updated according to the environment maintenance data. The environment object list is updated accordingly based on the update result.

[0043] The aforementioned data processing method, apparatus, computer equipment, computer-readable storage medium, and computer program product based on a distributed storage environment: The distributed storage environment management platform obtains an environment object list containing multiple environment objects based on multiple environment configuration information entered into the platform. Then, a multi-environment management page can be displayed, and in response to an environment maintenance operation triggered by a user on the page, a first environment object is determined from the environment object list, and environment maintenance data for updating the first target environment corresponding to that first environment object is obtained. Subsequently, the distributed storage device corresponding to the first target environment can be determined, and based on the environment maintenance data, the first target environment in the distributed storage device is updated, and the environment object list is updated accordingly based on the update results. In this embodiment, the multi-environment management page provides visualized and automated environment management. The first target environment to be updated can be selected and automatically updated, effectively shortening the environment maintenance change deployment cycle. Furthermore, after the environment update is completed, relevant information can be promptly updated in the environment object list, helping to provide users with timely information on each environment and effectively improving the maintenance efficiency of the distributed storage environment. Attached Figure Description

[0044] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0045] Figure 1 This is a flowchart illustrating a data processing method based on a distributed storage environment in one embodiment;

[0046] Figure 2 This is a schematic diagram of the structure of a distributed storage environment management platform in one embodiment;

[0047] Figure 3 This is a schematic diagram of a process for upgrading a distributed storage environment in one embodiment;

[0048] Figure 4 This is a schematic diagram of a process for monitoring a distributed storage environment in one embodiment;

[0049] Figure 5 This is a schematic diagram illustrating a process for obtaining data packets through a distributed storage environment management platform in one embodiment;

[0050] Figure 6 This is a schematic diagram of a testing process using a distributed storage environment management platform in one embodiment;

[0051] Figure 7 This is a structural block diagram of a data processing device based on a distributed storage environment in one embodiment;

[0052] Figure 8 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0053] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0054] Distributed storage, as a data storage technology, integrates disk space from multiple computers or servers into a virtual storage device via a network. Data is distributed across various nodes to improve data reliability, scalability, and performance. For more efficient automated testing, distributed storage can be used across multiple environments; for example, various testing and production environments can be stored on multiple distributed nodes.

[0055] However, with the increasing number of distributed storage environments, maintaining numerous distributed storage environments manually presents several inconveniences. For example, routine maintenance and upgrades are cumbersome, labor-intensive, slow, and have long maintenance cycles in the case of many environments. In case of emergencies, environmental information may not be updated in a timely manner. This not only consumes significant manpower, resources, and time, but also increases the risk of errors due to the cumbersome procedures. Furthermore, it is difficult to update environmental information promptly when changes occur. Therefore, the relevant technologies suffer from low efficiency in maintaining distributed storage environments.

[0056] Therefore, it is necessary to provide a data processing method, apparatus, computer equipment, computer-readable storage medium, and computer program product based on a distributed storage environment to address the aforementioned technical problems.

[0057] In one embodiment, such as Figure 1 As shown, a data processing method based on a distributed storage environment is provided. This embodiment illustrates the application of this method to a distributed storage environment management platform. The distributed storage environment management platform can be a system composed of terminals and servers, and the method is implemented through the interaction between the terminals and servers. In some exemplary embodiments, the framework of the distributed storage environment management platform can be as follows: Figure 2 As shown, a distributed storage environment management platform may include a continuous integration (CI) module, an environment maintenance module, an environment monitoring module, and an automated testing module.

[0058] The Continuous Integration (CI) module enables frequent code integration into a shared repository, automating builds and tests. This module includes a configuration management module, a build module related to code integration, a smoke testing module, and a package management module. Through the CI module, built packages undergo automated smoke testing, and after passing these automated tests, the packages are pushed to the distribution path for package management.

[0059] The environment maintenance module allows users to input environment information into the platform via the configuration maintenance module, and then query the environment object list module to select the required environment based on hardware and software parameters. When an upgrade is needed, the target distributed storage environment and its upgrade package are selected through the component upgrade module, and then the upgrade is performed. When users need to use an environment, they can apply for one and obtain approval; once approved, they gain access to the environment. Furthermore, the environment maintenance module also allows users to query the current user of each distributed storage environment.

[0060] The environment monitoring module can include a resource monitoring module, a performance monitoring module, and an alarm reporting module. The resource monitoring module allows users to view the CPU, memory, and other resource utilization of the selected distributed storage environment. The performance monitoring module can obtain performance data for the selected distributed storage environment. The alarm reporting module can configure alarm reporting conditions for the distributed storage environment; when these conditions are met, it can report any anomalies present in the distributed storage environment.

[0061] The automated testing module can include test configuration, automated code maintenance, result push, and result display modules. When a user wants to run automated tests, they can first configure the tests, selecting the environment to be tested and the corresponding test suite. Automated code maintenance can determine the corresponding code branch based on the configuration information entered by the user and then pull the latest automated code. After the test is completed, the automated test results are pushed to the configured path, and the results can also be viewed and graphically displayed on the platform.

[0062] In this embodiment, as Figure 1 As shown, the method includes the following steps:

[0063] S101: Based on the multiple environment configuration information entered into the distributed storage environment management platform, obtain a list of environment objects containing multiple environments.

[0064] In practical applications, for environments that are stored on multiple different nodes through distributed storage (also known as distributed storage environments), the environment configuration information corresponding to each of the multiple environments can be obtained and entered into the distributed storage environment management platform. After obtaining the multiple environment configuration information, the distributed storage environment management platform can generate a corresponding list of environment objects. This list of environment objects can include multiple environment objects. The environment object can be understood as a visual page element in the distributed storage environment management platform, and one environment object corresponds to one environment.

[0065] In some embodiments, with Figure 2 Taking the distributed storage environment management platform shown as an example, the configuration maintenance module allows users to input the environment configuration information of multiple distributed storage environments into the platform. Users can then modify this configuration information through this module, enabling flexible and unified adjustments to the environment configuration information of multiple distributed storage environments. Furthermore, the environment object list module displays a list of environment objects containing multiple environment objects, allowing users to view basic environment information (such as environment configuration information). In some examples, the displayed basic environment information may include the environment's hardware and software information, basic configuration, etc. Alternatively, users can filter the environment to view based on hardware and software parameters.

[0066] S102, display the multi-environment management page, and respond to the environment maintenance operation triggered by the user on the multi-environment management page, determine the first target environment from the list of environment objects and obtain the environment maintenance data for updating the first target environment.

[0067] In practice, the distributed storage environment management platform can display a multi-environment management page. This multi-environment management page allows for the simultaneous processing of multiple distributed storage environments. In other words, the multi-environment management page can integrate relevant information from multiple distributed storage environments and allow users to select a specific environment from among them for relevant data processing.

[0068] In this step, after displaying the multi-environment management page, the user can trigger an environment maintenance operation on the page to maintain a specified distributed storage environment. In response to the user-triggered environment maintenance operation, the environment object related to the operation can be determined from the list of environment objects. To distinguish it from other environment objects, this environment object is referred to as the first environment object. In some embodiments, the first environment object can be one or more; that is, in this embodiment, a single distributed storage environment can be updated, or multiple distributed storage environments can be updated in batches.

[0069] Furthermore, users can trigger environment maintenance operations and output environment maintenance data. This data may include information indicating the maintenance methods for the distributed storage environment, such as data packets and / or environment maintenance policies related to upgrading or updating the environment. In some exemplary embodiments, the distributed storage environment management platform can provide one or more optional types of environment maintenance data for users to select directly, or users can upload relevant environment maintenance data.

[0070] Furthermore, based on the environmental maintenance operation, the first environmental object can be determined, and environmental maintenance data for updating the environment corresponding to the first environmental object (i.e., the first target environment) can be obtained.

[0071] S103, determine the distributed storage device corresponding to the first target environment, update the first target environment in the distributed storage device according to the environment maintenance data, and update the environment object list accordingly based on the update result.

[0072] After determining the first target environment, the distributed storage device where the first target environment is located can be identified. Then, the environment of the first target environment in the distributed storage device is updated according to the environment maintenance data. After the update is completed, the environment object list can be updated accordingly based on the update results. For example, the environment configuration information of the first target environment after the update can be determined based on the update results, and then the relevant information of the first environment object in the environment object list can be updated according to the updated environment configuration information.

[0073] In the aforementioned data processing method based on a distributed storage environment, the distributed storage environment management platform obtains an environment object list containing multiple environment objects based on multiple environment configuration information entered into the platform. Then, a multi-environment management page can be displayed, and in response to an environment maintenance operation triggered by the user on the page, a first environment object is determined from the environment object list, and environment maintenance data for updating the first target environment corresponding to that first environment object is obtained. Subsequently, the distributed storage device corresponding to the first target environment is determined, and based on the environment maintenance data, the first target environment in the distributed storage device is updated, and the environment object list is updated accordingly based on the update results. In this embodiment, the multi-environment management page provides visualized and automated environment management. The first target environment to be updated can be selected and its automatic update triggered, effectively shortening the environment maintenance change deployment cycle. Furthermore, after the environment update is completed, relevant information can be updated in the environment object list in a timely manner, helping to provide users with timely information on the status of each environment and effectively improving the maintenance efficiency of the distributed storage environment.

[0074] In one embodiment, in step S102, in response to an environment maintenance operation triggered by the user on the multi-environment management page, determining the first environment object from the environment object list may include the following steps:

[0075] In response to the user's selection of an environment object from the list of environment objects displayed on the multi-environment management page, the first environment object selected by the user is determined from the list of environment objects; or, in response to the user's input of environment filter parameters triggered on the multi-environment management page, the environment object whose environment configuration information matches the environment filter parameters is determined from the list of environment objects and is selected as the first environment object.

[0076] In practice, this can be achieved by displaying a list of environment objects through a multi-environment management page. (See reference) Figure 3 After displaying the list of environment objects, the user can select one or more environment objects from the list by performing an environment object selection operation. In response to the user's operation, the distributed storage environment management platform can use the one or more environment objects selected by the user as the first environment object.

[0077] Alternatively, users can trigger environment filtering parameter input operations on the multi-environment management page. For example, they can input specified environment filtering parameters in the environment parameter configuration box provided on the multi-environment management page. These environment filtering parameters can be one or more of the environment configuration information. In some exemplary embodiments, the environment parameters input by the user can include software parameters and hardware parameters of the environment. Furthermore, the distributed storage environment management platform can respond to the user's environment filtering parameter input operation, obtain the environment filtering parameters, and for example, filter out distributed storage environments that correspond to the input environment parameters, or exclude distributed storage environments that correspond to the input environment parameters. Then, it can filter multiple environment objects in the environment object list according to the environment filtering parameters, and select the environment object whose environment configuration information matches the environment filtering parameters as the first environment object.

[0078] In this embodiment, the environment objects that need to be maintained can be quickly selected from the list of environment objects by selecting the environment object or inputting the environment filtering parameters, which can conveniently and efficiently maintain and update the specified distributed storage environment.

[0079] In other embodiments, reference is made to Figure 3Alternatively, users can select an environment object or input environment filtering parameters on the multi-environment management page to identify one or more fourth environment objects. Then, they can apply for access to the corresponding fourth target environment or manage access permissions for that fourth target environment. This process can be implemented through the platform's environment application module. Therefore, when a user wants to use a specific environment, they can apply for its use through this module. After administrator approval, the login information for that environment can be viewed. Administrators can also view the occupancy and availability of each environment, allowing for flexible scheduling of multiple distributed storage environments.

[0080] In an exemplary embodiment, after displaying the multi-environment management page in step S102, the method may further include the following steps:

[0081] In response to the user's environment monitoring operation triggered on the multi-environment management page, the system determines the second environment object from the list of environment objects; determines the second target environment corresponding to the second environment object, and obtains the resource usage of the environment resources in the second target environment and the performance information of the second target environment; based on the resource usage and performance information, the system displays the environment monitoring results corresponding to the second target environment on the multi-environment management page.

[0082] In practice, users can trigger environment monitoring operations on the multi-environment management page. These operations can include requesting to view parameters related to a specified environment. Furthermore, the distributed storage environment management platform can determine at least one second environment object from the list of environment objects to which the monitoring operation targets. This could be a second environment object selected by the user or obtained through environment filtering parameters, one or more second environment objects of a specified node, or even all environment objects on the platform.

[0083] Then, for each second environment object, the corresponding second target environment can be determined, and the resource usage of the environment resources in the second target environment and the performance information of the second target environment can be obtained. Based on the resource usage and performance information, the environment monitoring results corresponding to the second target environment can be displayed on the multi-environment management page.

[0084] For example, the platform's environment monitoring module can be used to monitor the hardware and software resources and performance of the distributed storage environment. Based on this monitoring, alarm reporting can be configured. (Reference) Figure 4 The environmental monitoring module can achieve various functions through the following modules:

[0085] (1) Resource monitoring: Users can view various hardware and software resources of the selected distributed storage environment, such as CPU and memory utilization, and assess the pressure of the current distributed storage environment. In addition, they can also view information such as the capacity of the environment, so as to carry out upgrade and maintenance operations such as expansion when the capacity of the environment is insufficient.

[0086] (2) Performance monitoring: Users can view the performance waveform of the selected distributed storage environment. When the mouse is placed on a certain position of the waveform, the corresponding performance data will be displayed, including the number of read / write operations per second (Input / OutputOperations Per Second, IOPS), bandwidth, latency, etc. Users can view at least one of real-time data and historical data. Historical data can be divided according to different unit durations, such as providing 1 hour, 1 day, 1 week and custom options.

[0087] (3) Alarm reporting: This module can configure alarm reporting parameters for the distributed storage environment (such as alarm reporting threshold). For example, if you configure the alarm information to be sent when the capacity utilization rate exceeds 90%, you can select the alarm reporting parameter of the capacity, fill in its threshold as 90%, and fill in the email address for the alarm sending object. When the capacity utilization rate of the distributed storage environment exceeds 90%, the alarm information will be sent to the email address.

[0088] In this embodiment, by triggering environment monitoring operations on the multi-environment management page, the performance information and resource usage of the second target environment can be obtained quickly and efficiently, enabling real-time monitoring of various distributed storage environments. Compared to related technologies where detailed hardware and software information of each distributed environment cannot be clearly seen, and where environmental information cannot be updated in a timely manner when changes occur, or where problems arise in the environment, this embodiment, by monitoring various environments, allows users to understand the detailed hardware and software information and configuration status of each distributed environment in a timely manner. When problems arise in the environment, they can be detected and dealt with promptly, improving environment maintenance efficiency.

[0089] In an exemplary embodiment, after displaying the multi-environment management page in step S102, the method may further include the following steps:

[0090] In response to a user's code testing operation triggered on the multi-environment management page, the system determines a third environment object and its subsequent test configuration information from the environment object list. Based on the test configuration information, it identifies the test object to be tested in the third target environment corresponding to the third environment object. The system retrieves the code corresponding to the test object from the code repository, performs build processing on the code, obtains the executable application data package corresponding to the test object, determines test cases based on the test configuration information, tests the executable application data package according to the test cases, and obtains the test results. If the test results indicate that the test passed, the executable application data package is saved to the application storage module.

[0091] The application storage module is used to store the data packets of each executable application that has passed the test.

[0092] In practice, users can trigger code testing operations on the multi-environment management page. These operations represent user requests to perform tests on a test object within a specified test environment. Specifically, code testing operations can include selecting the test environment and identifying the test object.

[0093] In response to code testing operations, the distributed storage environment management platform can identify a third environment object (such as the user-selected third environment object) from the list of environment objects, and obtain the test configuration information output by the user. Then, based on the test configuration information, it can determine the test object to be tested in the third target environment corresponding to the third environment object, retrieve the corresponding code from the code repository, perform code building processing on the code, and obtain the executable application data package corresponding to the test object. Furthermore, it can determine test cases based on the test configuration information, and then test the executable application data package according to the test cases, obtain the test results, and if the test results indicate that the test passed, save the executable application data package to the application storage module.

[0094] For example, during testing, the CI module in a distributed storage environment management platform can be used to continuously integrate code into the codebase and automate builds and tests. (Reference) Figure 5 The CI module can achieve various functions through the following modules:

[0095] (1) Configuration Management Module: This part contains the server configurations used for the build and the product code used for the build. Create appropriate configuration files for different distributed storage environments (development, testing, production) and use environment variables to dynamically load these configurations.

[0096] (2) Build module: After the configuration management part is completed, the build is performed when the package needs to be generated. This part is based on the written automated build script and the orchestration of the build process. For example, the written automated code can be converted into an executable software program or library through the build module.

[0097] (3) Smoke Testing Module: After the build is completed, a smoke test, including one or more automated tests, will be executed to ensure that the generated software package can work properly and avoid some basic problems. Among them, the smoke test can be used to verify whether the basic functions of the software can work properly, without testing every detail or edge case.

[0098] (4) Package Management Module: After the smoke test is completed, the package is generated. This module configures the storage path and version number of the package and controls which version the management user uses.

[0099] In this embodiment, suitable testing and production environments can be quickly selected for deployment, and the output of packages and the testing operations on the environment can be integrated through a distributed storage environment management platform, which effectively improves the efficiency of testing based on distributed storage environments.

[0100] In one embodiment, step S102, obtaining environmental maintenance data for updating the first target environment, includes:

[0101] From the application storage module, obtain the target executable application data package used to update the first target environment corresponding to the first environment object; obtain environment maintenance data based on the executable application data package.

[0102] In specific implementation, the distributed storage environment management platform provided in this application embodiment can be used to control the testing of executable application data packages used for environment upgrades and store them in the application storage module. Then, when an upgrade of the first target environment is required, the corresponding target executable application data package can be retrieved from the application storage module, and environment maintenance data can be obtained based on the executable application data package. For example, refer to... Figure 3 The component upgrade module can communicate with the package management module. If it is a self-developed software package, the target package (i.e., the target executable application data package) can be directly selected from the package management module, and the target version of the package will be automatically downloaded in the background and the environment will be upgraded. If it is a third-party software package, it can be uploaded and then upgraded in this module.

[0103] Compared to related technologies where each step—from packet generation and environment upgrade to testing—is fragmented and requires individual manual operation, this embodiment provides a distributed storage environment management platform that integrates multiple functions. By linking the steps of packet generation, environment upgrade, and testing through the distributed storage environment management platform, the complexity of maintaining the environment is reduced, and the efficiency of storage testing is improved.

[0104] In one embodiment, testing the executable application data package according to test cases to obtain test results may include the following steps:

[0105] Test the executable application data package based on the test cases, determine the total number of executed test cases, the number of successfully executed test cases, and the number of failed test cases; display the test results; the test results include the total number of executed test cases, the number of successfully executed test cases, and the number of failed test cases when the test object is tested in a third target environment.

[0106] In practice, during the testing of executable application data packages based on test cases, the total number of executed test cases, the number of successfully executed test cases, and the number of failed test cases can be determined. These numbers can then be displayed as test results.

[0107] In one embodiment, reference Figure 6 The automated testing module within a distributed storage environment management platform can perform automated testing of the distributed storage environment. Effective automated testing can improve the stability, reliability, and security of the distributed storage system while reducing the workload and error rate of manual testing. The automated testing module mainly consists of the following modules:

[0108] (1) Test configuration module: First, the test object and test cases are configured according to the test configuration information input by the user, and the environment and set of automated test cases to be automated are selected.

[0109] (2) Automation code maintenance module: This module configures the pull path of automation code and updates the pulled automation code.

[0110] (3) Results push: Users can configure the email address for results push. After the automated test is completed, the test results will be automatically pushed to the configured email address. For example, the test results may include one or more information such as the total number of test cases executed, the number of successful and failed test cases, and the start and end times of execution.

[0111] (4) Results Display: After the automated test is completed, the test results can be displayed graphically in this module. It can include the total number of executed test cases, the number of successful and failed test cases, and can be displayed in table or pie chart format. In addition, clicking on the failed test case will show the corresponding detailed execution log for further investigation.

[0112] In this embodiment, by displaying test results that include the total number of executed test cases, the number of successfully executed test cases, and the number of failed test cases, the efficiency of users in understanding the test situation is improved.

[0113] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0114] Based on the same inventive concept, this application also provides a data processing apparatus based on a distributed storage environment for implementing the data processing method based on a distributed storage environment described above. The solution provided by this apparatus is similar to the solution described in the above method; therefore, the specific limitations in one or more embodiments of the data processing apparatus based on a distributed storage environment provided below can be found in the limitations of the data processing method based on a distributed storage environment described above, and will not be repeated here.

[0115] In one exemplary embodiment, such as Figure 7 As shown, a data processing device based on a distributed storage environment is provided, which is applied to a distributed storage environment management platform. The device includes:

[0116] The list generation module 701 is used to obtain a list of environment objects containing multiple environment objects based on multiple environment configuration information entered into the distributed storage environment management platform.

[0117] The maintenance data acquisition module 702 is used to display a multi-environment management page and respond to the environment maintenance operation triggered by the user on the multi-environment management page, determine a first environment object from the list of environment objects and acquire environment maintenance data for updating the first target environment corresponding to the first environment object;

[0118] The environment update module 703 is used to determine the distributed storage device corresponding to the first target environment, update the first target environment in the distributed storage device according to the environment maintenance data, and update the environment object list accordingly based on the update result.

[0119] In one embodiment, the maintenance data acquisition module 702 is used for:

[0120] In response to the user's selection of an environment object from the list of environment objects displayed on the multi-environment management page, the first environment object selected by the user is determined from the list of environment objects;

[0121] or,

[0122] In response to the user's input of environment filtering parameters on the multi-environment management page, an environment object whose environment configuration information matches the environment filtering parameters is determined from the list of environment objects and designated as the first environment object.

[0123] In one embodiment, the apparatus further includes a performance monitoring module, the performance monitoring module being used for:

[0124] In response to an environment monitoring operation triggered by the user on the multi-environment management page, a second environment object is determined from the list of environment objects;

[0125] Determine the second target environment corresponding to the second environment object, and obtain the resource usage of environmental resources in the second target environment and the performance information of the second target environment;

[0126] Based on the resource usage and performance information, the environmental monitoring results corresponding to the second target environment are displayed on the multi-environment management page.

[0127] In one embodiment, the apparatus further includes a testing module, the testing module being used for:

[0128] In response to a code test operation triggered by a user on the multi-environment management page, a third environment object is determined from the list of environment objects and test configuration information is obtained. Based on the test configuration information, the test object to be tested in the third target environment corresponding to the third environment object is determined.

[0129] The code corresponding to the test object is obtained from the code repository, the code is built to obtain the executable application data package corresponding to the test object, test cases are determined according to the test configuration information, the executable application data package is tested according to the test cases, and test results are obtained.

[0130] If the test result indicates that the test has passed, the executable application data package is saved to the application storage module; the application storage module is used to store each executable application data package that has passed the test.

[0131] In one embodiment, the maintenance data acquisition module 702 is used for:

[0132] Obtain the target executable application data package for updating the first target environment corresponding to the first environment object from the application storage module;

[0133] Environment maintenance data is obtained from the executable application data package.

[0134] In one embodiment, the test module is used for:

[0135] The executable application data package is tested according to the test cases to determine the total number of test cases executed, the number of test cases executed successfully, and the number of test cases executed unsuccessfully.

[0136] The test results are displayed; the test results include the total number of executed test cases, the number of successfully executed test cases, and the number of failed test cases when the test object is tested in the third target environment.

[0137] The modules in the aforementioned data processing device based on a distributed storage environment can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.

[0138] In one exemplary embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 8As shown, this computer device includes a processor, memory, input / output interfaces (I / O), and a communication interface. The processor, memory, and I / O interfaces are connected via a system bus, and the communication interface is also connected to the system bus via the I / O interfaces. The processor provides computational and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and a database. The internal memory provides the environment for the operating system and computer programs in the non-volatile storage media. The database stores environmental data for the distributed storage environment. The I / O interfaces are used for exchanging information between the processor and external devices. The communication interface is used for communication with external terminals via a network connection. When the computer program is executed by the processor, it implements a data processing method based on a distributed storage environment.

[0139] Those skilled in the art will understand that Figure 8 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0140] In one embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above-described method embodiments.

[0141] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the steps in the above method embodiments.

[0142] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.

[0143] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.

[0144] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.

[0145] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0146] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A data processing method based on a distributed storage environment, characterized in that, The method, applied to a distributed storage environment management platform, includes: Based on the multiple environment configuration information entered into the distributed storage environment management platform, an environment object list containing multiple environment objects is obtained; each environment object corresponds to one environment. The system displays a multi-environment management page and, in response to an environment maintenance operation triggered by a user on the multi-environment management page, determines multiple first environment objects from the environment object list and obtains environment maintenance data for updating the first target environment corresponding to each first environment object. This includes: in response to a user's selection operation of an environment object from the environment object list displayed on the multi-environment management page, determining the first environment object selected by the user from the multiple environment objects included in the environment object list; or, in response to a user's input operation of environment filtering parameters triggered on the multi-environment management page, determining the environment object whose environment configuration information matches the environment filtering parameters from the environment object list, and using it as the first environment object. The distributed storage device corresponding to each first target environment is determined, and the first target environment in each of the distributed storage devices is updated in batches according to the environment maintenance data. The environment object list is updated accordingly based on the update results.

2. The method according to claim 1, characterized in that, Following the display of the multi-environment management page, the following is also included: In response to an environment monitoring operation triggered by the user on the multi-environment management page, a second environment object is determined from the list of environment objects; Determine the second target environment corresponding to the second environment object, and obtain the resource usage of environmental resources in the second target environment and the performance information of the second target environment; Based on the resource usage and performance information, the environmental monitoring results corresponding to the second target environment are displayed on the multi-environment management page.

3. The method according to claim 1, characterized in that, Following the display of the multi-environment management page, the following is also included: In response to a code test operation triggered by a user on the multi-environment management page, a third environment object is determined from the list of environment objects and test configuration information is obtained. Based on the test configuration information, the test object to be tested in the third target environment corresponding to the third environment object is determined. The code corresponding to the test object is obtained from the code repository, the code is built to obtain the executable application data package corresponding to the test object, test cases are determined according to the test configuration information, the executable application data package is tested according to the test cases, and test results are obtained. If the test result indicates that the test has passed, the executable application data package is saved to the application storage module; the application storage module is used to store each executable application data package that has passed the test.

4. The method according to claim 3, characterized in that, The step of obtaining environment maintenance data for updating the first target environment corresponding to the first environment object includes: Obtain the target executable application data package for updating the first target environment corresponding to the first environment object from the application storage module; Environment maintenance data is obtained from the executable application data package.

5. The method according to claim 3, characterized in that, The step of testing the executable application data package according to the test cases and obtaining test results includes: The executable application data package is tested according to the test cases to determine the total number of test cases executed, the number of test cases executed successfully, and the number of test cases executed unsuccessfully. The test results are displayed; the test results include the total number of executed test cases, the number of successfully executed test cases, and the number of failed test cases when the test object is tested in the third target environment.

6. A data processing device based on a distributed storage environment, characterized in that, The device, used in a distributed storage environment management platform, includes: The list generation module is used to obtain a list of environment objects containing multiple environment objects based on multiple environment configuration information entered into the distributed storage environment management platform; each environment object corresponds to one environment. The maintenance data acquisition module is used to display a multi-environment management page and, in response to an environment maintenance operation triggered by a user on the multi-environment management page, determine multiple first environment objects from the environment object list and acquire environment maintenance data for updating the first target environment corresponding to each first environment object; including: in response to a user's selection operation of an environment object from the environment object list displayed on the multi-environment management page, determining the first environment object selected by the user from the multiple environment objects included in the environment object list; or, in response to a user's input operation of environment filtering parameters triggered on the multi-environment management page, determining the environment object whose environment configuration information matches the environment filtering parameters from the environment object list as the first environment object; The environment update module is used to determine the distributed storage device corresponding to each first target environment, and to perform batch environment updates on the first target environments in each of the distributed storage devices according to the environment maintenance data, and to update the environment object list accordingly based on the update results.

7. The apparatus according to claim 6, characterized in that, The device further includes a performance monitoring module, which is used for: In response to an environment monitoring operation triggered by the user on the multi-environment management page, a second environment object is determined from the list of environment objects; Determine the second target environment corresponding to the second environment object, and obtain the resource usage of environmental resources in the second target environment and the performance information of the second target environment; Based on the resource usage and performance information, the environmental monitoring results corresponding to the second target environment are displayed on the multi-environment management page.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 5.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 5.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 5.

Images