Data processing method and device based on distributed storage environment, computer equipment, readable storage medium and program product

Abstract

The invention relates to a data processing method and device based on a distributed storage environment, computer equipment, a computer readable storage medium and a computer program product, relates to the technical field of distributed storage, and can improve the maintenance efficiency of the distributed storage environment. The method comprises the following steps: obtaining an environment object list containing a plurality of environment objects according to a plurality of pieces of environment configuration information input into a distributed storage environment management platform; displaying a multi-environment management page, and in response to an environment maintenance operation triggered by a user on the multi-environment management page, determining a first environment object from the environment object list and obtaining environment maintenance data used for updating a first target environment corresponding to the first environment object; and determining a distributed storage device corresponding to the first target environment, performing environment updating on the first target environment in the distributed storage device according to the environment maintenance data, and performing corresponding updating on the environment object list according to an updating result.

Description

Technical Field

[0001] The present application relates to the field of distributed storage technology, and in particular to a data processing method, apparatus, computer equipment, computer-readable storage medium, and computer program product based on a distributed storage environment. Background Art

[0002] Distributed storage is a data storage technology that can integrate the disk space on multiple computers or servers into a virtual storage device through the network. Data is stored in a dispersed manner on each node to improve data reliability, scalability and performance. In order to conduct automated testing more efficiently, multiple environments can be distributedly stored. For example, multiple test environments and production environments can be stored in multiple distributed nodes.

[0003] However, with the increasing number of distributed storage environments, daily maintenance and upgrades are very cumbersome and labor-intensive when maintaining multiple distributed storage environments. They often consume a lot of manpower and material resources, resulting in low efficiency in maintaining distributed storage environments. Summary of the invention

[0004] Based on this, it is necessary to provide a data processing method, apparatus, computer equipment, computer-readable storage medium and computer program product based on a distributed storage environment to address the above technical problems.

[0005] In a first aspect, the present application provides a data processing method based on a distributed storage environment, comprising:

[0006] Obtaining an environment object list including multiple environment objects according to multiple environment configuration information entered into the distributed storage environment management platform;

[0007] Displaying a multi-environment management page, and in response to an environment maintenance operation triggered by a user on the multi-environment management page, determining a first environment object from the environment object list and acquiring environment maintenance data for updating a first target environment corresponding to the first environment object;

[0008] Determine the distributed storage device corresponding to the first target environment, and update the first target environment in the distributed storage device according to the environment maintenance data, and correspondingly update the environment object list according to the update result.

[0009] In one of the embodiments, in response to the environment maintenance operation triggered by the user on the multi-environment management page, determining the first environment object from the environment object list includes:

[0010] In response to a user selecting an environment object from the environment object list displayed on the multi-environment management page, determining a first environment object selected by the user from the environment object list;

[0011] or,

[0012] In response to an environment screening parameter input operation triggered by a user on the multi-environment management page, an environment object whose environment configuration information matches the environment screening parameter is determined from the environment object list as a first environment object.

[0013] In one of the embodiments, after displaying the multi-environment management page, the method further includes:

[0014] In response to an environment monitoring operation triggered by a user on the multi-environment management page, determining a second environment object from the environment object list;

[0015] Determine a second target environment corresponding to the second environment object, and obtain resource usage of environment resources in the second target environment and performance information of the second target environment;

[0016] Based on the resource usage and the performance information, the environment monitoring result corresponding to the second target environment is displayed on the multi-environment management page.

[0017] In one of the embodiments, after displaying the multi-environment management page, the method further includes:

[0018] In response to a code test operation triggered by a user on the multi-environment management page, determining a third environment object from the environment object list and obtaining test configuration information, and determining a test object to be tested in a third target environment corresponding to the third environment object according to the test configuration information;

[0019] Obtaining the code corresponding to the test object from a code repository, constructing the code to obtain an executable application data packet corresponding to the test object, determining a test case according to the test configuration information, testing the executable application data packet according to the test case, and obtaining a test result;

[0020] When the test result indicates that the test is passed, the executable application data packet is saved to an application storage module; the application storage module is used to store each executable application data packet that has passed the test.

[0021] In one embodiment, the obtaining of environment maintenance data for updating a first target environment corresponding to the first environment object includes:

[0022] Acquire, from the application storage module, a target executable application data packet for updating a first target environment corresponding to the first environment object;

[0023] Environmental maintenance data is obtained according to the executable application data packet.

[0024] In one embodiment, the step of testing the executable application data packet according to the test case to obtain a test result includes:

[0025] Testing the executable application data packet according to the test case to determine the total number of executed cases, the number of successfully executed cases, and the number of failed cases;

[0026] Display test results; the test results include the total number of executed cases, the number of successfully executed cases, and the number of failed cases when the test object is tested in the third target environment.

[0027] In a second aspect, the present application further provides a data processing device based on a distributed storage environment, which is applied to a distributed storage environment management platform, and the device includes:

[0028] A list generation module, used to obtain an environment object list including multiple environment objects according to multiple environment configuration information entered into the distributed storage environment management platform;

[0029] a maintenance data acquisition module, configured to display a multi-environment management page, and in response to an environment maintenance operation triggered by a user on the multi-environment management page, determine a first environment object from the environment object list and acquire environment maintenance data for updating a first target environment corresponding to the first environment object;

[0030] The environment update module is used to determine the distributed storage device corresponding to the first target environment, and update the first target environment in the distributed storage device according to the environment maintenance data, and update the environment object list accordingly according to the update result.

[0031] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0032] Obtaining an environment object list including multiple environment objects according to multiple environment configuration information entered into the distributed storage environment management platform;

[0033] Displaying a multi-environment management page, and in response to an environment maintenance operation triggered by a user on the multi-environment management page, determining a first environment object from the environment object list and acquiring environment maintenance data for updating a first target environment corresponding to the first environment object;

[0034] Determine the distributed storage device corresponding to the first target environment, and update the first target environment in the distributed storage device according to the environment maintenance data, and correspondingly update the environment object list according to the update result.

[0035] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0036] Obtaining an environment object list including multiple environment objects according to multiple environment configuration information entered into the distributed storage environment management platform;

[0037] Displaying a multi-environment management page, and in response to an environment maintenance operation triggered by a user on the multi-environment management page, determining a first environment object from the environment object list and acquiring environment maintenance data for updating a first target environment corresponding to the first environment object;

[0038] Determine the distributed storage device corresponding to the first target environment, and update the first target environment in the distributed storage device according to the environment maintenance data, and correspondingly update the environment object list according to the update result.

[0039] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0040] Obtaining an environment object list including multiple environment objects according to multiple environment configuration information entered into the distributed storage environment management platform;

[0041] Displaying a multi-environment management page, and in response to an environment maintenance operation triggered by a user on the multi-environment management page, determining a first environment object from the environment object list and acquiring environment maintenance data for updating a first target environment corresponding to the first environment object;

[0042] Determine the distributed storage device corresponding to the first target environment, and update the first target environment in the distributed storage device according to the environment maintenance data, and correspondingly update the environment object list according to the update result.

[0043] The above-mentioned data processing method, device, computer equipment, computer-readable storage medium and computer program product based on the distributed storage environment, the distributed storage environment management platform obtains an environment object list containing multiple environment objects according to multiple environment configuration information entered into the distributed storage environment management platform; then, the multi-environment management page can be displayed, and in response to the environment maintenance operation triggered by the user on the multi-environment management page, the first environment object is determined from the environment object list and the environment maintenance data for updating the first target environment corresponding to the first environment object is obtained; then, the distributed storage device corresponding to the first target environment can be determined, and according to the environment maintenance data, the environment of the first target environment in the distributed storage device is updated, and the environment object list is updated accordingly according to the update result. In the embodiment of the present application, by providing visual and automated environment management through the multi-environment management page, the first target environment to be updated can be selected and the automated update of the first target environment can be triggered, which effectively shortens the environment maintenance change deployment cycle, and after the environment update is completed, the relevant information can be updated in the environment object list in a timely manner, which helps to provide users with the status of each environment in a timely manner, and effectively improves the maintenance efficiency of the distributed storage environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0045] Figure 1 A schematic diagram of a data processing method based on a distributed storage environment in an embodiment;

[0046] Figure 2 A schematic diagram of the structure of a distributed storage environment management platform in one embodiment;

[0047] Figure 3 A schematic diagram of a process for upgrading a distributed storage environment in one embodiment;

[0048] Figure 4 A schematic diagram of a process for monitoring a distributed storage environment in one embodiment;

[0049] Figure 5 A schematic diagram of a process of acquiring a data packet through a distributed storage environment management platform in one embodiment;

[0050] Figure 6 A schematic diagram of a process of testing through a distributed storage environment management platform in an embodiment;

[0051] Figure 7 is a structural block diagram of a data processing device based on a distributed storage environment in one embodiment;

[0052] Figure 8 The figure is a diagram of the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0054] Distributed storage is a data storage technology that can integrate the disk space on multiple computers or servers into a virtual storage device through the network. Data is stored in a dispersed manner on each node to improve data reliability, scalability and performance. In order to conduct automated testing more efficiently, multiple environments can be distributedly stored. For example, multiple test environments and production environments can be stored in multiple distributed nodes.

[0055] However, with the increasing number of distributed storage environments, there are also many inconveniences in manually maintaining many distributed storage environments. For example, daily maintenance and upgrades are very cumbersome, with a large workload and slow manual operations. In addition, the maintenance cycle is long in the case of a large number of environments. If there are urgent problems, the environmental information may not be changed in time. While consuming a lot of manpower, material resources and time, it is easy to cause environmental maintenance errors due to cumbersome operations. In addition, when the environmental information changes, the environmental information cannot be maintained and updated in time. It can be seen that the relevant technology has the problem of low efficiency in distributed storage environment maintenance.

[0056] Based on this, it is necessary to provide a data processing method, apparatus, computer equipment, computer-readable storage medium and computer program product based on a distributed storage environment to address the above technical problems.

[0057] In one embodiment, Figure 1 As shown, a data processing method based on a distributed storage environment is provided. This embodiment is described by applying the method to a distributed storage environment management platform, wherein the distributed storage environment management platform may be a system composed of a terminal and a server, and the method is implemented through the interaction between the terminal and the server. In some exemplary embodiments, the framework of the distributed storage environment management platform may be as follows: Figure 2 As shown, the distributed storage environment management platform may include a continuous integration (CI) module, an environment maintenance module, an environment monitoring module, and an automated testing module.

[0058] Among them, the continuous integration module can frequently integrate the code into the shared repository and perform automated building and testing. This module also includes the configuration management module, the building module related to code integration, the smoke test module and the package management module. Through the CI module, the built package can be automatically smoked, and then after passing the smoke automated test, the built package can be pushed to the package release path for package management.

[0059] The environment maintenance module can enter the environment information into the platform through the configuration maintenance module, and then query the environment object list through the environment object list module and select the required environment according to parameters such as software and hardware. When an upgrade is required, the target distributed storage environment and the target upgrade package that need to be upgraded are selected through the component upgrade module, and then the upgrade is performed. When a user needs to use the environment, he can apply for the environment and pass the approval. After the approval, he can obtain the environment use permission. In addition, the current specific user of each distributed storage environment can also be queried through the environment maintenance module.

[0060] The environment monitoring module may include a resource monitoring module, a performance monitoring module, and an alarm reporting module. Among them, the resource monitoring module allows users to view the CPU, memory and other resource utilization of the selected distributed storage environment, and the performance monitoring module can obtain the performance data of the selected distributed storage environment. The alarm reporting module can configure the alarm reporting conditions of the distributed storage environment, and when the alarm reporting conditions are met, the alarm reporting of the abnormalities in the distributed storage environment can be performed.

[0061] The automated test module can include test configuration, automated code maintenance, result push, and result display. When the user wants to run an automated test, he can first configure the test, select the environment to be tested and the corresponding test suite. The automated code maintenance can determine the corresponding code branch based on the configuration information entered by the user and then pull the latest automated code. After the test is completed, the automated test results will be pushed to the configured path, and the results can also be viewed and graphically displayed on the platform.

[0062] In this embodiment, if Figure 1 As shown, the method comprises the following steps:

[0063] S101, obtaining an environment object list including multiple environments according to multiple environment configuration information entered into a distributed storage environment management platform.

[0064] In actual applications, for environments stored in multiple different nodes through distributed storage (also referred to as distributed storage environments), environment configuration information corresponding to the multiple environments can be obtained, and the multiple environment configuration information can be entered into a distributed storage environment management platform. After obtaining the multiple environment configuration information, the distributed storage environment management platform can generate a corresponding environment object list, which can include multiple environment objects. The environment object can be understood as a page element visualized in the distributed storage environment management platform, and one environment object corresponds to one environment.

[0065] In some embodiments, Figure 2 Taking the distributed storage environment management platform shown as an example, the environment configuration information of multiple distributed storage environments can be entered into the platform through the configuration maintenance module. Later, users can continue to modify the environment configuration information through this module to achieve flexible and unified adjustment of the environment configuration information of multiple distributed storage environments. In addition, the environment object list module can be used to display an environment object list containing multiple environment objects, and basic environment information (such as environment configuration information) can be viewed. In some examples, the displayed basic environment information can include the environment's hardware and software information, basic configuration, etc., or the environment to be viewed can be filtered out based on hardware and software parameters.

[0066] S102, displaying a multi-environment management page, and in response to an environment maintenance operation triggered by a user on the multi-environment management page, determining a first target environment from an environment object list and acquiring environment maintenance data for updating the first target environment.

[0067] In a specific implementation, the distributed storage environment management platform can display a multi-environment management page, wherein the multi-environment management page is a page that can perform multiple processing on multiple distributed storage environments at the same time, that is, the multi-environment management page can integrate relevant information of multiple distributed storage environments, and select a specific environment from multiple distributed storage environments through this page for related data processing.

[0068] In this step, after the multi-environment management page is displayed, the user can trigger an environment maintenance operation for maintaining the specified distributed storage environment on the multi-environment management page. In response to the environment maintenance operation triggered by the user, an environment object related to the environment maintenance operation can be determined from the environment object list. To facilitate distinction from other environment objects, the environment object is referred to as a first environment object. In some embodiments, the first environment object can be one or more, that is, in this embodiment, a single distributed storage environment can be updated, or multiple distributed storage environments can be updated in batches.

[0069] In addition, by triggering an environment maintenance operation, the user can also output environment maintenance data, wherein the environment maintenance data can include data indicating the distributed storage environment maintenance method, such as relevant data packages and / or environment maintenance policies for upgrading or updating the environment. In some exemplary embodiments, the distributed storage environment management platform can provide one or more optional environment maintenance data for the user to directly select, or the user can upload the relevant environment maintenance data.

[0070] Furthermore, based on the environment maintenance operation, a first environment object may be determined, and environment maintenance data for updating the environment corresponding to the first environment object (ie, the first target environment) may be obtained.

[0071] S103, determining the distributed storage device corresponding to the first target environment, and updating the first target environment in the distributed storage device according to the environment maintenance data, and correspondingly updating the environment object list according to the update result.

[0072] After determining the first target environment, the distributed storage device where the first target environment is located can be determined, and then the first target environment in the distributed storage device can be updated according to the environment maintenance data. After the update is completed, the environment object list can be updated accordingly according to the update result. For example, the environment configuration information of the first target environment after the update can be determined according to the update result, and then the relevant information of the first environment object in the environment object list can be updated according to the updated environment configuration information.

[0073] In the above-mentioned data processing method based on distributed storage environment, the distributed storage environment management platform obtains an environment object list including multiple environment objects according to multiple environment configuration information entered into the distributed storage environment management platform; then, the multi-environment management page can be displayed, and in response to the environment maintenance operation triggered by the user on the multi-environment management page, the first environment object can be determined from the environment object list and the environment maintenance data for updating the first target environment corresponding to the first environment object can be obtained; then, the distributed storage device corresponding to the first target environment can be determined, and according to the environment maintenance data, the environment in the distributed storage device is updated, and the environment object list is updated accordingly according to the update result. In the embodiment of the present application, by providing visual and automated environment management through the multi-environment management page, the first target environment to be updated can be selected and the automated update of the first target environment can be triggered, which effectively shortens the environment maintenance change deployment cycle, and after the environment update is completed, the relevant information can be updated in the environment object list in a timely manner, which helps to provide users with the status of each environment in a timely manner, and effectively improves the maintenance efficiency of the distributed storage environment.

[0074] In one embodiment, in step S102, in response to an environment maintenance operation triggered by a user on the multi-environment management page, determining a first environment object from the environment object list may include the following steps:

[0075] In response to a user's environment object selection operation on the environment object list displayed in the multi-environment management page, a first environment object selected by the user is determined from the environment object list; or, in response to a user's environment screening parameter input operation triggered on the multi-environment management page, an environment object whose environment configuration information matches the environment screening parameters is determined from the environment object list as the first environment object.

[0076] In the specific implementation, the list of environment objects can be displayed through the multi-environment management page. Figure 3 After displaying the environment object list, the user selects one or more environment objects in the environment object list by performing an environment object selection operation on the environment object list. In response to the user's operation, the distributed storage environment management platform can use the one or more environment objects selected by the user as the first environment object.

[0077] Alternatively, the user may also trigger an input operation of an environment screening parameter on the multi-environment management page, for example, by inputting a specified environment screening parameter in the environment parameter configuration box provided on the multi-environment management page. The environment screening parameter may be one or more of the environment configuration information. In some exemplary embodiments, the environment parameters input by the user may include software parameters and hardware parameters of the environment. Furthermore, the distributed storage environment management platform may respond to the user's environment screening parameter input operation and obtain the environment screening parameter, for example, by filtering out the distributed storage environment corresponding to the input environment parameter, or excluding the distributed storage environment corresponding to the input environment parameter, and then filtering multiple environment objects in the environment object list according to the environment screening parameter, and taking the environment object whose environment configuration information matches the environment screening parameter as the first environment object.

[0078] In this embodiment, the environment objects that need to be maintained can be quickly screened out from the environment object list through the environment object selection operation or the environment screening parameter input operation, so that the specified distributed storage environment can be maintained and updated conveniently and efficiently.

[0079] In some other embodiments, reference Figure 3, or by triggering the environment object selection operation or the environment screening parameter input operation in the multi-environment management page, one or more fourth environment objects can be determined, and then the fourth environment object corresponding to the fourth target environment usage permission or the fourth target environment environment usage permission management can be applied for. This process can be implemented through the environment application module in the platform. Therefore, when a user wants to use a specified environment, he can apply for occupation through this module. After the administrator completes the approval, he can view the login information of this environment. The administrator can also view the occupation and idleness of each environment, and flexibly schedule the use of multiple distributed storage environments.

[0080] In an exemplary embodiment, after the multi-environment management page is displayed in step S102, the method may further include the following steps:

[0081] In response to an environment monitoring operation triggered by a user on a multi-environment management page, a second environment object is determined from the environment object list; a second target environment corresponding to the second environment object is determined, and resource usage of environmental resources in the second target environment and performance information of the second target environment are obtained; based on the resource usage and performance information, the environment monitoring results corresponding to the second target environment are displayed on the multi-environment management page.

[0082] In a specific implementation, a user can trigger an environment monitoring operation on the multi-environment management page, where the environment monitoring operation can be an operation requesting to view parameters related to a specified environment. Furthermore, the distributed storage environment management platform can determine from the environment object list at least one second environment object targeted by the environment monitoring operation, such as a second environment object selected by a user or obtained by filtering through environment filtering parameters, or one or more second environment objects of a specified node, or of course all environment objects of the platform.

[0083] Then, for each second environment object, the second target environment corresponding to the second environment object can be determined, and the resource usage of the environmental resources in the second target environment and the performance information of the second target environment can be obtained. Then, based on the resource usage and performance information, the environmental monitoring results corresponding to the second target environment can be displayed on the multi-environment management page.

[0084] For example, the platform's environment monitoring module can be used to monitor the software and hardware resources and performance of the distributed storage environment, and based on the monitoring, alarm reporting configuration can be performed. Figure 4 , the environmental monitoring module can achieve multiple functions through the following modules. Including:

[0085] (1) Resource monitoring: Users can view various software and hardware resources of the selected distributed storage environment, such as CPU and memory utilization, to evaluate the pressure of the current distributed storage environment. In addition, users can also view information such as the capacity of the environment, so as to perform upgrade and maintenance operations such as capacity expansion when the environment capacity is insufficient.

[0086] (2) Performance monitoring: Users can view the performance waveform of the selected distributed storage environment. By placing the mouse on a certain position on the waveform, the corresponding performance data will be displayed, including the number of read / write operations per second (Input / Output Operations Per Second, IOPS), bandwidth, latency, etc. Users can view at least one of real-time data and historical data. Historical data can be divided according to different unit time lengths, such as 1 hour, 1 day, 1 week and custom options.

[0087] (3) Alarm reporting: This module can configure the alarm reporting parameters of the distributed storage environment (such as the alarm reporting threshold). For example, if you configure the alarm information to be sent when the capacity utilization rate exceeds 90%, you can select the capacity alarm reporting parameter, fill in its threshold as 90%, and fill in the email address as the alarm sending object. When the capacity utilization rate of the distributed storage environment exceeds 90%, the alarm information will be sent to the email address.

[0088] In this embodiment, by triggering the environment monitoring operation on the multi-environment management page, the performance information and resource usage of the second target environment can be obtained quickly and efficiently, and various distributed storage environments can be monitored at any time. Compared with the related technologies, it is impossible to clearly see the detailed software and hardware information of each distributed environment, and when the environmental information changes, the environmental information cannot be maintained and updated in time, and when problems occur in the environment, they cannot be discovered and handled in time. This embodiment monitors various environments, allowing users to timely understand the detailed software and hardware information and configuration status of each distributed environment, and can promptly discover and handle problems when the environment occurs, thereby improving environmental maintenance efficiency.

[0089] In an exemplary embodiment, after the multi-environment management page is displayed in step S102, the method may further include the following steps:

[0090] In response to a code testing operation triggered by a user on a multi-environment management page, a third environment object and test configuration information are determined from an environment object list, and a test object to be tested in a third target environment corresponding to the third environment object is determined according to the test configuration information; the code corresponding to the test object is obtained from a code repository, the code is constructed to obtain an executable application data packet corresponding to the test object, a test case is determined according to the test configuration information, the executable application data packet is tested according to the test case, and a test result is obtained; when the test result indicates that the test is passed, the executable application data packet is saved to an application storage module.

[0091] The application storage module is used to store each executable application data packet that has passed the test.

[0092] In a specific implementation, a user can trigger a code test operation on the multi-environment management page, wherein the code test operation represents a user request to perform relevant tests on a test object in a specified test environment. The code test operation may include an operation of selecting a test environment and an operation of determining a test object.

[0093] In response to the code test operation, the distributed storage environment management platform can determine the third environment object (such as the third environment object selected by the user) from the environment object list, and can obtain the test configuration information output by the user configuration. Then, the test object to be tested in the third target environment corresponding to the third environment object can be determined according to the test configuration information, and the code corresponding to the test object can be obtained from the code repository, and the code can be constructed and processed to obtain the executable application data packet corresponding to the test object. In addition, the test case can be determined according to the test configuration information, and then the executable application data packet can be tested according to the test case to obtain the test result. When the test result indicates that the test is passed, the executable application data packet can be saved to the application storage module.

[0094] For example, when testing, you can use the CI module in the distributed storage environment management platform to continuously integrate the code into the code base and perform automated building and testing. Figure 5 , CI module can realize various functions through the following modules:

[0095] (1) Configuration management module: This part contains the server configuration used for the build and the product code used for the configuration build. Create appropriate configuration files for different distributed storage environments (development, test, production) and use environment variables to dynamically load these configurations.

[0096] (2) Building modules: After completing the configuration management part, build the package when it is needed. This part is based on the written automated build scripts and the orchestration of the build process. For example, the written automation code can be converted into executable software programs or libraries through building modules.

[0097] (3) Smoke test module: After the build is completed, a smoke test consisting of one or more automated tests will be performed to ensure that the generated software package can work properly and avoid some basic problems. Among them, smoke testing can be used to verify whether the basic functions of the software can work properly without deeply testing every detail or edge case.

[0098] (4) Package management module: After the smoke test is completed, a software package is generated. This module configures the storage path and version number of the software package and controls which version the management user uses.

[0099] In this embodiment, the test and production environments that meet the requirements can be quickly screened for deployment, and the package output and test operations on the environment can be integrated through the distributed storage environment management platform, effectively improving the efficiency of distributed storage environment-based testing.

[0100] In one embodiment, in step S102, obtaining environment maintenance data for updating the first target environment includes:

[0101] A target executable application data packet for updating a first target environment corresponding to a first environment object is obtained from an application storage module; and environment maintenance data is obtained according to the executable application data packet.

[0102] In a specific implementation, the distributed storage environment management platform provided in the embodiment of the present application can be used to control the testing of the executable application data package used for environment upgrade and store it in the application storage module. Then, when the first target environment needs to be upgraded, the corresponding target executable application data package can be obtained from the application storage module, and the environment maintenance data can be obtained according to the executable application data package. For example, referring to Figure 3 The component upgrade module can communicate with the package management module. If it is a self-developed software package, you can directly select the target package (that is, the target executable application data package) from the package management module. The background will automatically download the target version package and upgrade the environment. If it is a third-party software package, you can upload it in this module and then upgrade it.

[0103] Compared with the situation in related technologies where each link such as package output, environment upgrade, and testing on the environment is separated from each other and requires manual operation separately, in this embodiment, a distributed storage environment management platform with integrated multiple functions can be provided. By connecting the steps of package output, environment upgrade, and testing on the environment through the distributed storage environment management platform, the complexity of maintaining the environment is reduced and the efficiency of storage testing is improved.

[0104] In one embodiment, testing the executable application data packet according to the test case to obtain the test result may include the following steps:

[0105] The executable application data package is tested according to the test cases to determine the total number of executed cases, the number of successful execution cases and the number of failed execution cases; the test results are displayed; the test results include the total number of executed cases, the number of successful execution cases and the number of failed execution cases when the test object is tested in a third target environment.

[0106] In the specific implementation, in the process of testing the executable application data package based on the test case, the total number of execution cases, the number of successful execution cases and the number of failed execution cases in the entire test process can be determined, and then the total number of execution cases, the number of successful execution cases and the number of failed execution cases can be displayed as test results.

[0107] In one embodiment, reference Figure 6 , the automated testing module in the distributed storage environment management platform can realize the automated testing function of the distributed storage environment. Through effective automated testing, the stability, reliability and security of the distributed storage system can be improved, while reducing the workload and error rate of manual testing. The automated testing module is mainly composed of the following modules:

[0108] (1) Test configuration module: First, configure the test object and test case according to the test configuration information input by the user, and select the environment that needs to be automated tested and the set of automated test cases.

[0109] (2) Automation code maintenance module: This module configures the pulling path of the automation code and updates the pulled automation code.

[0110] (3) Result push: Users can configure an email address for result push. After the automated test is completed, the test results will be automatically pushed to the configured email address. For example, the test results may include one or more information such as the total number of executed cases, the number of successful and failed cases, the start and end time of the execution, etc.

[0111] (4) Result display: After the automated test is completed, the test results can be displayed graphically in this module, including the total number of executed cases, the number of successful and failed cases, and can be displayed in table and pie chart form. In addition, by clicking on the failed case, you can view the corresponding detailed execution log for location.

[0112] In this embodiment, by displaying the test results including the total number of executed cases, the number of successfully executed cases, and the number of failed cases, the efficiency of the user's understanding of the test situation is improved.

[0113] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0114] Based on the same inventive concept, the embodiment of the present application also provides a data processing device based on a distributed storage environment for implementing the data processing method based on a distributed storage environment involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the one or more embodiments of the data processing device based on a distributed storage environment provided below can refer to the limitations of the data processing method based on a distributed storage environment above, and will not be repeated here.

[0115] In an exemplary embodiment, Figure 7 As shown, a data processing device based on a distributed storage environment is provided, which is applied to a distributed storage environment management platform, and the device includes:

[0116] A list generation module 701 is used to obtain an environment object list including multiple environment objects according to multiple environment configuration information entered into the distributed storage environment management platform;

[0117] A maintenance data acquisition module 702 is used to display a multi-environment management page, and in response to an environment maintenance operation triggered by a user on the multi-environment management page, determine a first environment object from the environment object list and acquire environment maintenance data for updating a first target environment corresponding to the first environment object;

[0118] The environment update module 703 is used to determine the distributed storage device corresponding to the first target environment, and update the first target environment in the distributed storage device according to the environment maintenance data, and update the environment object list accordingly according to the update result.

[0119] In one embodiment, the maintenance data acquisition module 702 is used to:

[0120] In response to a user selecting an environment object from the environment object list displayed on the multi-environment management page, determining a first environment object selected by the user from the environment object list;

[0121] or,

[0122] In response to an environment screening parameter input operation triggered by a user on the multi-environment management page, an environment object whose environment configuration information matches the environment screening parameter is determined from the environment object list as a first environment object.

[0123] In one embodiment, the device further includes a performance monitoring module, wherein the performance monitoring module is configured to:

[0124] In response to an environment monitoring operation triggered by a user on the multi-environment management page, determining a second environment object from the environment object list;

[0125] Determine a second target environment corresponding to the second environment object, and obtain resource usage of environment resources in the second target environment and performance information of the second target environment;

[0126] Based on the resource usage and the performance information, the environment monitoring result corresponding to the second target environment is displayed on the multi-environment management page.

[0127] In one embodiment, the device further comprises a testing module, wherein the testing module is configured to:

[0128] In response to a code test operation triggered by a user on the multi-environment management page, determining a third environment object from the environment object list and obtaining test configuration information, and determining a test object to be tested in a third target environment corresponding to the third environment object according to the test configuration information;

[0129] Obtaining the code corresponding to the test object from a code repository, constructing the code to obtain an executable application data packet corresponding to the test object, determining a test case according to the test configuration information, testing the executable application data packet according to the test case, and obtaining a test result;

[0130] When the test result indicates that the test is passed, the executable application data packet is saved to an application storage module; the application storage module is used to store each executable application data packet that has passed the test.

[0131] In one embodiment, the maintenance data acquisition module 702 is used to:

[0132] Acquire, from the application storage module, a target executable application data packet for updating a first target environment corresponding to the first environment object;

[0133] Environmental maintenance data is obtained according to the executable application data packet.

[0134] In one embodiment, the test module is used to:

[0135] Testing the executable application data packet according to the test case to determine the total number of executed cases, the number of successfully executed cases, and the number of failed cases;

[0136] Display test results; the test results include the total number of executed cases, the number of successfully executed cases, and the number of failed cases when the test object is tested in the third target environment.

[0137] Each module in the above-mentioned data processing device based on the distributed storage environment can be implemented in whole or in part by software, hardware and a combination thereof. Each of the above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0138] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Figure 8As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store environmental data of a distributed storage environment. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a data processing method based on a distributed storage environment is implemented.

[0139] Those skilled in the art will understand that Figure 8 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0140] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above-mentioned method embodiments when executing the computer program.

[0141] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0142] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0143] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0144] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0145] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0146] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A data processing method based on a distributed storage environment, characterized in that: Applied to a distributed storage environment management platform, the method includes: Obtaining an environment object list including multiple environment objects according to multiple environment configuration information entered into the distributed storage environment management platform; Displaying a multi-environment management page, and in response to an environment maintenance operation triggered by a user on the multi-environment management page, determining a first environment object from the environment object list and acquiring environment maintenance data for updating a first target environment corresponding to the first environment object; Determine the distributed storage device corresponding to the first target environment, and update the first target environment in the distributed storage device according to the environment maintenance data, and correspondingly update the environment object list according to the update result.

2. The method according to claim 1, characterized in that: In response to the environment maintenance operation triggered by the user on the multi-environment management page, determining the first environment object from the environment object list includes: In response to a user selecting an environment object from the environment object list displayed on the multi-environment management page, determining a first environment object selected by the user from the environment object list; or, In response to an environment screening parameter input operation triggered by a user on the multi-environment management page, an environment object whose environment configuration information matches the environment screening parameter is determined from the environment object list as a first environment object.

3. The method according to claim 1, characterized in that: After the multi-environment management page is displayed, it also includes: In response to an environment monitoring operation triggered by a user on the multi-environment management page, determining a second environment object from the environment object list; Determine a second target environment corresponding to the second environment object, and obtain resource usage of environment resources in the second target environment and performance information of the second target environment; Based on the resource usage and the performance information, the environment monitoring result corresponding to the second target environment is displayed on the multi-environment management page.

4. The method according to claim 1, characterized in that: After the multi-environment management page is displayed, it also includes: In response to a code test operation triggered by a user on the multi-environment management page, determining a third environment object from the environment object list and obtaining test configuration information, and determining a test object to be tested in a third target environment corresponding to the third environment object according to the test configuration information; Obtaining the code corresponding to the test object from a code repository, constructing the code to obtain an executable application data packet corresponding to the test object, determining a test case according to the test configuration information, testing the executable application data packet according to the test case, and obtaining a test result; When the test result indicates that the test is passed, the executable application data packet is saved to an application storage module; the application storage module is used to store each executable application data packet that has passed the test.

5. The method according to claim 4, characterized in that The acquiring of environment maintenance data for updating the first target environment corresponding to the first environment object includes: Acquire, from the application storage module, a target executable application data packet for updating a first target environment corresponding to the first environment object; Environmental maintenance data is obtained according to the executable application data packet.

6. The method according to claim 4, characterized in that The step of testing the executable application data packet according to the test case to obtain a test result includes: Testing the executable application data packet according to the test case to determine the total number of executed cases, the number of successfully executed cases, and the number of failed cases; Display test results; the test results include the total number of executed cases, the number of successfully executed cases, and the number of failed cases when the test object is tested in the third target environment.

7. A data processing device based on a distributed storage environment, characterized in that: Applied to a distributed storage environment management platform, the device comprises: A list generation module, used to obtain an environment object list including multiple environment objects according to multiple environment configuration information entered into the distributed storage environment management platform; a maintenance data acquisition module, configured to display a multi-environment management page, and in response to an environment maintenance operation triggered by a user on the multi-environment management page, determine a first environment object from the environment object list and acquire environment maintenance data for updating a first target environment corresponding to the first environment object; The environment update module is used to determine the distributed storage device corresponding to the first target environment, and update the first target environment in the distributed storage device according to the environment maintenance data, and update the environment object list accordingly according to the update result.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images