Business test method and device for migration of storage system
By performing regression testing, diff testing and upload performance comparison testing after the node migration of the object storage system, the problem of inaccurate testing in the existing technology is solved, and a comprehensive evaluation of the impact of node migration of the object storage system is achieved, improving the accuracy of the test degree and user experience.
Patent Information
- Application Number
- CN202411411404.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-10
- Publication Date
- 2024-12-27
AI Technical Summary
In the existing technology, when the object storage system nodes are migrated as a whole, the test cannot consider multiple dimensions from the overall perspective, resulting in the inaccurate test results and the impact of migration on the upper-level network storage services cannot be accurately evaluated.
Provide a business test method for storage system migration, including regression testing, diff testing and upload performance comparison testing after the object storage system node is migrated, and randomly select online users to compare data, evaluate the availability, completeness and Service performance.
It extends the comprehensiveness of the test, improves the accuracy of the test, ensures that users have basically no perception of the migration of the underlying object storage service, and can comprehensively evaluate the impact of the migration on the functions and business services of the upper layer.
Smart Images
Figure CN119201743A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computers, and in particular to a storage system migration service testing method and electronic equipment. Background Art
[0002] With the rapid development of the Internet and the explosive growth of data volume, traditional local storage methods can no longer meet the needs of enterprises and individuals for massive data processing. Therefore, network storage services came into being and gradually became an important part of the field of modern information technology.
[0003] Network storage service refers to a service mode that stores user files or data on a remote server through the network. From a technical perspective, network storage service involves multiple levels of knowledge and technical support. For example, high-performance server equipment is required as a supporting platform, especially the deployment of advanced object storage systems to store user file data information.
[0004] Therefore, the object storage system is the core and basic system of the network storage service. All the storage, viewing, sharing, and operation of files in various formats such as documents, videos, and pictures are based on this file storage system. The object storage system is relatively stable after construction, and is generally used to expand the system by deploying new storage nodes. The overall migration of object storage system nodes rarely occurs. However, if the object storage system nodes are migrated as a whole, it will directly affect the technical foundation of the upper-level network storage service, thereby affecting the stability, availability, data completeness, and many other aspects of the business products; however, the current tests for the overall migration of object storage system nodes are either only for the object storage system itself or only for business services. There is no overall test that can consider multiple dimensions from a holistic perspective, so it is impossible to give accurate test results, and the accuracy of the test is insufficient.
[0005] In view of the above problems, a service testing method and electronic device for storage system migration of the present application are proposed. Summary of the invention
[0006] In order to address the deficiencies of the prior art, the present application provides a business testing method for storage system migration, which solves the problems in the prior art that either only business services are tested, there is no overall test that can consider multiple dimensions from a holistic perspective, accurate test results cannot be given, and the test accuracy is insufficient.
[0007] The technical effects to be achieved by this application are achieved through the following solutions: In a first aspect, the present application provides a storage system migration service testing method, comprising: S1. After data migration of the object storage system nodes, a regression test related to the functions of the storage system is performed on the front-end APP for the new nodes and the old nodes. The regression test is used to verify the file management function of the stock data and the incremental data, and obtain the regression test result. The regression test result is used to determine the availability of the data migration. S2. Perform a diff test on the data of the new node and the data of the old node, where the diff test is used to determine the completeness of the data migration; S3. Determine a plurality of online users by random sampling, wherein the online users have corresponding data, wherein the corresponding data includes the data of the new node and the data of the corresponding old node, and perform the diff test of step S2 on the corresponding data; S4. Perform a comparative test on upload performance for the new node and the old node. The comparative test is performed by simulating user access by calling an upload interface using an interface call function. The comparative test is used to determine the service performance of data migration.
[0008] In some embodiments, the file management functions include file upload, file download, file query, and file deletion.
[0009] In some embodiments, performing a diff test on the data of the new node and the data of the old node includes: Select multiple test accounts that meet the requirements; On the new node and the old node, respectively, export data information corresponding to the test account from the object storage system, the data information including the total number of files, the total space occupied by the files, the file names, and a detailed list of occupied space; Performing diff comparison on the data information item by item to obtain comparison results; The completeness of the data migration is determined based on the comparison result.
[0010] In some embodiments, the comparative test comprises: Use large files to upload concurrently to test node bandwidth; Use small files to download concurrently to test node throughput.
[0011] In some embodiments, the node bandwidth indicators include: uploaded file size, average upload bandwidth, and maximum upload bandwidth.
[0012] In some embodiments, the uploaded file size = the upload segment size per thread * the number of concurrent connections; The average upload bandwidth = upload file size / upload time; The maximum upload bandwidth is the maximum bandwidth monitored during the upload process.
[0013] In some embodiments, the testing node throughput by concurrently downloading small files includes: Download a small file in each thread of the batch thread and record the completion time of the batch thread; Node throughput = number of concurrent requests / completion time.
[0014] In some embodiments, the impact of data migration of the object storage system node on upper-layer user functions and business services is determined based on the availability of data migration, the completeness of data migration, and the service performance of data migration.
[0015] In a second aspect, the present application provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any one of the methods described above when executing the computer program.
[0016] In a third aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement any of the methods described above.
[0017] Through the business testing method and electronic device for storage system migration provided in the embodiments of the present application, the method tests the overall migration of object storage system nodes in the storage service in terms of availability, correctness, data completeness, service performance, etc., to determine the impact of the overall migration on upper-level user functions and business services, thereby expanding the comprehensiveness of the test, improving the accuracy of the test, and ensuring that users are basically unaware of the overall migration of the underlying object storage service. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] In order to more clearly illustrate the embodiments of the present application or the existing technical solutions, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0019] Figure 1 A flowchart of a service testing method for storage system migration in an embodiment of the present application; Figure 2 It is a schematic block diagram of an electronic device in an embodiment of the present application. DETAILED DESCRIPTION
[0020] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.
[0021] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in one or more embodiments of the present application should be understood by people with ordinary skills in the field to which the present application belongs. The "first", "second" and similar words used in one or more embodiments of the present application do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprise" and similar words mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.
[0022] In the related art, network storage service refers to a service mode that stores user files or data on a remote server through the network. This service mode has many advantages: first, it can provide a large capacity of data storage space, so that users do not need to worry about insufficient hard disk space; second, because the data is stored on the network, it can be accessed anytime and anywhere, greatly improving work efficiency and convenience; in addition, network storage also has good security and stability, and usually adopts multiple backup mechanisms to ensure the security and reliability of data.
[0023] From a technical perspective, network storage services involve knowledge and technical support at multiple levels. For example, high-performance server equipment is required as a supporting platform, especially the deployment of advanced object storage systems to save user file data information. Therefore, the object storage system is the core and basic system of the network storage service. All file storage, viewing, sharing, and operations in various formats such as documents, videos, and pictures are based on this file storage system. After the object storage system is built, it is relatively stable, and new storage nodes are generally deployed for system expansion. The overall migration of object storage system nodes rarely occurs. However, if the object storage system nodes are migrated as a whole, it will directly affect the technical foundation of the upper-level network storage service, thereby affecting the stability, availability, data completeness, and many other aspects of the business products. Therefore, a test verification method is needed to evaluate the impact of the migration plan on the business.
[0024] On the one hand, the relevant technologies are only tested on the object storage system itself. Generally, the object storage system itself is tested with relevant special tests, such as performance test, security test, reliability test, etc. Therefore, the test results are the properties of the object storage system itself, which are usually independent of the upper-layer business and cannot evaluate the impact of the object storage system node migration on the upper-layer business network storage service.
[0025] On the other hand, the relevant technology is only aimed at testing upper-level business services. Generally, the upper-level business services, that is, the business functions of network storage, are tested, such as file upload, image viewing, AI services and other user-oriented C-end functions; therefore, the test results are the availability, ease of use or other related indicators of user functions. The test objects of this technology may not cover the underlying object storage system, so it is impossible to test the impact of object storage system node migration on business services.
[0026] The present application is used to implement a testing method for the impact of overall migration of object storage system nodes in a network storage service on upper-level user functions and business services.
[0027] Various non-limiting implementations of the present application are described in detail below in conjunction with the accompanying drawings.
[0028] First, refer to Figure 1 , the business testing method of the storage system migration of this application is described in detail: In a first aspect, the present application provides a storage system migration service testing method, comprising: S1. After data migration of the object storage system nodes, a regression test related to the functions of the storage system is performed on the front-end APP for the new nodes and the old nodes. The regression test is used to verify the file management function of the stock data and the incremental data, and obtain the regression test result. The regression test result is used to determine the availability of the data migration. S2. Perform a diff test on the data of the new node and the data of the old node, wherein the diff test is used to determine the completeness of the data migration; wherein the new node represents the destination node to which the data is migrated, and the old node represents the original node from which the data is migrated, and both the destination node and the original node belong to the object storage system node.
[0029] S3. Determine a plurality of online users by random sampling, wherein the online users have corresponding data, wherein the corresponding data includes the data of the new node and the data of the corresponding old node, and perform the diff test of step S2 on the corresponding data; Specifically, step S3 is to expand the user surface of the stock data comparison test, thereby expanding the diversity of the stock data for the comparison test. By randomly selecting one or more online users, repeating step S2 for the stock data of these users to perform a diff test; this step verifies the completeness and potential problems of data migration from the perspective of the richness of stock data.
[0030] S4. Perform a comparative test on upload performance for the new node and the old node. The comparative test is performed by simulating user access by calling an upload interface using an interface call function. The comparative test is used to determine the service performance of data migration.
[0031] In some embodiments, the file management functions include file upload, file download, file query, and file deletion.
[0032] Specifically, step S1 is a comparative test of the file management functions of the new node and the old node.
[0033] Exemplarily, after the object storage system node completes data migration, the functions related to the storage system are regression tested on the front-end APP to verify the basic management functions of existing and incremental data files, such as uploading, downloading, querying, and deleting files, from the perspective of user-oriented functions. This step systematically verifies the correctness and availability of the service from the basic business function level.
[0034] In some embodiments, performing a diff test on the data of the new node and the data of the old node includes: Select multiple test accounts that meet the requirements; On the new node and the old node, respectively, export data information corresponding to the test account from the object storage system, the data information including the total number of files, the total space occupied by the files, the file names, and a detailed list of occupied space; Performing diff comparison on the data information item by item to obtain comparison results; The completeness of the data migration is determined based on the comparison result.
[0035] Specifically, the multiple test accounts selected in the diff test in step S2 may be accounts of a specified user, that is, a diff test of the stock data of the specified user on the new node and the old node is completed.
[0036] Exemplarily, after the data migration of the object storage system node, a diff test is performed on the data of the new node and the data of the old node. Through daily testing and use, the tester has accumulated a sufficient number of files in different formats in the online service, such as different types of pictures, videos, audios, documents, etc., which meet the basic requirements of the stock data comparison test. Select multiple test accounts that meet the conditions, and export the data information of the test accounts from the object storage system in the new node and the old node respectively, including the total number of files, the total size of the space occupied by the files, the file name and the detailed list of the occupied space, and perform a diff comparison on the data item by item to compare whether the total number and the detailed list are consistent, so as to preliminarily verify the completeness of the data migration from the stock data level.
[0037] Specifically, step S4 is to perform a comparative test of the upload performance of the new node and the old node.
[0038] For example, since different network storage nodes have different configurations in terms of network bandwidth and machine performance, they have a significant impact on the upper-layer network storage services. When it is impossible to directly evaluate node performance, an indirect evaluation is mainly performed through an upload performance comparison test. The comparison test mainly includes testing node bandwidth using concurrent uploads of large files and testing node throughput using concurrent downloads of small files; the test is mainly performed by using an interface call function to call the upload interface to simulate user access.
[0039] In some embodiments, the comparative test comprises: Use large files to upload concurrently to test node bandwidth; Use small files to download concurrently to test node throughput.
[0040] In some embodiments, the node bandwidth indicators include: uploaded file size, average upload bandwidth, and maximum upload bandwidth.
[0041] In some embodiments, the uploaded file size = uploaded segment size per thread * concurrent number; that is, uploaded file size (totalSize) = uploaded segment size per thread (partitionSize) * concurrent number (threadNum).
[0042] The average upload bandwidth = upload file size / upload time; that is, the average upload bandwidth (averageBandwidth) = (upload file size (totalSize) / upload time (t).
[0043] The maximum upload bandwidth is the maximum bandwidth monitored during the upload process, that is, the maximum upload bandwidth (maxBandwidth) = the maximum bandwidth monitored during the upload process.
[0044] In some embodiments, the testing node throughput by concurrently downloading small files includes: Download a small file in each thread of the batch thread and record the completion time of the batch thread; Node throughput (or download throughput) = number of concurrent requests / completion time, that is, number of concurrent requests (threadNum) / time (t).
[0045] Specifically, during the test, you can adjust factors such as concurrency, file size, and upload segment size to test the bandwidth and throughput of different scenarios; For example, under the same number of concurrent connections, a small sharding solution may have better upload bandwidth than a large sharding solution. This step verifies the performance of the node after migration from the upload service level, where the network storage service performance is prone to bottleneck problems. Generally, the performance of the service after migration is required to be no lower than that of the old node.
[0046] In some embodiments, the impact of data migration of the object storage system node on upper-layer user functions and business services is determined based on the availability of data migration, the completeness of data migration, and the service performance of data migration.
[0047] Through the business testing method and electronic device for storage system migration provided in the embodiments of the present application, the method tests the overall migration of object storage system nodes in the storage service in terms of availability, correctness, data completeness, service performance, etc., to determine the impact of the overall migration on upper-level user functions and business services, thereby expanding the comprehensiveness of the test, improving the accuracy of the test, and ensuring that users are basically unaware of the overall migration of the underlying object storage service.
[0048] It should be noted that the method of one or more embodiments of the present application can be performed by a single device, such as a computer or server. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of one or more embodiments of the present application, and the multiple devices will interact with each other to complete the described method.
[0049] It should be noted that the above describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0050] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present application also discloses an electronic device; Specifically, Figure 2 A schematic diagram of the hardware structure of an electronic device for a service test method for storage system migration provided in this embodiment is shown, and the device may include: a processor 410, a memory 420, an input / output interface 430, a communication interface 440, and a bus 450. The processor 410, the memory 420, the input / output interface 430, and the communication interface 440 are connected to each other in communication within the device through the bus 450.
[0051] The processor 410 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application.
[0052] The memory 420 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 420 may store an operating system and other application programs. When the technical solution provided in the embodiment of the present application is implemented by software or firmware, the relevant program code is stored in the memory 420 and is called and executed by the processor 410.
[0053] The input / output interface 430 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.
[0054] The communication interface 440 is used to connect a communication module (not shown in the figure) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (for example, USB, network cable, etc.) or a wireless mode (for example, mobile network, WIFI, Bluetooth, etc.).
[0055] The bus 450 includes a path that transmits information between the various components of the device (eg, the processor 410 , the memory 420 , the input / output interface 430 , and the communication interface 440 ).
[0056] It should be noted that, although the above device only shows the processor 410, the memory 420, the input / output interface 430, the communication interface 440 and the bus 450, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiment of the present application, and does not necessarily include all the components shown in the figure.
[0057] The electronic device of the above embodiment is used to implement the corresponding service test method of storage system migration in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.
[0058] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, one or more embodiments of the present application also provide a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the business testing method for storage system migration as described in any of the above embodiments.
[0059] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.
[0060] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the service testing method for storage system migration as described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.
[0061] A person skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application (including the claims) is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of different aspects of one or more embodiments of the present application as described above, which are not provided in detail for the sake of simplicity.
[0062] In addition, to simplify the description and discussion, and in order not to make one or more embodiments of the present application difficult to understand, the well-known power / ground connections to the integrated circuit (IC) chip and other components may or may not be shown in the provided figures. In addition, the device may be shown in the form of a block diagram to avoid making one or more embodiments of the present application difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which one or more embodiments of the present application will be implemented (that is, these details should be fully within the scope of understanding of those skilled in the art). Where specific details (e.g., circuits) are set forth to describe exemplary embodiments of the present application, it is obvious to those skilled in the art that one or more embodiments of the present application can be implemented without these specific details or with changes in these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.
[0063] Although the present application has been described in conjunction with specific embodiments of the present application, many alternatives, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the discussed embodiments.
[0064] One or more embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of one or more embodiments of the present application should be included in the scope of protection of the present application.
Claims
1. A storage system migration service testing method, characterized in that: The method comprises: S1. After the data migration of the object storage system nodes, a regression test related to the functions of the storage system is performed on the front-end APP for the new nodes and the old nodes. The regression test is used to verify the file management function of the stock data and the incremental data, and obtain the regression test result. The regression test result is used to determine the availability of the data migration; S2. Perform a diff test on the data of the new node and the data of the old node, where the diff test is used to determine the completeness of the data migration; S3. Determine a plurality of online users by random sampling, wherein the online users have corresponding data, wherein the corresponding data includes the data of the new node and the data of the corresponding old node, and perform the diff test of step S2 on the corresponding data; S4. Perform a comparative test on upload performance for the new node and the old node. The comparative test is performed by simulating user access by calling an upload interface using an interface call function. The comparative test is used to determine the service performance of data migration.
2. The service testing method for storage system migration according to claim 1, characterized in that: The file management functions include file upload, file download, file query, and file deletion.
3. The service testing method for storage system migration according to claim 2, characterized in that: The diff test on the data of the new node and the data of the old node includes: Select multiple test accounts that meet the requirements; On the new node and the old node, respectively, export the data information corresponding to the test account from the object storage system, the data information including the total number of files, the total space occupied by the files, the file names and the detailed list of occupied space; Performing diff comparison on the data information item by item to obtain comparison results; The completeness of the data migration is determined based on the comparison result.
4. The service testing method for storage system migration according to claim 1, characterized in that: The comparative tests include: Use large files to upload concurrently to test node bandwidth; Use small files to download concurrently to test node throughput.
5. The service testing method for storage system migration according to claim 4, characterized in that: The node bandwidth indicators include: uploaded file size, average upload bandwidth, and maximum upload bandwidth.
6. The service testing method for storage system migration according to claim 5, characterized in that: The uploaded file size = upload fragment size per thread * concurrent number; The average upload bandwidth = upload file size / upload time; The maximum upload bandwidth is the maximum bandwidth monitored during the upload process.
7. The service testing method for storage system migration according to claim 5, characterized in that: The node throughput test using concurrent download of small files includes: Download a small file in each thread of the batch thread and record the completion time of the batch thread; Node throughput = number of concurrent requests / completion time.
8. The service testing method for storage system migration according to any one of claims 1 to 7, characterized in that: The impact of data migration of object storage system nodes on upper-layer user functions and business services is determined based on the availability, completeness and service performance of data migration.
9. An electronic device, comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method according to any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the method according to any one of claims 1 to 7.