Detection method, device, medium and computing equipment for full-link stress testing data isolation
By using shadow technology in full-link pressure measurement, the pressure measurement data is stored in the database and buried in the point, the problem of difficulty in distinguishing pressure measurement data from real data is solved, and the efficiency and accuracy of automatic detection are achieved.
Patent Information
- Application Number
- CN202111413202.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-25
- Publication Date
- 2025-04-25
- Estimated Expiration
- 2041-11-25
AI Technical Summary
During the full-link pressure measurement process, insufficient offline resources are very different from the online environment, which leads to the failure of offline pressure measurement conclusions that cannot fully represent the online situation, and it is necessary to prevent the pressure measurement data from being confused with the real data, resulting in operational accidents.
By carrying an identifier in the pressure measurement request, the link node obtains the pressure measurement data when responding, and stores the data in the database of the data storage node based on shadow technology to bury the points to generate the buried point log.
It realizes automatic detection of whether the pressure test data is correctly isolated, replaces manual detection, saves costs, improves detection efficiency and accuracy, reduces system coupling, and ensures the integrity of link detection.
Smart Images

Figure CN114064504B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present disclosure relate to the field of stress testing technology. More specifically, the embodiments of the present disclosure relate to a detection method, device, medium and computing equipment for full-link stress testing data isolation. Background Art
[0002] This section is intended to provide a background or context to the embodiments of the disclosure that are recited in the claims. No description herein is admitted to be prior art by inclusion in this section.
[0003] Full-link stress testing refers to the process of stress testing the entire business chain by simulating massive user requests and data based on actual business scenarios and system environments.
[0004] At present, with the continuous expansion of the company's business and the continuous increase in user traffic, the scale of the entire business chain is also getting larger and larger, but the complexity problems that come with it are also increasing dramatically. Therefore, in order to ensure the stable operation of the business chain and improve the reliability of the entire business chain, various stability problems can usually be discovered based on full-link stress testing, such as whether the system resource usage is reasonable, whether there is a memory leak, and verifying the system performance bottleneck. Summary of the invention
[0005] In this context, embodiments of the present disclosure are intended to provide a detection method, apparatus, medium, and computing device for full-link stress testing data isolation.
[0006] In a first aspect of the embodiments of the present disclosure, a method for detecting isolation of full-link stress testing data is provided, including:
[0007] receiving a stress test request; wherein the stress test request includes an identifier corresponding to the stress test request;
[0008] In response to the identifier stored in the link context corresponding to the link node being the same as the identifier carried in the stress testing request, stress testing data is obtained and stored in the database corresponding to the data storage node based on shadow technology, so that the data storage node performs tracking based on the stored stress testing data and obtains tracking logs for detection.
[0009] In one embodiment of the present disclosure, the database comprises a relational database;
[0010] Further, storing the stress test data in a database corresponding to the data storage node based on the shadow technology includes:
[0011] Based on the shadow technology, the stress testing data is stored in a shadow table pre-configured in the relational database corresponding to the data storage node.
[0012] In one embodiment of the present disclosure, the database comprises a non-relational database;
[0013] Further, storing the stress test data in a database corresponding to the data storage node based on the shadow technology includes:
[0014] Based on the shadow technology, the stress testing data is stored in a pre-configured shadow key in the non-relational database corresponding to the data storage node.
[0015] In one embodiment of the present disclosure, the database includes a message queue;
[0016] Further, storing the stress test data in a database corresponding to the data storage node based on the shadow technology includes:
[0017] Based on the shadow technology, the stress testing data is stored in a shadow message body pre-configured in the message queue database corresponding to the data storage node.
[0018] In one embodiment of the present disclosure, the method further includes:
[0019] The link context is transferred to the next link node by means of a synchronous message, so that the next link node responds to the stress testing request.
[0020] In one embodiment of the present disclosure, the method further includes:
[0021] The link context is delivered to the message queue corresponding to the current link node in an asynchronous message manner, so that the next link node responds to the stress test request when it monitors a preset topic from the message body.
[0022] In one embodiment of the present disclosure, the method further includes:
[0023] Obtain the tracking point logs corresponding to the various link nodes, and upload them to the log server so that the log server can detect the tracking point logs.
[0024] In one embodiment of the present disclosure, the tracking log presets a standard data format, and the tracking log at least includes a field for indicating the stress testing data;
[0025] Furthermore, the detection of the tracking log includes:
[0026] In response to the field in the tracking log used to indicate the stress testing data being consistent with the preset standard data format, the detection is passed.
[0027] In a second aspect of the embodiments of the present disclosure, a detection device for full-link stress testing data isolation is provided, including:
[0028] A receiving module receives a stress test request; wherein the stress test request includes an identifier corresponding to the stress test request;
[0029] The storage module, in response to the identifier stored in the link context corresponding to the link node being the same as the identifier carried in the stress testing request, obtains stress testing data and stores the stress testing data in the database corresponding to the data storage node based on shadow technology, so that the data storage node performs point tracking based on the stored stress testing data and obtains a point tracking log for detection.
[0030] In a third aspect of the embodiments of the present disclosure, a computer-readable storage medium is provided; a computer instruction is stored on the storage medium, and when the instruction is executed by a processor, the steps of the method described below are implemented:
[0031] receiving a stress test request; wherein the stress test request includes an identifier corresponding to the stress test request;
[0032] In response to the identifier stored in the link context corresponding to the link node being the same as the identifier carried in the stress testing request, stress testing data is obtained and stored in the database corresponding to the data storage node based on shadow technology, so that the data storage node performs tracking based on the stored stress testing data and obtains tracking logs for detection.
[0033] In a fourth aspect of the embodiments of the present disclosure, there is provided a computing device, comprising:
[0034] A processor; and a memory for storing instructions executable by the processor;
[0035] The processor executes the executable instructions to implement the following steps:
[0036] receiving a stress test request; wherein the stress test request includes an identifier corresponding to the stress test request;
[0037] In response to the identifier stored in the link context corresponding to the link node being the same as the identifier carried in the stress testing request, stress testing data is obtained and stored in the database corresponding to the data storage node based on shadow technology, so that the data storage node performs tracking based on the stored stress testing data and obtains tracking logs for detection.
[0038] The above embodiments of the present disclosure have at least the following beneficial effects:
[0039] On the one hand, the data storage nodes connected by the link nodes perform tracking based on the stress test data to obtain tracking logs for automatic detection, which can replace manual detection of whether the stress test data is correctly isolated, greatly saving costs, improving the efficiency and accuracy of detection, and avoiding omissions. On the other hand, through the link context corresponding to the link node and the cooperation with the data storage node, the link node can realize automatic detection of data isolation without changing the original business logic, reducing the coupling of the system, ensuring the integrity of the link detection, and avoiding omissions. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] The above and other objects, features and advantages of the exemplary embodiments of the present disclosure will become readily understood by reading the detailed description below with reference to the accompanying drawings. In the accompanying drawings, several embodiments of the present disclosure are shown in an exemplary and non-limiting manner, in which:
[0041] Figure 1 A flowchart of a detection method for full-link stress testing data isolation according to an embodiment of the present disclosure is schematically shown;
[0042] Figure 2 A schematic diagram schematically shows a detection method for full-link stress testing data isolation according to an embodiment of the present disclosure;
[0043] Figure 3 A block diagram of a detection device for full-link stress testing data isolation according to an embodiment of the present disclosure is schematically shown;
[0044] Figure 4 A schematic diagram of a detection medium for full-link stress test data isolation according to an embodiment of the present disclosure is schematically shown;
[0045] Figure 5 A schematic diagram of an electronic device capable of implementing the above method according to an embodiment of the present disclosure is schematically shown.
[0046] In the drawings, the same or corresponding reference numerals represent the same or corresponding parts. DETAILED DESCRIPTION
[0047] The principles and spirit of the present disclosure will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are provided only to enable those skilled in the art to better understand and implement the present disclosure, and are not intended to limit the scope of the present disclosure in any way. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.
[0048] Those skilled in the art know that the embodiments of the present disclosure can be implemented as a system, device, equipment, method or computer-readable storage medium. Therefore, the present disclosure can be specifically implemented in the following forms, namely: complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.
[0049] According to an embodiment of the present disclosure, a detection method, apparatus, medium and computing device for full-link stress testing data isolation are proposed.
[0050] It should be understood herein that any number of elements in the drawings is for illustration rather than limitation, and any naming is only for distinction rather than having any limiting meaning.
[0051] The principle and spirit of the present disclosure are explained in detail below with reference to several representative embodiments of the present disclosure. SUMMARY OF THE INVENTION
[0053] The inventors found that when performing full-link stress testing, due to insufficient offline resources and great differences from the online environment, the offline stress testing conclusions cannot fully represent the online stress testing situation. Therefore, full-link stress testing is usually performed based on the online real environment. However, when performing full-link stress testing online, in order to prevent stress testing data from contaminating the user's real data and causing operational accidents, it is necessary to ensure that stress testing data is distinguished from the user's real data. Therefore, when performing full-link stress testing, it is necessary to isolate stress testing data.
[0054] In view of this, the present specification provides a technical solution for carrying an identifier corresponding to the stress test request in the stress test request during full-link stress testing, so that after receiving the stress test request, the link nodes in the full link respond that the identifier stored in the link context corresponding to the link node is the same as the identifier carried in the stress test request, thereby obtaining stress test data and storing the stress test data in a database corresponding to the data storage node connected to the link node based on shadow technology, so that the data storage node performs point tracking based on the stored stress test data and obtains a point tracking log for detection.
[0055] The core technical concept of this manual is:
[0056] When the stress test data is stored in the database corresponding to the data storage node based on the shadow technology, it is necessary to check the data in the database corresponding to each link node to further confirm whether the stress test data is correctly stored in the database. However, manual inspection is too time-consuming and laborious. Therefore, when the stress test data is stored in the data storage node, the stress test data can be embedded based on the stress test data to obtain the embedded log, so that the embedded log can be automatically detected later to determine whether the stress test data is correctly isolated.
[0057] Through the above technical solution, on the one hand, the data storage nodes connected by the link nodes perform point tracking based on the stress test data, and obtain the point tracking log for automatic detection, which can replace the manual detection of whether the stress test data is correctly isolated, greatly saving costs, improving the efficiency and accuracy of detection, and avoiding omissions. On the other hand, through the link context corresponding to the link node and the cooperation with the data storage node, the link node can realize automatic detection of data isolation without changing the original business logic, reducing the coupling of the system, ensuring the integrity of the link detection, and avoiding omissions.
[0058] After introducing the basic principles of the present disclosure, various non-limiting embodiments of the present disclosure are described in detail below.
[0059] Application Scenario Overview
[0060] In the process of implementing full-link stress testing, in order to be close to the real online environment and business scenarios, the entire system is usually stress-tested by simulating massive amounts of user data. The simulated user data is not the user data generated by the actual business, and is usually called stress testing data, also called shadow data.
[0061] However, although stress testing data is not real user data, it may also affect normal online business, such as business data analysis, report generation, and data auditing. Therefore, it is necessary to ensure that when performing full-link stress testing, the stress testing data and the real online user data are not confused.
[0062] Currently, when checking the correctness of stress test data, it is usually possible to manually confirm whether the stress test data carries a pre-set stress test tag to determine whether the stress test data is correctly isolated. However, manual detection methods take a long time, are inefficient, and are prone to omissions.
[0063] It should be noted that the above application scenarios are only shown to facilitate understanding of the spirit and principle of the present disclosure, and the embodiments of the present disclosure are not limited in this respect. On the contrary, the embodiments of the present disclosure can be applied to any applicable scenario.
[0064] Exemplary Methods
[0065] The technical concept of this specification will be described in detail below through specific embodiments.
[0066] The present disclosure aims to provide a technical solution for carrying an identifier corresponding to the stress testing request in the stress testing request during full-link stress testing, so that after receiving the stress testing request, the link nodes in the full link respond that the identifier stored in the link context corresponding to the link node is the same as the identifier carried in the stress testing request, thereby obtaining stress testing data and storing the stress testing data in a database corresponding to the data storage node connected to the link node based on the shadow technology, so that the data storage node performs tracking based on the stored stress testing data and obtains a tracking log for detection.
[0067] During implementation, a link node in the full link may receive a stress test request; wherein the stress test request includes an identifier corresponding to the stress test request; and the link node is connected to a data storage node.
[0068] Furthermore, in response to the identifier stored in the link context corresponding to the link node being the same as the identifier carried in the stress testing request, stress testing data can be obtained and stored in the database corresponding to the data storage node based on shadow technology, so that the data storage node can perform tracking based on the stored stress testing data and obtain tracking logs for detection.
[0069] Through the above technical solution, on the one hand, the data storage nodes connected by the link nodes perform point tracking based on the stress test data, and obtain the point tracking log for automatic detection, which can replace the manual detection of whether the stress test data is correctly isolated, greatly saving costs, improving the efficiency and accuracy of detection, and avoiding omissions. On the other hand, through the link context corresponding to the link node and the cooperation with the data storage node, the link node can realize automatic detection of data isolation without changing the original business logic, reducing the coupling of the system, ensuring the integrity of the link detection, and avoiding omissions.
[0070] See also Figure 1 , Figure 1 This is a flowchart of a detection method for full-link stress testing data isolation provided by an exemplary embodiment, the method comprising the following steps:
[0071] Step 101: Receive a stress test request.
[0072] The stress testing request includes an identifier corresponding to the stress testing request.
[0073] For example, a stress test request may be initiated from a stress test platform, and a stress test identifier corresponding to the stress test request may be carried in the stress test request. The identifier may be a unique ID corresponding to the stress test request, and different stress test requests may correspond to different IDs.
[0074] It is worth noting that before performing full-link stress testing, the link nodes in the full link need to be connected to the data storage nodes, and the data storage nodes corresponding to each link node are used to store the stress testing data.
[0075] Among them, the data storage node can be a middleware client, such as a MySQL client, a Redis client, a message queue client, etc.
[0076] In addition, each link node in the entire link holds a corresponding link context, and the link context is a data structure that contains a description of the link status and other information.
[0077] The link context may store an identifier corresponding to the stress test request and transmit it in the link, so that the identifier corresponding to the stress test request can be received on the entire link, thereby being able to identify the identifier carried in the stress test request and respond.
[0078] Step 102, in response to the identifier stored in the link context corresponding to the link node being the same as the identifier carried in the stress testing request, obtain stress testing data and store the stress testing data in the database corresponding to the data storage node based on shadow technology, so that the data storage node performs tracking based on the stored stress testing data and obtains tracking logs for detection.
[0079] In this embodiment, after the link node receives the stress testing request initiated by the stress testing platform, it can be determined whether the identifier corresponding to the stress testing request carried in the stress testing request is the same as the identifier stored in the link context.
[0080] If they are the same, the stress test request is responded to according to the link context, and the stress test data is obtained in a predetermined manner.
[0081] For example, the link node may be an application node, which responds to the stress test request according to the link context and obtains stress test data in a predetermined manner. The stress test data is different from the real data in that it will not affect the real business results of the application node.
[0082] The stress test data is obtained in a predetermined manner, and may be obtained by constructing the stress test data in a predetermined manner, or may be obtained by performing data migration on real business data in a predetermined manner.
[0083] For example, in order to simulate the real scenario more realistically, when data migration is performed in a predetermined manner to obtain stress testing data, the online data can be cleaned, sampled, offset, and other operations can be performed to obtain stress testing data. The obtained stress testing data has good completeness and high simulation degree.
[0084] The above stress test data can also be colored by adding special fields to facilitate subsequent detection.
[0085] For example, you can add a preset suffix to the stress testing data to distinguish it from the actual business data.
[0086] In addition, the stress testing data may also be prepared in advance according to the predetermined method, so that when the link node responds to the stress testing request according to the link context, the pre-prepared stress testing data is directly obtained.
[0087] Furthermore, the link node can store the stress test data in the database corresponding to the data storage node based on the shadow technology.
[0088] As mentioned above, when performing full-link stress testing, the most important thing is that the stress testing data cannot pollute the normal real business data. Therefore, it is necessary to make a mirror of the normal business library table for storage, that is, the shadow library table. The data storage node stores the data flow of the stress testing traffic in the shadow library table and the data flow of the normal business traffic in the normal business library table, thereby isolating the two types of traffic so that they do not affect each other.
[0089] The software and hardware configuration of the shadow table can be consistent with that of the normal business table, with the same structure, but different in purpose. It is only used to store stress testing data. This ensures that the real problems of the normal business table online are fully exposed during stress testing.
[0090] In addition, when naming the shadow library table, in order to distinguish it from the normal business library table, you can add a specific character prefix or suffix when configuring the shadow library table.
[0091] When isolating data, the types of databases corresponding to the data storage nodes are different, and the methods of storing stress test data in the databases corresponding to the data storage nodes based on shadow technology are also different.
[0092] In one embodiment shown, the database comprises a relational database;
[0093] Furthermore, the stress testing data may be stored in a shadow table pre-configured in the relational database corresponding to the data storage node based on the shadow technology.
[0094] For example, when the data storage node is a MySQL client, the corresponding database is a MySQL database, and shadow technology can be used to store the stress test data in a pre-configured shadow table in the MySQL database.
[0095] In another embodiment shown, the database comprises a non-relational database;
[0096] Furthermore, the stress testing data may be stored in a pre-configured shadow key in the non-relational database corresponding to the data storage node based on the shadow technology.
[0097] For example, when the data storage node is a Redis client, the corresponding database is a Redis database, and shadow technology can be used to store the stress test data in a pre-configured shadow key in the Redis database.
[0098] In yet another embodiment shown, the database includes a message queue;
[0099] Furthermore, the stress testing data may be stored in a shadow message body pre-configured in the message queue database corresponding to the data storage node based on the shadow technology.
[0100] For example, when the data storage node is a message queue client, the corresponding database is a message queue database, and the shadow technology can be used to store the stress testing data in a pre-configured message body in the message queue database.
[0101] After the current link node stores the stress test data in the database corresponding to the data storage node based on the shadow technology, the current link node can pass the link context to the next link node so that the next link node responds to the stress test request.
[0102] It should be noted that the link context is transferred in different ways depending on the type of database corresponding to the data storage node to which the link node is connected.
[0103] In one embodiment shown, the link context may be transferred to the next link node in the form of a synchronous message, so that the next link node responds to the stress testing request.
[0104] For example, when the database corresponding to the data storage node connected to the current node is a relational database or a non-relational database, the link context can be transferred to the next link node by synchronous messaging so that the next link node responds to the stress test request.
[0105] In another embodiment shown, the link context may be delivered to the message queue corresponding to the current link node in an asynchronous message manner, so that the next link node responds to the stress test request when it monitors a preset topic from the message body.
[0106] For example, when the database corresponding to the data storage node connected to the current node is a message queue database, the link context can be passed to the message queue corresponding to the current link node in an asynchronous message manner, so that the next link node can respond to the stress testing request when it listens to the preset topic from the message body.
[0107] Among them, Topics can be used to classify different business messages and implement message filtering. Multiple Topics can be created for the message queue, and different Topics can be used for different message types. For example, for a certain trading platform, order messages and payment messages belong to different business types of messages, and Topic_Order and Topic_Pay can be created respectively.
[0108] In the business chain, by listening to the topic in the message body, that is, subscribing to the Topic, the business structure can be made clear and efficiency can be improved.
[0109] In addition, under the same Topic, you can also create multiple message tags to further distinguish the message categories under the Topic. For example, order messages can be subdivided with different tags according to product categories, such as electrical appliances, men's clothing, women's clothing, cosmetics, etc.
[0110] Similarly, Tags are used as a further division of Topics, and Tags can also be subscribed to.
[0111] It should be noted that those skilled in the art are clear about how to subscribe to a Topic or a Tag, and it is achievable, so it will not be elaborated here.
[0112] In the above process, for each link node in the entire link, while obtaining the stress test data and storing it in the database corresponding to the data storage node based on the shadow technology, tracking can be performed based on the stored stress test data and a tracking log for detection can be obtained.
[0113] It should be noted that tracking refers to the relevant technology and implementation process for capturing, processing and sending specific user behaviors or events. It is a commonly used data collection method. The essence of tracking technology is to monitor events during the operation of software applications and judge and capture events that require attention when they occur.
[0114] For example, you can use client-side tracking to record user behaviors such as music playback time, click operations, etc.
[0115] In this embodiment, by monitoring the event that the data storage node stores stress test data in the database, tracking points can be performed according to the content of the stored stress test data to obtain tracking point logs for detection.
[0116] The format of the tracking log can be pre-configured. When generating the tracking log, the name of the stored stress test data is obtained as the field to be detected.
[0117] In one embodiment shown, the burial point logs corresponding to the respective link nodes may be obtained and uploaded to a log server so that the log server can detect the burial point logs.
[0118] For example, the tracking logs corresponding to each link node can be collected and uploaded to the log server for storage, and the log server can automatically detect the tracking logs based on the preset script.
[0119] In one embodiment shown, the tracking log presets a standard data format, and the tracking log at least includes a field for indicating the stress testing data.
[0120] For example, the standard data format of tracking logs may include the following fields:
[0121] UUID, used to indicate the identifier corresponding to the stress testing request;
[0122] Spanid, used to indicate the location of the log in the entire link;
[0123] Name, used to indicate the name of the link node;
[0124] Datetype, used to represent data types, such as MySQL, Redis, message queues, etc.;
[0125] Resource, used to represent the stored stress testing data;
[0126] Data, used to indicate data details.
[0127] Further, the detection may be passed in response to the field in the tracking log used to indicate that the stress testing data is consistent with the preset standard data format.
[0128] For example, assuming that all stress test data have shadow as a suffix, when performing automatic detection, it is necessary to determine whether the field used to indicate stress test data included in the preset standard data format of the tracking point log contains shadow. If so, the detection passes.
[0129] In addition, in order to better display the detection results, a visual interface can be provided based on automatic detection, and the nodes where data isolation errors occur can be marked to warn of the errors.
[0130] See also Figure 2 , Figure 2 It is a schematic diagram of a detection method for full-link stress testing data isolation provided by an exemplary embodiment.
[0131] like Figure 2As shown, the link nodes included in the full link are application A, application B, application C and application D respectively.
[0132] The data storage nodes connected above are respectively a MySQL client, a Redis client, a message queue client and a MySQL client.
[0133] Correspondingly, the shadow library tables constructed by the database corresponding to the above data storage node are shadow table, shadow key, shadow message body and shadow table respectively.
[0134] like Figure 2 As shown, the stress test request is initiated from the stress test platform.
[0135] When application A receives a stress test request, in response to application A identifying that the identifier in the link context is the same as the identifier in the stress test request, the stress test data is obtained and stored in the shadow table of the MySQL database corresponding to the MySQL client based on the shadow technology. At the same time, the MySQL client performs log embedding.
[0136] Application A calls the interface of application B and passes the link context to application B through synchronous messages, so that application B responds to the stress test request. When application B recognizes that the identifier in the link context is the same as the identifier in the stress test request, it obtains the stress test data and stores the stress test data in the shadow key of the Redis database corresponding to the Redis client based on the shadow technology. At the same time, the Redis client performs log embedding.
[0137] Application B calls the interface of application C and passes the link context to application C through synchronous messages, so that application C responds to the stress test request. When application C recognizes that the identifier in the link context is the same as the identifier in the stress test request, it obtains the stress test data and stores the stress test data in the shadow message body of the message queue database corresponding to the message queue client based on the shadow technology. At the same time, the message queue client performs log embedding.
[0138] Application D will subscribe to the shadow message body in the message queue. Therefore, when application C uses asynchronous messaging to pass the link context to the message queue corresponding to application C, application D will listen to the preset topic from the message body and respond to the stress test request. When application D recognizes that the identifier in the link context is the same as the identifier in the stress test request, it obtains the stress test data and stores the stress test data in the shadow table of the MySQL database corresponding to the MySQL client based on the shadow technology. At the same time, the MySQL client performs log embedding.
[0139] The above-mentioned tracking logs will be collected and uploaded to the log server, which will detect the tracking logs and finally display them visually.
[0140] For the specific process in the above process, please refer to the detailed description in the above method, which will not be repeated here.
[0141] In the above embodiments, on the one hand, the data storage nodes connected by the link nodes perform point tracking based on the stress test data to obtain the point tracking log for automatic detection, which can replace the manual detection of whether the stress test data is correctly isolated, greatly saving costs, improving the efficiency and accuracy of detection, and avoiding omissions. On the other hand, through the link context corresponding to the link node and the cooperation with the data storage node, the link node can realize automatic detection of data isolation without changing the original business logic, reducing the coupling of the system, ensuring the integrity of the link detection, and avoiding omissions.
[0142] Exemplary Devices
[0143] After introducing the method of the exemplary embodiment of the present disclosure, next, see Figure 3 , Figure 3 It is a block diagram of a detection device for full-link stress testing data isolation provided by an exemplary embodiment.
[0144] The implementation process of the functions and effects of each module in the following device is specifically described in the implementation process of the corresponding steps in the above method, which will not be repeated here. For the device embodiment, since it basically corresponds to the method embodiment, the relevant parts can be referred to the partial description of the method embodiment.
[0145] like Figure 3 As shown, the detection device 300 for full-link stress test data isolation may include: a receiving module 301 and a storage module 302. Among them:
[0146] The receiving module 301 is configured to receive a stress testing request; wherein the stress testing request includes an identifier corresponding to the stress testing request;
[0147] The storage module 302 is configured to obtain stress testing data and store the stress testing data in the database corresponding to the data storage node based on shadow technology in response to the identifier stored in the link context corresponding to the link node being the same as the identifier carried in the stress testing request, so that the data storage node performs tracking based on the stored stress testing data and obtains tracking logs for detection.
[0148] Among them, the detection device 300 for full-link stress testing data isolation is used for link nodes in the full link, and the link nodes are connected to data storage nodes.
[0149] In one embodiment, the database comprises a relational database;
[0150] The storage module 302 further:
[0151] Based on the shadow technology, the stress testing data is stored in a shadow table pre-configured in the relational database corresponding to the data storage node.
[0152] In one embodiment, the database comprises a non-relational database;
[0153] The storage module 302 further:
[0154] Based on the shadow technology, the stress testing data is stored in a pre-configured shadow key in the non-relational database corresponding to the data storage node.
[0155] In one embodiment, the database includes a message queue;
[0156] The storage module 302 further:
[0157] Based on the shadow technology, the stress testing data is stored in a shadow message body pre-configured in the message queue database corresponding to the data storage node.
[0158] In one embodiment, the apparatus 300 further includes:
[0159] The first transmission module 303 transmits the link context to the next link node by means of a synchronous message, so that the next link node responds to the stress testing request.
[0160] In one embodiment, the apparatus 300 further includes:
[0161] The second transmission module 304 transmits the link context to the message queue corresponding to the current link node in an asynchronous message manner, so that the next link node responds to the stress testing request when it monitors a preset topic from the message body.
[0162] In one embodiment, the apparatus 300 further includes:
[0163] The uploading module 305 obtains the tracking point logs corresponding to the respective link nodes and uploads the tracking point logs to the log server so that the log server can detect the tracking point logs.
[0164] In one embodiment, the tracking log presets a standard data format, and the tracking log at least includes a field for indicating the stress testing data;
[0165] The detection of the tracking log includes:
[0166] In response to the field in the tracking log used to indicate the stress testing data being consistent with the preset standard data format, the detection is passed.
[0167] The specific details of each module of the above-mentioned full-link stress testing data isolation detection device 300 have been described in detail in the previous description of the full-link stress testing data isolation detection method process, so they will not be repeated here.
[0168] It should be noted that although several modules or units of the detection device 300 for full-link stress measurement data isolation are mentioned in the above detailed description, this division is not mandatory. In fact, according to an embodiment of the present disclosure, the features and functions of two or more modules or units described above can be concretized in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units to be concretized.
[0169] Exemplary Media
[0170] After introducing the apparatus of the exemplary embodiment of the present disclosure, next, see Figure 4 , Figure 4 It is a schematic diagram of a detection medium for full-link stress testing data isolation provided by an exemplary embodiment.
[0171] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible embodiments, various aspects of the present disclosure may also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to perform the steps according to various exemplary embodiments of the present disclosure described in the above "Exemplary Method" section of the present specification.
[0172] refer to Figure 4 As shown, a readable storage medium 40 for implementing the above method according to an embodiment of the present disclosure is described, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the readable storage medium of the present disclosure is not limited thereto. In this document, the readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.
[0173] The readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0174] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.
[0175] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.
[0176] Program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).
[0177] Exemplary Computing Devices
[0178] After introducing the method, medium and apparatus of the exemplary embodiments of the present disclosure, see Figure 5 , Figure 5 It is a schematic diagram of an electronic device provided by an exemplary embodiment that can implement the above-mentioned full-link stress testing data isolation detection method.
[0179] Refer to the following Figure 5 hereinafter describes an electronic device 500 according to such an embodiment of the present disclosure. Figure 5 The electronic device 500 shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0180] like Figure 5 As shown, the electronic device 500 is in the form of a general computing device. The components of the electronic device 500 may include but are not limited to: at least one processing unit 501, at least one storage unit 502, and a bus 503 connecting different system components (including the storage unit 502 and the processing unit 501).
[0181] The storage unit stores program codes, and the program codes can be executed by the processing unit 501, so that the processing unit 501 executes the steps of the above-mentioned various embodiments of this specification.
[0182] The storage unit 502 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 5021 and / or a cache storage unit 5022 , and may further include a read-only storage unit (ROM) 5023 .
[0183] The storage unit 502 may also include a program / utility 5024 having a set (at least one) of program modules 5025, such program modules 5025 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include the reality of a network environment.
[0184] Bus 503 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
[0185] The electronic device 500 may also communicate with one or more external devices 504 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 500, and / or may communicate with any device that enables the electronic device 500 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 505. Furthermore, the electronic device 500 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via a network adapter 506. As shown, the network adapter 506 communicates with other modules of the electronic device 500 via a bus 503. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 500, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.
[0186] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the embodiment of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiment of the present disclosure.
[0187] It should be noted that, although several units / modules or subunits / modules of the device are mentioned in the above detailed description, this division is merely exemplary and not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more units / modules described above can be embodied in one unit / module. Conversely, the features and functions of one unit / module described above can be further divided into multiple units / modules to be embodied.
[0188] In addition, although the operations of the disclosed method are described in a specific order in the drawings, this does not require or imply that the operations must be performed in this specific order, or that all the operations shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.
[0189] Although the spirit and principle of the present disclosure have been described with reference to several specific embodiments, it should be understood that the present disclosure is not limited to the disclosed specific embodiments, and the division of various aspects does not mean that the features in these aspects cannot be combined to benefit, and such division is only for the convenience of expression. The present disclosure is intended to cover various modifications and equivalent arrangements included in the spirit and scope of the attached claims.
Claims
1. A detection method for full-link stress testing data isolation, used for link nodes in the full link, the link nodes are connected to data storage nodes, and each link node in the full link holds a corresponding link context; The link context stores an identifier corresponding to the stress test request; the method includes: receiving a stress test request; wherein the stress test request includes an identifier corresponding to the stress test request; In response to the identifier stored in the link context corresponding to the link node being the same as the identifier carried in the stress test request, the stress test data is obtained and stored in the database corresponding to the data storage node based on the shadow technology, so that the data storage node performs point tracking based on the stored stress test data and obtains a point tracking log for automatic detection; wherein the point tracking log is used to determine whether the stress test data is correctly isolated; Among them, after the current link node stores the stress testing data in the database corresponding to the data storage node based on the shadow technology, the current link node transfers the link context to the next link node so that the next link node responds to the stress testing request.
2. The method according to claim 1, wherein the database comprises a relational database; The storing the stress test data in a database corresponding to the data storage node based on the shadow technology includes: Based on the shadow technology, the stress testing data is stored in a shadow table pre-configured in the relational database corresponding to the data storage node.
3. The method according to claim 1, wherein the database comprises a non-relational database; The storing the stress test data in a database corresponding to the data storage node based on the shadow technology includes: Based on the shadow technology, the stress testing data is stored in a pre-configured shadow key in the non-relational database corresponding to the data storage node.
4. The method according to claim 1, wherein the database comprises a message queue; The storing the stress test data in a database corresponding to the data storage node based on the shadow technology includes: Based on the shadow technology, the stress testing data is stored in a shadow message body pre-configured in the message queue database corresponding to the data storage node.
5. The method according to claim 2 or 3, further comprising: The link context is transferred to the next link node by means of a synchronous message, so that the next link node responds to the stress testing request.
6. The method according to claim 4, further comprising: The link context is delivered to the message queue corresponding to the current link node in an asynchronous message manner, so that the next link node responds to the stress test request when it monitors a preset topic from the message body.
7. The method according to claim 1, further comprising: Obtain the tracking point logs corresponding to the various link nodes, and upload them to the log server so that the log server can detect the tracking point logs.
8. According to the method of claim 7, the tracking log presets a standard data format, and the tracking log at least includes a field for indicating the stress test data; Check the tracking logs, including: In response to the field in the tracking log used to indicate the stress testing data being consistent with the preset standard data format, the detection is passed.
9. A detection device for full-link stress test data isolation, used for link nodes in the full link, the link nodes are connected to data storage nodes, and each link node in the full link holds a corresponding link context; The link context stores an identifier corresponding to the stress test request; the device includes: A receiving module receives a stress test request; wherein the stress test request includes an identifier corresponding to the stress test request; A storage module, in response to the identifier stored in the link context corresponding to the link node being the same as the identifier carried in the stress test request, obtains stress test data and stores the stress test data in a database corresponding to the data storage node based on shadow technology, so that the data storage node performs point tracking based on the stored stress test data and obtains a point tracking log for automatic detection; wherein the point tracking log is used to determine whether the stress test data is correctly isolated; Among them, after the current link node stores the stress testing data in the database corresponding to the data storage node based on the shadow technology, the current link node transfers the link context to the next link node so that the next link node responds to the stress testing request.
10. The apparatus according to claim 9, wherein the database comprises a relational database; The storage module further: Based on the shadow technology, the stress testing data is stored in a shadow table pre-configured in the relational database corresponding to the data storage node.
11. The apparatus according to claim 9, wherein the database comprises a non-relational database; The storage module further: Based on the shadow technology, the stress testing data is stored in a pre-configured shadow key in the non-relational database corresponding to the data storage node.
12. The apparatus according to claim 9, wherein the database comprises a message queue; The storage module further: Based on the shadow technology, the stress testing data is stored in a shadow message body pre-configured in the message queue database corresponding to the data storage node.
13. The device according to claim 10 or 11, further comprising: The first transmission module transmits the link context to the next link node by means of a synchronous message, so that the next link node responds to the stress testing request.
14. The apparatus according to claim 12, further comprising: The second transmission module uses an asynchronous message to transmit the link context to the message queue corresponding to the current link node, so that the next link node responds to the stress testing request when it monitors a preset topic from the message body.
15. The apparatus according to claim 9, further comprising: The uploading module obtains the tracking point logs corresponding to the respective link nodes and uploads them to the log server so that the log server can detect the tracking point logs.
16. The device according to claim 15, wherein the tracking log presets a standard data format, and the tracking log at least includes a field for indicating the stress test data; Check the tracking logs, including: In response to the field in the tracking log used to indicate the stress testing data being consistent with the preset standard data format, the detection is passed.
17. A computer-readable storage medium having computer instructions stored thereon, which, when executed by a processor, implement the steps of the method according to any one of claims 1 to 8.
18. A computing device comprising: processor; a memory for storing processor-executable instructions; The processor implements the method according to any one of claims 1 to 8 by running the executable instructions.
Citation Information
Patent Citations
Log processing method and device, mobile terminal and storage medium
CN109862379A
Buried point test method and device, buried point management system and storage medium
CN111813655A
Full-link pressure measurement assembly, full-link pressure measurement method and device
CN112615759A