Testing method, device and equipment for international freight rate testing data and medium

Abstract

The invention is suitable for the technical field of civil aviation, and discloses a test method, device and equipment for international freight rate test data and a medium, and the method comprises the steps: obtaining first test data and second test data based on a token bucket algorithm and a sampling method; storing the first test data and the second test data in a local database; based on an accuracy index, comparing and analyzing the first test data and the second test data to obtain accuracy data corresponding to the accuracy index; and determining a test result of the international freight rate test data based on the accuracy rate data corresponding to the accuracy rate index. According to the technical scheme, comprehensive benchmarking verification is carried out on key indexes of the international freight rate cache product and the standard search system, and the data cache efficiency of the international freight rate search cache product and high accuracy and reliability of result data of the international freight rate search cache product are powerfully guaranteed.

Description

Technical Field

[0001] The present invention relates to the field of civil aviation technology, and in particular to a method, device, equipment and medium for testing international freight rate test data. Background Art

[0002] With the rapid progress of computer science and technology and the deepening of global informatization, the demand for data processing speed and response capabilities in all walks of life is constantly increasing. Especially in the context of the big data era, the complexity of business systems and the rapid growth of data volume have made traditional data query and processing methods face severe challenges. Therefore, in order to improve data access efficiency, reduce latency, and ensure business continuity and user experience, various advanced cache search technologies have emerged.

[0003] The international freight rate search cache product was launched in 2021, but there are currently no verification tools for key indicators such as the overall cache accuracy, cabin change rate accuracy, and price change rate accuracy compared with the international freight rate search cache product and the international standard search system, making it impossible to verify the authenticity and accuracy of the system's cache data. Summary of the invention

[0004] To solve the above problems, the present invention provides a testing method, device, equipment and medium for international freight rate test data, which realizes a comprehensive benchmarking verification of key indicators of international freight rate cache products and standard search systems, and effectively guarantees the data caching efficiency of international freight rate search cache products and the high accuracy and reliability of their result data.

[0005] To achieve the above object, the present invention adopts the following technical solutions:

[0006] In a first aspect, the present invention provides a method for testing international freight rate test data, comprising:

[0007] Based on the token bucket algorithm and the sampling method, obtaining the first test data and the second test data;

[0008] storing the first test data and the second test data in a local database;

[0009] Based on the accuracy index, the first test data and the second test data are compared and analyzed to obtain accuracy data corresponding to the accuracy index;

[0010] Based on the accuracy data corresponding to the accuracy index, the test results of the international freight rate test data are determined.

[0011] Further, based on the token bucket algorithm and the sampling method, the first test data and the second test data are obtained, including:

[0012] Generate a token based on the cache interface and OD template data of the first test data and the second test data, and put the token into a token bucket;

[0013] The token is used to control the rate at which the OD template data is split and put into the memory cache, and the parameter values ​​in the OD template data are set in a decreasing manner in a polling time distribution;

[0014] Based on the request template corresponding to the OD template data, encapsulate the OD template data into a first request and a second request corresponding to the cache interface for obtaining the first test data and the second test data;

[0015] The request rates of the first request and the second request are controlled by a token bucket algorithm, and the first request and the second request are initiated to obtain the first test data and the second test data.

[0016] Further, storing the first test data and the second test data in a local database includes:

[0017] The first test data and the second test data, as well as a request template corresponding to the first test data and the second test data, are stored in a local database.

[0018] Further, based on the accuracy index, the first test data and the second test data are compared and analyzed to obtain data accuracy data corresponding to the accuracy index, including:

[0019] cyclically acquiring the stored first test data and second test data from the local database;

[0020] Compare the solutions of the first test data and the second test data. If the solutions are inconsistent, store the inconsistent data in the local database.

[0021] Based on the accuracy index, the stored inconsistent data is calculated to obtain accuracy data corresponding to the accuracy index.

[0022] In a second aspect, the present invention further provides a testing device for international freight rate test data, comprising:

[0023] A request module, used to obtain first test data and second test data based on a token bucket algorithm and a sampling method;

[0024] A storage module, used for storing the first test data and the second test data in a local database;

[0025] An analysis and comparison module, used to compare and analyze the first test data and the second test data based on the accuracy index to obtain accuracy data corresponding to the accuracy index;

[0026] The result determination module is used to determine the test result of the international freight rate test data based on the accuracy data corresponding to the accuracy index.

[0027] Furthermore, the request module is also used to:

[0028] Generate a token based on the cache interface and OD template data of the first test data and the second test data, and put the token into a token bucket;

[0029] The token is used to control the rate at which the OD template data is split and put into the memory cache, and the parameter values ​​in the OD template data are set in a decreasing manner in a polling time distribution;

[0030] Based on the request template corresponding to the OD template data, encapsulate the OD template data into a first request and a second request corresponding to the cache interface for obtaining the first test data and the second test data;

[0031] The request rates of the first request and the second request are controlled by a token bucket algorithm, and the first request and the second request are initiated to obtain the first test data and the second test data.

[0032] Furthermore, the storage module is also used for:

[0033] The first test data and the second test data, as well as a request template corresponding to the first test data and the second test data, are stored in a local database.

[0034] Furthermore, the analysis and comparison module is also used to:

[0035] cyclically acquiring the stored first test data and second test data from the local database;

[0036] Compare the solutions of the first test data and the second test data. If the solutions are inconsistent, store the inconsistent data in the local database.

[0037] Based on the accuracy index, the stored inconsistent data is calculated to obtain accuracy data corresponding to the accuracy index.

[0038] In a third aspect, the present invention further provides an electronic device, comprising: a processor and a memory;

[0039] The processor is coupled to the memory;

[0040] The processor is used to read and execute the program or instructions stored in the memory, so that the device executes the method of the first aspect.

[0041] In a fourth aspect, the present invention further provides a computer-readable storage medium storing a computer program, which implements the method of the first aspect when executed by a processor.

[0042] In summary, the technical solution provided by the present invention has at least the following technical effects or advantages:

[0043] By calling the cache interfaces of the two search systems respectively, the token bucket concept and sampling algorithm are used to simulate the user's real search behavior to obtain cache interface data. On the basis of obtaining a comprehensive data set, through fine data disassembly and in-depth analysis and comparison, the accuracy indicators of various key data of the day are calculated. Finally, these rigorously processed indicator results will be presented to the user in a visual effect to ensure the intuitiveness and comprehensibility of information transmission. The technical solution of the present invention realizes a comprehensive benchmarking and verification of the key indicators of the international freight rate cache product and the standard search system, which effectively guarantees the data cache efficiency of the international freight rate search cache product and the high accuracy and reliability of its result data.

[0044] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures pointed out in the description, claims and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0046] Figure 1 It is a flowchart of a method for testing international freight rate test data in an embodiment of the present invention;

[0047] Figure 2 A software flow chart of a testing method for caching data of international freight rates;

[0048] Figure 3 A testing device for testing international freight rate test data in an embodiment of the present invention;

[0049] Figure 4 A processing flow chart of a test device for caching data of international freight rates;

[0050] Figure 5 The present invention is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0051] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0052] In order to further illustrate the technical solution of the present invention, the professional terms involved are explained as follows:

[0053] The international standard search system is an indispensable and important supporting platform for airlines' e-commerce direct sales and agents' online distribution in the Internet era. It can provide fare search services for international routes, and return the lowest prices of several service levels for each flight combination on a specified date according to the itinerary information and query requirements specified by passengers. The full-class search can search for available prices for all classes of a specified flight on a specified date, effectively helping customers expand international product sales and improve market competitiveness.

[0054] The international freight rate cache product is developed to meet customers' needs for high concurrency and high performance of international search systems, and is based on a certain accuracy rate. The international freight rate cache product has the same call parameters as the international standard search system, and can provide international freight rate hot route search cache according to customer's personalized needs.

[0055] OD, flight data (Origin-Destination).

[0056] MinIO, a high-performance, S3-compatible object storage.

[0057] Grafana is a system monitoring tool and monitoring instrumentation system open sourced by Grafana Labs.

[0058] Solution: Returns the solution node message in the cache data.

[0059] Figure 1 The flowchart of a method for testing international freight rate test data in an embodiment of the present invention is shown in the figure. The method includes:

[0060] S101, obtaining first test data and second test data based on a token bucket algorithm and a sampling method;

[0061] A token is generated based on the cache interface for obtaining the first test data and the second test data and the OD template data, and the token is placed in a token bucket; the rate at which the OD template data is split and placed in the memory cache is controlled by the token, and the parameter value in the OD template data is set in a decreasing manner with a polling time distribution; based on the request template corresponding to the OD template data, the OD template data is encapsulated into a first request and a second request corresponding to the cache interface for obtaining the first test data and the second test data; the request rate of the first request and the second request is controlled by the token bucket algorithm, and the first request and the second request are initiated to obtain the first test data and the second test data.

[0062] Exemplarily, according to the specified OD template, OD template data is obtained. An example of OD template data is shown in Table 1. A token is generated based on the international standard search system cache interface, the international freight rate cache product cache interface and the OD template data, and the token is placed in a token bucket. The international standard search system cache interface is a cache interface for obtaining the first test data. The international freight rate cache product cache interface is a cache interface for obtaining the second test data. The token is used to control the rate at which the OD template data is split and placed in the memory cache, and the parameter values ​​in the OD template data, such as the OFFSET value, are set in a decreasing manner in a polling time distribution. Based on the request module corresponding to the OD template data, such as the JSON request template, the OD template data is encapsulated into a JSON request corresponding to the international standard search system cache interface and a JSON request corresponding to the international freight rate cache product cache interface, that is, the OD template data is encapsulated into the first request and the second request corresponding to the cache interface for obtaining the first test data and the second test data. The token bucket algorithm is used to control the request rate of the JSON requests corresponding to the international standard search system cache interface and the international freight rate cache product cache interface, and the JSON requests corresponding to the international standard search system cache interface and the international freight rate cache product cache interface are respectively initiated. The received JSON request response data corresponding to the international standard search system cache interface is the first test data. The received JSON request response data corresponding to the international freight rate cache product cache is the second test data. The above steps can simulate the most realistic request scenario of the user.

[0063] Table 1

[0064] Fields value illustrate OFFICE PEK209 Sales Department ORIGIN SHA Flight Origin DESTINATION LON Flight destinations OWRT OW / RT Type of flight OFFSET 30 The number of days from the current system date STAY 7 For a one-way trip, fill in 0; for a round trip, fill in the maximum number of days of stay.

[0065] S102, storing the first test data and the second test data in a local database;

[0066] The first test data and the second test data, as well as a request template corresponding to the first test data and the second test data, are stored in a local database.

[0067] Exemplarily, the response data of the JSON request corresponding to the international standard search system cache interface and the response data of the JSON request corresponding to the international freight rate cache product cache, as well as the corresponding JSON request templates, are stored in Redis.

[0068] S103, based on the accuracy index, performing comparative analysis on the first test data and the second test data to obtain accuracy data corresponding to the accuracy index;

[0069] The first test data and the second test data are cyclically obtained from the local database; the solutions of the first test data and the second test data are compared, and if the solutions are inconsistent, the inconsistent data are stored in the local database; based on the accuracy index, the stored inconsistent data are calculated to obtain the accuracy data corresponding to the accuracy index.

[0070] Exemplarily, the response data of the international standard search system cache interface and the response data of the international freight rate cache product cache interface stored in Redis are obtained cyclically; the solutions of the above response data are compared, and if the solutions are inconsistent, the inconsistent data are stored in Redis, and the relevant logs are printed to the log file; the accuracy index is determined by mining the data of the airline dimension or the OD dimension, and the inconsistent data stored in Redis is calculated based on the accuracy index to obtain the accuracy data corresponding to the accuracy index. Accuracy indicators include but are not limited to various core indicators such as direct flight accuracy, direct flight cabin change accuracy, and direct flight price change accuracy. Comprehensively evaluating the overall accuracy, overall cabin change rate, and overall price change rate can fully grasp and analyze the performance of the two major interface data.

[0071] S104. Determine the test result of the international freight rate test data based on the accuracy data corresponding to the accuracy index.

[0072] Exemplarily, the accuracy data corresponding to the accuracy index is stored in the database to achieve long-term storage and fast retrieval of the data. At the same time, based on the accuracy data corresponding to the accuracy index, a historical report of all accuracy data in the past 30 days is generated according to a scheduled task (such as a daily task), and uploaded to the MinIO cloud storage platform in a structured table format, which enhances the intuitiveness of data visualization and the convenience of analysis. The structured table can be an Excel table, which can be analyzed intuitively by the user. You can also upload the inconsistent log files and the generated Excel files on the same day to MinIO, and clear the logs on MinIO before 15 days. Table 2 is an example of data stored in the database for accuracy data on a certain day.

[0073] Table 2

[0074]

[0075] The technical solution of the present invention is described below in conjunction with a specific practical process, as follows:

[0076] (1) Initialize basic configuration information

[0077] Call the post-processor MinIO tool class to download the cronCfg.properties configuration file, parse its content and store it in an object, create a thread pool and thread pool monitoring binding: create a request sending thread pool, create a result comparison thread pool, bind Redis / memory cache monitoring items, bind request sending / result comparison thread pool monitoring items, and finally parse the scheduled task configuration.

[0078] (2) Get request response data

[0079] First, start the token generation thread and put the tokens into the created token buckets. Then bind the monitoring metric information, register the timing statistics of the international standard search system cache interface and the international freight rate cache product cache interface (metric statistics can only be performed after registration), and integrate the thread pool and cache-related monitoring indicators into the monitoring system Grafana.

[0080] Start the request sending / result comparison thread pool and create a predetermined number of threads and put them into the thread pool.

[0081] The request sending thread starts:

[0082] 1) First, obtain the OD split token from the OD token bucket, then obtain the request json template from Redis, and finally determine which specific request template it belongs to through the split OD data, assemble the OD object into the request json template, and poll one by one through the sampling algorithm, and send requests to the international standard search system cache interface and the international freight rate cache product cache interface in a time-decrease manner.

[0083] 2) After receiving the response result, the requested OD object, the assembled request json template and the response data of the two interfaces will be stored in Redis.

[0084] Results comparison thread pool starts:

[0085] 1) The data stored by the request sending thread is obtained cyclically from Redis. When the solutions of the two interfaces are inconsistent, the relevant inconsistent data will be recorded and stored in Redis, and the relevant logs will be printed to the log file.

[0086] 2) If the comparison is consistent, the Redis log will be deleted and will not be printed to the log file.

[0087] (3) Data analysis and storage

[0088] Stop the thread pool of the main task, empty the token bucket, stop the timing statistics of the international standard search system cache interface and the international freight rate cache product cache interface, obtain the inconsistent data information recorded by the result comparison thread from Redis, and calculate the direct flight accuracy, direct flight cabin change accuracy, direct flight price change accuracy, total accuracy, total cabin change rate, total price change rate and other data according to the dimensions of the airline and OD request template. Finally, store the accuracy calculation results in the database.

[0089] Query the accuracy data of the last 30 days from the database, export it to an Excel table, upload the inconsistent log files and the generated Excel to MinIO, and clear the logs on MinIO older than 15 days.

[0090] (4) Accuracy index I read information example

[0091] For example: cache overall accuracy

[0092] The number of solutions that hit the cache and return the same result / the total number of solutions. For example: Assume that 500,000 ODs are tested, and each OD returns 100 solutions, that is, the total number of solutions is 50 million, of which 49 million solutions are completely consistent with the data in the international standard search system, that is, the number of solutions that hit the cache and return the same result is 49 million, and the accuracy rate is 98%.

[0093] The consistent result returned by Solution means that the total price of the flight package is consistent with the international standard search system (including ticket price, national tax, fuel and security fee, etc.).

[0094] Figure 2 The software flow chart of a testing method for international freight rate cache data.

[0095] Figure 3 A testing device for testing international freight rate test data in an embodiment of the present invention is shown in the figure, and the device includes:

[0096] A request module, used to obtain first test data and second test data based on a token bucket algorithm and a sampling method;

[0097] A storage module, used for storing the first test data and the second test data in a local database;

[0098] An analysis and comparison module, used to compare and analyze the first test data and the second test data based on the accuracy index to obtain accuracy data corresponding to the accuracy index;

[0099] The result determination module is used to determine the test result of the international freight rate test data based on the accuracy data corresponding to the accuracy index.

[0100] Exemplarily, the request module is further used to:

[0101] Generate a token based on the cache interface and OD template data of the first test data and the second test data, and put the token into a token bucket;

[0102] The token is used to control the rate at which the OD template data is split and put into the memory cache, and the parameter values ​​in the OD template data are set in a decreasing manner in a polling time distribution;

[0103] Based on the request template corresponding to the OD template data, encapsulate the OD template data into a first request and a second request corresponding to the cache interface for obtaining the first test data and the second test data;

[0104] The request rates of the first request and the second request are controlled by a token bucket algorithm, and the first request and the second request are initiated to obtain the first test data and the second test data.

[0105] Exemplarily, the storage module is further used for:

[0106] The first test data and the second test data, as well as a request template corresponding to the first test data and the second test data, are stored in a local database.

[0107] Exemplarily, the analysis and comparison module is also used for:

[0108] cyclically acquiring the stored first test data and second test data from the local database;

[0109] Compare the solutions of the first test data and the second test data. If the solutions are inconsistent, store the inconsistent data in the local database.

[0110] Based on the accuracy index, the stored inconsistent data is calculated to obtain accuracy data corresponding to the accuracy index.

[0111] It should be noted that, for the sake of convenience, Figure 3 For example, only the main modules of the test device structure for testing international freight rate test data are shown. In practical applications, the system may also include modules or components not shown in the figure; the system is not limited to the above module structure, but may also be other module structures for implementing the above method embodiments.

[0112] Figure 4 The present invention is a processing flow chart of a test device for caching data of international freight rates.

[0113] In summary, the technical solutions in the embodiments of the present invention have at least the following technical effects or advantages:

[0114] By calling the cache interfaces of the two search systems respectively, the token bucket concept and sampling algorithm are used to simulate the user's real search behavior to obtain cache interface data. On the basis of obtaining a comprehensive data set, through fine data disassembly and in-depth analysis and comparison, the accuracy indicators of various key data of the day are calculated. Finally, these rigorously processed indicator results will be presented to the user in a visual effect to ensure the intuitiveness and comprehensibility of information transmission. The technical solution of the present invention realizes a comprehensive benchmarking and verification of the key indicators of the international freight rate cache product and the standard search system, which effectively guarantees the data cache efficiency of the international freight rate search cache product and the high accuracy and reliability of its result data.

[0115] Figure 5 The present invention is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention.

[0116] like Figure 5 As shown, the electronic device includes: a processor and a memory;

[0117] The processor is used to read and execute programs and instructions stored in the memory, so that the electronic device executes the above method embodiment.

[0118] It should be noted that, for the sake of convenience, Figure 5 Only the main components of the electronic device are shown. In practical applications, the electronic device may also include components or assemblies not shown in the figure.

[0119] The present invention also provides a computer-readable storage medium storing a program or instruction. When a computer reads and executes the program or instruction, the computer executes the above method embodiment.

[0120] Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent substitutions for some of the technical features therein; and these modifications or substitutions do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for testing international freight rate test data, characterized in that: include: Based on the token bucket algorithm and the sampling method, obtaining the first test data and the second test data; storing the first test data and the second test data in a local database; Based on the accuracy index, the first test data and the second test data are compared and analyzed to obtain accuracy data corresponding to the accuracy index; Based on the accuracy data corresponding to the accuracy index, the test results of the international freight rate test data are determined.

2. The method for testing international freight rate test data according to claim 1, characterized in that: The obtaining of the first test data and the second test data based on the token bucket algorithm and the sampling method includes: Generate a token based on the cache interface and OD template data of the first test data and the second test data, and put the token into a token bucket; The token is used to control the rate at which the OD template data is split and put into the memory cache, and the parameter values ​​in the OD template data are set in a decreasing manner in a polling time distribution; Based on the request template corresponding to the OD template data, encapsulating the OD template data into a first request and a second request corresponding to the cache interface for obtaining the first test data and the second test data; The request rates of the first request and the second request are controlled by a token bucket algorithm, and the first request and the second request are initiated to obtain first test data and second test data.

3. The method for testing international freight rate test data according to claim 1, characterized in that: The storing the first test data and the second test data in a local database includes: The first test data and the second test data, as well as a request template for obtaining the first test data and the second test data corresponding to each other, are stored in a local database.

4. The method for testing international freight rate test data according to any one of claims 1 to 3, characterized in that: The comparing and analyzing the first test data and the second test data based on the accuracy index to obtain data accuracy data corresponding to the accuracy index includes: cyclically acquiring the first test data and the second test data stored in the local database; Comparing the solutions of the first test data and the second test data, if the solutions are inconsistent, storing the inconsistent data in a local database; Based on the accuracy index, the stored inconsistent data is calculated to obtain accuracy data corresponding to the accuracy index.

5. A testing device for international freight rate test data, comprising: A request module, used to obtain first test data and second test data based on a token bucket algorithm and a sampling method; A storage module, used for storing the first test data and the second test data in a local database; An analysis and comparison module, configured to compare and analyze the first test data and the second test data based on an accuracy index to obtain accuracy data corresponding to the accuracy index; The result determination module is used to determine the test result of the international freight rate test data based on the accuracy data corresponding to the accuracy index.

6. The testing device for international freight rate test data according to claim 5, characterized in that: The request module is also used for: Generate a token based on the cache interface and OD template data of the first test data and the second test data, and put the token into a token bucket; The token is used to control the rate at which the OD template data is split and put into the memory cache, and the parameter values ​​in the OD template data are set in a decreasing manner in a polling time distribution; Based on the request template corresponding to the OD template data, encapsulating the OD template data into a first request and a second request corresponding to the cache interface for obtaining the first test data and the second test data; The request rates of the first request and the second request are controlled by a token bucket algorithm, and the first request and the second request are initiated to obtain first test data and second test data.

7. The testing device for international freight rate test data according to claim 5, characterized in that: The storage module is further used for: The first test data and the second test data, as well as a request template for obtaining the first test data and the second test data corresponding to each other, are stored in a local database.

8. The testing device for international freight rate test data according to any one of claims 5 to 7, characterized in that: The analysis and comparison module is also used for: cyclically acquiring the first test data and the second test data stored in the local database; Comparing the solutions of the first test data and the second test data, if the solutions are inconsistent, storing the inconsistent data in a local database; Based on the accuracy index, the stored inconsistent data is calculated to obtain accuracy data corresponding to the accuracy index.

9. An electronic device, characterized in that: include: Processor and memory; The processor is coupled to the memory; The processor is used to read and execute the program or instruction stored in the memory, so that the device executes the method according to any one of claims 1 to 4.

10. A computer-readable storage medium, characterized in that: A computer program is stored, and when the program is executed by a processor, the method according to any one of claims 1 to 4 is implemented.

Images