Limited retrieval result accuracy testing method and device, equipment and storage medium

Abstract

The invention relates to a limited retrieval result accuracy testing method and device, equipment and a storage medium, and belongs to the technical field of databases, the limited retrieval result accuracy testing method comprises the steps that field information of a data storage table in a database is acquired, and limited retrieval conditions are configured based on the field information; generating retrieval test data based on the limited retrieval conditions and the field information, and adding the retrieval test data into a database; and performing retrieval in the database based on the limited retrieval condition to obtain limited retrieval result data, and comparing the limited retrieval result data with the retrieval test data to determine the accuracy of the limited retrieval result. According to the method, the retrieval test data generated according to the limited retrieval condition is added into the database, the accuracy of the limited retrieval result can be accurately judged according to whether the limited retrieval result is consistent with the retrieval test data or not, and the accuracy of the limited retrieval result can be accurately judged under the condition that the data size of the limited retrieval result does not reach the target number. And the accuracy of limited retrieval results can still be judged.

Description

Technical Field

[0001] The present invention relates to the field of database technology, and in particular to a limited search result accuracy testing method, device, equipment and storage medium. Background Art

[0002] The traffic used by traffic products is the traffic data mirrored from the core equipment of the entire company or computer room. The traffic in the mirror contains the access data of a large number of devices. The number of visits initiated by these devices per second is at least hundreds of thousands. The larger the access traffic, the more connections per second. These massive amounts of data are ultimately stored in the data storage table of the database. When users query data, the larger the time range selected, the more total data is queried, and the more memory resources consumed by the operating system. In order to meet the timeliness of data retrieval and reduce the loss of hardware resources, traffic products have set quantity limits on the amount of data retrieval returned, and only retrieve and return the latest fixed number of data within the current time range.

[0003] In the case of this limited search, since there is a large amount of data with the same IP address, port or application in the traffic, if you enter any search condition at random, the returned results will reach the maximum fixed number of data items. In addition, in the case of an unknown traffic model, if too many search conditions are entered, there is a high probability that the traffic data will not be matched. Even if some data results are retrieved, it is impossible to verify whether the number of results is correct. At the same time, it is difficult to find a search condition with less than the fixed number of items to verify whether the time range has been searched and traversed. Therefore, the accuracy of the limited search results cannot be verified.

[0004] It can be seen that the existing technology is unable to determine the accuracy of the search results under limited search conditions. Summary of the invention

[0005] In view of this, it is necessary to provide a limited search result accuracy testing method, device, equipment and storage medium to solve the problem that the prior art cannot determine the accuracy of the search results under limited search conditions.

[0006] In order to solve the above problems, the present invention provides a limited search result accuracy testing method, comprising: Obtain the field information of the data storage table in the database, and configure limited search conditions based on the field information; Generate retrieval test data based on limited retrieval conditions and field information, and add the retrieval test data to a database; Based on the limited search conditions, a search is performed in the database to obtain limited search result data, and the limited search result data is compared with the search test data to determine the accuracy of the limited search result.

[0007] In a possible implementation, configuring limited search conditions based on field information includes: Determine the target field based on field information and preset search requirements; Configure limited search conditions based on the data type of the target field.

[0008] In a possible implementation, generating retrieval test data based on limited retrieval conditions and field information includes: Configure data content that meets limited search conditions for the target field for retrieving test data, and configure default data content for other fields for retrieving test data.

[0009] In a possible implementation, the target field includes a time field, and adding the search test data to the database includes: The retrieval test data is sequentially added to the database according to the time information of the time field in the retrieval test data.

[0010] In a possible implementation, the limited search condition includes a search time range, and the time information of the time field in the search test data is distributed in different time periods within the search time range.

[0011] In a possible implementation, comparing the limited search result data with the search test data to determine the accuracy of the limited search result includes: When the limited search result data contains all the search test data, the limited search result is determined to be accurate.

[0012] In a possible implementation manner, the limited search conditions also include a source IP range, a destination IP range, a source port range, and a destination port range.

[0013] The present invention also provides a limited search result accuracy testing device, comprising: A search condition determination module is used to obtain field information of a data storage table in a database and configure limited search conditions based on the field information; A test data generation module, used to generate retrieval test data based on limited retrieval conditions and field information, and add the retrieval test data to the database; The data comparison module is used to search in the database based on limited search conditions to obtain limited search result data, compare the limited search result data with the search test data, and determine the accuracy of the limited search results.

[0014] The present invention also provides an electronic device, comprising a memory and a processor, wherein: Memory, used to store programs; The processor is coupled to the memory and is used to execute the program stored in the memory to implement the steps in the limited search result accuracy test method of any of the above embodiments.

[0015] The present invention also provides a computer-readable storage medium for storing a computer-readable program or instruction, which, when executed by a processor, can implement the steps in the limited retrieval result accuracy testing method of any of the above-mentioned embodiments.

[0016] The beneficial effects of the present invention are as follows: the limited search result accuracy test method provided by the present invention obtains the field information of the data storage table in the database, configures the limited search conditions according to the field information, then generates the search test data according to the limited search conditions and the field information, adds the search test data to the database, searches the database based on the limited search conditions, obtains the limited search results, and compares the limited search results with the search test data to judge the accuracy of the limited search results. By adding the search test data generated according to the limited search conditions to the database, and judging whether the limited search results are consistent with the search test data, the accuracy of the limited search results can be accurately judged, and when the data amount of the limited search results does not reach the target amount, the accuracy of the limited search results can still be judged. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0018] Figure 1 A flowchart of a limited search result accuracy testing method provided by an embodiment of the present invention; Figure 2 A schematic diagram of a flow chart of a limited search condition configuration method provided by an embodiment of the present invention; Figure 3 A schematic diagram of the structure of a limited search result accuracy testing device provided by an embodiment of the present invention; Figure 4 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0019] The preferred embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings, wherein the accompanying drawings constitute a part of the present invention and are used together with the embodiments of the present invention to illustrate the principles of the present invention, but are not used to limit the scope of the present invention.

[0020] Reference to an "embodiment" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiment may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0021] A specific embodiment of the present invention, as Figure 1 As shown, a limited search result accuracy testing method is disclosed, comprising: S101, obtaining field information of a data storage table in a database, and configuring limited search conditions based on the field information; S102, generating retrieval test data based on limited retrieval conditions and field information, and adding the retrieval test data to a database; S103, searching in the database based on the limited search conditions to obtain limited search result data, comparing the limited search result data with the search test data to determine the accuracy of the limited search result.

[0022] In the embodiment of the present invention, the data storage table refers to a table in the database for storing data fields, data field types and data contents. For each stored data in the database, the corresponding fields, field types and data contents are stored in the corresponding positions of the data storage table. Field information is information used to indicate different characteristics of data, such as the source IP address, destination IP address, source port, destination port, application type, start time, connection status, existence duration, etc. of the data. All stored data in the database have the same fields, but for each field, different stored data may have different corresponding field information. Limited search conditions refer to search conditions configured to limit the number of search results. In the embodiment of the present invention, in order to test the accuracy of limited search results, some special limited search conditions need to be set. These limited search conditions are configured according to the field information of the data, for example, corresponding limited search conditions are configured according to certain fields of the data. The specific configuration method is described in detail later in the present invention.

[0023] In an embodiment of the present invention, the retrieval test data is data similar to the data stored in the database generated based on limited retrieval conditions and field information. Specifically, the retrieval test data that meets the limited retrieval conditions can be generated according to the field information of each field of the database stored in the database, that is, the retrieval test data should meet the limited retrieval conditions, and the field information should comply with the storage rules of the data storage table. The specific generation of the retrieval test data will be described in detail later in the present invention. At the production retrieval test data port, the retrieval test data is added to the database. In particular, when there are some special fields in the retrieval test data, the special fields will affect the position or storage time of the retrieval test data in the database, and the retrieval test data should be added to the database according to the specific field information of the special fields.

[0024] In an embodiment of the present invention, for a database to which retrieval test data has been added, a configured limited retrieval condition is used to perform a search to obtain limited retrieval results, and then the limited retrieval results are compared with the retrieval test data to determine whether the limited retrieval results are accurate. Specifically, the limited retrieval condition will limit the number of limited retrieval results, and in an embodiment of the present invention, even if the number of limited retrieval results does not reach the number limited by the limited retrieval condition, it is possible to determine whether the limited retrieval results are accurate by comparing the limited retrieval results with the retrieval test data. The specific judgment method will be described in detail later in the present invention.

[0025] The limited search result accuracy test method provided by the present invention obtains the field information of the data storage table in the database, configures the limited search conditions according to the field information, generates the search test data according to the limited search conditions and the field information, adds the search test data to the database, searches in the database based on the limited search conditions, obtains the limited search results, and compares the limited search results with the search test data to judge the accuracy of the limited search results. By adding the search test data generated according to the limited search conditions to the database, and judging whether the limited search results are consistent with the search test data, the accuracy of the limited search results can be accurately judged, and when the data amount of the limited search results does not reach the target amount, the accuracy of the limited search results can still be judged.

[0026] As a possible implementation mode of the present invention, in this implementation mode, Figure 2 As shown, limited search conditions are configured based on field information, including: S201, determining a target field based on field information and preset search requirements; S202: configuring limited search conditions based on the data type of the target field.

[0027] In an embodiment of the present invention, the preset search requirement may be a search requirement that can distinguish whether the limited search result is accurate. Based on the preset search requirement and field information, the target field may be determined. The target field refers to a field that will be restricted by the limited search condition and is the field to be searched when searching by the limited search condition. Specifically, in order to facilitate the determination of the accuracy of the limited search result, the start time, source IP, destination IP, source port, and destination port may be used as target fields, and the limited search conditions may be configured based on the data types of these target fields. Furthermore, for the convenience of explanation, taking a specific embodiment as an example, the limited search conditions are set as the search time range (2024-10-10 09:00:00 to 2024-10-11 09:00:00), source IP 111.111.111.111, destination IP 222.222.222.222, source port 1234, destination port 4321. Of course, the limited search conditions are only a simple embodiment for easy expression. In the specific implementation process, specific settings can be made according to actual conditions.

[0028] The embodiment of the present invention sets corresponding limited search conditions through the target field, so as to facilitate the subsequent generation of test data based on the limited search conditions.

[0029] As a possible implementation of the present invention, in this implementation, generating retrieval test data based on limited retrieval conditions and field information includes: Configure data content that meets limited search conditions for the target field for retrieving test data, and configure default data content for other fields for retrieving test data.

[0030] In an embodiment of the present invention, the retrieval test data generated according to the limited retrieval condition and the field information has the same number of fields as the number stored in the database, wherein for the target field used to configure the limited retrieval condition, the data content that meets the limited retrieval condition is configured for the retrieval test data, and for other fields of the retrieval test data, the default data content is configured. Specifically, as in the aforementioned embodiment, the start time in the retrieval test data should be between 2024-10-10 09:00:00 and 2024-10-11 09:00:00, the source IP address should be 111.111.111.111, the destination IP address should be 222.222.222.222, the source port should be 1234, and the destination port should be 4321. For the data content of other fields, it can be set according to the actual situation or directly set to the default value.

[0031] The embodiment of the present invention configures data content that meets the limited search conditions for the target field of the search test data according to the limited search conditions, so that the search test data can be accurately retrieved when a subsequent search is performed according to the limited search conditions.

[0032] As a possible implementation of the present invention, in this implementation, the target field includes a time field, and adding the search test data to the database includes: The retrieval test data is sequentially added to the database according to the time information of the time field in the retrieval test data.

[0033] In an embodiment of the present invention, such as the aforementioned embodiment, the target field includes a time field, and the data content of the time field is the start time when the data is stored in the database. When adding retrieval test data to the database, the retrieval test data should be added to the database in sequence according to the order of the start time, and the time sequence relationship between the retrieval test data and other stored data in the database is also determined based on the time field. Specifically, for the convenience of explanation, taking a specific embodiment as an example, the data contents of the time fields of the multiple retrieval test data are respectively retrieval test data A: 2024-10-10 09:01:01, retrieval test data B: 2024-10-10 17:01:01, retrieval test data C: 2024-10-11 01:01:01, and the data contents of the time fields of the stored data in the database are stored data D: 2024-10-10 09:01:02, stored data E: 2024-10-10 17:01:02, and stored data F: 2024-10-11 01:01:02. When the retrieval test data is added to the database, the time sequence of each data should be A, D, B, E, C, and F. Of course, the above embodiment is only a simple embodiment for the convenience of description, and the specific application can be set according to the actual situation.

[0034] The embodiment of the present invention adds the retrieval test data to the database according to the time field, thereby ensuring the accuracy of the time of the retrieval test data in the database, and facilitating the judgment of the accuracy of subsequent limited retrieval results.

[0035] As a possible implementation manner of the present invention, in this implementation manner, the limited search condition includes a search time range, and the time information of the time field in the search test data is distributed in different time periods within the search time range.

[0036] In an embodiment of the present invention, the target field includes a time field. When configuring a limited search condition based on the time field, a search time range may be configured, such as between 2024-10-10 09:00:00 and 2024-10-11 09:00:00 in the aforementioned embodiment. When generating search test data based on the limited search condition, in order to ensure that the data is evenly distributed within the time range, multiple search test data may be set in the front, middle and back time periods within the time range. For example, 50 search test data may be set from 2024-10-10 09:00:00 to 2024-10-10 11:00:00, 50 search test data may be set from 2024-10-10 17:00:00 to 2024-10-10 18:00:00, and 50 search test data may be set from 2024-10-11 01:00:00 to 2024-10-11 50 search test data are set at 02:00:00. Further, multiple search test data can be evenly set within a time range from 2024-10-10 09:00:00 to 2024-10-11 09:00:00, and the specific setting method is not limited by the present invention.

[0037] The embodiment of the present invention configures retrieval test data in different time periods within the retrieval time range according to the retrieval time range in the limited retrieval condition, thereby ensuring the uniformity of data distribution within the retrieval time range and being able to more accurately determine the accuracy of the limited retrieval results.

[0038] As a possible implementation of the present invention, in this implementation, the limited search result data is compared with the search test data to determine the accuracy of the limited search result, including: When the limited search result data contains all the search test data, the limited search result is determined to be accurate.

[0039] In an embodiment of the present invention, when judging the accuracy of the limited search result based on the limited search result data and the search test data, by detecting the number of search test data in the limited search result data, when the number of search test data in the limited search result data is the same as the number of search test data added to the database, it is indicated that the limited search result is accurate, otherwise, the limited search result is inaccurate. Further, the data content of the search test data in the limited search result data and the search test data added to the database can be compared to see if they are the same, and if they are the same, it is determined that the limited search result is accurate.

[0040] The embodiment of the present invention can accurately determine whether the limited search result is accurate by comparing the number of search test data in the limited search result data with the number of search test data added to the database.

[0041] As a possible implementation manner of the present invention, in this implementation manner, the limited search conditions also include a source IP range, a destination IP range, a source port range, and a destination port range.

[0042] In the aforementioned embodiment, among the given limited search conditions, only the time field is a range value. Similarly, the limited search conditions determined by the source IP address, destination IP address, source port, and destination port fields can all be range values. Furthermore, the limited search conditions determined by other fields such as application type, start time, connection status, existence duration, etc. can also be range values. The present invention does not impose any limitation on this.

[0043] In the embodiment of the present invention, all fields of the limited search condition can be range values, which can increase the scope of the limited search and adapt to more scenarios.

[0044] In order to better implement the limited search result accuracy test method in the embodiment of the present invention, based on the limited search result accuracy test method, correspondingly, Figure 3 As shown, the embodiment of the present invention further provides a limited search result accuracy testing device, and the limited search result accuracy testing device 300 includes: A search condition determination module 301 is used to obtain field information of a data storage table in a database and configure limited search conditions based on the field information; A test data generating module 302, for generating retrieval test data based on limited retrieval conditions and field information, and adding the retrieval test data to a database; The data comparison module 303 is used to search in the database based on the limited search conditions to obtain limited search result data, compare the limited search result data with the search test data, and determine the accuracy of the limited search result.

[0045] The limited retrieval result accuracy testing device 300 provided in the above embodiment can implement the technical solution described in the above embodiment of the limited retrieval result accuracy testing method. The specific implementation principles of the above modules or units can refer to the corresponding contents in the above embodiment of the limited retrieval result accuracy testing method, which will not be repeated here.

[0046] The limited search result accuracy test device provided by the present invention obtains the field information of the data storage table in the database, configures the limited search conditions according to the field information, generates the search test data according to the limited search conditions and the field information, adds the search test data to the database, searches the database based on the limited search conditions, obtains the limited search results, and compares the limited search results with the search test data to judge the accuracy of the limited search results. By adding the search test data generated according to the limited search conditions to the database, and judging whether the limited search results are consistent with the search test data, the accuracy of the limited search results can be accurately judged, and when the data amount of the limited search results does not reach the target amount, the accuracy of the limited search results can still be judged.

[0047] like Figure 4 As shown, the present invention also provides an electronic device 400. The electronic device 400 includes a processor 401, a memory 402 and a display 403. Figure 4 Only some components of the electronic device 400 are shown, but it should be understood that it is not required to implement all of the components shown, and more or fewer components may be implemented instead.

[0048] In some embodiments, the processor 401 may be a central processing unit (CPU), a microprocessor or other data processing chip, used to run program codes or process data stored in the memory 402, such as the limited search result accuracy test method of the present invention.

[0049] In some embodiments, processor 401 may be a single server or a server group. The server group may be centralized or distributed. In some embodiments, processor 401 may be local or remote. In some embodiments, processor 401 may be implemented in a cloud platform. In some embodiments, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an internal cloud, a multi-cloud, etc., or any combination thereof.

[0050] In some embodiments, the memory 402 may be an internal storage unit of the electronic device 400, such as a hard disk or memory of the electronic device 400. In other embodiments, the memory 402 may also be an external storage device of the electronic device 400, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc., equipped on the electronic device 400.

[0051] Furthermore, the memory 402 may include both an internal storage unit of the electronic device 400 and an external storage device. The memory 402 is used to store application software installed in the electronic device 400 and various data.

[0052] In some embodiments, the display 403 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, etc. The display 403 is used to display information of the electronic device 400 and to display a visual user interface. The components 401-403 of the electronic device 400 communicate with each other via a system bus.

[0053] In some embodiments, when the processor 401 executes the limited search result accuracy test program in the memory 402, the following steps may be implemented: Obtain the field information of the data storage table in the database, and configure limited search conditions based on the field information; Generate retrieval test data based on limited retrieval conditions and field information, and add the retrieval test data to a database; Based on the limited search conditions, a search is performed in the database to obtain limited search result data, and the limited search result data is compared with the search test data to determine the accuracy of the limited search result.

[0054] It should be understood that: when the processor 401 executes the limited search result accuracy test program in the memory 402, in addition to the above functions, other functions can also be implemented. For details, please refer to the description of the corresponding method embodiment above.

[0055] Furthermore, the embodiment of the present invention does not specifically limit the type of the electronic device 400 mentioned, and the electronic device 400 may be a portable electronic device such as a mobile phone, a tablet computer, a personal digital assistant (PDA), a wearable device, a laptop computer, etc. Exemplary embodiments of portable electronic devices include but are not limited to portable electronic devices equipped with IOS, Android, Microsoft or other operating systems. The above-mentioned portable electronic devices may also be other portable electronic devices, such as a laptop computer with a touch-sensitive surface (e.g., a touch panel). It should also be understood that in some other embodiments of the present invention, the electronic device 400 may not be a portable electronic device, but a desktop computer with a touch-sensitive surface (e.g., a touch panel).

[0056] Correspondingly, an embodiment of the present invention also provides a computer-readable storage medium, which is used to store computer-readable programs or instructions. When the program or instructions are executed by a processor, it can implement the steps or functions of the limited retrieval result accuracy testing method provided by the above-mentioned method embodiments.

[0057] Those skilled in the art will appreciate that all or part of the processes of the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium, wherein the computer-readable storage medium is a disk, an optical disk, a read-only storage memory, or a random access memory, etc.

[0058] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily conceived by any technician familiar with the technical field within the technical scope disclosed by the present invention should be covered within the protection scope of the present invention.

Claims

1. A limited search result accuracy test method, characterized in that: include: Obtaining field information of a data storage table in a database, and configuring limited search conditions based on the field information; generating retrieval test data based on the limited retrieval condition and the field information, and adding the retrieval test data to the database; The database is searched based on the limited search conditions to obtain limited search result data, and the limited search result data is compared with the search test data to determine the accuracy of the limited search result.

2. The limited search result accuracy testing method according to claim 1, characterized in that: The configuring of limited search conditions based on the field information includes: Determining a target field based on the field information and a preset search requirement; The limited search conditions are configured based on the data type of the target field.

3. The limited search result accuracy testing method according to claim 2, characterized in that: The generating of the retrieval test data based on the limited retrieval condition and the field information includes: The target field for the retrieved test data is configured with data content that meets the limited search condition, and the other fields for the retrieved test data are configured with default data content.

4. The limited search result accuracy testing method according to claim 3 is characterized in that: The target field includes a time field, and adding the retrieved test data to the database includes: The retrieval test data are sequentially added to the database according to the time information of the time field in the retrieval test data.

5. The limited search result accuracy testing method according to claim 4, characterized in that: The limited search condition includes a search time range, and the time information of the time field in the search test data is distributed in different time periods of the search time range.

6. The limited search result accuracy testing method according to claim 5, characterized in that: The step of comparing the limited search result data with the search test data to determine the accuracy of the limited search result includes: When the limited search result data includes all the search test data, it is determined that the limited search result is accurate.

7. The limited search result accuracy testing method according to claim 1, characterized in that: The limited search conditions also include a source IP range, a destination IP range, a source port range and a destination port range.

8. A device for testing the accuracy of limited search results, characterized in that: include: A search condition determination module, used to obtain field information of a data storage table in a database and configure limited search conditions based on the field information; A test data generating module, configured to generate retrieval test data based on the limited retrieval condition and the field information, and add the retrieval test data to the database; The data comparison module is used to search the database based on the limited search conditions to obtain limited search result data, compare the limited search result data with the search test data, and determine the accuracy of the limited search result.

9. An electronic device, characterized in that: comprising a memory and a processor, wherein: The memory is used to store programs; The processor is coupled to the memory and is used to execute the program stored in the memory to implement the steps in the limited search result accuracy testing method as described in any one of claims 1 to 7 above.

10. A computer-readable storage medium, characterized in that: Used to store computer-readable programs or instructions, which, when executed by a processor, can implement the steps of the limited search result accuracy testing method described in any one of claims 1 to 7.

Images