Map data change verification method and device, and electronic device

Abstract

The present disclosure provides a map data change verification method and device and electronic equipment, relates to the technical field of artificial intelligence, and in particular to the technical field of intelligent map, intelligent search and the like. The specific implementation scheme is: in the case of a target change involving a POI, a first set of map data information and a second set of map data information are obtained; based on the first set of map data information and the second set of map data information, difference data information is determined, the difference data information is used to represent the difference between a third set of map data information used for being issued to a search service and a fourth set of map data information used by the search service, and the third set of map data information includes the first set of map data information; and the validity of the fourth set of map data information is verified based on the difference data information. The present disclosure can improve the verification effect of map data information.

Description

Technical Field

[0001] This disclosure relates to the field of artificial intelligence technology, and in particular to the field of intelligent maps and intelligent retrieval technology, specifically to a method, apparatus and electronic device for verifying map data changes. Background Technology

[0002] Map services frequently involve changes to Points of Interest (POIs), such as changes to POI data processing services or changes to the original POI data. Currently, for changes involving POIs, only the data information used to send to the retrieval service is verified; that is, verification is only performed on the data side. Summary of the Invention

[0003] This disclosure provides a method, apparatus, and electronic device for verifying map data changes.

[0004] According to one aspect of this disclosure, a method for verifying map data changes is provided, comprising:

[0005] In the event of a change involving a POI, a first map data information set and a second map data information set are obtained. The first map data information set includes data information for distribution to the retrieval service, and the second map data information set includes data information obtained by the retrieval service.

[0006] Based on the first map data information set and the second map data information set, difference data information is determined. The difference data information is used to represent the difference between the third map data information set used to be sent to the retrieval service and the fourth map data information set used by the retrieval service. The third map data information set includes the first map data information set.

[0007] The validity of the fourth map data set is verified based on the aforementioned difference data information.

[0008] According to another aspect of this disclosure, a map data change verification device is provided, comprising:

[0009] The first acquisition module is used to acquire a first map data information set and a second map data information set when a target change involving a POI occurs. The first map data information set includes data information for sending to the retrieval service, and the second map data information set includes data information acquired by the retrieval service.

[0010] The first determining module is used to determine difference data information based on the first map data information set and the second map data information set. The difference data information is used to represent the difference between the third map data information set used to be sent to the retrieval service and the fourth map data information set used by the retrieval service. The third map data information set includes the first map data information set.

[0011] The first verification module is used to verify the validity of the fourth map data information set based on the difference data information.

[0012] According to another aspect of this disclosure, an electronic device is provided, comprising:

[0013] At least one processor; and

[0014] A memory communicatively connected to the at least one processor; wherein,

[0015] The memory stores instructions that can be executed by the at least one processor, which, when executed by the at least one processor, enables the at least one processor to perform the map data change verification method provided in this disclosure.

[0016] According to another aspect of this disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the map data change verification method provided in this disclosure.

[0017] According to another aspect of this disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the map data change verification method provided in this disclosure.

[0018] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0019] The accompanying drawings are provided to better understand this solution and do not constitute a limitation of this disclosure. Wherein:

[0020] Figure 1 This is a flowchart of a map data change verification method provided in this disclosure;

[0021] Figure 2 This is a schematic diagram of a map data change verification method provided in this public disclosure;

[0022] Figures 3a to 3b This is a structural diagram of the map data change verification device disclosed herein;

[0023] Figure 4 This is a block diagram of an electronic device used to implement embodiments of the present disclosure. Detailed Implementation

[0024] The exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments to aid understanding, and should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this disclosure. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0025] Please see Figure 1 , Figure 1 This is a flowchart of a map data change verification method provided in this disclosure, such as... Figure 1 As shown, it includes the following steps:

[0026] Step S101: In the event of a target change involving a POI, obtain a first map data information set and a second map data information set. The first map data information set includes data information for distribution to the retrieval service, and the second map data information set includes data information obtained by the retrieval service.

[0027] The aforementioned target changes can be changes to POI data processing services or changes to POI raw data.

[0028] In the case of a change involving a Point of Interest (POI), obtaining the first map data set and the second map data set can be done by obtaining the first map data set and the second map data set after the aforementioned change in the target.

[0029] The data information mentioned above used to send to the retrieval service can be data information processed by the data processing service and then sent to the retrieval service. For example, data information processed by the POI data processing service. Additionally, in this disclosure, the data information used to send to the retrieval service can also be referred to as data-side data information.

[0030] The aforementioned first map data information set may be a set of changed data information in the data information used to be sent to the retrieval service, or it may be all the data information used to be sent to the retrieval service.

[0031] The aforementioned second map data information set includes the data information obtained by the retrieval service, which may be the changed data information obtained by the retrieval service, or it may be all the data information obtained by the retrieval service. In this disclosure, the retrieval service can be understood as a service that provides users with map data information retrieval.

[0032] In some implementations, the data information obtained by the retrieval service may be data information stored in the retrieval storage service, which is used to store the data information sent to the retrieval service.

[0033] In this disclosure, map data information can be POI (Point of Interest) data information, such as the POI's name, coordinates, telephone number, image, description, etc. Additionally, for ease of description, in this disclosure, a piece of map data information can be represented by an identifier (e.g., bid).

[0034] Step S102: Based on the first map data information set and the second map data information set, determine the difference data information. The difference data information is used to represent the difference between the third map data information set used to send to the retrieval service and the fourth map data information set used by the retrieval service. The third map data information set includes the first map data information set.

[0035] The aforementioned third map data information set used to be sent to the retrieval service can be any set of map data information used to be sent to the retrieval service, such as all map data information processed by the POI data processing service.

[0036] The aforementioned fourth set of map data information may be all the map data information used by the aforementioned retrieval service.

[0037] The aforementioned difference data information can represent the number of differences in map data information between the third map data information set and the fourth map data information set, or it can represent the different map data information between the third map data information set and the fourth map data information set.

[0038] The differences between the third map data set used to distribute the data to the retrieval service and the fourth map data set used by the retrieval service may be due to the distribution process, the retrieval service itself, the retrieval storage service, or human operation, etc. This disclosure does not limit the reasons for these differences.

[0039] Step S103: Verify the validity of the fourth map data information set based on the difference data information.

[0040] The above-mentioned verification of the validity of the fourth map data information set based on the difference data information can be achieved by determining the degree of difference between the third and fourth map data information sets based on the difference data information. If the degree of difference is lower than a preset difference procedure, the fourth map data information set is determined to be valid; otherwise, it is determined to be invalid. Alternatively, the above-mentioned verification of the validity of the fourth map data information set based on the difference data information can be achieved by determining whether the different map data information between the third and fourth map data information sets is map data information associated with the POI involved in the target change. If so, the fourth map data information set is determined to be invalid; otherwise, it is determined to be valid.

[0041] In addition, the above-mentioned determination of the validity of the fourth map data information set can be to determine the validity of some or all of the map data information in the fourth map data information set.

[0042] In this disclosure, the above steps enable the validity verification of map data information used by the retrieval service based on the data information sent to the retrieval service, thereby improving the verification effect of map data information.

[0043] It should be noted that the map data used in the search service is the map data provided to the user, that is, the data that the user ultimately sees. Therefore, in this disclosure, validating the map data used in the search service can be understood as validating the map data provided to the user, thus enabling verification of the map data from the user's perspective and improving the effectiveness of the verification.

[0044] In one embodiment, the first map data information set includes: the map data information set that has been changed in the third map data information set in the event of the target change;

[0045] The second map data information set includes: in the event of the target change, the map data information set that has been changed in the fifth map data information set, wherein the fifth map data information set is the map data information set obtained by the retrieval service, and the fifth map data information set includes the fourth map data information set.

[0046] The changed map data information set in the third map data information set mentioned above can be understood as the set of map data information that has actually changed on the data side for the aforementioned target change, such as the set of bid information changed on the data side, represented as F = {bid1:F1,…..bidN:FN}.

[0047] The aforementioned fifth set of map data information can be understood as the set of map data information after it has been sent to the retrieval service. For example, after the data is sent to the retrieval service, the updated bid information set is obtained from the retrieval storage service, which is represented as B = {bid1:B1,bid2:B2,…,bidN:BN}.

[0048] The aforementioned second map data information set can be understood as the actual map data information set obtained from the retrieval service for the aforementioned target change, such as the actual bid information set obtained from the retrieval service, represented as D={bid1:D1,bid2:D2,….,bidN:DN}.

[0049] The aforementioned fourth map data set can be understood as the map data set used by the retrieval service, which in turn can be understood as the map data set used to display to the user. This fourth map data set can be the map data set used to display to the user from the aforementioned fifth map data set. For example, the set of bid fields used for retrieval can be represented as C = {bid1:C1,bid2:C2,…,bidN:CN}.

[0050] In this implementation, it is possible to determine the difference data information based on the map data information set changed on the data side and the map data information set changed on the retrieval service side, thereby reducing computational overhead.

[0051] It should be noted that this disclosure is not limited to determining the difference data information based on the map data information set changed on the data side and the map data information set changed on the retrieval service side as described above. For example, the difference data information can also be determined directly based on the complete map data information set on the data side and the complete map data information set on the retrieval service side.

[0052] In one embodiment, determining the difference data information based on the first map data information set and the second map data information set includes:

[0053] Based on the first map data information set and the fourth map data information set, a sixth map data information set is determined, wherein the sixth map data information set is the intersection of the fourth map data information set and the first map data information set;

[0054] Based on the second map data information set and the fourth map data information set, a seventh map data information set is determined, wherein the seventh map data information set is the intersection of the fourth map data information set and the second map data information set;

[0055] The difference data information is determined based on the sixth map data information set and the seventh map data information set.

[0056] The aforementioned sixth map data information set can be understood as the map data information set that has actually changed on the data side and needs to be retrieved by the service, such as G=C∩F={bid1:G1,……,bidN:GN}.

[0057] The aforementioned seventh map data information set can be understood as the map data information set that has actually changed on the retrieval service side and needs to be associated with the retrieval service, such as represented as E=C∩D={bid1:E1,bid2:E2,….,bidN:EN}.

[0058] The above-mentioned determination of the difference data information based on the sixth map data information set and the seventh map data information set can be achieved by calculating the difference data information between the sixth map data information set and the seventh map data information set.

[0059] In some implementations, the difference data information determined based on the sixth map data information set and the seventh map data information set may be unexpected map data information other than the map data information generated by the target change and the map data information associated with the current online launch, which can be represented as H = EG = {bid1: H1, ..., bidN: HN}.

[0060] In this embodiment, since the sixth map data information set is the intersection of the fourth map data information set and the first map data information set, and the seventh map data information set is the intersection of the fourth map data information set and the second map data information set, the computational overhead can be reduced. This is because the sixth and seventh map data information sets contain less data than the first and second map data information sets, which may reduce the computational overhead.

[0061] In one embodiment, obtaining the second map data information set in step S101 includes:

[0062] Obtain the eighth map data information set, which is the map data information set obtained by the retrieval service before the target change occurred;

[0063] The difference between the eighth map data information set and the fifth map data information set is used as the second map data information set.

[0064] The aforementioned eighth map data information set can be understood as the map data information stored in the storage service when the aforementioned target change is not sent. For example, the hierarchical bid information set A obtained from the storage service is represented as A = {bid1:A1,bid2:A2,….,bidN:AN}.

[0065] The aforementioned second map data set can be represented as D = B - (B ∩ A) = {bid1:D1,bid2:D2,….,bidN:DN}.

[0066] In this embodiment, the aforementioned second map data information set can be accurately obtained through the eighth map data information set and the fifth map data information set.

[0067] It should be noted that this disclosure does not limit the acquisition of the second map data information set through the eighth map data information set and the fifth map data information set. For example, in some embodiments, the time of map data information change can also be recorded, and the map data information whose change time is after the above-mentioned target change occurs can be used as the second map data information set.

[0068] In one embodiment, Figure 1 Step S103 in the illustrated embodiment includes:

[0069] The number of differential data information is compared with a first preset threshold. If the number of differential data information is less than or equal to the first preset threshold, the fourth map data information set is determined to be valid. If the number of differential data information is greater than the first preset threshold, the fourth map data information set is determined to be invalid.

[0070] The fact that the amount of the aforementioned difference data information is less than or equal to the first preset threshold can be understood as the fact that the amount of unexpected data on the data side and the retrieval service side caused by the aforementioned target change is relatively small, thereby determining the validity of the fourth map data information set.

[0071] The fact that the amount of the aforementioned discrepancy data exceeds the first preset threshold can be interpreted as indicating a significant amount of unexpected data on both the data side and the retrieval service side due to the aforementioned target change, thus determining the invalidity of the fourth map data set. This invalidity can mean that the fourth map data set is ineffective in addressing the aforementioned target change.

[0072] In this embodiment, the validity of the fourth map data set can be determined by comparing the number of differential data information with a first preset threshold, thereby reducing computational overhead.

[0073] In one embodiment, the first preset threshold is a threshold set according to the display frequency of the target POI involved in the target change, and the first preset threshold is positively correlated with the display frequency of the target POI.

[0074] Among them, the above-mentioned target POI is the POI affected by the above-mentioned target change. The display frequency of the above-mentioned target POI can be the display frequency of the target POI recorded in advance after being retrieved. For example: For a famous location POI in an international metropolis, the display frequency of this POI is often relatively high. In this way, when the target change involves this POI, the affected map data information will also be relatively large, so a high threshold is set. For a location or store POI in a county, the display frequency of this POI is often relatively low. In this way, when the target change involves this POI, the affected map data information will also be relatively small, so a low threshold is set.

[0075] The fact that the above-mentioned first preset threshold is positively correlated with the display frequency of the target POI can be understood as that when the display frequency of the target POI is relatively high, the set threshold is relatively high; on the contrary, the set threshold is relatively low.

[0076] In some embodiments, it is possible to select a value that matches the display frequency of the above-mentioned target POI from a pre-configured threshold set. For example, the pre-set threshold set I = {low pv: I1, medium pv: I2, high pv: I3}, so as to select a matching value from this set according to the display frequency of the above-mentioned target POI. For example, the above-mentioned first threshold is expressed as pv, where the value of pv includes: high pv (pv > 300), medium pv (10 < pv < 300), and low pv (pv < 10). When the display frequency of the POI is relatively high, select the threshold of (pv > 300); when the display frequency of the POI is relatively low, select the threshold of (pv < 10). It should be noted that the pv values shown here are only illustrative data, and the value of the above-mentioned first threshold in the present disclosure can be specifically set according to actual needs.

[0077] In this embodiment, since the first preset threshold is positively correlated with the display frequency of the target POI, this can make the first preset threshold match the target POI involved in the above-mentioned target change, so as to improve the accuracy of validity verification.

[0078] It should be noted that in the present disclosure, it is not limited to setting the above-mentioned first preset threshold through the display frequency of the above-mentioned target POI. For example: In some scenarios or embodiments, a default threshold can be directly adopted.

[0079] In one embodiment, it further includes at least one of the following:

[0080] The first verification rule is pre-configured to perform rule verification on all fields of the map data information in the fourth map data information set, wherein the first verification rule is effective on all fields of the map data information in the fourth map data information set;

[0081] The second verification rule is pre-configured to perform rule verification on some fields of the map data information in the fourth map data information set, wherein the second verification rule is effective on the some fields of the map data information in the fourth map data information set;

[0082] Obtain a first recall set of target retrieval information in the retrieval service before the target change, and obtain a second recall set of target retrieval information in the retrieval service after the target change, and determine the recall difference information of the target retrieval information based on the first recall set and the second recall set.

[0083] The aforementioned map data information, including all fields, can be understood as all fields displayed to the user. This allows for the verification of field information presented to the user from their perspective. However, the map data information sent to the retrieval service is diverse; the fifth map data information set stored in the retrieval storage service contains various types of information, some of which are not displayed to the user. This allows for the verification of only information relevant to the user, while other information unrelated to the user is not verified. For example, the fourth map data information set could include information such as name, alias, address, coordinates, city, and status.

[0084] In this embodiment, the aforementioned first verification rule and first verification rule can be a general rule and a characteristic rule customized according to business characteristics. The general rule means that it is valid for all fields, and the characteristic rule means that the rule is customized according to the characteristics of the field.

[0085] The first and second verification rules mentioned above verify different things, for example:

[0086] The first verification rule mentioned above can be used to verify the following:

[0087] Encoding rules for fields and field values, length verification of field values, whether parentheses are matched if the field value contains parentheses, whether the nesting level of parentheses meets expectations, and whether fields and field values ​​contain special characters (e.g., special characters are not allowed).

[0088] The second verification rule mentioned above can be used to verify the following:

[0089] Field values ​​are within their respective allowed ranges. For example, for domestic address data, the address value must contain Chinese characters. Other fields are configured for validation according to their respective value ranges.

[0090] Cross-validation between fields, such as coordinates and city matching. For example, if the city is Beijing, then the coordinates must be within the range of Beijing; otherwise, the data will not meet expectations.

[0091] In some implementations, each field validation rule is represented by a one-dimensional array [A1, A2, A3, A4]. The relationship between all fields and their validation rules is described by a dictionary D, where D = {C1: [A1, A2, A3], C2: [A1, B1, A2, B3], ..., CN: [A1, B1, F1, F2, A2]}, where D represents the set of fourth map data information and validation rules in the above embodiment, and A1, B1, etc., represent validation rules. Therefore, validation rule A1 is valid for all fields, and rule B1 is valid for fields C2 and CN. Therefore, by iterating through the set of validation rules for each field, we can obtain the mapping between validation rules and fields. Taking validation rule A1 as an example, we can obtain various permutations and combinations such as A1 = [C1, C2, C3…CN], A1 = [C1, C2], [C3, ..., CN], and A1 = [C1], [C2], [C3], [C4]. It can be seen that A1 = [C1, C2, C3…CN] is the complete mapping between validation rules and fields. Based on this method, we can obtain the complete mapping set E of all validation rules and fields, that is, E = {A1: [C1, C2, C3…CN], B1: [C2…C], ...}, where validation rule A1 is valid for all fields, which is the first validation rule mentioned above, and B1 is valid for some fields, which is the second validation rule mentioned above.

[0092] It should be noted that the letters A, B, C, D, and E in this embodiment have different meanings than the letters used to represent map data information sets in the previous embodiments.

[0093] In this embodiment, all or part of the fields of the map data information in the fourth map data information set can be verified, thereby further improving the verification effect.

[0094] In addition, in this embodiment, data that does not meet expectations in the first and second verification rules can be recorded and blocked, and will not be displayed to the user.

[0095] In one embodiment, it also includes:

[0096] Obtain a first recall set of target retrieval information in the retrieval service before the target change, and obtain a second recall set of target retrieval information in the retrieval service after the target change, and determine the recall difference information of the target retrieval information based on the first recall set and the second recall set.

[0097] The aforementioned recall set can be either a recall set obtained by simulating the retrieval of the target retrieval information on a map, or a recall set obtained by actually performing a retrieval using the target retrieval information in map software.

[0098] The target retrieval information mentioned above can be one or more retrieval information (queries).

[0099] The aforementioned recall discrepancies may be differences in the content of the recall information, or differences in the order in which the recall information is displayed, etc.

[0100] In this embodiment, the recall difference information can be used to verify the impact of the target change on the retrieval of target retrieval information, thereby further improving the verification effect.

[0101] In addition, the above recall discrepancy information can be output, such as displayed to staff or sent to other electronic devices.

[0102] In one embodiment, the aforementioned determination of the recall difference information of the target retrieval information based on the first recall set and the second recall set includes:

[0103] Calculate the first intersection data information between the first recall set and the first map data information set; calculate the second intersection data information between the second recall set and the first map data information set; based on the first intersection data information and the second intersection data information, determine the recall difference information of the target retrieval information; wherein, the first map data information set includes: the set of map data information that has changed in the third map data information when the target changes.

[0104] In this embodiment, the target retrieval information can be multiple retrieval information, such as multiple high-frequency retrieval information.

[0105] For example: Using the above target retrieval information to simulate a user's map search function, send multiple queries to the search service to obtain the top 10 results of the recall set before the target change, denoted as top10_A={query1:top10_A1,….,queryN:top10_AN}, where top10_AN=[bid_A1,bid_A2,…,bid_AN], and the number of elements in top10_AN is 10; obtain the top 10 results of the recall set after the target change, denoted as top10_B={query1:top10_B1,….,queryN:top10_BN}, where top10_BN=[bid_B1,bid_B2,…,bid_BN].

[0106] The data set that is launched this time due to the change of target, or the data set that is affected on the data side after the service is launched, is the first map data information set mentioned above, which can be represented as F = {bid1:F1,…..bidN:FN}.

[0107] Taking the intersection of top10_A and F yields top10_E = {query1:top10_E1,…,queryN:top10_EN}, and taking the intersection of top10_B and F yields top10_F = {query1:top10_F1,…,queryN:top10_FN}. Difference between top10_E and top10_F yields the set top10_G = {query1:top10_G1,…,queryN:top10_GN}. The set top10_G represents the impact of this change on the recall of high-frequency requests, both before and after the change.

[0108] It should be noted that the letters A, B, E, F, and G in this embodiment have different meanings than the letters used to represent map data information sets in the previous embodiments.

[0109] The recall difference information for determining the target retrieval information based on the first intersection data information and the second intersection data information may be the difference information between the first intersection data information and the second intersection data information.

[0110] In this embodiment, the first intersection data information can represent the map data information that has changed in the recall results before the target change, and the second intersection data information can represent the map data information that has changed in the recall results after the target change. This allows the final determined difference information to only include the map data information that has changed on the data side, so as to achieve a simpler and more direct determination of the recall results affected by the target change.

[0111] In one embodiment, the target retrieval information includes at least one of the following:

[0112] High-frequency retrieval information or constructing retrieval information;

[0113] Wherein, the high-frequency retrieval information is pre-recorded retrieval information, or the retrieval frequency of the high-frequency retrieval information is higher than a second preset threshold;

[0114] The constructed retrieval information is constructed based on the target POI involved in the target change and is related to the target POI.

[0115] In some implementations, the aforementioned high-frequency retrieval information may include high-frequency primary requirements, or it may include the most frequent high-frequency multi-primary requirements. High-frequency primary requirements can be manually labeled, which allows for retrieval verification of both high-frequency primary requirements and high-frequency multi-primary requirements.

[0116] In some implementations, the high-frequency retrieval information (high-frequency query) mentioned above can be queries already existing in a pre-recorded high-frequency term list. This allows for the acquisition of changes in the retrieval results of high-frequency retrieval information before and after changes in the target involving the POI, thereby determining whether the data launch or changes in the POI data processing service have any impact on users.

[0117] In this embodiment, by verifying high-frequency search information, it is possible to avoid verifying a large amount of search information, thereby saving computational overhead. Furthermore, the effect of search verification can also be achieved by verifying high-frequency search information.

[0118] The aforementioned constructed retrieval information can be achieved by simulating a user's search for map data information on the impact of the aforementioned target changes, in order to obtain the direct impact of the target change impact data on the user. Furthermore, the aforementioned constructed retrieval information can be one or more retrieval pieces of information.

[0119] In some implementations, the query body can be constructed using the most frequently used search value recorded in the database when a user wants to access a certain piece of data, and then this body can be used to construct a simulated user request. Alternatively, for the generalized demand construction method, the query for retrieving this data can be retrieved by back-engineering the map data information affected by the aforementioned target change from the retrieval log. Furthermore, the chained demand construction method can be the same as the generalized demand construction method.

[0120] Here is an example:

[0121] Using the data impacted by the aforementioned target changes, search queries are constructed, with different query scenarios created based on the affected fields. For example, when the affected data involves changes in name, address, phone number, status, coordinates, or city fields, precise queries are constructed. When the affected data involves changes in industry (tag), general queries are constructed. If the brand field changes, chain queries are constructed.

[0122] Once the query is constructed, the system simulates a user using the map search function, sending query = [query1, ..., queryN] to the search service. This retrieves the top 10 and top 3 results from the recall set of the request before the target change. The top 10 results before the change are denoted as user_top10_A = {query1:top10_A1, ..., queryN:top10_AN}, where top10_AN = [bid_A1, bid_A2, ..., bid_AN], and top10_AN has 10 elements. The top 3 results before the change are denoted as user_top3_B = {query1:top3_B1, ..., queryN:top3_BN}, where top10_BN = [bid_B1, bid_B2, ..., bid_BN], and top3_BN has 3 elements.

[0123] The modified top 10 is denoted as result user_top10_C={query1:top10_C1,….,queryN:top10_CN}, where top10_CN=[bid_C1,bid_C2,…,bid_CN], and the number of elements in top10_CN is 10. The modified recall top 3 is denoted as result user_top3_D={query1:top3_D1,….,queryN:top3_DN}, where top3_DN=[bid_D1,bid_D2,…,bid_DN], and the number of elements in top10_DN is 3.

[0124] Compare the recall results before and after the change. The recall difference can exist in the following two scenarios:

[0125] Scenario 1: Focusing only on the difference in recall results, such as diffing the recall bid sets top10_AN and top10_CN for a query N in user_top10_A and user_top10_C, without considering the order of elements in the two arrays top10_AN and top10_CN, we get user_top10_E = {query1:top10_E1,….,queryN:top10_EN}, where top10_EN = [bid_E1,bid_E2,…,bid_EN], indicating the difference in top10 recall for the same batch of queries before and after data or service changes.

[0126] Scenario 2: Under the premise of recall, consider the order of the recalled map data information (such as bid). That is, for a certain query N, first obtain the same map data information in top10_AN and top10_CN, and then compare the order of the map data information in the arrays top10_AN and top10_CN. If the order is different, it is recorded as a difference (diff). Thus, user_top_10_F = {query1:top10_F1,….,queryN:top10_FN}, where top10_FN = [bid_F1,bid_F2,…,bid_FN], indicating that after recalling the same map data information for the same batch of queries before and after the target change, the order of results displayed to the user is different. Similarly, the same processing is applied to user_top3_B and user_top3_D to obtain user_top_3_G, which shows the difference in the top 3 recalls for the same batch of queries before and after the target change, and user_top_3_H, which shows the different order of the top 3 recall results displayed to the user after recalling the same batch of queries with the same bid before and after the data or service change in scenario 2.

[0127] In this embodiment, by verifying the constructed retrieval information, it is possible to only retrieve and verify map data information affected by target changes, thereby saving computational overhead.

[0128] In one embodiment, such as Figure 2 As shown, this involves the data source 201, the POI data processing architecture 202, the data application party 203, and the user application layer 204, among which:

[0129] The data source 201 includes basic data, such as user scenario fields that affect retrieval, industry (Tag), brand identifier (brand id, bid), where brand identifier involves general demand and chain demand, as well as other scenario basic fields, and also detail cards, which may include specific map data information.

[0130] The POI data processing architecture 202 includes: POI access service, POI basic subsystem, POI details subsystem and POI exit service, and performs data validity verification within the POI data processing architecture.

[0131] Data application providers 203 include: retrieval and storage services, retrieval architecture and strategy services, dictionary platforms (including large, medium, and small databases), and information display services, as well as other application providers. Data application providers can perform data validity verification and rule verification, and can also verify the effectiveness of data on the dictionary platform.

[0132] User application layer 204 can perform recall result ranking, specifically to verify the impact of high-frequency main demand, the recall ranking effect of high-frequency retrieval information, and the recall ranking effect of online data construction retrieval information retrieval side, such as verifying the recall ranking effect of precise demand, general demand and chain demand on the retrieval side.

[0133] In this disclosure, the effectiveness of map data verification can be improved by verifying the validity of map data information used by the retrieval service based on the data information used to issue to the retrieval service.

[0134] Please see Figure 3a , Figure 3a This disclosure provides a map data change verification device, such as... Figure 3a As shown, the map data change verification device 300 includes:

[0135] The first acquisition module 301 is used to acquire a first map data information set and a second map data information set when a target change involving a point of interest (POI) occurs. The first map data information set includes data information for sending to the retrieval service, and the second map data information set includes data information acquired by the retrieval service.

[0136] The first determining module 302 is used to determine difference data information based on the first map data information set and the second map data information set. The difference data information is used to represent the difference between the third map data information set used to be sent to the retrieval service and the fourth map data information set used by the retrieval service. The third map data information set includes the first map data information set.

[0137] The first verification module 303 is used to verify the validity of the fourth map data information set based on the difference data information.

[0138] Optionally, the first map data information set includes: the map data information set that has been changed in the third map data information set in the event of the target change;

[0139] The second map data information set includes: in the event of the target change, the map data information set that has been changed in the fifth map data information set, wherein the fifth map data information set is the map data information set obtained by the retrieval service, and the fifth map data information set includes the fourth map data information set.

[0140] Optionally, the first determining module 302 is used to:

[0141] Based on the first map data information set and the fourth map data information set, a sixth map data information set is determined, wherein the sixth map data information set is the intersection of the fourth map data information set and the first map data information set;

[0142] Based on the second map data information set and the fourth map data information set, a seventh map data information set is determined, wherein the seventh map data information set is the intersection of the fourth map data information set and the second map data information set;

[0143] The difference data information is determined based on the sixth map data information set and the seventh map data information set.

[0144] Optionally, the first acquisition module 301 is used for:

[0145] In the event of a target change involving a Point of Interest (POI), a first set of map data information is obtained, and an eighth set of map data information is obtained, wherein the eighth set of map data information is the set of map data information obtained by the retrieval service before the target change occurred.

[0146] The difference between the eighth map data information set and the fifth map data information set is used as the second map data information set.

[0147] Optionally, the first verification module 303 is used for:

[0148] The number of differential data information is compared with a first preset threshold. If the number of differential data information is less than or equal to the first preset threshold, the fourth map data information set is determined to be valid. If the number of differential data information is greater than the first preset threshold, the fourth map data information set is determined to be invalid.

[0149] Optionally, the first preset threshold is a threshold set based on the display frequency of the target POI involved in the target change, and the first preset threshold is positively correlated with the display frequency of the target POI.

[0150] Optional, such as Figure 3b As shown, it also includes at least one of the following:

[0151] The second verification module 304 is used to perform rule verification on all fields of map data information in the fourth map data information set using a pre-configured first verification rule, wherein the first verification rule applies to all fields of map data information in the fourth map data information set.

[0152] The third verification module 305 is used to perform rule verification on some fields of map data information in the fourth map data information set using a pre-configured second verification rule, wherein the second verification rule applies to the some fields of map data information in the fourth map data information set.

[0153] The second determining module 306 is used to obtain a first recall set of target retrieval information in the retrieval service before the target change, and to obtain a second recall set of target retrieval information in the retrieval service after the target change, and to determine recall difference information of the target retrieval information based on the first recall set and the second recall set.

[0154] Optionally, the second determining module 306 is used to:

[0155] Obtain a first recall set of target retrieval information in the retrieval service before the target change, and obtain a second recall set of target retrieval information in the retrieval service after the target change; calculate a first intersection data information between the first recall set and the first map data information set; calculate a second intersection data information between the second recall set and the first map data information set; determine the recall difference information of the target retrieval information based on the first intersection data information and the second intersection data information; wherein, the first map data information set includes: the map data information set that has changed in the third map data information when the target change occurs.

[0156] Optionally, the target retrieval information includes at least one of the following:

[0157] High-frequency retrieval information or constructing retrieval information;

[0158] Wherein, the high-frequency retrieval information is pre-recorded retrieval information, or the retrieval frequency of the high-frequency retrieval information is higher than a second preset threshold;

[0159] The constructed retrieval information is constructed based on the target POI involved in the target change and is related to the target POI.

[0160] The map data change verification device provided in this disclosure can implement all the processes of the map data change verification method provided in this disclosure and achieve the same technical effect. To avoid duplication, it will not be described in detail here.

[0161] According to embodiments of this disclosure, this disclosure also provides an electronic device, a readable storage medium, and a computer program product.

[0162] The aforementioned electronic device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the map data change verification method provided in this disclosure.

[0163] The aforementioned readable storage medium stores computer instructions, wherein the computer instructions are used to cause the computer to execute the map data change verification method provided in this disclosure.

[0164] The aforementioned computer program product includes a computer program that, when executed by a processor, implements the map data change verification method provided in this disclosure.

[0165] The acquisition, storage, and application of user personal information involved in the technical solution disclosed herein comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0166] Figure 4 A schematic block diagram of an example electronic device 400 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0167] like Figure 4 As shown, device 400 includes a computing unit 401, which can perform various appropriate actions and processes based on a computer program stored in read-only memory (ROM) 402 or a computer program loaded from storage unit 408 into random access memory (RAM) 403. RAM 403 may also store various programs and data required for the operation of device 400. The computing unit 401, ROM 402, and RAM 403 are interconnected via bus 404. Input / output (I / O) interface 405 is also connected to bus 404.

[0168] Multiple components in device 400 are connected to I / O interface 405, including: input unit 406, such as keyboard, mouse, etc.; output unit 407, such as various types of monitors, speakers, etc.; storage unit 408, such as disk, optical disk, etc.; and communication unit 409, such as network card, modem, wireless transceiver, etc. Communication unit 409 allows device 400 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0169] The computing unit 401 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 401 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 401 performs the various methods and processes described above, such as the map data change verification method. For example, in some embodiments, the map data change verification method may be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 408. In some embodiments, part or all of the computer program may be loaded and / or installed on device 400 via ROM 402 and / or communication unit 409. When the computer program is loaded into RAM 403 and executed by the computing unit 401, one or more steps of the map data change verification method described above may be performed. Alternatively, in other embodiments, the computing unit 401 may be configured to perform the map data change verification method by any other suitable means (e.g., by means of firmware).

[0170] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0171] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0172] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0173] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0174] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with embodiments of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.

[0175] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other. Servers can be cloud servers, servers in distributed systems, or servers incorporating blockchain technology.

[0176] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0177] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.

Claims

1. A method for verifying map data changes, comprising: In the event of a change involving a Point of Interest (POI), a first map data information set and a second map data information set are obtained. The first map data information set includes data information for being sent to the retrieval service, and the second map data information set includes data information obtained by the retrieval service. The data information obtained by the retrieval service includes data information stored in the retrieval storage service. The retrieval storage service is used to store the data information sent to the retrieval service, and the retrieval service is a service that provides map data information retrieval to users. Based on the first map data information set and the second map data information set, difference data information is determined. The difference data information is used to represent the difference between the third map data information set used to be sent to the retrieval service and the fourth map data information set used by the retrieval service. The third map data information set includes the first map data information set. The third map data information set is all map data information used to be sent to the retrieval service, and the fourth map data information set is all map data information used by the retrieval service. The validity of the fourth map data set is verified based on the aforementioned difference data information; The system acquires a first recall set of target retrieval information in the retrieval service before the target change, and a second recall set of target retrieval information in the retrieval service after the target change; calculates a first intersection data information between the first recall set and the first map data information set, and calculates a second intersection data information between the second recall set and the first map data information set; based on the first intersection data information and the second intersection data information, it determines the recall difference information of the target retrieval information; wherein, the first map data information set includes: the set of map data information that has changed in the third map data information when the target change occurs; The map data information refers to the POI (Point of Interest) data.

2. The method according to claim 1, wherein, The first map data information set includes: the map data information set that has been changed in the third map data information set in the event of the target change; The second map data information set includes: in the event of the target change, the map data information set that has been changed in the fifth map data information set, wherein the fifth map data information set is the map data information set obtained by the retrieval service, and the fifth map data information set includes the fourth map data information set.

3. The method according to claim 2, wherein, The step of determining the difference data information based on the first map data information set and the second map data information set includes: Based on the first map data information set and the fourth map data information set, a sixth map data information set is determined, wherein the sixth map data information set is the intersection of the fourth map data information set and the first map data information set; Based on the second map data information set and the fourth map data information set, a seventh map data information set is determined, wherein the seventh map data information set is the intersection of the fourth map data information set and the second map data information set; The difference data information is determined based on the sixth map data information set and the seventh map data information set.

4. The method according to claim 2, wherein, The acquisition of the second map data information set includes: Obtain the eighth map data information set, which is the map data information set obtained by the retrieval service before the target change occurred; The difference between the eighth map data information set and the fifth map data information set is used as the second map data information set.

5. The method according to any one of claims 1 to 4, wherein, The verification of the validity of the fourth map data information set based on the difference data information includes: The number of differential data information is compared with a first preset threshold. If the number of differential data information is less than or equal to the first preset threshold, the fourth map data information set is determined to be valid. If the number of differential data information is greater than the first preset threshold, the fourth map data information set is determined to be invalid.

6. The method according to claim 5, wherein, The first preset threshold is a threshold set based on the display frequency of the target POI involved in the target change, and the first preset threshold is positively correlated with the display frequency of the target POI.

7. The method according to any one of claims 1 to 4, further comprising at least one of the following: The pre-configured first verification rule is used to perform rule verification on all fields of the map data information in the fourth map data information set, wherein... The first verification rule applies to all fields of the map data information in the fourth map data information set; The second verification rule is pre-configured to perform rule verification on some fields of the map data information in the fourth map data information set, wherein the second verification rule is effective on the some fields of the map data information in the fourth map data information set.

8. The method according to claim 1, characterized in that, The target retrieval information includes at least one of the following: High-frequency retrieval information or constructing retrieval information; Wherein, the high-frequency retrieval information is pre-recorded retrieval information, or the retrieval frequency of the high-frequency retrieval information is higher than a second preset threshold; The constructed retrieval information is constructed based on the target POI involved in the target change and is related to the target POI.

9. A map data change verification device, comprising: The first acquisition module is used to acquire a first map data information set and a second map data information set when a target change involving a Point of Interest (POI) occurs. The first map data information set includes data information to be sent to the retrieval service, and the second map data information set includes data information acquired by the retrieval service. The data information acquired by the retrieval service includes data information stored in the retrieval storage service. The retrieval storage service is used to store the data information sent to the retrieval service, and the retrieval service is a service to provide map data information retrieval to users. The first determining module is used to determine difference data information based on the first map data information set and the second map data information set. The difference data information is used to represent the difference between the third map data information set used to be sent to the retrieval service and the fourth map data information set used by the retrieval service. The third map data information set includes the first map data information set. The third map data information set is all map data information used to be sent to the retrieval service, and the fourth map data information set is all map data information used by the retrieval service. The first verification module is used to verify the validity of the fourth map data information set based on the difference data information; The second determining module is used to obtain a first recall set of target retrieval information in the retrieval service before the target change, and to obtain a second recall set of target retrieval information in the retrieval service after the target change; calculate a first intersection data information between the first recall set and the first map data information set, and calculate a second intersection data information between the second recall set and the first map data information set; and determine the recall difference information of the target retrieval information based on the first intersection data information and the second intersection data information; wherein, the first map data information set includes: the map data information set that has changed in the third map data information when the target change occurs; The map data information refers to the POI (Point of Interest) data.

10. The apparatus according to claim 9, wherein, The first map data information set includes: the map data information set that has been changed in the third map data information set in the event of the target change; The second map data information set includes: in the event of the target change, the map data information set that has been changed in the fifth map data information set, wherein the fifth map data information set is the map data information set obtained by the retrieval service, and the fifth map data information set includes the fourth map data information set.

11. The apparatus according to claim 10, wherein, The first determining module is used for: Based on the first map data information set and the fourth map data information set, a sixth map data information set is determined, wherein the sixth map data information set is the intersection of the fourth map data information set and the first map data information set; Based on the second map data information set and the fourth map data information set, a seventh map data information set is determined, wherein the seventh map data information set is the intersection of the fourth map data information set and the second map data information set; The difference data information is determined based on the sixth map data information set and the seventh map data information set.

12. The apparatus according to claim 10, wherein, The first acquisition module is used for: In the event of a target change involving a Point of Interest (POI), a first set of map data information is obtained, and an eighth set of map data information is obtained, wherein the eighth set of map data information is the set of map data information obtained by the retrieval service before the target change occurred. The difference between the eighth map data information set and the fifth map data information set is used as the second map data information set.

13. The apparatus according to any one of claims 9 to 12, wherein, The first verification module is used for: The number of differential data information is compared with a first preset threshold. If the number of differential data information is less than or equal to the first preset threshold, the fourth map data information set is determined to be valid. If the number of differential data information is greater than the first preset threshold, the fourth map data information set is determined to be invalid.

14. The apparatus according to claim 13, wherein, The first preset threshold is a threshold set based on the display frequency of the target POI involved in the target change, and the first preset threshold is positively correlated with the display frequency of the target POI.

15. The apparatus according to any one of claims 9 to 12, further comprising at least one of the following: The second verification module is used to perform rule verification on all fields of the map data information in the fourth map data information set using pre-configured first verification rules. The first verification rule applies to all fields of the map data information in the fourth map data information set; The third verification module is used to perform rule verification on some fields of map data information in the fourth map data information set using a pre-configured second verification rule, wherein the second verification rule applies to the relevant fields of the map data information in the fourth map data information set.

16. The apparatus according to claim 15, characterized in that, The target retrieval information includes at least one of the following: High-frequency retrieval information or constructing retrieval information; Wherein, the high-frequency retrieval information is pre-recorded retrieval information, or the retrieval frequency of the high-frequency retrieval information is higher than a second preset threshold; The constructed retrieval information is constructed based on the target POI involved in the target change and is related to the target POI.

17. An electronic device comprising: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-8.

18. A non-transitory computer-readable storage medium storing computer instructions, wherein, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-8.

19. A computer program product comprising a computer program that, when executed by a processor, implements the method according to any one of claims 1-8.

Images