Blacklist duplicate checking method and system, computer equipment and storage medium

Abstract

The invention relates to a blacklist duplicate checking method, which comprises the following steps: receiving at least one data list as an incoming parameter, the at least one data list comprising user basic information; querying in a preset blacklist database according to the user basic information to obtain a query result; determining a target user according to the query result, and assembling to obtain a query character string including unique identification information of the target user; according to the query character string, performing query in the blacklist database to obtain a data number corresponding to the related data; screening the at least one data list according to the data number, and determining whether a target data list meeting a preset condition exists or not; and if the target data list exists, determining that the incoming parameters are not completely repeated in the blacklist database, otherwise, determining that the incoming parameters are completely repeated in the blacklist database. According to the invention, the efficiency of duplicate checking during addition of the blacklist is improved.

Description

Technical Field

[0001] The present application relates to the fields of information processing and financial technology, and is applied to the scenario of checking for duplicate data when adding a new blacklist, and in particular to a blacklist duplication checking method, system, computer equipment and storage medium. Background Art

[0002] As an industry closely integrated with financial technology, the insurance industry generally needs to verify whether customers are on the blacklist during business processes to avoid risks. Therefore, it is particularly important to manage the blacklist.

[0003] However, due to the numerous business lines, the blacklist has many sources and the data volume is huge, which makes the management of the blacklist face many challenges. Among them, the most critical is the deduplication operation when adding new blacklists. When adding new data, if it is not screened to remove the duplicates in the blacklist database, the data volume will expand rapidly, resulting in a decline in system performance.

[0004] At present, the traditional solution is to use different interfaces to perform data verification and insertion operations respectively. However, except for the final storage operation, the two interfaces are almost the same in the duplicate checking part. Both compare the input data with the data in the blacklist database one by one to determine whether they are all repeated. If they are all repeated, it will directly prompt the front-end data that the data already exists and no insertion is required; if they are not all repeated, the non-duplicate parts will be inserted. However, using this method to check for duplicates is too inefficient, and as the amount of data continues to increase, the system performance will gradually decline, affecting the user experience. Summary of the invention

[0005] The purpose of the embodiments of the present application is to propose a blacklist duplication checking method, system, computer device and storage medium to solve the technical problem that the efficiency of duplication checking is too low during the deduplication operation when adding a new blacklist.

[0006] In order to solve the above technical problems, the present application embodiment provides a blacklist duplicate checking method, which adopts the following technical solution:

[0007] A blacklist duplicate checking method comprises the following steps:

[0008] receiving at least one data list as an input parameter, wherein the at least one data list includes basic information of a user;

[0009] According to the basic information of the user, a query is performed in a preset blacklist database to obtain a query result;

[0010] Determine the target user according to the query result, and assemble to obtain a query string including the unique identification information of the target user;

[0011] According to the query string, query the blacklist database to obtain the number of data items corresponding to the relevant data;

[0012] Screening the at least one data list according to the number of data items to determine whether there is a target data list that meets the preset conditions;

[0013] If the target data list exists, it is confirmed that the input parameters are not all repeated in the blacklist database; otherwise, it is confirmed that the input parameters are all repeated in the blacklist database.

[0014] Furthermore, the step of screening the at least one data list according to the number of data items to determine whether there is a target data list that meets the preset conditions specifically includes:

[0015] Calculate the list size of each data list in the at least one data list by using a size function;

[0016] The list size of each data list is compared with the number of data items to determine whether there is a data list whose list size is greater than the number of data items, and the data list is used as the target data list.

[0017] Furthermore, the unique identification information includes a primary key ID, and the step of determining the target user according to the query result and assembling a query string including the unique identification information of the target user specifically includes:

[0018] Determine, according to the query result, a target user matching the basic information of the user;

[0019] Obtain the primary key ID of the target user, and determine the individual group identifier, verification type and entry organization of the target user according to the primary key ID;

[0020] The query string is obtained by assembling according to the primary key ID, the individual group identifier, the verification type, the entry organization and the at least one data list.

[0021] Furthermore, the basic user information includes name, certificate number and certificate type, and the step of querying a preset blacklist database based on the basic user information to obtain a query result specifically includes:

[0022] Searching the blacklist database according to the name, the ID number and the ID type to determine whether there is a relevant data record and verifying it through a matching algorithm;

[0023] If the data record exists, and the name, the certificate number, and the certificate type are verified, the user corresponding to the data record is used as the target user and output as the query result;

[0024] Otherwise, it is determined that the target user does not exist, and the result is output as the query result.

[0025] Furthermore, after the step of performing a query in a preset blacklist database according to the basic information of the user to obtain a query result, the method further includes:

[0026] According to the query result, if it is determined that the target user does not exist, it is confirmed that the input parameters are not all repeated in the blacklist database.

[0027] Furthermore, the step of querying the blacklist database according to the query string to obtain the number of data items corresponding to the relevant data specifically includes:

[0028] According to the query character string, query the blacklist database to determine the relevant data;

[0029] Standardizing the relevant data to obtain standardized data;

[0030] The number of the standardized data is counted as the number of data items.

[0031] Further, after the step of confirming that the input parameters are not all repeated in the blacklist database if the target data list exists, or otherwise confirming that the input parameters are all repeated in the blacklist database, it also includes:

[0032] If it is confirmed that the input parameters are not all repeated in the blacklist database, the input parameters are screened to obtain non-repeated information, and the non-repeated information is entered into the blacklist database;

[0033] If it is confirmed that the input parameters are all repeated in the blacklist database, a preset prompt message that the blacklist is all repeated is sent to the administrator client.

[0034] In order to solve the above technical problems, the present application also provides a blacklist duplicate checking system, which adopts the following technical solution:

[0035] A receiving module, used for receiving at least one data list as an input parameter, wherein the at least one data list includes basic information of a user;

[0036] A first query module, used to query a preset blacklist database according to the basic information of the user to obtain a query result;

[0037] An assembling module, used to determine a target user according to the query result, and assemble a query string including unique identification information of the target user;

[0038] A second query module, used to query the blacklist database according to the query string to obtain the number of data items corresponding to the relevant data;

[0039] A screening module, used to screen the at least one data list according to the number of data items, and determine whether there is a target data list that meets the preset conditions;

[0040] The confirmation module is used to confirm that the input parameters are not all repeated in the blacklist database if the target data list exists, otherwise, confirm that the input parameters are all repeated in the blacklist database.

[0041] In order to solve the above technical problems, the embodiment of the present application further provides a computer device, which adopts the following technical solution:

[0042] A computer device includes a memory and a processor, wherein the memory stores computer-readable instructions, and the processor implements the steps of the blacklist duplicate checking method as described above when executing the computer-readable instructions.

[0043] In order to solve the above technical problems, the embodiment of the present application further provides a computer-readable storage medium, which adopts the following technical solution:

[0044] A computer-readable storage medium stores computer-readable instructions, which, when executed by a processor, implement the steps of the blacklist duplicate checking method as described above.

[0045] Compared with the prior art, the embodiments of the present application have the following beneficial effects:

[0046] The blacklist duplicate checking method disclosed in the present application receives at least one data list as an input parameter, and the at least one data list includes basic user information; then, according to the basic user information, a query is performed in a preset blacklist database to obtain a query result; then, according to the query result, a target user is determined, and a query string including the unique identification information of the target user is assembled; then, according to the query string, a query is performed in the blacklist database to obtain the number of data items corresponding to the relevant data; thereby, the at least one data list is screened according to the number of data items to determine whether there is a target data list that meets the preset conditions; if the target data list exists, it is confirmed that the input parameters are not all repeated in the blacklist database, otherwise, it is confirmed that the input parameters are all repeated in the blacklist database. The present application queries the target user corresponding to the data list in the input parameter, and queries the number of data items of the relevant data according to the target user, so that the comparison between the data list size and the number of data items can be used to determine whether the input data is all repeated in the blacklist database, so that when a new blacklist is added, it is not necessary to compare the data one by one during the deduplication operation, thereby improving the efficiency of blacklist duplicate checking, alleviating the impact of the increase in data volume on system performance, and improving user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the scheme in the present application, a brief introduction is given below to the drawings required for use in the description of the embodiments of the present application. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0048] Figure 1 is an exemplary system architecture diagram to which the present application may be applied;

[0049] Figure 2 It is a flowchart of an embodiment of the blacklist duplicate checking method according to the present application;

[0050] Figure 3 It is a structural diagram of an embodiment of a blacklist duplicate checking system according to the present application;

[0051] Figure 4 It is a structural diagram of an embodiment of a computer device according to the present application. DETAILED DESCRIPTION

[0052] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by technicians in the technical field of the present application; the terms used in the specification of the application herein are only for the purpose of describing specific embodiments and are not intended to limit the present application; the terms "including" and "having" and any variations thereof in the specification and claims of the present application and the above-mentioned drawings are intended to cover non-exclusive inclusions. The terms "first", "second", etc. in the specification and claims of the present application or the above-mentioned drawings are used to distinguish different objects, not to describe a specific order.

[0053] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0054] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings.

[0055] like Figure 1 As shown, the system architecture 100 may include terminal devices 101, 102, 103, a network 104 and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0056] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 101, 102, 103, such as web browser applications, shopping applications, search applications, instant messaging tools, email clients, social platform software, etc.

[0057] Terminal devices 101, 102, 103 can be various electronic devices with display screens and supporting web browsing, including but not limited to smart phones, tablet computers, e-book readers, MP3 (Moving Picture Experts Group Audio Layer III) players, MP4 (Moving Picture Experts Group Audio Layer IV) players, laptop computers, desktop computers, etc.

[0058] The server 105 may be a server that provides various services, such as a background server that provides support for web pages displayed on the terminal devices 101 , 102 , and 103 .

[0059] It should be noted that the blacklist duplication checking method provided in the embodiment of the present application is generally executed by a server, and accordingly, the blacklist duplication checking system is generally set in the server.

[0060] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0061] Continue to refer Figure 2 , shows a flow chart of an embodiment of a blacklist duplicate checking method according to the present application. The blacklist duplicate checking method comprises the following steps:

[0062] Step S201: receiving at least one data list as an input parameter, wherein the at least one data list includes basic information of a user.

[0063] In this embodiment, the electronic device (eg Figure 1 The server shown in the figure) can receive or send data through a wired connection or a wireless connection. It should be noted that the above wireless connection method may include but is not limited to 3G / 4G / 5G connection, WiFi connection, Bluetooth connection, WiMAX connection, Zigbee connection, UWB (ultra wideband) connection, and other wireless connection methods currently known or to be developed in the future.

[0064] It should be noted that insurance is an important part of the financial industry, and financial technology has a significant impact on the insurance industry. With the development of financial technology, insurance companies' innovations in financial technology include channel innovation, product innovation and service innovation based on the Internet. For insurance companies, whether it is products, marketing and underwriting, or claims, services and anti-fraud, they all need to combine innovations in financial technology on the basis of business scenarios in order to achieve better results.

[0065] It should be noted that in the process of managing the blacklist, the main functions used generally include adding (adding to the blacklist), accommodating (not belonging to the blacklist for a period of time), withdrawing (not belonging to the blacklist) and querying (viewing the list and details page).

[0066] In this embodiment, in order to perform deduplication when a new blacklist is added, it is necessary to first determine whether the input data is all repeated in the blacklist database. First, at least one data list is received as an input parameter, wherein at least one data list contains basic user information. Specifically, the input parameter is the input parameter, which is sent by the front end. The input parameter includes at least one data list, and at least one data list contains basic user information. This means that no matter how many data lists the input parameter includes, it at least contains basic user information. For example, the input parameter can include four data lists, namely, the input customer ListA, the product category ListB, the technical product ListC and the market product ListD, wherein the input customer ListA contains the basic user information, and the basic user information can include the user's name, ID number and ID type. The next step can be performed based on the user's basic information.

[0067] It can be understood that, based on the above content, since the participating customers ListA contains the basic information of the user, for entry, the participating customers ListA is required, while the major product categories ListB, the technical products ListC and the market products ListD are not required. In addition, unlike the participating customers ListA, the major product categories ListB, the technical products ListC and the market products ListD are in a secondary relationship, and the major product categories ListB is the parent data list of the technical products ListC, and the technical products ListC is the parent data list of the market products ListD.

[0068] Step S202: query a preset blacklist database based on the basic information of the user to obtain a query result.

[0069] In this embodiment, after receiving at least one data list as an input parameter, the user basic information contained in the at least one data list can be queried in the preset blacklist database to obtain the query result. Specifically, after receiving at least one data list as an input parameter, the user basic information can be extracted from it. The user basic information can include name, ID number and ID type, etc. According to the user basic information, the preset blacklist database can be queried to determine whether there is a related data record and verify it through a matching algorithm. If there is a related data record and the user basic information is verified, the user corresponding to the data record is used as the target user and output as the query result; otherwise, it is determined that the target user does not exist and is output as the query result.

[0070] Optionally, the preset blacklist database can be a MySQL database, which is a widely used relational database. Its query methods include basic query, conditional query, sorting, aggregate function, grouping, paging query, etc. The query means used in this embodiment may include but are not limited to any one of the above query methods.

[0071] Step S203: determine the target user according to the query result, and assemble to obtain a query string including the unique identification information of the target user.

[0072] In this embodiment, after obtaining the query results, the target user can be determined based on the query results, and a query string including the unique identification information of the target user can be assembled. Specifically, the unique identification information of the user can include a primary key ID, which is an attribute that already exists in the business field and can uniquely identify a certain entity. According to the query results, the target user matching the basic information of the user can be determined, and then the primary key ID of the target user is obtained, and the individual group identification, verification type and entry organization of the target user are determined based on the primary key ID, and then assembled based on the primary key ID, individual group identification, verification type, entry organization and at least one data list as input parameters to obtain a query string for subsequent queries.

[0073] Step S204: query the blacklist database according to the query string to obtain the number of data items corresponding to the relevant data.

[0074] In this embodiment, after assembling the query string including the unique identification information of the target user, the preset blacklist database can be queried according to the query string to obtain the number of data items corresponding to the relevant data. Specifically, according to the query string, the preset blacklist database can be queried to obtain the relevant data of the query string, and then the relevant data can be standardized to obtain the standardized data, and then the number of standardized data is counted as the number of data items corresponding to the relevant data, which is used for subsequent screening of at least one data list.

[0075] Step S205: screening the at least one data list according to the number of data items to determine whether there is a target data list that meets preset conditions.

[0076] In this embodiment, after obtaining the number of data items corresponding to the relevant data, at least one data list can be screened according to the number of data items to determine whether there is a target data list that meets the preset conditions. Specifically, the number of data items is the number of standardized data obtained by statistics after standardizing the relevant data, and the preset condition is greater than the number of data items. The list size of each data list in at least one data list can be calculated through the size function, and the list size of each data list is compared with the number of data items to determine whether there is a data list whose list size is greater than the number of data items. If it exists, the data list meets the preset conditions and can be used as the target data list. If it does not exist, it means that there is no data list that meets the preset conditions and there is no target data list.

[0077] Step S206: If the target data list exists, confirm that the input parameters are not all repeated in the blacklist database; otherwise, confirm that the input parameters are all repeated in the blacklist database.

[0078] In this embodiment, when determining whether there is a target data list that meets the preset conditions, if there is a target data list, it is confirmed that the input parameters are not all repeated in the blacklist database, otherwise, it is confirmed that the input parameters are all repeated in the blacklist database. Specifically, when there is a target data list whose list size is larger than the number of data items, it means that the data in the data list is not completely stored in the blacklist database. At this time, it is confirmed that the input parameters are not all repeated in the preset blacklist database; when there is no target data list whose list size is larger than the number of data items, the list size of each data list in at least one data list is less than or equal to the number of data items, which means that the data in at least one data list is completely stored in the blacklist database. At this time, it is confirmed that the input parameters are all repeated in the preset blacklist database. For example, the received incoming parameters include four data lists, namely, customer ListA, product category ListB, technical product ListC, and market product ListD. The sizes of the four data lists are calculated by the size function, namely, sizeA, sizeB, sizeC, and sizeD, and compared with the number of data items. If any of the four list sizes is greater than the number of data items, the first preset result can be returned to the front end, indicating that the incoming parameters are not all repeated in the blacklist database; if the sizes of the four lists are all less than or equal to the number of data items, the second preset result can be returned to the front end, indicating that the incoming parameters are all repeated in the blacklist database.

[0079] This application queries the target user corresponding to the data list in the input parameter, and based on the number of data items queried by the target user, it can use the comparison between the data list size and the number of data items to determine whether all the input data are repeated in the blacklist database, so that when adding a new blacklist, there is no need to compare the data one by one during the deduplication operation, thereby improving the efficiency of blacklist duplication checking, alleviating the impact of the increase in data volume on system performance, and improving user experience.

[0080] In some optional implementations of this embodiment, the step of screening the at least one data list according to the number of data items to determine whether there is a target data list that meets the preset conditions includes:

[0081] Calculate the list size of each data list in the at least one data list by using a size function;

[0082] The list size of each data list is compared with the number of data items to determine whether there is a data list whose list size is greater than the number of data items, and the data list is used as the target data list.

[0083] In this embodiment, after querying the preset blacklist database according to the query string and obtaining the number of data items corresponding to the relevant data, the list size of each data list in at least one data list can be calculated by the size function, and the list size of each data list is compared with the number of data items to determine whether there is a data list whose list size is greater than the number of data items as the target data list. Specifically, in a programming language, the size function can return the number of elements in an array, which is used to refer to the length of a dynamic array. By calculating with the help of the size function, the list size of each data list in at least one data list can be obtained, and the number of data items is obtained by querying the query string, and the query string is obtained by assembling data based on the unique identification information of the target user. Therefore, the number of data items represents the total amount of the relevant data of the target user in the preset blacklist database, and the list size of each data list in at least one data list is compared with the number of data items to determine whether there is a target data list whose list size is greater than the number of data items. If it exists, it means that the amount of its data exceeds the total amount of the relevant data in the preset blacklist database; if it does not exist, it means that the data in at least one data list is completely stored in the blacklist database, and different preset results can be returned to the front end according to the comparison result for corresponding processing.

[0084] By comparing the input data with the amount of related data in the blacklist database, this application can easily determine whether the input data is completely repeated in the blacklist database, thereby improving the efficiency of duplicate checking during the deduplication operation when adding a new blacklist.

[0085] In some optional implementations, the unique identification information includes a primary key ID, and the step of determining the target user according to the query result and assembling a query string including the unique identification information of the target user includes:

[0086] Determine, according to the query result, a target user matching the basic information of the user;

[0087] Obtaining the primary key ID of the target user, and determining the individual group ID, verification type and entry organization of the target user according to the primary key ID;

[0088] The query string is obtained by assembling according to the primary key ID, the individual group identifier, the verification type, the entry organization and the at least one data list.

[0089] In this embodiment, the unique identification information of the target user includes the primary key ID. After obtaining the query result, the target user matching the basic information of the user can be determined according to the query result, the primary key ID of the target user is obtained, and the individual group identification, verification type and input organization of the target user are determined according to the primary key ID. Then, the query string is obtained according to the primary key ID, the individual group identification, verification type, input organization and at least one data list. Specifically, the "field" or "combination of fields" that can uniquely identify each record in the data table is called the primary key (primary code). Therefore, the primary key ID can be used as the unique identification information of each user, and according to the unique identification information of the target user, the relevant business information of the target user, such as the individual group identification, verification type and input organization, can also be determined and extracted in the record, wherein the individual group identification distinguishes whether the user is an individual or a group, and the verification type is the verification type used when the user is verified. Finally, on the basis of the primary key ID, the individual group identification, verification type and input organization, at least one data list as an input parameter is added for data assembly, and a set of data can be obtained as a query string for subsequent query of related data.

[0090] The present application assembles data on the unique identification information and related business information of the target user and at least one data list as an input parameter to obtain a query string subsequently used to query related data, thereby improving the efficiency of duplicate checking during the deduplication operation when adding a new blacklist.

[0091] In some optional implementations, the basic user information includes name, certificate number and certificate type, and the step of performing a query in a preset blacklist database based on the basic user information to obtain a query result includes:

[0092] Searching the blacklist database according to the name, the ID number and the ID type to determine whether there is a relevant data record and verifying it through a matching algorithm;

[0093] If the data record exists, and the name, the certificate number, and the certificate type are verified, the user corresponding to the data record is used as the target user and output as the query result;

[0094] Otherwise, it is determined that the target user does not exist, and the result is output as the query result.

[0095] In this embodiment, the basic information of the user includes name, ID number and ID type. Since at least one data list as the incoming parameter contains the basic information of the user, after receiving the incoming parameters, a query can be performed in the preset blacklist database according to the name, ID number and ID type to determine whether there is a related data record and verify it through a matching algorithm. If there is a related data record and the name, ID number and ID type are verified, the user corresponding to the data record is taken as the target user and output as the query result; otherwise, it is determined that the target user does not exist and is output as the query result. Specifically, when the user's basic information such as name, ID number and ID type is obtained in the passed parameters, a query can be performed in the preset blacklist database based on the user's basic information to determine whether there is a related data record, that is, the field of the data record contains information related to the user's basic information. At the same time, the data record is verified through a matching algorithm to determine whether the name, ID number and ID type in the data record are consistent with the user's basic information. If they are consistent, it is deemed that the verification has passed, and the user corresponding to the data record is taken as the target user, and output as the query result; if the relevant data record is not found, or if the relevant data record is found but the name does not match the ID number and ID type during the verification process, the verification fails, it is determined that the target user does not exist, and is output as the query result.

[0096] Optionally, even if the user's name in the user basic information is the same as in the data record but the ID number and ID type are different, the matching algorithm can also verify whether the ID and ID number match the name. As long as they belong to the same person, they are considered to be the target user.

[0097] This application queries the corresponding target user in the blacklist database through the basic user information carried in the data list in the input parameter, so that the query string can be assembled according to the target user to query the number of data items of the relevant data, which is used to determine whether all the input parameter data are repeated, thereby improving the efficiency and accuracy of duplicate checking during the deduplication operation when adding a new blacklist.

[0098] In some optional implementations, after the step of performing a query in a preset blacklist database according to the basic information of the user to obtain a query result, the method further includes:

[0099] According to the query result, if it is determined that the target user does not exist, it is confirmed that the input parameters are not all repeated in the blacklist database.

[0100] In this embodiment, after querying the preset blacklist database according to the basic information of the user and obtaining the query result, the target user can be determined according to the query result. However, according to the query result, if it is determined that the target user does not exist, it is confirmed that the input parameters are not all repeated in the blacklist database. Specifically, when querying the preset blacklist database according to the basic information of the user, the query result obtained may also be that the target user does not exist. For example, if the relevant data record is not found or the relevant data record is found but the verification fails, it can be determined that the target user does not exist and output as the query result. At this time, it is determined that the target user does not exist according to the query result, and the first preset result can be directly returned to the front end to indicate that the input parameters are not all repeated in the blacklist database.

[0101] When this application queries the blacklist database for the corresponding target user through the basic user information carried in the data list in the input parameter, if the target user does not exist, the result that is not completely repeated can be directly returned, thereby omitting the subsequent steps, greatly improving the efficiency of the deduplication process when adding a new blacklist, alleviating the impact of the increase in data volume on system performance, and improving the user experience.

[0102] In some optional implementations, the step of querying the blacklist database according to the query string to obtain the number of data items corresponding to the relevant data specifically includes:

[0103] According to the query character string, query the blacklist database to determine the relevant data;

[0104] Standardizing the relevant data to obtain standardized data;

[0105] The number of the standardized data is counted as the number of data items.

[0106] In this embodiment, after assembling a query string including the unique identification information of the target user, a query can be performed in a preset blacklist database according to the query string to determine the relevant data, and the relevant data can be standardized to obtain standardized data, and finally the number of standardized data can be counted as the number of data items corresponding to the relevant data. Specifically, the relevant data is the data related to it that is queried according to the query string, such as data related to the individual group identification, data related to the verification type, data related to the input organization, or data related to other data in the data list. After determining the relevant data, it is necessary to form a fixed structure so that the number can be accurately counted. Therefore, the relevant data is standardized, and after obtaining the standardized data, the number of standardized data is counted as the number of data items corresponding to the relevant data, which can be used for subsequent screening of the incoming parameters.

[0107] It is understandable that the above process of querying the preset blacklist database according to the query string is a secondary query after the target user is determined. Therefore, the relevant data queried are all based on the primary key ID matching, thereby avoiding the reduction of efficiency due to excessive data volume.

[0108] This application obtains a query string by assembling to query related data, and uses data standardization to better count the number of data items of related data, so that it is possible to subsequently determine whether all the input data are repeated by comparing the size of the data list with the number of data items, thereby improving the efficiency and accuracy of duplicate checking during the deduplication operation when adding a blacklist.

[0109] In some optional implementations, after the step of confirming that the input parameters are not all repeated in the blacklist database if the target data list exists, and otherwise confirming that the input parameters are all repeated in the blacklist database, the method further includes:

[0110] If it is confirmed that the input parameters are not all repeated in the blacklist database, the input parameters are screened to obtain non-repeated information, and the non-repeated information is entered into the blacklist database;

[0111] If it is confirmed that the input parameters are all repeated in the blacklist database, a preset prompt message that the blacklist is all repeated is sent to the administrator client.

[0112] In this embodiment, when determining whether there is a target data list that meets the preset conditions, if it is confirmed that the incoming parameters are not all repeated in the preset blacklist database, the incoming parameters are screened to obtain non-repeated information, and the non-repeated information is entered into the blacklist database; if it is confirmed that the incoming parameters are all repeated in the preset blacklist database, a preset prompt message of all blacklist repetitions is sent to the administrator user end. Specifically, when the incoming parameters are not all repeated in the blacklist database, it is necessary to screen the incoming parameters, determine the non-repeated parts as non-repeated information, and enter the non-repeated information into the blacklist database; in addition, the administrator has preset a prompt message, the content of which at least includes "all blacklist repetitions". When the incoming parameters are all repeated in the blacklist database, the preset prompt message can be directly sent to the administrator user end so that manual intervention can be performed to ensure that the incoming parameters are not entered into the blacklist database to complete the deduplication operation.

[0113] This application sends prompt information in a timely manner, allowing humans to intervene in the process of deduplication when adding new blacklists, ensuring that all duplicate data will not be entered into the blacklist database, thereby alleviating the impact of increased data volume on system performance and improving user experience.

[0114] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Among them, artificial intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.

[0115] The basic technologies of artificial intelligence generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics, etc. Artificial intelligence software technologies mainly include computer vision technology, robotics technology, biometrics technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0116] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through computer-readable instructions, and the computer-readable instructions can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the aforementioned storage medium can be a non-volatile storage medium such as a disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0117] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

[0118] Further references Figure 3 , as a response to the above Figure 2 The present application provides an embodiment of a blacklist duplicate checking system, which is similar to Figure 2 Corresponding to the method embodiment shown, the system can be specifically applied to various electronic devices.

[0119] like Figure 3 As shown, the blacklist duplicate checking system 300 described in this embodiment includes: a receiving module 301, a first query module 302, an assembly module 303, a second query module 304, a screening module 305 and a confirmation module 306. Among them:

[0120] A receiving module 301 is used to receive at least one data list as an input parameter, wherein the at least one data list includes basic information of a user;

[0121] The first query module 302 is used to query a preset blacklist database according to the basic information of the user to obtain a query result;

[0122] An assembling module 303 is used to determine a target user according to the query result, and assemble a query string including unique identification information of the target user;

[0123] A second query module 304 is used to query the blacklist database according to the query string to obtain the number of data items corresponding to the relevant data;

[0124] A screening module 305, configured to screen the at least one data list according to the number of data items to determine whether there is a target data list that meets a preset condition;

[0125] The confirmation module 306 is used to return the first preset result if the target data list exists, and otherwise return the second preset result.

[0126] The blacklist duplicate checking system provided in the present application can use the comparison between the size of the data list and the number of data items to determine whether all the input data are repeated in the blacklist database by querying the target user corresponding to the data list in the input parameter and querying the number of data items based on the target user's related data. This makes it unnecessary to compare the data one by one during the deduplication operation when adding a new blacklist, thereby improving the efficiency of the blacklist duplicate checking, alleviating the impact of the increase in data volume on system performance, and improving the user experience.

[0127] In some optional implementations of this embodiment, the screening module 305 is further used to:

[0128] Calculate the list size of each data list in the at least one data list by using a size function;

[0129] The list size of each data list is compared with the number of data items to determine whether there is a data list whose list size is greater than the number of data items, and the data list is used as the target data list.

[0130] The blacklist duplication checking system provided in the present application determines whether all the input data are repeated in the blacklist database by comparing the input data with the amount of related data in the blacklist database, thereby improving the efficiency of duplication checking during the deduplication operation when adding a new blacklist.

[0131] In some optional implementations of this embodiment, the unique identification information includes a primary key ID, and the assembly module 303 is further used to:

[0132] Determine, according to the query result, a target user matching the basic information of the user;

[0133] Obtaining the primary key ID of the target user, and determining the individual group ID, verification type and entry organization of the target user according to the primary key ID;

[0134] The query string is obtained by assembling according to the primary key ID, the individual group identifier, the verification type, the entry organization and the at least one data list.

[0135] The blacklist duplicate checking system provided in the present application assembles data on the unique identification information and relevant business information of the target user and at least one data list as an input parameter, and obtains a query string that is subsequently used to query related data, thereby improving the efficiency of duplicate checking during the deduplication operation when adding a new blacklist.

[0136] In some optional implementations of this embodiment, the basic user information includes name, certificate number and certificate type, and the first query module 302 is further used to:

[0137] Searching the blacklist database according to the name, the ID number and the ID type to determine whether there is a relevant data record and verifying it through a matching algorithm;

[0138] If the data record exists, and the name, the certificate number, and the certificate type are verified, the user corresponding to the data record is used as the target user and output as the query result;

[0139] Otherwise, it is determined that the target user does not exist, and the result is output as the query result.

[0140] The blacklist duplicate checking system provided by the present application queries the corresponding target user in the blacklist database through the basic information of the user carried in the data list in the input parameter, so that the query string can be assembled according to the target user to query the number of data items of the relevant data, which is used to determine whether all the input data are repeated, thereby improving the efficiency and accuracy of duplicate checking during the deduplication operation when adding a new blacklist.

[0141] In some optional implementations of this embodiment, the blacklist duplicate checking system 300 is further used to:

[0142] According to the query result, if it is determined that the target user does not exist, the first preset result is directly returned.

[0143] The blacklist duplicate checking system provided by the present application can directly return the results that are not completely repeated when searching for the corresponding target user in the blacklist database through the basic information of the user carried in the data list in the input parameter, if the target user does not exist, thereby omitting the subsequent steps, greatly improving the efficiency of the duplicate checking process of deduplication operation when adding a new blacklist, alleviating the impact of the increase in data volume on system performance, and improving the user experience.

[0144] In some optional implementations of this embodiment, the second query module 304 is further configured to:

[0145] According to the query character string, query the blacklist database to determine the relevant data;

[0146] Standardizing the relevant data to obtain standardized data;

[0147] The number of the standardized data is counted as the number of data items.

[0148] The blacklist duplicate checking system provided in the present application obtains query strings by assembling to query relevant data, and uses data standardization to better count the number of data items of relevant data, so that it is possible to subsequently judge whether all the input data are repeated by comparing the size of the data list with the number of data items, thereby improving the efficiency and accuracy of duplicate checking during the deduplication operation when adding a new blacklist.

[0149] In some optional implementations of this embodiment, the blacklist duplicate checking system 300 is further used to:

[0150] If the second preset result is returned, a preset prompt message indicating that all the duplicates in the blacklist are present is sent to the administrator client.

[0151] The blacklist duplication checking system provided in this application allows manual intervention in the process of deduplication when adding new blacklists by sending prompt information in a timely manner, ensuring that all duplicate data will not be entered into the blacklist database, thereby alleviating the impact of the increase in data volume on system performance and improving user experience.

[0152] To solve the above technical problems, the present application also provides a computer device. Figure 4 , Figure 4 This is a basic structural block diagram of the computer device in this embodiment.

[0153] The computer device 4 includes a memory 41, a processor 42, and a network interface 43 that are interconnected through a system bus. It should be noted that the figure only shows a computer device 4 with components 41-43, but it should be understood that it is not required to implement all the components shown, and more or fewer components can be implemented instead. Among them, those skilled in the art can understand that the computer device here is a device that can automatically perform numerical calculations and / or information processing according to pre-set or stored instructions, and its hardware includes but is not limited to microprocessors, application specific integrated circuits (Application Specific Integrated Circuit, ASIC), programmable gate arrays (Field-Programmable Gate Array, FPGA), digital processors (Digital Signal Processor, DSP), embedded devices, etc.

[0154] The computer device may be a computing device such as a desktop computer, a notebook, a PDA, a cloud server, etc. The computer device may interact with a user through a keyboard, a mouse, a remote controller, a touch pad, or a voice control device.

[0155] The memory 41 includes at least one type of readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the memory 41 can be an internal storage unit of the computer device 4, such as a hard disk or memory of the computer device 4. In other embodiments, the memory 41 can also be an external storage device of the computer device 4, such as a plug-in hard disk equipped on the computer device 4, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (FlashCard), etc. Of course, the memory 41 can also include both the internal storage unit of the computer device 4 and its external storage device. In this embodiment, the memory 41 is generally used to store the operating system and various application software installed on the computer device 4, such as computer-readable instructions of the blacklist duplicate checking method, etc. In addition, the memory 41 can also be used to temporarily store various types of data that have been output or are to be output.

[0156] The processor 42 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chip in some embodiments. The processor 42 is generally used to control the overall operation of the computer device 4. In this embodiment, the processor 42 is used to run computer-readable instructions stored in the memory 41 or process data, such as computer-readable instructions for running the blacklist duplicate checking method.

[0157] The network interface 43 may include a wireless network interface or a wired network interface. The network interface 43 is generally used to establish a communication connection between the computer device 4 and other electronic devices.

[0158] The computer device provided by the present application can use the comparison between the size of the data list and the number of data items to determine whether all the input data are repeated in the blacklist database by querying the target user corresponding to the data list in the input parameter and querying the number of data items of the relevant data based on the target user, so that when adding a new blacklist, it is not necessary to compare the data one by one during the deduplication operation, thereby improving the efficiency of blacklist duplication checking, alleviating the impact of the increase in data volume on system performance, and improving user experience.

[0159] The present application also provides another implementation, namely, providing a computer-readable storage medium, which stores computer-readable instructions, and the computer-readable instructions can be executed by at least one processor to enable the at least one processor to perform the steps of the blacklist duplication checking method as described above.

[0160] The computer-readable storage medium provided by the present application can determine whether all the input data are repeated in the blacklist database by comparing the size of the data list with the number of data items by querying the target user corresponding to the data list in the input parameter and querying the relevant data according to the number of data items of the target user, so that when a new blacklist is added, it is not necessary to compare the data one by one during the deduplication operation, thereby improving the efficiency of blacklist duplication checking, alleviating the impact of the increase in data volume on system performance, and improving user experience.

[0161] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0162] Obviously, the embodiments described above are only some embodiments of the present application, rather than all embodiments. The preferred embodiments of the present application are given in the accompanying drawings, but they do not limit the patent scope of the present application. The present application can be implemented in many different forms. On the contrary, the purpose of providing these embodiments is to make the understanding of the disclosure of the present application more thorough and comprehensive. Although the present application is described in detail with reference to the aforementioned embodiments, for those skilled in the art, it is still possible to modify the technical solutions recorded in the aforementioned specific implementation methods, or to perform equivalent replacement of some of the technical features therein. Any equivalent structure made using the contents of the specification and drawings of this application, directly or indirectly used in other related technical fields, is similarly within the scope of patent protection of this application.

Claims

1. A blacklist duplicate checking method, characterized in that: The steps include: receiving at least one data list as an input parameter, wherein the at least one data list includes basic information of a user; According to the basic information of the user, a query is performed in a preset blacklist database to obtain a query result; Determine the target user according to the query result, and assemble a query string including the unique identification information of the target user; According to the query string, query the blacklist database to obtain the number of data items corresponding to the relevant data; Screening the at least one data list according to the number of data items to determine whether there is a target data list that meets the preset conditions; If the target data list exists, it is confirmed that the input parameters are not all repeated in the blacklist database; otherwise, it is confirmed that the input parameters are all repeated in the blacklist database.

2. The blacklist duplicate checking method according to claim 1, characterized in that: The step of screening the at least one data list according to the number of data items to determine whether there is a target data list that meets the preset conditions specifically includes: Calculate the list size of each data list in the at least one data list by using a size function; The list size of each data list is compared with the number of data items to determine whether there is a data list whose list size is greater than the number of data items, and the data list is used as the target data list.

3. The blacklist duplicate checking method according to claim 1, characterized in that: The unique identification information includes a primary key ID. The step of determining the target user according to the query result and assembling a query string including the unique identification information of the target user specifically includes: Determine, according to the query result, a target user matching the basic information of the user; Obtaining the primary key ID of the target user, and determining the individual group ID, verification type and entry organization of the target user according to the primary key ID; The query string is obtained by assembling according to the primary key ID, the individual group identifier, the verification type, the entry organization and the at least one data list.

4. The blacklist duplicate checking method according to claim 1, characterized in that: The user basic information includes name, certificate number and certificate type. The step of querying a preset blacklist database based on the user basic information to obtain a query result specifically includes: Searching the blacklist database according to the name, the ID number and the ID type to determine whether there is a relevant data record and verifying it through a matching algorithm; If the data record exists, and the name, the certificate number, and the certificate type are verified, the user corresponding to the data record is used as the target user and output as the query result; Otherwise, it is determined that the target user does not exist, and the result is output as the query result.

5. The blacklist duplicate checking method according to claim 1, characterized in that: After the step of querying a preset blacklist database according to the basic information of the user to obtain a query result, the method further includes: According to the query result, if it is determined that the target user does not exist, it is confirmed that the input parameters are not all repeated in the blacklist database.

6. The blacklist duplicate checking method according to claim 1, characterized in that: The step of querying the blacklist database according to the query string to obtain the number of data items corresponding to the relevant data specifically includes: According to the query character string, query the blacklist database to determine the relevant data; Standardizing the relevant data to obtain standardized data; The number of the standardized data is counted as the number of data items.

7. The blacklist duplicate checking method according to claim 1, characterized in that: After the step of confirming that the input parameters are not all repeated in the blacklist database if the target data list exists, or otherwise confirming that the input parameters are all repeated in the blacklist database, the method further includes: If it is confirmed that the input parameters are not all repeated in the blacklist database, the input parameters are screened to obtain non-repeated information, and the non-repeated information is entered into the blacklist database; If it is confirmed that the input parameters are all repeated in the blacklist database, a preset prompt message that the blacklist is all repeated is sent to the administrator client.

8. A blacklist duplicate checking system, characterized in that: include: A receiving module, used for receiving at least one data list as an input parameter, wherein the at least one data list includes basic information of a user; A first query module, used to query a preset blacklist database according to the basic information of the user to obtain a query result; An assembling module, used to determine a target user according to the query result, and assemble a query string including unique identification information of the target user; A second query module, used to query the blacklist database according to the query string to obtain the number of data items corresponding to the relevant data; A screening module, used to screen the at least one data list according to the number of data items, and determine whether there is a target data list that meets the preset conditions; The confirmation module is used to confirm that the input parameters are not all repeated in the blacklist database if the target data list exists, otherwise, confirm that the input parameters are all repeated in the blacklist database.

9. A computer device, characterized in that: It includes a memory and a processor, the memory stores computer-readable instructions, and the processor implements the steps of the blacklist duplicate checking method as described in any one of claims 1 to 7 when executing the computer-readable instructions.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the steps of the blacklist duplicate checking method as described in any one of claims 1 to 7 are implemented.

Images