Data processing method, device, equipment and storage medium

Abstract

The data processing method in the embodiment of the present invention obtains at least one first search result from the data to be searched based on a predetermined first search expression; the at least one first search result is filtered according to the first filtering method and / or the second filtering method to obtain a second search result; because the data processing method first searches the first search expression based on the single-word segmentation result of the data to be searched, performs a first coarse filtering process, and then performs a second fine filtering process according to the first filtering method and / or the second filtering method on the basis of the first coarse filtering, the amount of data of the obtained second search result is not very large, the matching accuracy is higher, and the problem of keyword mismatching can be solved. The embodiment of the present invention also proposes a data processing device, an electronic device, and a computer storage medium.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a data processing method, device, electronic equipment and computer storage medium. Background Art

[0002] In the related technology, in the Internet real-time data analysis and processing technology, the public opinion analysis system completely adopts the topic matching scheme based on the search engine's query parser. Since the scheme directly retrieves the keywords corresponding to the topic through the search engine's query parser, the retrieved data with keywords may not be matching data. For example, if "ensure safety" appears in a certain search data, and the topic is configured with the keyword "security", at this time, since the search data contains the keyword "security", it can be considered as matching data, which will cause data mismatching and a large amount of matched data. Summary of the invention

[0003] The embodiment of the present invention is intended to provide a technical solution for data processing to solve the problems of excessive document data and mismatching in the prior art.

[0004] An embodiment of the present invention provides a data processing method, the method comprising:

[0005] Based on a predetermined first search expression, obtaining at least one first search result from the data to be searched;

[0006] The at least one first search result is filtered according to the first filtering method and / or the second filtering method to obtain a second search result; wherein the first filtering method represents a method of filtering data based on a first type of keyword, the first type of keyword represents a keyword of a preset length in the first search expression, and the preset length represents at least one integer in a set of integers greater than 1; the second filtering method represents a method of filtering the regional identification result of the data based on the second type of keyword, and the second type of keyword represents a regional type keyword.

[0007] Optionally, filtering the at least one first search result according to the first filtering method to obtain a second search result includes:

[0008] Perform word segmentation on each of the first search results to obtain a word segmentation result;

[0009] The at least one first search result is filtered according to the word library segmentation result and the first type of keyword to obtain a second search result.

[0010] Optionally, filtering the at least one first search result according to the word library segmentation result and the first type of keyword includes:

[0011] When the word segmentation result of the word library and the first type of keywords meet a preset condition, retaining the first search result corresponding to the word segmentation result of the word library;

[0012] When the word library segmentation result and the first type of keyword do not satisfy the preset condition, the first search result corresponding to the word library segmentation result is filtered.

[0013] Optionally, the word library segmentation result includes at least one word segmentation; and the preset condition includes at least one of the following:

[0014] The first type of keywords exists in the word library segmentation results;

[0015] The word library word segmentation results contain single-word segmentations corresponding to the first type of keywords;

[0016] The first type of keyword is a prefix or suffix of any word whose part of speech is not a person's name in the word segmentation result of the word library.

[0017] Optionally, when the word library segmentation result and the first type of keyword do not meet a preset condition, filtering the first search result corresponding to the word library segmentation result includes at least one of the following:

[0018] In the case where the first type of keywords and the third type of keywords are in a logical AND relationship, deleting the first search result corresponding to the word library segmentation result; wherein the third type of keywords are other keywords of the preset length in the first search expression except the first type of keywords;

[0019] When the first type of keyword and the third type of keyword are in a logical OR relationship, and the operation result of the second search expression is 1, the first search result corresponding to the word library segmentation result is re-filtered by the third type of keyword, and the second search expression represents a logical expression obtained by replacing the first type of keyword in the first expression with 0 and replacing all other keywords except the first type of keyword with 1;

[0020] When the first type of keywords and the third type of keywords are in a logical OR relationship and the operation result of the second search expression is 0, the first search result corresponding to the word library segmentation result is deleted.

[0021] Optionally, the method further comprises:

[0022] Obtain a predetermined third search expression, remove the second type of keywords from the third search expression, and obtain the first search expression;

[0023] Filtering the at least one first search result according to the second filtering method to obtain a second search result includes:

[0024] Obtaining a first region identification result for each of the at least one first search result;

[0025] Each of the first search results is filtered according to the first region identification result and the second type of keyword to obtain a second search result.

[0026] Optionally, filtering each of the first search results according to the first region identification result and the second type of keyword to obtain a second search result includes:

[0027] When the first region identification result and the second type of keyword match successfully, the first search result corresponding to the first region identification result is retained; when the first region identification result and the second type of keyword match unsuccessfully, the first search result corresponding to the first region identification result is deleted; and all retained first search results are used as second search results.

[0028] Optionally, filtering the at least one first search result according to the first filtering method and the second filtering method to obtain a second search result includes:

[0029] Performing word segmentation on each of the at least one first search result to obtain a word segmentation result;

[0030] Filtering the first search result according to the word library segmentation result and the first type of keywords to obtain a third search result;

[0031] Obtaining a second region identification result of the third search result;

[0032] filtering each of the first search results according to the second region identification result and the second type of keyword to obtain a second search result;

[0033] or,

[0034] Obtaining a first region identification result for each of the at least one first search result;

[0035] filtering each of the first search results according to the first region identification result and the second type of keyword to obtain a fourth search result;

[0036] Performing word segmentation on the fourth search result to obtain a word segmentation result;

[0037] The fourth search result is filtered according to the word library segmentation result and the first type of keywords to obtain a second search result.

[0038] The embodiment of the present invention further provides a data processing device, the device comprising: a first retrieval module and a second retrieval module, wherein:

[0039] A first search module, used to obtain at least one first search result from the data to be searched based on a predetermined first search expression;

[0040] The second retrieval module is used to filter the at least one first retrieval result according to the first filtering method and / or the second filtering method to obtain a second retrieval result; wherein the first filtering method represents a method of filtering data based on a first type of keyword, and the first type of keyword represents a keyword of a preset length in the first search expression; the second filtering method represents a method of filtering the regional identification result of the data based on the second type of keyword, and the second type of keyword represents a regional type keyword.

[0041] Optionally, the second search module is used to filter the at least one first search result according to the first filtering method to obtain a second search result, including:

[0042] Perform word segmentation on each of the first search results to obtain a word segmentation result;

[0043] The at least one first search result is filtered according to the word library segmentation result and the first type of keyword to obtain a second search result.

[0044] Optionally, the second search module is used to filter the at least one first search result according to the word library segmentation result and the first type of keyword, including:

[0045] When the word segmentation result of the word library and the first type of keywords meet a preset condition, retaining the first search result corresponding to the word segmentation result of the word library;

[0046] When the word library segmentation result and the first type of keyword do not satisfy the preset condition, the first search result corresponding to the word library segmentation result is filtered.

[0047] Optionally, the word library segmentation result includes at least one word segmentation; and the preset condition includes at least one of the following:

[0048] The first type of keywords exists in the word library segmentation results;

[0049] The word library word segmentation results contain single-word segmentations corresponding to the first type of keywords;

[0050] The first type of keyword is a prefix or suffix of any word whose part of speech is not a person's name in the word segmentation result of the word library.

[0051] Optionally, the second search module is used to filter the first search result corresponding to the word library segmentation result when the word library segmentation result and the first type of keyword do not meet a preset condition, including at least one of the following:

[0052] In the case where the first type of keyword and the third type of keyword are in a logical AND relationship, deleting the first search result corresponding to the word library segmentation result;

[0053] When the first type of keyword and the third type of keyword are in a logical OR relationship, and the operation result of the second search expression is 1, the first search result corresponding to the word library segmentation result is re-filtered by the third type of keyword, and the second search expression represents a logical expression obtained by replacing the first type of keyword in the first expression with 0 and replacing all other keywords except the first type of keyword with 1;

[0054] When the first type of keywords and the third type of keywords are in a logical OR relationship and the operation result of the second search expression is 0, the first search result corresponding to the word library segmentation result is deleted.

[0055] Optionally, the second search module is further used to obtain a predetermined third search expression, and remove the second type of keywords from the third search expression to obtain the first search expression;

[0056] Filtering the at least one first search result according to the second filtering method to obtain a second search result includes:

[0057] Obtaining a first region identification result for each of the at least one first search result;

[0058] Each of the first search results is filtered according to the first region identification result and the second type of keyword to obtain a second search result.

[0059] Optionally, the second search module is used to filter each of the first search results according to the first region identification result and the second type of keyword to obtain a second search result, including:

[0060] When the first region identification result and the second type of keyword match successfully, the first search result corresponding to the first region identification result is retained; when the first region identification result and the second type of keyword match unsuccessfully, the first search result corresponding to the first region identification result is deleted; and all retained first search results are used as second search results.

[0061] Optionally, the second search module is used to filter the at least one first search result according to the first filtering method and the second filtering method to obtain a second search result, including:

[0062] Performing word segmentation on each of the at least one first search result to obtain a word segmentation result;

[0063] Filtering the first search result according to the word library segmentation result and the first type of keywords to obtain a third search result;

[0064] Obtaining a second region identification result of the third search result;

[0065] filtering each of the first search results according to the second region identification result and the second type of keyword to obtain a second search result;

[0066] or,

[0067] Obtaining a first region identification result for each of the at least one first search result;

[0068] filtering each of the first search results according to the first region identification result and the second type of keyword to obtain a fourth search result;

[0069] Performing word segmentation on the fourth search result to obtain a word segmentation result;

[0070] The fourth search result is filtered according to the word library segmentation result and the first type of keywords to obtain a second search result.

[0071] An embodiment of the present invention further provides an electronic device, comprising a processor and a memory for storing a computer program that can be run on the processor; wherein:

[0072] When the processor is used to run the computer program, it executes any one of the data processing methods described above.

[0073] An embodiment of the present invention further provides a computer storage medium on which a computer program is stored. When the computer program is executed by a processor, any one of the above-mentioned data processing methods is implemented.

[0074] It can be seen that the data processing method in the embodiment of the present invention obtains at least one first search result from the data to be searched based on a predetermined first search expression; and filters the at least one first search result according to the first filtering method and / or the second filtering method to obtain a second search result; wherein the first filtering method represents a method of filtering the data based on a first type of keyword, the first type of keyword represents a keyword of a preset length in the first search expression, and the second filtering method represents a method of filtering the regional identification result of the data based on the second type of keyword, and the second type of keyword represents a keyword of the regional type. Since the data processing method first searches the first search expression based on the single-word segmentation result of the data to be searched, performs a first coarse filtering process, and then performs a second fine filtering process according to the first filtering method and / or the second filtering method on the basis of the first coarse filtering, the amount of data of the second search result obtained is not very large, the matching accuracy is higher, and the problem of keyword mismatch can be solved.

[0075] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0076] The accompanying drawings herein are incorporated into and constitute a part of the specification. These drawings illustrate embodiments consistent with the present invention and, together with the specification, are used to explain the technical solutions of the present invention.

[0077] Figure 1 A flowchart of a data processing method according to an embodiment of the present invention;

[0078] Figure 2 A schematic diagram of the overall filtering process for the single-word segmentation results of the data to be searched according to an embodiment of the present invention;

[0079] Figure 3 A schematic diagram of the structure of a hierarchical parse tree according to an embodiment of the present invention;

[0080] Figure 4 A schematic diagram of the structure of a data processing device according to an embodiment of the present invention;

[0081] Figure 5 Schematic diagram of the structure of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0082] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the embodiments provided herein are only used to explain the present invention and are not intended to limit the present invention. In addition, the embodiments provided below are partial embodiments for implementing the present invention, rather than providing all embodiments for implementing the present invention. In the absence of conflict, the technical solutions recorded in the embodiments of the present invention can be implemented in any combination.

[0083] It should be noted that, in the embodiments of the present invention, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a method or apparatus including a series of elements includes not only the elements explicitly recorded, but also includes other elements not explicitly listed, or also includes elements inherent to the implementation of the method or apparatus. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other related elements (such as steps in a method or units in a device, for example, a unit may be a part of a circuit, a part of a processor, a part of a program or software, etc.) in the method or apparatus including the element.

[0084] The term "and / or" herein is only a description of the association relationship of the associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.

[0085] For example, the data processing method provided by the embodiment of the present invention includes a series of steps, but the data processing method provided by the embodiment of the present invention is not limited to the recorded steps. Similarly, the data processing device provided by the embodiment of the present invention includes a series of modules, but the device provided by the embodiment of the present invention is not limited to including the modules explicitly recorded, and may also include modules required to obtain relevant information or perform processing based on information.

[0086] The embodiments of the present invention can be applied to hardware such as terminals and servers or computer systems composed of hardware, and can operate with many other general or special computing system environments or configurations, or can be implemented by a processor running computer executable code. Here, the terminal can be a thin client, a thick client, a handheld or laptop device, a microprocessor-based system, a set-top box, a programmable consumer electronic product, a network personal computer, a small computer system, etc., and the server can be a server computer system, a small computer system, a large computer system, and a distributed cloud computing technology environment including any of the above systems, etc.

[0087] Electronic devices such as terminals and servers can be described in the general context of computer system executable instructions (such as program modules) executed by a computer system. In general, program modules can include routines, programs, object programs, components, logic, data structures, etc., which perform specific tasks or implement specific abstract data types. Computer systems / servers can be implemented in a distributed cloud computing environment, where tasks are performed by remote processing devices linked through a communication network. In a distributed cloud computing environment, program modules can be located on local or remote computing system storage media including storage devices.

[0088] In the related technologies, there are two main topic matching methods used in public opinion analysis systems: Method 1, a topic matching method based on the Chinese word segmenter ANSJ and the search engine Lucene query parser syntax; Method 2, a topic matching method based on logical expression splitting and string matching. Among them, ANSJ Chinese word segmentation is a Java implementation of Chinese word segmentation based on n-Gram+CRF+HMM. The word segmentation speed reaches about 2 million words per second, and the accuracy rate can reach more than 96%. It currently realizes Chinese word segmentation, Chinese name recognition, user-defined dictionary, keyword extraction, automatic summary, keyword tagging and other functions. Lucene is an open source full-text search engine tool released by the Apache Software Foundation. A topic is a set of user-defined keyword configurations in the public opinion analysis system. It supports logical expressions +|-(), which represent AND, OR, and operation order respectively. For example, if the system user pays attention to the relevant public opinion of location 1 and unit 1, the possible topic configuration expression is as follows: (location 1+unit 1)+(event 1|event 2|event 3|event 4|event 5|event 6|event 7|event 8|)+(-(event 9)), where "+" represents logical AND operation, "|" represents logical OR operation, and "-" represents logical NOT operation. Since this solution directly searches for keywords corresponding to the topic through the query parser of the search engine, the data retrieved with keywords may not be matching data. For example, if "ensure safety" appears in a certain search data, and the topic is configured with the keyword "security", at this time, since the search data contains the keyword "security", it can be considered as matching data, which will cause data mismatch and a large amount of matched data.

[0089] In order to solve the above technical problems, an embodiment of the present invention proposes a data processing method. Figure 1 is a flow chart of a data processing method according to an embodiment of the present invention, such as Figure 1 As shown, the process may include:

[0090] Step 101: Based on a predetermined first search expression, obtain at least one first search result from the data to be searched.

[0091] In one embodiment, the data to be searched may be part of the data appearing on the network or all the data appearing on the network, for example, it may be document data on a forum, document data on a blog or document data on other networks; of course, the data on the network changes all the time, therefore, the data to be searched may be data appearing on the network within a preset time period starting from the current moment, and data collection may be performed on the data on the network through a data collection device to obtain the data to be searched.

[0092] In a specific example, the data to be searched may also be a stream processing batch or multiple stream processing batches. The stream processing batch here corresponds to a concept in the computing engine Apache Spark, where Apache Spark is a fast and general computing engine designed for large-scale data processing. Batch data can divide real-time stream data into batches in time slices, and convert stream processing into batch processing of time slice data. Specifically, a stream processing batch may be a collection of all data obtained from the network within a preset time or unit time. For example, a stream processing batch may be a data collection of all data obtained from the network within 10 seconds. The data collection here may be a collection of multiple data pieces, and a piece of data may be a document. The predetermined first search expression may be an expression set by the user. Specifically, it may be a user pre-configuring a logical expression, and then formatting the configured logical expression to obtain an expression after formatting. Here, the logical expression may be an expression composed of multiple keywords based on a certain logical operation relationship, for example, (event 100|event 101)+(event 102). Specifically, the user may pre-determine the first search expression according to needs, or may extract keywords from the data that the user cares about, and determine the first search expression based on the extracted keywords. The predetermined first search expression may be applied to the public opinion analysis system for topic matching, or may be applied to other data analysis systems to achieve matching or searching of data that the user cares about. Here, in the case where the predetermined first search expression is a logical expression configured for a topic, the first search expression may be a keyword that does not contain a regional type. For example, if the user of the public opinion analysis system is concerned about the relevant public opinion of the court, the topic configuration logical expression may be: (event 1|event 2|event 3|event 4|event 5|event 6|event 7|event 8|)+(-(event 9)), and the corresponding first search expression may be: (“Event 1” OR “Event 2” OR “Event 3” OR “Event 4” OR “Event 5” OR “Event 6” OR “Event 7” OR “Event 8”) AND (-(“Event 9”)).

[0093] In an embodiment of the present invention, the at least one first search result may be one or more pieces of data in the data to be searched, which needs to be determined based on the specific data to be searched and a predetermined first search expression. For example, if there are 50 pieces of data to be searched, and it is determined through the single-word segmentation results that there are 10 pieces of data that match the first search expression, then 10 first search results are included.

[0094] An implementation method for obtaining at least one first search result from the data to be searched based on a predetermined first search expression may, exemplarily, be to first convert a preconfigured expression into an expression format having a grammar that supports query parsing of the search engine, that is, to obtain the first search expression, and then search for matching data in the single-word segmentation results of the data to be searched based on the search engine, and use the obtained matching data as a first search result set. When the found data is multiple pieces of data, the corresponding first search result set includes multiple first search results.

[0095] Here, the single-word segmentation result of the data to be searched can be a set composed of single words by splitting the data to be searched. For example, for the document: Juveniles are the flowers of the motherland, the corresponding single-word segmentation results are: Shao, Nian, Shi, Zu, Guo, De, Hua, Duo. Based on the predetermined first search expression, at least one first search result can be obtained from the data to be searched as follows: first, the expression (event 1|event 2|event 3|event 4|event 5|event 6|event 7|event 8|)+(- (event 9)) configured by the user is converted into the corresponding first search expression ("event 1" OR "event 2" OR "event 3" OR "event 4" OR "event 5" OR "event 6" OR "event 7" OR "event 8") AND (-("event 9")); then, based on the search engine, matching data is found in the single-word segmentation results of the data to be searched. For example, when the matching data is 10 pieces of data, the 10 pieces of data constitute the first search result set. The coarse filtering result of the data to be searched can be obtained by the above-mentioned search method.

[0096] Figure 2 FIG. 1 is a schematic diagram of the overall filtering process for the single-word segmentation results of the data to be searched according to an embodiment of the present invention, such as Figure 2As shown, the topic information can be a search expression configured by the user. Each stream processing batch is a job. A job is divided into multiple tasks executed on different executors. Each executor process builds a memory-based search engine. Here, a task corresponds to a thread in an executor. An executor is equivalent to a container running a Java Virtual Machine (JVM) instance. A computer can run one or more executors. The memory-based search engine relies on ANSJ+Lucene, and adds the keyword set with a length greater than or equal to 2 and less than or equal to 4 in the configuration library to the custom dictionary. Since the real-time stream batch data is small and multi-machine distributed processing is performed, it is feasible for a single task to build an index based entirely on the RAM directory (Random Access Memory Directory, RAMDirectory). Here, RAMDirectory is implemented based on memory and has a high storage speed, but is limited by the memory size; the configuration library can be a dictionary of user-configured keyword thesaurus sorted by popularity, and the custom dictionary can be the configuration added to the word segmentation logic by the index service. Among them, the format of the custom dictionary is as follows:

[0097] Event 11 24000

[0098] Event 12 1200

[0099] Event 13 2300

[0100] Event 14 2300

[0101] Event 15 1200

[0102] The number after the keyword indicates the popularity of the keyword.

[0103] The overall filtering process for the single-word segmentation results of the data to be searched can be to establish a memory-based index for the data that falls on a single executor in each stream processing batch in the stream processing batch, use a copy field index based on the single-word segmentation to establish the copy field index, and cache the regional identification result set of each document, and cache the word library segmentation result of each data or each document at the same time. The word library segmentation can be ANSJ query segmentation or other types of word library segmentation. The word library segmentation result of each data or each document can include caching the offset of each document segmentation. Here, the starting position, end position and length of the word obtained by the word library segmentation can be represented by the offset. For example, for the document "I have been to the World Cup", the following word segmentation offsets can be recorded: "I": 0, "been to": 1, "World Cup": 3. The copy field can be a copy field that merges the original document title and body. Here, caching the regional identification result of each document and the word library segmentation result of each data or each document can be the preparation work for filtering the obtained at least one first search result.

[0104] Step 102: Filter the at least one first search result according to the first filtering method and / or the second filtering method to obtain a second search result; wherein the first filtering method represents a method of filtering data based on a first type of keyword, and the first type of keyword represents a keyword of a preset length in the first search expression; the second filtering method represents a method of filtering the regional identification result of the data based on the second type of keyword, and the second type of keyword represents a regional type keyword.

[0105] As an implementation mode, the preset length may represent at least one integer in a set of integers greater than 1, and the first type of keyword may be a keyword with a length of 2 or greater than 2. For example, for the first search expression ("event 21" OR "event 22") AND ("event 23"), the first type of keyword may include: "event 21", "event 22" and "event 23". The first filtering method may be to search for the first type of keyword in the word library segmentation result corresponding to at least one first search result, and perform data filtering processing according to the search result. In one example, the first type of keyword may be searched in the word library segmentation result corresponding to at least one first search result through a word library segmentation offset dictionary. Here, the word library segmentation offset dictionary represents a data set representing the start position, end position and segmentation length of each word segmentation obtained after word library segmentation of at least one search result.

[0106] The second type of keywords can be region names. For the first search expression (place 31|event 31|event 32)+(event 33), the corresponding second type of keywords include: "place 31". The second filtering method can be to search for the second type of keywords in the word library segmentation results corresponding to at least one first search result, and perform data filtering processing based on the search results.

[0107] The implementation method of filtering the at least one first search result according to the first filtering method and / or the second filtering method to obtain the second search result can be to filter the first search result set containing multiple first search results according to the first filtering method and / or the second filtering method, delete one or more first search results that do not meet the preset conditions, and use the remaining first search results as the second search results. Here, the second search result can be the same as the first search result, and also include one or more first search results. For example, in the case where at least one search result is 10 first search results, the filtering process can be performed according to the first filtering method and / or the second filtering method, and the obtained second search result can be the corresponding 1 or 5 first search results, or the corresponding 10 first search results.

[0108] In practical applications, steps 101 to 102 can be implemented using a processor in an electronic device, and the processor can be at least one of an application specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), an FPGA, a central processing unit (CPU), a controller, a microcontroller, and a microprocessor.

[0109] It can be seen that the data processing method in the embodiment of the present invention obtains at least one first search result from the data to be searched based on a predetermined first search expression; the at least one first search result is filtered according to the first filtering method and / or the second filtering method to obtain a second search result; wherein the first filtering method represents a method of filtering the data based on a first type of keyword, and the first type of keyword represents a keyword of a preset length in the first search expression; the second filtering method represents a method of filtering the regional identification result of the data based on the second type of keyword, and the second type of keyword represents a keyword of the regional type. Since the data processing method first searches the first search expression based on the single-word segmentation result of the data to be searched, performs a first coarse filtering process, and then performs a second fine filtering process according to the first filtering method and / or the second filtering method on the basis of the first coarse filtering, the amount of data of the second search result obtained is not very large, the matching accuracy is higher, and the problem of keyword mismatch can be solved.

[0110] In one embodiment, filtering the at least one first search result according to the first filtering method to obtain the second search result may include: performing vocabulary segmentation on each of the first search results to obtain a vocabulary segmentation result; filtering the at least one first search result according to the vocabulary segmentation result and the first type of keyword to obtain the second search result.

[0111] In one example, performing vocabulary segmentation on each of the first search results to obtain a vocabulary segmentation result may refer to performing vocabulary segmentation on the document corresponding to each first search result to obtain a vocabulary segmentation result set corresponding to the first search result set, or performing vocabulary segmentation on all documents corresponding to the data to be searched in advance to obtain a vocabulary segmentation result set for the data to be searched, storing the vocabulary segmentation result set for the data to be searched, and then obtaining the vocabulary segmentation result set corresponding to the first search result from the stored vocabulary segmentation result set for the data to be searched. For example, the first search result set consists of the first search result A and the first search result B, where the first search result A can be: Our motherland is a garden, and the segmentation result corresponding to the first search result obtained by using the vocabulary segmentation can be: We, of, motherland, is, garden; the first search result B can be: Teenagers are the flowers of the motherland, and the segmentation result corresponding to the first search result obtained by using the vocabulary segmentation can be: Teenagers, are, motherland, of, flowers, and the corresponding first search combination can include: Our motherland is a garden and Teenagers are the flowers of the motherland, and the corresponding vocabulary segmentation set can include "We, of, motherland, is, garden" and "Teenagers, are, motherland, flowers".

[0112] The implementation method of filtering the at least one first search result according to the word library segmentation result and the first type of keyword to obtain the second search result may be to retain the first search result corresponding to the word library segmentation result when the word library segmentation result and the first type of keyword meet the preset condition; and to filter the first search result corresponding to the word library segmentation result when the word library segmentation result and the first type of keyword do not meet the preset condition to obtain the second search result. The word library segmentation result includes at least one word segmentation; the preset condition includes at least one of the following:

[0113] The first type of keywords exists in the word library segmentation results;

[0114] The word library word segmentation results contain single-word segmentations corresponding to the first type of keywords;

[0115] The first type of keyword is a prefix or suffix of any word whose part of speech is not a person's name in the word segmentation result of the word library.

[0116] In a specific example, for the first search result that the teenager is the flower of the motherland, and the word segmentation result of the vocabulary is: "teenager, is, motherland, of, flowers", when the first type of keyword is "motherland", it can be seen that the word segmentation set contains the "motherland" participle, therefore, it can be determined that the first search result contains the keyword, and the first search result is retained; for the first search result that our motherland is a garden, and the word segmentation result of the vocabulary is: "we, of, ancestor, country, is, garden", when the first type of keyword is "motherland", it can be seen that the word segmentation set does not contain the "motherland" participle, but the motherland is segmented into two independent words "ancestor" and "country" by the vocabulary, then it is also determined that the first search result contains the keyword, and the first search result is retained. However, for the first test result: we must ensure safe arrival at the top of the mountain during the mountain climbing activity organized by the class, and the word segmentation result of the vocabulary is: "we, must, ensure, safe arrival, during, participating, in, the, mountain climbing activity, organized by the class", when the first type keyword "security" and other first type keywords are included in the first search expression, it can be seen that "security" is not in the word segmentation set, and security is not divided into "security" and "safety", and the word segmentation "ensure safety" does not have the search word "security" as a prefix or suffix. Therefore, the first search result needs to be filtered to determine whether to delete or retain the first search result.

[0117] In an example, for the first search result that Li Changfeng is an excellent people's teacher, and the word library segmentation result is "Li Changfeng, is, an, excellent, people, teacher", when the first type of keyword is "Changfeng", it can be seen that the word segmentation set does not contain "Changfeng" and Changfeng is not divided into "Chang" and "Feng". At the same time, although the "Li Changfeng" word segmentation is suffixed with the search word "Changfeng", the part of speech of the "Li Changfeng" word segmentation is a person's name. Therefore, the first search result needs to be filtered to determine whether to delete the first search result or retain the first search result.

[0118] In one embodiment, when the word segmentation result of the vocabulary and the first type of keywords do not meet the preset conditions, filtering the corresponding first search results may include: when the first type of keywords and the third type of keywords are in a logical and relationship, deleting the corresponding first search results; when the first type of keywords and the third type of keywords are in a logical or relationship, and the operation result of the second search expression is 1, re-filtering the corresponding first search results by the third type of keywords, the second search expression representing the logical expression obtained by replacing the first type of keywords in the first expression with 0 and replacing all other keywords except the first type of keywords with 1; when the first type of keywords and the third type of keywords are in a logical or relationship, and the operation result of the second search expression is 0, deleting the corresponding first search result.

[0119] In one example, the operation result of the second search expression is 1, indicating that the second search expression is true, and the operation result of the second search expression is 0, indicating that the second search expression is false.

[0120] In a possible implementation, for the case where the first detection result is: we must ensure safe arrival at the top of the mountain during the mountain climbing activity organized by the class, and the word database segmentation result is: "we, must, in, participating, in, the, class, organization, of, mountain climbing, activities, during, ensuring, safety, arrival, at, the top of the mountain", the first search expression is: "security" AND "mountain climbing" or "security" AND ("mountain climbing" OR "mountain top"). When the first type of keyword is "security", the corresponding third type of keyword is "mountain climbing" and / or "mountain top". It can be seen that the first search result needs to be filtered. Since "security" and "mountain climbing" are in a logical AND relationship, "security" and "mountain top" are also in a logical AND relationship. Therefore, the first search result "We must ensure safe arrival at the top of the mountain while participating in the mountain climbing activities organized by the class" can be deleted; when the first search expression is: "security" OR "mountain climbing", the corresponding second search expression is: "0" OR "1". It can be seen that the calculation result of the second search expression is 1, and the second search expression is true. Therefore, the first search result "We must ensure safe arrival at the top of the mountain while participating in the mountain climbing activities organized by the class" can be re-filtered by "mountain climbing". Since "mountain climbing" is in the word segmentation result corresponding to the first search result, the first search result "We must ensure safe arrival at the top of the mountain while participating in the mountain climbing activities organized by the class" can be retained; when the first search expression is: -("security" OR "mountain climbing"), the corresponding second search expression is -("0" OR "1"), it can be seen that the logical operation result of the second search is 0, and the second search expression is false. Therefore, the first search result "We must ensure safe arrival at the top of the mountain while participating in the mountain climbing activities organized by the class" can be deleted.

[0121] It can be seen that by filtering the first search result based on the first type of keywords, the second detection result obtained is conducive to eliminating the problem of mismatching of keywords and achieving a better matching effect.

[0122] In one embodiment, a predetermined third search expression can also be obtained, and the second type of keywords can be removed from the third search expression to obtain the first search expression. For example, the third search expression can be: (place 1 + unit 1) + (event 1 | event 2 | event 3 | event 4 | event 5 | event 6 | event 7 | event 8 |) + (-(event 9)) ("place 1" AND "unit 1") AND ("event 1" OR "event 2" OR "event 3" OR "event 4" OR "event 5" OR "event 6" OR "event 7" OR "event 8") AND (-("event 9")), and the corresponding first search expression can be: ("unit 1") + ("event 1" OR "event 2" OR "event 3" OR "event 4" OR "event 5" OR "event 6" OR "event 7" OR "event 8") AND (-("event 9")).

[0123] In one example, filtering the at least one first search result according to the second filtering method to obtain the second search result may be to obtain the first region identification result of each of the at least one first search result; filtering each of the first search results according to the first region identification result and the second type of keywords to obtain the second search result. Specifically, filtering each of the first search results according to the first region identification result and the second type of keywords to obtain the second search result may be to retain the corresponding first search result if the first region identification result and the second type of keywords match successfully; to delete the corresponding first search result if the first region identification result and the second type of keywords do not match successfully; and to use all retained first search results as the second search results.

[0124] The first region identification result of each of the at least one first search result may be obtained by using a natural language processing (Natural Language Processing, NLP) region identification technology.

[0125] In a specific example, for the case where the first search result is "XX District, a city of education, major schools organize spring outing activities", the first search combination may also include other first search results besides the first search result. Through the NLP regional recognition technology, the regional recognition result can be obtained as "XX Province XX City Education City". When the second type of keyword is "XX City", it can be seen that the first search result contains the second type of keyword, that is, the first regional recognition result and the second type of keyword match successfully, and then the first search result "XX District, a city of education, major schools organize spring outing activities" can be retained. When the second type of keyword is "XXX City", it can be seen that the first search result does not contain the second type of keyword, that is, the first regional recognition result and the second type of keyword match successfully. The keyword matching is unsuccessful, and the first search result "XX District, a city of education, major universities organize spring outing activities" can be deleted, and the other search results except the first search result can be used as the second search result; of course, for the first search result "XXX City XX District XXXX University organized the 5th Knowledge Seminar", when the regional identification result is "XXX City XX District", the regional identification result can be obtained through NLP regional identification technology as "XXX City XX District". When the second type of keyword is "XX City", it can be seen that the first search result does not contain the second type of keyword, that is, the first regional identification result and the second type of keyword match unsuccessful, and the first search result "XXX City XX District XXXX University organized the 5th Knowledge Seminar" can be deleted.

[0126] It can be seen that the second search result obtained by performing the above-mentioned secondary filtering based on the regional attribute on the first search result is conducive to eliminating the problem of mismatching of keywords, and the matching is more accurate and the effect is better.

[0127] In one embodiment, the first search expression can be represented by a hierarchical parsing number, and the parsing process of data processing can be implemented by pruning the nodes corresponding to the keywords in the hierarchical parsing tree.

[0128] Figure 3 Schematic diagram of the structure of the hierarchical parse tree of an embodiment of the present invention, such as Figure 3As shown, the logical expression corresponding to the hierarchical parsing number is: (unit 1) + (event 1 | event 2 | event 3 | event 4 | event 5 | event 6 | event 7 | event 8) + (-(event 9)), and the corresponding first search expression is: ("unit 1") AND ("event 1" OR "event 2" OR "event 3" OR "event 4" OR "event 5" OR "event 6" OR "event 7" OR "event 8") AND (-("event 9")). In an example, in obtaining the single-word segmentation result corresponding to the data to be searched, a search is performed based on the first search expression to obtain a first search result set, and then the first search result set is filtered by the keyword "word 1" with a word length of 2 corresponding to "event 1". Specifically, the keyword "word 1" can be searched in the word library segmentation result set corresponding to the first search result set. If the word is found in the word library segmentation result set corresponding to the first search result set, the corresponding first search result is retained, otherwise it is continued to be determined whether the word is in the word library segmentation result set corresponding to the first search result set. If the word "Word 1" is divided into two single-word words in the word library segmentation result set, if so, the corresponding first search result is retained. Otherwise, it is determined whether the word is the prefix or suffix of any word with a non-personal name in the word library segmentation result set corresponding to the first search result set. If so, the corresponding detection result is retained. If not, it is determined whether the word "Word 1" has a logical AND relationship with other first-type keywords. If so, the corresponding first search result is deleted. If not, it is determined whether the word "Word 1" has a logical OR relationship with other first-type keywords. If so, the node corresponding to "Word 1" can be removed from the hierarchical tree, and then for the logical expression corresponding to the deleted logic tree, when the nodes corresponding to other keywords are logically true, the truth or falsity of the logical expression is determined. If it is true, the corresponding first search result is re-matched through the keyword "Word 2" corresponding to event 2. If it is false, the corresponding first search result is deleted.

[0129] Next, the keywords with a length greater than or equal to 3 are filtered in sequence according to the above method to obtain the second search result.

[0130] In one embodiment, filtering the at least one first search result according to the first filtering method and the second filtering method to obtain the second search result includes: performing word segmentation on each of the at least one first search result to obtain a word segmentation result; filtering the first search result according to the word segmentation result and the first type of keywords to obtain a third search result; obtaining a second region identification result of the third search result; filtering each of the first search results according to the second region identification result and the second type of keywords to obtain a second search result;

[0131] or,

[0132] Obtain a first regional identification result for each of the at least one first search result; filter each of the first search results according to the first regional identification result and the second type of keywords to obtain a fourth search result; perform word library segmentation on the fourth search result to obtain a word library segmentation result; filter the fourth search result according to the word library segmentation result and the first type of keywords to obtain a second search result.

[0133] In one example, the third search result is an intermediate search result obtained by filtering the first search result according to the word library segmentation result and the first type of keywords after performing word library segmentation on each of the at least one first search result; the fourth detection result is an intermediate detection result obtained by filtering each of the first search results according to the first region identification result and the second type of keywords after performing word library segmentation on each of the at least one first search result. This method of filtering the first search result set by both the regional attributes and the first type of keywords can obtain a second detection result that is not only conducive to eliminating the problem of keyword mismatching, but also more accurate matching, higher recall rate, and better effect.

[0134] Based on the data processing method proposed in the above-mentioned embodiment, an embodiment of the present invention proposes a data processing device.

[0135] Figure 4 FIG. 1 is a schematic diagram of the structure of a data processing device according to an embodiment of the present invention. Figure 4 As shown, the device may include: a first retrieval module 401 and a second retrieval module 402, wherein:

[0136] A first search module 401, configured to obtain at least one first search result from the data to be searched based on a predetermined first search expression;

[0137] The second retrieval module 402 is used to filter the at least one first retrieval result according to the first filtering method and / or the second filtering method to obtain a second retrieval result; wherein the first filtering method represents a method of filtering data based on a first type of keyword, and the first type of keyword represents a keyword of a preset length in the first search expression; the second filtering method represents a method of filtering the regional identification result of the data based on the second type of keyword, and the second type of keyword represents a regional type keyword.

[0138] Optionally, the second search module 402 is used to filter the at least one first search result according to the first filtering method to obtain a second search result, including:

[0139] Perform word segmentation on each of the first search results to obtain a word segmentation result;

[0140] The at least one first search result is filtered according to the word library segmentation result and the first type of keyword to obtain a second search result.

[0141] Optionally, the second search module 402 is used to filter the at least one first search result according to the word library segmentation result and the first type of keyword, including:

[0142] When the word segmentation result of the word library and the first type of keywords meet a preset condition, retaining the first search result corresponding to the word segmentation result of the word library;

[0143] When the word library segmentation result and the first type of keyword do not satisfy the preset condition, the first search result corresponding to the word library segmentation result is filtered.

[0144] Optionally, the word library segmentation result includes at least one word segmentation; and the preset condition includes at least one of the following:

[0145] The first type of keywords exists in the word library segmentation results;

[0146] The word library word segmentation results contain single-word segmentations corresponding to the first type of keywords;

[0147] The first type of keyword is a prefix or suffix of any word whose part of speech is not a person's name in the word segmentation result of the word library.

[0148] Optionally, the second search module 402 is configured to filter the first search result corresponding to the word library segmentation result when the word library segmentation result and the first type of keyword do not meet a preset condition, including at least one of the following:

[0149] In the case where the first type of keyword and the third type of keyword are in a logical AND relationship, deleting the first search result corresponding to the word library segmentation result;

[0150] When the first type of keyword and the third type of keyword are in a logical OR relationship, and the operation result of the second search expression is 1, the first search result corresponding to the word library segmentation result is re-filtered by the third type of keyword, and the second search expression represents a logical expression obtained by replacing the first type of keyword in the first expression with 0 and replacing all other keywords except the first type of keyword with 1;

[0151] When the first type of keywords and the third type of keywords are in a logical OR relationship and the operation result of the second search expression is 0, the first search result corresponding to the word library segmentation result is deleted.

[0152] Optionally, the second search module 402 is further used to obtain a predetermined third search expression, and remove the second type of keywords from the third search expression to obtain the first search expression;

[0153] Filtering the at least one first search result according to the second filtering method to obtain a second search result includes:

[0154] Obtaining a first region identification result for each of the at least one first search result;

[0155] Each of the first search results is filtered according to the first region identification result and the second type of keyword to obtain a second search result.

[0156] Optionally, the second search module 402 is used to filter each of the first search results according to the first region identification result and the second type of keyword to obtain a second search result, including:

[0157] When the first region identification result and the second type of keyword match successfully, the first search result corresponding to the first region identification result is retained; when the first region identification result and the second type of keyword match unsuccessfully, the first search result corresponding to the first region identification result is deleted; and all retained first search results are used as second search results.

[0158] Optionally, the second search module 402 is used to filter the at least one first search result according to the first filtering method and the second filtering method to obtain a second search result, including:

[0159] Performing word segmentation on each of the at least one first search result to obtain a word segmentation result;

[0160] Filtering the first search result according to the word library segmentation result and the first type of keywords to obtain a third search result;

[0161] Obtaining a second region identification result of the third search result;

[0162] filtering each of the first search results according to the second region identification result and the second type of keyword to obtain a second search result;

[0163] or,

[0164] Obtaining a first region identification result for each of the at least one first search result;

[0165] filtering each of the first search results according to the first region identification result and the second type of keyword to obtain a fourth search result;

[0166] Performing word segmentation on the fourth search result to obtain a word segmentation result;

[0167] The fourth search result is filtered according to the word library segmentation result and the first type of keywords to obtain a second search result.

[0168] In practical applications, the first retrieval module 401 and the second retrieval module 402 can be implemented using a processor in an electronic device, and the processor can be at least one of an ASIC, a DSP, a DSPD, a PLD, a FPGA, a CPU, a controller, a microcontroller, and a microprocessor.

[0169] In addition, each functional module in this embodiment can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or software functional modules.

[0170] If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment is essentially or the part that contributes to the prior art or the whole or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the method described in this embodiment. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk, etc., various media that can store program codes.

[0171] Specifically, a computer program instruction corresponding to a data processing method in this embodiment can be stored on a storage medium such as a CD, a hard disk, or a USB flash drive. When the computer program instruction corresponding to a data processing method in the storage medium is read or executed by an electronic device, any data processing method in the aforementioned embodiments is implemented.

[0172] Based on the same technical concept as the above embodiments, see Figure 5 , which shows an electronic device provided by an embodiment of the present invention, which may include: a memory 501 and a processor 502; wherein,

[0173] The memory 501 is used to store computer programs and data;

[0174] The processor 502 is used to execute the computer program stored in the memory to implement any one of the data processing methods in the foregoing embodiments.

[0175] In practical applications, the memory 501 may be a volatile memory, such as RAM; or a non-volatile memory, such as ROM, flash memory, hard disk drive (HDD) or solid-state drive (SSD); or a combination of the above types of memory, and provide instructions and data to the processor 502.

[0176] The processor 502 may be at least one of ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, and microprocessor. It is understandable that for different augmented reality cloud platforms, the electronic device used to implement the processor function may also be other, which is not specifically limited in the embodiment of the present invention.

[0177] In some embodiments, the functions or modules included in the apparatus provided in the embodiments of the present invention can be used to execute the method described in the above method embodiment. The specific implementation can refer to the description of the above method embodiment. For the sake of brevity, it will not be repeated here.

[0178] The above description of the various embodiments tends to emphasize the differences between the various embodiments. The same or similar aspects can be referenced to each other. For the sake of brevity, this article will not repeat them.

[0179] The methods disclosed in the various method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0180] The features disclosed in the various product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0181] The features disclosed in the various method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0182] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0183] The embodiments of the present invention are described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementation modes, which are merely illustrative rather than restrictive. Under the guidance of the present invention, ordinary technicians in this field can also make many forms without departing from the scope of protection of the present invention and the claims, all of which are within the protection of the present invention.

Claims

1. A data processing method, characterized in that: The method comprises: Based on a predetermined first search expression, obtaining at least one first search result from the data to be searched; The at least one first search result is filtered according to a first filtering method and a second filtering method to obtain a second search result; wherein the first filtering method refers to a method of filtering data based on a first type of keyword, and the first type of keyword refers to a keyword of a preset length in the first search expression; the second filtering method refers to a method of filtering the region identification result of the data based on a second type of keyword, and the second type of keyword refers to a region type keyword; The filtering process of the at least one first search result according to the first filtering method to obtain a second search result includes: Perform word segmentation on each of the first search results to obtain a word segmentation result; When the word segmentation result of the word library and the first type of keywords meet a preset condition, retaining the first search result corresponding to the word segmentation result of the word library; When the word library segmentation result and the first type of keyword do not satisfy the preset condition, filtering the first search result corresponding to the word library segmentation result to obtain a second search result; When the word segmentation result of the word library and the first type of keyword do not meet the preset condition, filtering the first search result corresponding to the word segmentation result of the word library includes at least one of the following: In the case where the first type of keywords and the third type of keywords are in a logical AND relationship, deleting the first search result corresponding to the word library segmentation result; wherein the third type of keywords are other keywords of the preset length in the first search expression except the first type of keywords; When the first type of keyword and the third type of keyword are in a logical OR relationship, and the operation result of the second search expression is 1, the first search result corresponding to the word library segmentation result is re-filtered by the third type of keyword, and the second search expression represents a logical expression obtained by replacing the first type of keyword in the first search expression with 0 and replacing all other keywords except the first type of keyword with 1; When the first type of keyword and the third type of keyword are in a logical OR relationship and the operation result of the second search expression is 0, the first search result corresponding to the word library segmentation result is deleted.

2. The method according to claim 1, characterized in that The word library segmentation result includes at least one word segmentation; the preset condition includes at least one of the following: The first type of keywords exists in the word library segmentation results; The word library word segmentation results contain single-word segmentations corresponding to the first type of keywords; The first type of keyword is a prefix or suffix of any word whose part of speech is not a person's name in the word segmentation result of the word library.

3. The method according to claim 1, characterized in that: The method further comprises: Obtain a predetermined third search expression, remove the second type of keywords from the third search expression, and obtain the first search expression; The filtering process of the at least one first search result according to the second filtering mode to obtain the second search result includes: Obtaining a first region identification result for each of the at least one first search result; Each of the first search results is filtered according to the first region identification result and the second type of keyword to obtain a second search result.

4. The method according to claim 3, characterized in that The filtering process is performed on each of the first search results according to the first region identification result and the second type of keyword to obtain the second search result, including: If the first region identification result and the second type of keyword match successfully, retain the first search result corresponding to the first region identification result; if the first region identification result and the second type of keyword match unsuccessfully, delete the first search result corresponding to the first region identification result; All the retained first search results are used as the second search results.

5. The method according to claim 1, characterized in that The filtering process of the at least one first search result according to the first filtering mode and the second filtering mode to obtain the second search result includes: Performing word segmentation on each of the at least one first search result to obtain a word segmentation result; Filtering the first search result according to the word library segmentation result and the first type of keywords to obtain a third search result; Obtaining a second region identification result of the third search result; filtering each of the first search results according to the second region identification result and the second type of keyword to obtain a second search result; or, Obtaining a first region identification result for each of the at least one first search result; filtering each of the first search results according to the first region identification result and the second type of keyword to obtain a fourth search result; Performing word segmentation on the fourth search result to obtain a word segmentation result; The fourth search result is filtered according to the word library segmentation result and the first type of keywords to obtain a second search result.

6. A data processing device, characterized in that: The device comprises: a first retrieval module and a second retrieval module, wherein: A first search module, used to obtain at least one first search result from the data to be searched based on a predetermined first search expression; The second search module is used to filter the at least one first search result according to the first filtering method and the second filtering method to obtain a second search result; wherein the first filtering method refers to a method of filtering the data based on a first type of keyword, and the first type of keyword refers to a keyword of a preset length in the first search expression; the second filtering method refers to a method of filtering the region identification result of the data based on a second type of keyword, and the second type of keyword refers to a region type keyword; The second search module is further used to perform word segmentation on each of the first search results to obtain a word segmentation result; if the word segmentation result and the first type of keyword meet a preset condition, retain the first search result corresponding to the word segmentation result; if the word segmentation result and the first type of keyword do not meet the preset condition, filter the first search result corresponding to the word segmentation result to obtain a second search result; the filtering of the first search result corresponding to the word segmentation result when the word segmentation result and the first type of keyword do not meet the preset condition includes at least one of the following: when the first type of keyword and the third type of keyword are in a logical AND relationship, delete the first search result corresponding to the word segmentation result result; wherein, the third type of keywords are keywords of the preset length other than the first type of keywords in the first search expression; when the first type of keywords and the third type of keywords are in a logical OR relationship, and the operation result of the second search expression is 1, the first search result corresponding to the word library segmentation result is re-filtered by the third type of keywords, and the second search expression represents a logical expression obtained by replacing the first type of keywords in the first search expression with 0 and replacing all keywords other than the first type of keywords with 1; when the first type of keywords and the third type of keywords are in a logical OR relationship, and the operation result of the second search expression is 0, the first search result corresponding to the word library segmentation result is deleted.

7. An electronic device, characterized in that: comprising a processor and a memory for storing a computer program capable of running on the processor; wherein, When the processor is used to run the computer program, it executes the data processing method according to any one of claims 1 to 5.

8. A computer storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the data processing method according to any one of claims 1 to 5 is implemented.

Images