Interactive data cleaning methods, apparatus and computer equipment
By calculating periodic interaction values to filter potential related objects and clean interaction data, this technology solves the problems of low screening efficiency and poor accuracy caused by the large scale and variety of interaction data in existing technologies. It realizes the automatic identification and cleaning of interaction data of potential related enterprises, and improves the efficiency and accuracy of data screening.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-09
- Publication Date
- 2026-03-10
AI Technical Summary
In existing technologies, the scale of company interaction data is huge and the types are diverse. Manual screening is inefficient and inaccurate, making it difficult to effectively identify the impact of interaction data of potentially related companies on the actual profile of the client company.
By acquiring the interaction data to be cleaned between the target object and the interacting object, calculating the periodic interaction value of the periodic interaction information, filtering out potential related objects, and cleaning the data based on these objects, removing or adjusting the relevant interaction data.
It enables the automatic identification of interaction data of potential related enterprises, improves the efficiency and accuracy of data screening, and ensures that the interaction of the target object is not affected by potential related parties.
Smart Images

Figure CN116644277B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of data processing, in particular to an interactive data cleaning method and device, computer equipment, storage medium and computer program product. BACKGROUND
[0002] With the advent of the big data era, the growth rate of data is increasing, the network mode of the interactive process is gradually emerging, the scale of the interactive data is becoming huge, and the types and structures of the interactive data are more diverse. Therefore, the integration, analysis and processing of the interactive data are particularly important.
[0003] The interactive data generated by a company usually includes the interactive data between the associated enterprises and the potential associated enterprises. The associated enterprises refer to the enterprises that have a direct or indirect control relationship or a significant influence relationship with the company. For example, a control company can be identified as an affiliated company of the associated enterprise. The potential associated enterprises refer to the enterprises that have a direct or indirect control relationship or a significant influence relationship with the company, but the associated relationship is not disclosed. The interactive data generated by the associated enterprises and the potential associated enterprises will also affect the actual portrait of the customer company. Generally, a financial company will use full-time personnel to screen and extract the customer interactive data to prevent the interactive data related to the associated enterprises and the potential associated enterprises from affecting the actual portrait of the customer company. However, the huge amount of interactive data brings great obstacles to manual processing. The process of manual screening is not only inefficient, but also lacks uniform standards, and the accuracy of screening is not high enough. SUMMARY
[0004] Therefore, it is necessary to provide an interactive data cleaning method, device, computer equipment, storage medium and computer program product capable of automatically identifying the interactive data related to the potential associated enterprises.
[0005] In a first aspect, the present application provides an interactive data cleaning method, comprising:
[0006] obtaining the interactive data to be cleaned of a target object and each interactive object;
[0007] when the interactive information of the interactive data to be cleaned contains the periodic interactive information corresponding to the interactive object, calculating the periodic interactive value corresponding to the periodic interactive information;
[0008] According to the periodic interactive value, a potential associated object is selected from each of the interactive objects;
[0009] According to the potential associated object, the interactive data to be cleaned is cleaned to obtain cleaned interactive data.
[0010] In one of the embodiments, before the calculating the periodic interaction value corresponding to the periodic interaction information of the interaction object when the periodic interaction information of the interaction object exists in the interaction information of the to-be-cleaned interaction data, the method further comprises:
[0011] According to a preset interaction amount threshold, the to-be-cleaned interaction data is filtered;
[0012] The calculating the periodic interaction value corresponding to the periodic interaction information of the interaction object when the periodic interaction information of the interaction object exists in the interaction information of the to-be-cleaned interaction data comprises:
[0013] The calculating the periodic interaction value corresponding to the periodic interaction information of the interaction object when the periodic interaction information of the interaction object exists in the interaction information of the to-be-cleaned interaction data comprises:
[0014] In one of the embodiments, the method further comprises:
[0015] When the periodic interaction information of the interaction object does not exist in the interaction information of the to-be-cleaned interaction data, the to-be-cleaned interaction data is taken as the cleaned interaction data.
[0016] In one of the embodiments, the interaction information comprises interaction time;
[0017] Before the calculating the periodic interaction value corresponding to the periodic interaction information of the interaction object when the periodic interaction information of the interaction object exists in the interaction information of the to-be-cleaned interaction data, the method further comprises:
[0018] The interaction time of each to-be-cleaned interaction data corresponding to the interaction object is acquired;
[0019] When the interaction time of each to-be-cleaned interaction data corresponding to the interaction object satisfies a first preset condition, it is determined that the periodic interaction information of the interaction object exists in the to-be-cleaned interaction data.
[0020] In one of the embodiments, the interaction information further comprises interaction amount;
[0021] The determining that the periodic interaction information of the interaction object exists in the to-be-cleaned interaction data when the interaction time of each to-be-cleaned interaction data corresponding to the interaction object satisfies a first preset condition comprises:
[0022] The determining that the periodic interaction information of the interaction object exists in the to-be-cleaned interaction data when the interaction time of each to-be-cleaned interaction data corresponding to the interaction object satisfies a first preset condition, and the interaction amount of the to-be-cleaned interaction data satisfying the first preset condition satisfies a second preset condition.
[0023] In one embodiment, the first preset condition includes the number of interaction data to be cleaned reaching a first preset number threshold when the interval between any two consecutive interaction times is within a preset duration.
[0024] The second preset condition includes the existence of a number of interactive data to be cleaned where the difference between any two consecutive pairs of the interaction amounts is within a preset amount range, reaching a second preset number threshold.
[0025] When the interaction time of each piece of interaction data to be cleaned corresponding to the interaction object meets a first preset condition, and the number of interactions of the interaction data to be cleaned that meets the first preset condition meets a second preset condition, it is determined that there is periodic interaction information corresponding to the interaction object in the interaction data to be cleaned, including:
[0026] When the number of interaction data to be cleaned whose interval between consecutive pairs of interaction times is within a preset time range reaches the first preset number threshold, and the number of interaction data to be cleaned whose difference between consecutive pairs of interaction amounts is within a preset number range reaches the second preset number threshold, it is determined that there is periodic interaction information corresponding to the interaction object in the interaction data to be cleaned.
[0027] In one embodiment, determining that periodic interaction information corresponding to the interaction object exists in the interaction data to be cleaned when the interaction time of each interaction data to be cleaned corresponding to the interaction object meets a first preset condition, and the number of interactions of the interaction data to be cleaned that meets the first preset condition meets a second preset condition, further includes:
[0028] The interactive data to be cleaned that meets the first preset condition and the second preset condition will be used as periodic interactive information.
[0029] In one embodiment, the step of filtering potential associated objects from each of the interaction objects based on the periodic interaction values includes:
[0030] When the periodic interaction value reaches a preset value threshold, the interaction object corresponding to the periodic interaction value is regarded as the potential associated object.
[0031] In one embodiment, the step of cleaning the interaction data to be cleaned based on the potential associated objects to obtain cleaned interaction data includes:
[0032] Remove the interaction data to be cleaned corresponding to the potential associated objects, and use the remaining interaction data to be cleaned as the cleaned interaction data.
[0033] Secondly, this application also provides an interactive data cleaning apparatus, comprising:
[0034] The first acquisition module is used to acquire the interaction data to be cleaned between the target object and each interaction object;
[0035] The calculation module is used to calculate the periodic interaction value corresponding to the periodic interaction information when there is periodic interaction information corresponding to the interaction object in the interaction data to be cleaned.
[0036] The first filtering module is used to filter out potential related objects from each of the interaction objects based on the periodic interaction values.
[0037] The cleaning module is used to clean the interaction data to be cleaned based on the potential associated objects, so as to obtain cleaned interaction data.
[0038] Thirdly, this application also provides a computer device. The computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the interactive data cleaning method described in any of the above embodiments.
[0039] Fourthly, this application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program thereon, which, when executed by a processor, implements the interactive data cleaning method described in any of the above embodiments.
[0040] Fifthly, this application also provides a computer program product. The computer program product includes a computer program that, when executed by a processor, implements the interactive data cleaning method described in any of the above embodiments.
[0041] The aforementioned interactive data cleaning method, apparatus, computer equipment, storage medium, and computer program products can automatically acquire all interactive data to be cleaned generated between the target object and all related interactive objects, and filter out potential related objects based on the interactive information related to the interactive data to be cleaned. This achieves automatic screening of potential related parties according to unified screening rules, and further cleans all interactive data to be cleaned based on potential related objects to eliminate the influence of the relevant interactive information of potential related parties on the actual interaction of the target object. This achieves automatic exclusion of data related to potential related objects, improves data screening efficiency, and ensures the accuracy and precision of data screening. Attached Figure Description
[0042] Figure 1 This is a diagram illustrating the application environment of the interactive data cleaning method in one embodiment;
[0043] Figure 2 This is a flowchart illustrating an interactive data cleaning method in one embodiment;
[0044] Figure 3 This is a flowchart illustrating an interactive data cleaning method in one embodiment;
[0045] Figure 4 This is a flowchart illustrating an interactive data cleaning method in one embodiment;
[0046] Figure 5 This is a structural block diagram of an interactive data cleaning device in one embodiment;
[0047] Figure 6 This is a structural block diagram of an interactive data cleaning device in one embodiment;
[0048] Figure 7 This is a structural block diagram of an interactive data cleaning device in one embodiment;
[0049] Figure 8 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation
[0050] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0051] The interactive data cleaning method provided in this application embodiment can be applied to, for example, Figure 1 In the application environment shown, terminal 102 communicates with server 104 via a network.
[0052] For example, the interactive data cleaning method is applied to terminal 102. Terminal 102 first acquires the interactive data to be cleaned between the target object and each interactive object. When there is periodic interactive information corresponding to the interactive object in the interactive information to be cleaned, the periodic interactive value corresponding to the periodic interactive information is calculated. Then, based on the periodic interactive value, terminal 102 filters out potential related objects from each interactive object. Based on the potential related objects, the interactive data to be cleaned is cleaned to obtain cleaned interactive data. Terminal 102 can send the cleaned interactive data to server 104. Server 104 stores the cleaned interactive data in the data storage system. Terminal 102 can be, but is not limited to, various personal computers, laptops, smartphones, tablets, IoT devices, and portable wearable devices. IoT devices can be smart speakers, smart TVs, smart air conditioners, smart in-vehicle devices, etc. Portable wearable devices can be smartwatches, smart bracelets, head-mounted devices, etc. Server 104 can be implemented using a standalone server or a server cluster composed of multiple servers. Terminal 102 and server 104 can be directly or indirectly connected via wired or wireless communication, such as through a network connection.
[0053] For example, the interactive data cleaning method is applied to server 104. Terminal 102 first obtains the interactive data to be cleaned between the target object and each interactive object, and sends the interactive data to be cleaned to server 104. When server 104 finds periodic interactive information corresponding to the interactive object in the interactive information of the interactive data to be cleaned, it calculates the periodic interactive value corresponding to the periodic interactive information. Subsequently, server 104 filters out potential related objects from each interactive object based on the periodic interactive value. Based on the potential related objects, it cleans the interactive data to be cleaned to obtain cleaned interactive data. Server 104 can then save the cleaned interactive data to the data storage system. It can be understood that the data storage system can be an independent storage device, or the data storage system can be located on the server, or the data storage system can be located on another terminal.
[0054] In one embodiment, an interactive data cleaning method is provided. This embodiment illustrates this method by applying it to a processor; it is understood that the processor may be located on a terminal or a server. Figure 2 As shown, this interactive data cleaning method includes:
[0055] Step 202: Obtain the interaction data to be cleaned between the target object and each interactive object.
[0056] The target object can be any entity that requires evaluation based on interaction data, specifically an enterprise whose actual business operations need to be assessed. The interaction data to be cleaned can be all the interaction log data generated between the target object and all other interacting objects. The interaction log data includes the interaction log records between the target object and multiple interacting objects. The interaction log records are the information generated by the interaction operations between the target object and the transaction object. Typically, each interaction generates one interaction log record, but it is not limited to this.
[0057] The interactive data to be cleaned can be obtained by the processor from a third-party interactive platform, such as an online payment platform or a securities trading platform.
[0058] Step 204: When there is periodic interaction information corresponding to the interaction object in the interaction information of the interaction data to be cleaned, calculate the periodic interaction value corresponding to the periodic interaction information.
[0059] Interaction information refers to information related to interactive operations. This includes, but is not limited to, the target object name, the interaction object name, the interaction date, the interaction account, the interaction amount, the number of interactions, the interaction object identifier, and the interaction status.
[0060] Periodic interactive information refers to information related to interactive operations that exhibit periodic patterns.
[0061] Periodic interaction values refer to the relationship between information related to interactive operations that exhibit periodic patterns and all information generated by those operations. They are used to characterize the relationship between information related to interactive operations that exhibit periodic patterns and all information generated by those operations.
[0062] As an example, the processor can acquire all the interaction data to be cleaned generated by the target object within a preset time period, and divide all the interaction data to be cleaned according to the different interaction objects. After the division is completed, it is determined whether there is a periodic pattern in the interaction data to be cleaned related to each interaction object. If there is, it is considered that there is periodic interaction information corresponding to the current interaction object in the interaction information of the interaction data to be cleaned. If not, it is considered that there is no periodic interaction information corresponding to the current interaction object in the interaction information of the interaction data to be cleaned.
[0063] The periodicity can be such that the intervals between the interaction dates corresponding to each piece of interaction data to be cleaned are similar. For example, if the interaction data to be cleaned corresponding to each interaction object are arranged according to the corresponding interaction dates, the interval between the interaction dates corresponding to any two pieces of interaction data to be cleaned is within a preset time range. Alternatively, the periodicity can be such that the differences in the interaction amounts corresponding to each piece of interaction data to be cleaned are similar. For example, if the interaction data to be cleaned corresponding to each interaction object are arranged according to the corresponding interaction dates, the difference in the interaction amounts corresponding to any two pieces of interaction data to be cleaned is within a preset numerical range. Or, the periodicity can be such that the intervals between the interaction dates corresponding to each piece of interaction data to be cleaned are similar, and the differences in the interaction amounts are similar. For example, if the interaction data to be cleaned corresponding to each interaction object are arranged according to the corresponding interaction dates, the interval between the interaction dates corresponding to any two pieces of interaction data to be cleaned is within a preset time range, and the difference in the interaction amounts corresponding to any two pieces of interaction data to be cleaned is within a preset numerical range.
[0064] Step 206: Based on the periodic interaction values, filter out potential related objects from each interaction object.
[0065] Potentially related objects refer to interactive objects that have a direct or indirect control relationship with the target object, and that such relationship is not publicly disclosed.
[0066] Step 208: Based on the potential related objects, perform data cleaning on the interaction data to be cleaned to obtain the cleaned interaction data.
[0067] The data cleaning process may include removing the interaction data to be cleaned that is related to potentially related objects, or setting corresponding weights for the interaction data to be cleaned that is related to potentially related objects, so as to distinguish the interaction data to be cleaned that is related to potentially related objects from other interaction data to be cleaned.
[0068] In the aforementioned interactive data cleaning method, the processor can automatically acquire all interactive data to be cleaned generated by the target object and all related interactive objects. Based on the interactive information related to the interactive data to be cleaned, it determines whether the interactive data to be cleaned contains interactive data related to the same interactive object that exhibits a periodic pattern. If so, the interactive object is regarded as a potential associated object. This achieves automatic screening of potential related parties according to a unified filtering rule. Furthermore, all interactive data to be cleaned is cleaned based on the potential associated objects to eliminate the influence of the relevant interactive information of potential related parties on the actual interaction of the target object. In this way, the automatic exclusion of data related to potential associated objects is achieved, improving data screening efficiency and ensuring the accuracy and precision of data screening.
[0069] like Figure 3 As shown, in some optional embodiments, before step 204, the method further includes: step 203a, filtering the interaction data to be cleaned according to a preset interaction amount threshold;
[0070] Step 204 includes:
[0071] When the interaction information of the filtered interaction data to be cleaned contains periodic interaction information corresponding to the interaction object, the periodic interaction value of the periodic interaction information is calculated.
[0072] As an example, the processor can filter out interactive data to be cleaned that does not reach a preset threshold for the number of interactions.
[0073] Typically, the target object generates a large amount of interactive data to be cleaned with all interacting objects. The large amount of data to be processed during the data cleaning process will result in low cleaning efficiency. In this embodiment, the processor sets a preset interaction amount threshold to filter out interactive data with a small interaction amount, thereby reducing the amount of data and speeding up the data cleaning process.
[0074] In some optional embodiments, the interactive data cleaning method further includes:
[0075] When there is no periodic interaction information corresponding to any interaction object in the interaction information of the interaction data to be cleaned, the interaction data to be cleaned is used as the cleaned interaction data.
[0076] When the processor determines that the interaction data to be cleaned does not contain any interaction data related to the same interaction object that has a periodic pattern, it assumes that the target object does not have any interaction data to be cleaned with potential related objects. In this case, all the interaction data to be cleaned obtained are directly used as the cleaned interaction data.
[0077] like Figure 4 In some optional embodiments, the interaction information includes the interaction time; before step 204, the method further includes: step 203b, obtaining the interaction time of the interaction data to be cleaned corresponding to each interaction object; step 203c, when the interaction time of each interaction data to be cleaned corresponding to the interaction object meets the first preset condition, determining that there is periodic interaction information corresponding to the interaction object in the interaction data to be cleaned.
[0078] The first preset condition refers to the time interval between the interaction of two consecutive pieces of interactive data to be cleaned being within a preset duration.
[0079] After acquiring all the interaction data to be cleaned generated by the target object and all interacting objects, the processor obtains the interaction time from the interaction information of the interaction data to be cleaned, and further determines whether the interaction time of the interaction data to be cleaned related to each interaction object satisfies the condition that the interval between the interaction times of any two consecutive interaction data to be cleaned is within a preset time range. If it satisfies the condition, it is considered that there is periodic interaction information corresponding to the current interaction object in the interaction data to be cleaned; otherwise, it is considered that there is no periodic interaction information corresponding to the current interaction object in the interaction data to be cleaned.
[0080] As an example, consider interaction objects A and B. Interaction object A has four related interaction data sets to be cleaned: A1, A2, A3, and A4. The interaction time interval between A1 and A2 is 10 days, between A2 and A3 is 21 days, and between A3 and A4 is 25 days. Interaction object B has four related interaction data sets to be cleaned: B1, B2, B3, and B4. The interaction time interval between B1 and B2 is 23 days, and between B2 and B4 is... The interaction time interval for data B3 is 25 days, and the interaction time interval between data B3 and data B4 to be cleaned is 22 days. The processor's preset duration range is 20-30 days. Therefore, it can be concluded that the four data points to be cleaned for interaction object A do not satisfy the condition that the interaction time interval between any two data points to be cleaned is within the preset duration range, and there is no periodic interaction information corresponding to interaction object A in the data to be cleaned. The four data points to be cleaned for interaction object B satisfy the condition that the interaction time interval between any two data points to be cleaned is within the preset duration range, and there is periodic interaction information corresponding to interaction object A in the data to be cleaned.
[0081] In some optional embodiments, the interaction information further includes the interaction amount; the step of considering that periodic interaction information corresponding to the interaction object exists in the interaction data to be cleaned when the interaction time of each interaction data to be cleaned corresponding to the interaction object meets the first preset condition includes:
[0082] When the interaction time of each interactive data to be cleaned corresponding to the interactive object meets the first preset condition, and the number of interactions of the interactive data to be cleaned that meets the first preset condition meets the second preset condition, it is considered that there is periodic interactive information corresponding to the interactive object in the interactive data to be cleaned.
[0083] The second preset condition refers to the difference in the interaction amount between two consecutive pieces of interactive data to be cleaned being within a preset numerical range.
[0084] After acquiring all the interaction data to be cleaned generated by the target object and all interacting objects, the processor obtains the interaction time from the interaction information of the interaction data to be cleaned, and further determines whether the interaction time of the interaction data to be cleaned related to each interaction object satisfies the condition that the interval between any two consecutive interaction times of the interaction data to be cleaned is within a preset time range. If it satisfies the condition, the processor further determines whether the interaction amount of the interaction data to be cleaned related to each interaction object satisfies the condition that the difference between any two consecutive interaction amounts of the interaction data to be cleaned is within a preset numerical range. If it satisfies the condition, the processor considers that there is periodic interaction information corresponding to the current interaction object in the interaction data to be cleaned; otherwise, the processor considers that there is no periodic interaction information corresponding to the current interaction object in the interaction data to be cleaned.
[0085] As an example, consider interaction objects A and B. Interaction object A has four related interaction data sets to be cleaned: A1, A2, A3, and A4. The interaction time interval between A1 and A2 is 20 days, and the difference in interaction amount is 100. The interaction time interval between A2 and A3 is 21 days, and the difference in interaction amount is 400. The interaction time interval between A3 and A4 is 25 days, and the difference in interaction amount is 2000. Interaction object B has four related interaction data sets to be cleaned: B1, B2, B3, and B4. The interaction time interval between B1 and B2 is 23 days, and the difference in interaction amount is 100. The interaction time interval between B2 and B3 is 25 days, and the difference in interaction amount is... The value is 150. The interval between the interaction times of the interaction data B3 and B4 to be cleaned is 22 days, and the difference in the interaction amount is 200. The processor's preset duration range is 20-30 days, and the preset value range is 50-200. Therefore, it can be seen that the four interaction data to be cleaned for interaction object A satisfy that the interval between any two consecutive interaction data is within the preset duration range, but does not satisfy that the difference between any two consecutive interaction data is within the preset value range. The four interaction data to be cleaned for interaction object B satisfy that the interval between any two consecutive interaction data is within the preset duration range, and also satisfy that the difference between any two consecutive interaction data is within the preset value range. Therefore, there is no periodic interaction information corresponding to interaction object A in the interaction data to be cleaned, but there is periodic interaction information corresponding to interaction object B.
[0086] In some optional embodiments, the first preset condition includes the number of interactive data to be cleaned reaching a first preset number threshold when the interval between consecutive pairwise interactions is within a preset time range.
[0087] The second preset condition includes the existence of a number of interactive data to be cleaned where the difference between consecutive pairwise interaction amounts is within a preset amount range, reaching the second preset number threshold.
[0088] When the interaction time of each piece of interaction data to be cleaned corresponding to the interaction object meets the first preset condition, and the number of interactions of the interaction data to be cleaned that meets the first preset condition meets the second preset condition, the steps to consider that there is periodic interaction information corresponding to the interaction object in the interaction data to be cleaned include:
[0089] When the number of interaction data to be cleaned whose interval between consecutive pairwise interactions is within a preset time range reaches a first preset number threshold, and the number of interaction data to be cleaned whose difference between consecutive pairwise interactions is within a preset number range reaches a second preset number threshold, it is considered that there is periodic interaction information corresponding to the interaction object in the interaction data to be cleaned.
[0090] After acquiring all the interaction data to be cleaned generated by the target object and all interacting objects, the processor obtains the interaction time from the interaction information of the interaction data to be cleaned. It further determines whether the number of interaction data to be cleaned in each interaction object that satisfies the condition that the interval between any two consecutive interaction times is within a preset duration range reaches a first preset number threshold. If it does, the interaction data to be cleaned that satisfies the first preset condition is extracted. The processor then further determines whether the number of interaction data to be cleaned that satisfies the condition that the difference between any two consecutive interaction amounts is within a preset numerical range reaches a second preset number threshold. If it does, it is considered that there is periodic interaction information corresponding to the current interaction object in the interaction data to be cleaned. Otherwise, it is considered that there is no periodic interaction information corresponding to the current interaction object in the interaction data to be cleaned.
[0091] As an example, the processor has a first preset threshold of 4 and a second preset threshold of 3. There are two interaction objects, A and B. Interaction object A has four related interaction data points to be cleaned: A1, A2, A3, and A4. The interval between the interaction times of two consecutive interaction data points to be cleaned is within a preset time range. Interaction object B has three related interaction data points to be cleaned: B1, B2, and B3. The interval between the interaction times of two consecutive interaction data points to be cleaned is also within a preset time range. Therefore, the number of interaction data points to be cleaned for interaction object B where the interval between two consecutive interaction times is within the preset time range does not reach the first preset threshold, and will proceed... The processor obtains the interaction amounts of four pieces of interaction data A1, A2, A3, and A4 in interaction object A, where the interval between the interaction times of two consecutive interaction data to be cleaned is within a preset time range. If interaction object A has three related pieces of interaction data A1, A2, and A3 to be cleaned, and the difference between any two consecutive interaction amounts is within a preset value range, then the number of interaction data to be cleaned where the difference between two consecutive interaction amounts is within the preset value range reaches a second preset number threshold. The processor considers that there is periodic interaction information corresponding to interaction object A in the interaction data to be cleaned, but there is no periodic interaction information corresponding to interaction object B.
[0092] In some optional embodiments, when the interaction time of each piece of interaction data to be cleaned corresponding to the interaction object meets a first preset condition, and the number of interactions of the interaction data to be cleaned that meets the first preset condition meets a second preset condition, it is considered that there is periodic interaction information corresponding to the interaction object in the interaction data to be cleaned, and the method further includes:
[0093] The interactive data to be cleaned that meets the first and second preset conditions will be used as periodic interactive information.
[0094] As an example, as shown above, when the processor's preset first preset quantity threshold is 4, the preset second preset quantity threshold is 3, and there are four related interactive data A1, A2, A3, and A4 to be cleaned for interactive object A, the interval between the interaction time of two consecutive interactive data to be cleaned is within a preset duration range, and there are three related interactive data A1, A2, and A3 to be cleaned, the difference between any two consecutive interaction amounts is within a preset numerical range, then the processor will treat the interactive data A1, A2, and A3 to be cleaned as periodic interactive information of interactive object A.
[0095] In one embodiment, after the processor obtains the periodic interaction information of the interaction object, it uses the quotient of the number of periodic interaction information and the number of all periodic interaction information related to the interaction object as the periodic interaction value.
[0096] In some optional embodiments, step 206 includes: when the periodic interaction value reaches a preset value threshold, the interaction object corresponding to the periodic interaction value is regarded as a potential associated object.
[0097] The preset numerical threshold can be a ratio value set by the user in advance.
[0098] As an example, the processor stores a preset value threshold of 50%. The periodic interaction information of interaction object A includes interaction data A1, A2, and A3 to be cleaned, and the periodic interaction information related to interaction object A includes A1, A2, A3, A4, and A5. Then the periodic interaction value is 3 ÷ 5 = 60%, which reaches the preset value threshold. At this time, the processor will treat interaction object A as a potential associated object.
[0099] In some optional embodiments, step 208 includes: removing the interaction data to be cleaned corresponding to the potential associated objects, and using the remaining interaction data to be cleaned as the cleaned interaction data.
[0100] In the aforementioned interactive data cleaning method, the processor can automatically acquire all interactive data to be cleaned generated by the target object and all related interactive objects. Based on the interactive information related to the interactive data to be cleaned, it determines whether the interactive data to be cleaned contains interactive data related to the same interactive object that exhibits a periodic pattern. If so, the interactive object is regarded as a potential associated object. This achieves automatic screening of potential related parties according to a unified filtering rule. Furthermore, all interactive data to be cleaned is cleaned based on the potential associated objects to eliminate the influence of the relevant interactive information of potential related parties on the actual interaction of the target object. In this way, the automatic exclusion of data related to potential associated objects is achieved, improving data screening efficiency and ensuring the accuracy and precision of data screening.
[0101] It should be understood that although the steps in the flowcharts of the above embodiments are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the above embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.
[0102] Based on the same inventive concept, this application also provides an interactive data cleaning apparatus for implementing the interactive data cleaning method described above. The solution provided by this apparatus is similar to the implementation described in the above method; therefore, the specific limitations in one or more interactive data cleaning apparatus embodiments provided below can be found in the limitations of the interactive data cleaning method described above, and will not be repeated here.
[0103] In one embodiment, such as Figure 5 As shown, an interactive data cleaning device 500 is provided, including: a first acquisition module 502, a calculation module 504, a first filtering module 506, and a cleaning module 508, wherein:
[0104] The first acquisition module 502 is used to acquire the interaction data to be cleaned between the target object and each interactive object;
[0105] The calculation module 504 is used to calculate the periodic interaction value corresponding to the periodic interaction information when there is periodic interaction information corresponding to the interaction object in the interaction data to be cleaned.
[0106] The first filtering module 506 is used to filter out potential related objects from each interaction object based on the periodic interaction value;
[0107] The cleaning module 508 is used to clean the interaction data to be cleaned based on the potential related objects, and obtain the cleaned interaction data.
[0108] like Figure 6 As shown, in some optional embodiments, the interactive data cleaning apparatus 500 further includes:
[0109] The second filtering module 503a is used to filter the interaction data to be cleaned according to a preset interaction amount threshold.
[0110] The computing module 504 is also configured as follows:
[0111] When the interaction information of the filtered interaction data to be cleaned contains periodic interaction information corresponding to the interaction object, the periodic interaction value of the periodic interaction information is calculated.
[0112] In some optional embodiments, the interactive data cleaning apparatus 500 is further configured to:
[0113] When there is no periodic interaction information corresponding to any interaction object in the interaction information of the interaction data to be cleaned, the interaction data to be cleaned is used as the cleaned interaction data.
[0114] like Figure 7 As shown, in some optional embodiments, the interactive data cleaning apparatus 500 further includes:
[0115] The second acquisition module 503b is used to acquire the interaction time of the interaction data to be cleaned corresponding to each interaction object;
[0116] The determination module 503c is used to determine that there is periodic interaction information corresponding to the interaction object in the interaction data to be cleaned when the interaction time of each interaction data to be cleaned corresponding to the interaction object meets the first preset condition.
[0117] In some optional embodiments, the interaction information may also include the interaction amount;
[0118] In some optional embodiments, the determining module 503c is further configured to:
[0119] When the interaction time of each interactive data to be cleaned corresponding to the interactive object meets the first preset condition, and the number of interactions of the interactive data to be cleaned that meets the first preset condition meets the second preset condition, it is determined that there is periodic interactive information corresponding to the interactive object in the interactive data to be cleaned.
[0120] In some optional embodiments, the first preset condition includes the number of interactive data to be cleaned reaching a first preset number threshold when the interval between consecutive pairwise interactions is within a preset time range.
[0121] The second preset condition includes the existence of a number of interactive data to be cleaned where the difference between consecutive pairwise interaction amounts is within a preset amount range, reaching the second preset number threshold.
[0122] The 503c module is also configured as follows:
[0123] When the number of interactive data to be cleaned whose interval between consecutive pairwise interactions is within a preset time range reaches a first preset number threshold, and the number of interactive data to be cleaned whose difference between consecutive pairwise interactions is within a preset number range reaches a second preset number threshold, it is determined that there is periodic interactive information corresponding to the interactive object in the interactive data to be cleaned.
[0124] In some optional embodiments, the determining module 503c is further configured to: use the interactive data to be cleaned that meets the first preset condition and the second preset condition as periodic interactive information.
[0125] In some optional embodiments, the first screening module 506 is further configured to:
[0126] When the periodic interaction value reaches a preset value threshold, the interaction object corresponding to the periodic interaction value is regarded as a potential associated object.
[0127] In some optional embodiments, the cleaning module is also configured to:
[0128] Remove the interaction data to be cleaned corresponding to potentially related objects, and use the remaining interaction data to be cleaned as the cleaned interaction data.
[0129] Each module in the aforementioned interactive data cleaning device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.
[0130] In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 8 As shown, the computer device includes a processor, memory, input / output interfaces, a communication interface, a display unit, and an input device. The processor, memory, and input / output interfaces are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interfaces. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The input / output interfaces are used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it implements an interactive data cleaning method. The display unit is used to form a visually visible image and can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the computer device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the computer device, or external keyboards, touchpads, or mice, etc.
[0131] Those skilled in the art will understand that Figure 8 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0132] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, the computer program performing the following steps when executed by a processor:
[0133] Obtain the interaction data to be cleaned between the target object and each interacting object;
[0134] When there is periodic interaction information corresponding to the interaction object in the interaction information of the interaction data to be cleaned, calculate the periodic interaction value corresponding to the periodic interaction information.
[0135] Based on the periodic interaction values, potential related objects are selected from each interaction object;
[0136] Based on the potential related objects, the interaction data to be cleaned is cleaned to obtain the cleaned interaction data.
[0137] In some alternative embodiments, the computer program, when executed by the processor, is also used to perform the following steps:
[0138] Based on a preset threshold for the amount of interaction, the interaction data to be cleaned is filtered; and
[0139] When the interaction information of the filtered interaction data to be cleaned contains periodic interaction information corresponding to the interaction object, the periodic interaction value of the periodic interaction information is calculated.
[0140] In some alternative embodiments, the computer program, when executed by the processor, is also used to perform the following steps:
[0141] When there is no periodic interaction information corresponding to any interaction object in the interaction information of the interaction data to be cleaned, the interaction data to be cleaned is used as the cleaned interaction data.
[0142] In some optional embodiments, the interaction information includes the interaction time; the computer program, when executed by the processor, is also used to perform the following steps:
[0143] Obtain the interaction time of the corresponding interaction data to be cleaned for each interaction object;
[0144] When the interaction time of each interactive data to be cleaned corresponding to the interactive object meets the first preset condition, it is determined that there is periodic interactive information corresponding to the interactive object in the interactive data to be cleaned.
[0145] In some optional embodiments, the interaction information may also include the interaction amount;
[0146] When a computer program is executed by a processor, it is also used to perform the following steps:
[0147] When the interaction time of each interactive data to be cleaned corresponding to the interactive object meets the first preset condition, and the number of interactions of the interactive data to be cleaned that meets the first preset condition meets the second preset condition, it is determined that there is periodic interactive information corresponding to the interactive object in the interactive data to be cleaned.
[0148] In some optional embodiments, the first preset condition includes the number of interactive data to be cleaned reaching a first preset number threshold when the interval between consecutive pairwise interactions is within a preset time range.
[0149] The second preset condition includes the existence of a number of interactive data to be cleaned where the difference between consecutive pairwise interaction amounts is within a preset amount range, reaching the second preset number threshold.
[0150] When a computer program is executed by a processor, it is also used to perform the following steps:
[0151] When the number of interactive data to be cleaned whose interval between consecutive pairwise interactions is within a preset time range reaches a first preset number threshold, and the number of interactive data to be cleaned whose difference between consecutive pairwise interactions is within a preset number range reaches a second preset number threshold, it is determined that there is periodic interactive information corresponding to the interactive object in the interactive data to be cleaned.
[0152] In some alternative embodiments, the computer program, when executed by the processor, is also used to perform the following steps:
[0153] The interactive data to be cleaned that meets the first and second preset conditions will be used as periodic interactive information.
[0154] In some alternative embodiments, the computer program, when executed by the processor, is also used to perform the following steps:
[0155] When the periodic interaction value reaches a preset value threshold, the interaction object corresponding to the periodic interaction value is regarded as a potential associated object.
[0156] In some alternative embodiments, the computer program, when executed by the processor, is also used to perform the following steps:
[0157] Remove the interaction data to be cleaned corresponding to potentially related objects, and use the remaining interaction data to be cleaned as the cleaned interaction data.
[0158] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, performs the following steps:
[0159] Obtain the interaction data to be cleaned between the target object and each interacting object;
[0160] When there is periodic interaction information corresponding to the interaction object in the interaction information of the interaction data to be cleaned, calculate the periodic interaction value corresponding to the periodic interaction information.
[0161] Based on the periodic interaction values, potential related objects are selected from each interaction object;
[0162] Based on the potential related objects, the interaction data to be cleaned is cleaned to obtain the cleaned interaction data.
[0163] In some alternative embodiments, the computer program, when executed by the processor, is also used to perform the following steps:
[0164] Based on a preset threshold for the amount of interaction, the interaction data to be cleaned is filtered; and
[0165] When the interaction information of the filtered interaction data to be cleaned contains periodic interaction information corresponding to the interaction object, the periodic interaction value of the periodic interaction information is calculated.
[0166] In some alternative embodiments, the computer program, when executed by the processor, is also used to perform the following steps:
[0167] When there is no periodic interaction information corresponding to any interaction object in the interaction information of the interaction data to be cleaned, the interaction data to be cleaned is used as the cleaned interaction data.
[0168] In some optional embodiments, the interaction information includes the interaction time; the computer program, when executed by the processor, is also used to perform the following steps:
[0169] Obtain the interaction time of the corresponding interaction data to be cleaned for each interaction object;
[0170] When the interaction time of each interactive data to be cleaned corresponding to the interactive object meets the first preset condition, it is determined that there is periodic interactive information corresponding to the interactive object in the interactive data to be cleaned.
[0171] In some optional embodiments, the interaction information may also include the interaction amount;
[0172] When a computer program is executed by a processor, it is also used to perform the following steps:
[0173] When the interaction time of each interactive data to be cleaned corresponding to the interactive object meets the first preset condition, and the number of interactions of the interactive data to be cleaned that meets the first preset condition meets the second preset condition, it is determined that there is periodic interactive information corresponding to the interactive object in the interactive data to be cleaned.
[0174] In some optional embodiments, the first preset condition includes the number of interactive data to be cleaned reaching a first preset number threshold when the interval between consecutive pairwise interactions is within a preset time range.
[0175] The second preset condition includes the existence of a number of interactive data to be cleaned where the difference between consecutive pairwise interaction amounts is within a preset amount range, reaching the second preset number threshold.
[0176] When a computer program is executed by a processor, it is also used to perform the following steps:
[0177] When the number of interactive data to be cleaned whose interval between consecutive pairwise interactions is within a preset time range reaches a first preset number threshold, and the number of interactive data to be cleaned whose difference between consecutive pairwise interactions is within a preset number range reaches a second preset number threshold, it is determined that there is periodic interactive information corresponding to the interactive object in the interactive data to be cleaned.
[0178] In some alternative embodiments, the computer program, when executed by the processor, is also used to perform the following steps:
[0179] The interactive data to be cleaned that meets the first and second preset conditions will be used as periodic interactive information.
[0180] In some alternative embodiments, the computer program, when executed by the processor, is also used to perform the following steps:
[0181] When the periodic interaction value reaches a preset value threshold, the interaction object corresponding to the periodic interaction value is regarded as a potential associated object.
[0182] In some alternative embodiments, the computer program, when executed by the processor, is also used to perform the following steps:
[0183] Remove the interaction data to be cleaned corresponding to potentially related objects, and use the remaining interaction data to be cleaned as the cleaned interaction data.
[0184] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.
[0185] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0186] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.
Claims
1. An interactive data cleansing method, characterized in that, The method comprises: obtaining target object and each interaction object to be cleaned interaction data; when the interaction information of the to-be-cleaned interaction data contains the periodic interaction information corresponding to the interaction object, calculating the periodic interaction value corresponding to the periodic interaction information; according to the periodic interaction value, screening a potential associated object from each of the interaction objects; according to the potential associated object, performing data cleaning on the to-be-cleaned interaction data to obtain cleaned interaction data; wherein the interaction information comprises interaction time and interaction amount; before the step of when the interaction information of the to-be-cleaned interaction data contains the periodic interaction information corresponding to the interaction object, calculating the periodic interaction value corresponding to the periodic interaction information, the method further comprises: obtaining the interaction time of each to-be-cleaned interaction data corresponding to the interaction object; when the interaction time of each to-be-cleaned interaction data corresponding to the interaction object meets a first preset condition, determining that the to-be-cleaned interaction data contains the periodic interaction information corresponding to the interaction object; the step of when the interaction time of each to-be-cleaned interaction data corresponding to the interaction object meets a first preset condition, determining that the to-be-cleaned interaction data contains the periodic interaction information corresponding to the interaction object, comprises: when the interaction time of each to-be-cleaned interaction data corresponding to the interaction object meets a first preset condition, and the interaction amount of the to-be-cleaned interaction data meeting the first preset condition meets a second preset condition, it is determined that the to-be-cleaned interaction data contains the periodic interaction information corresponding to the interaction object; the first preset condition comprises that the number of to-be-cleaned interaction data in which the interval between two consecutive interaction times is within a preset time range reaches a first preset number threshold; the second preset condition comprises that the number of to-be-cleaned interaction data in which the difference between two consecutive interaction amounts is within a preset amount range reaches a second preset number threshold; the step of when the interaction time of each to-be-cleaned interaction data corresponding to the interaction object meets a first preset condition, and the interaction amount of the to-be-cleaned interaction data meeting the first preset condition meets a second preset condition, it is determined that the to-be-cleaned interaction data contains the periodic interaction information corresponding to the interaction object, comprises: when the number of to-be-cleaned interaction data in which the interval between two consecutive interaction times is within a preset time range reaches the first preset number threshold, and the number of to-be-cleaned interaction data in which the difference between two consecutive interaction amounts is within a preset amount range reaches the second preset number threshold, it is determined that the to-be-cleaned interaction data contains the periodic interaction information corresponding to the interaction object.
2. The method of claim 1, wherein, before the step of when the interaction information of the to-be-cleaned interaction data contains the periodic interaction information corresponding to the interaction object, calculating the periodic interaction value corresponding to the periodic interaction information, the method further comprises: screening the to-be-cleaned interaction data according to a preset interaction amount threshold; the step of when the interaction information of the to-be-cleaned interaction data contains the periodic interaction information corresponding to the interaction object, calculating the periodic interaction value corresponding to the periodic interaction information, comprises: When the interaction information of the screened to-be-cleaned interaction data contains the periodic interaction information corresponding to the interaction object, a periodic interaction value of the periodic interaction information is calculated.
3. The method of claim 1, wherein, Further comprising: When the interaction information of the to-be-cleaned interaction data does not contain the periodic interaction information corresponding to any of the interaction objects, the to-be-cleaned interaction data is taken as cleaned interaction data.
4. The method of claim 1, wherein, When the interaction time of each to-be-cleaned interaction data corresponding to the interaction object meets a first preset condition, and the interaction amount of the to-be-cleaned interaction data meeting the first preset condition meets a second preset condition, it is determined that the to-be-cleaned interaction data contains the periodic interaction information corresponding to the interaction object, and further comprising: The to-be-cleaned interaction data meeting the first preset condition and the second preset condition is taken as periodic interaction information.
5. The method of claim 1, wherein, The periodic interaction value is used to screen out a potential associated object from each of the interaction objects, comprising: When the periodic interaction value reaches a preset value threshold, the interaction object corresponding to the periodic interaction value is taken as the potential associated object.
6. The method of claim 1, wherein, The to-be-cleaned interaction data corresponding to the potential associated object is removed, and the remaining to-be-cleaned interaction data is taken as cleaned interaction data. Comprising:
7. An interactive data cleansing apparatus, characterized by, A first acquisition module is configured to acquire to-be-cleaned interaction data of a target object and each interaction object; A calculation module is configured to calculate a periodic interaction value corresponding to periodic interaction information when the to-be-cleaned interaction data contains the periodic interaction information corresponding to the interaction object; A first screening module is configured to screen out a potential associated object from each of the interaction objects according to the periodic interaction value; A cleaning module is configured to clean the to-be-cleaned interaction data according to the potential associated object to obtain cleaned interaction data; The interaction information includes interaction time and interaction amount. A second acquisition module is configured to acquire interaction time of to-be-cleaned interaction data corresponding to each of the interaction objects; A determination module is configured to determine that the to-be-cleaned interaction data contains periodic interaction information corresponding to the interaction object when the interaction time of each to-be-cleaned interaction data corresponding to the interaction object meets a first preset condition; The determination module is further configured to determine that the to-be-cleaned interaction data contains periodic interaction information corresponding to the interaction object when the interaction time of each to-be-cleaned interaction data corresponding to the interaction object meets a first preset condition, and the interaction amount of the to-be-cleaned interaction data meeting the first preset condition meets a second preset condition; The first preset condition includes that the number of to-be-cleaned interaction data in which the interval between two consecutive interaction times is within a preset time range reaches a first preset number threshold; The second preset condition includes that the number of to-be-cleaned interaction data in which the difference between two consecutive interaction amounts is within a preset amount range reaches a second preset number threshold; The determining module is further configured to determine that the periodic interaction information corresponding to the interaction object exists in the to-be-cleaned interaction data when the number of to-be-cleaned interaction data whose intervals between two consecutive interaction times are within a preset time length range reaches the first preset number threshold, and the number of to-be-cleaned interaction data whose differences between two consecutive interaction amounts are within a preset amount range reaches the second preset number threshold.
8. A computing device comprising a memory and a processor, the memory storing a computer program, characterized in that, The processor, when executing the computer program, implements the steps of the method of any one of claims 1 to 6.
9. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program, when executed by the processor, implements the steps of the method of any one of claims 1 to 6.
10. A computer program product comprising a computer program, characterized in that, The computer program, when executed by the processor, implements the steps of the method of any one of claims 1 to 6. The computer program, when executed by the processor, implements the steps of the method of any one of claims 1 to 6.
Citation Information
Patent Citations
Abnormal data identification method and device, computing equipment and medium
CN111181982A
Enterprise association relationship identification method and device, equipment and medium
CN114238655A