Active patrol method and device, storage medium and computer equipment

Abstract

According to the active patrol method and device, the storage medium and the computer equipment provided by the invention, when the asynchronous data generated in the target application by the target user in the at least one risk control list of the target application and the data processing result obtained by processing the asynchronous data according to the preset processing strategy are obtained, the risk control list of the target application is obtained; in addition, whether the asynchronous data and / or the data processing result meet the patrol condition configured by the active patrol task being executed or not can be judged, if yes, relevant information of the target user can be comprehensively evaluated, and when it is determined that the target user violates rules according to the comprehensive evaluation result, the target user is punished. Therefore, the illegal content generated by the subject and the illegal behavior of the subject can be effectively handled, the illegal content and the illegal subject can be effectively prevented from being exposed, the risk behavior of the subject can be captured and treated in real time, and the illegal missing can be avoided.

Description

Technical Field

[0001] The present application relates to the field of risk control and safety technology, and in particular to an active inspection method, device, storage medium, and computer equipment. Background Art

[0002] With the rapid development of the internet, the number and gameplay of social voice apps are increasing. As the volume of these apps grows, so too are the user groups prone to generating illegal information. These high-risk, highly exposed, and frequently violating groups not only impact the experience of regular platform users but can also lead to the loss of high-paying, high-value users, further impacting the platform's ecological security and generating public outcry. Therefore, platforms need to identify these high-risk, highly exposed, and frequently violating groups and take appropriate action to maintain the platform's ecological security and enhance the user experience.

[0003] At present, the risk management methods for people with high risks, high exposure, and frequent violations are relatively simple, which leads to the situation where violations are missed. Summary of the Invention

[0004] The purpose of this application is to solve at least one of the above-mentioned technical defects, especially the technical defect that the existing technology has a relatively simple control method for risk management of high-risk, high-exposure, and frequent and multiple-violation groups, which leads to the situation of violations being missed.

[0005] This application provides an active inspection method, which includes:

[0006] Acquire asynchronous data generated in the target application by a target user in at least one risk control list of the target application, and a data processing result after processing the asynchronous data according to a preset processing strategy;

[0007] When the asynchronous data and / or the data processing result meets the inspection conditions configured for the active inspection task being executed, a comprehensive evaluation is performed on the relevant information of the target user, and when it is determined that the target user has violated the rules based on the comprehensive evaluation result, the target user is punished.

[0008] Optionally, the determining whether the asynchronous data and / or the data processing result meets the inspection condition configured for the active inspection task being executed includes:

[0009] Determining an active patrol strategy associated with the active patrol task being executed, and determining patrol conditions configured for the active patrol strategy;

[0010] The asynchronous data and / or the data processing result are matched with the inspection condition, and it is determined whether the asynchronous data and / or the data processing result meet the inspection condition according to the matching result.

[0011] Optionally, the active inspection strategy includes at least one inspection condition group, and each inspection condition group includes at least one inspection condition;

[0012] The determining, based on the matching result, whether the asynchronous data and / or the data processing result satisfies the inspection condition includes:

[0013] When there is one inspection condition group, and the matching result is that the asynchronous data and / or the data processing result matches all the inspection conditions in the inspection condition group, determining that the asynchronous data and / or the data processing result meets the inspection condition;

[0014] When there are multiple inspection condition groups, it is determined whether the asynchronous data and / or the data processing result meets the inspection condition according to the satisfaction conditions of the inspection condition groups and the matching results.

[0015] Optionally, determining whether the asynchronous data and / or the data processing result satisfies the inspection condition according to the satisfaction condition of the inspection condition group and the matching result includes:

[0016] When the satisfaction condition of the inspection condition group is to satisfy all inspection conditions of any inspection condition group, if the matching result is that the asynchronous data and / or the data processing result matches all inspection conditions in one of the inspection condition groups, it is determined that the asynchronous data and / or the data processing result satisfies the inspection condition;

[0017] When the satisfaction condition of the inspection condition group is to satisfy all the inspection conditions of all the inspection condition groups, if the matching result is that the asynchronous data and / or the data processing result matches all the inspection conditions in all the inspection condition groups, it is determined that the asynchronous data and / or the data processing result meets the inspection condition.

[0018] Optionally, the relevant information includes at least subject information, real-time interactive content, and subject attributes of the target user;

[0019] The comprehensive evaluation of the relevant information of the target user to obtain a comprehensive evaluation result includes:

[0020] The subject information, real-time interactive content and subject attributes of the target user are evaluated respectively through a plurality of pre-set risk assessment mechanisms, and the comprehensive assessment results are obtained after reviewing the assessment results.

[0021] Optionally, when it is determined according to the comprehensive evaluation result that the target user has violated a rule, punishing the target user includes:

[0022] When it is determined that the target user has violated the rules based on the comprehensive evaluation results, the violation level of the target user is determined, and the target user is punished based on the violation level.

[0023] Optionally, the method further includes:

[0024] Count the completed active inspection tasks and obtain statistical results;

[0025] The statistical results are classified and summarized.

[0026] This application also provides an active patrol device, including:

[0027] a data acquisition module, configured to acquire asynchronous data generated in a target application by a target user in at least one risk control list of the target application, and a data processing result after processing the asynchronous data according to a preset processing strategy;

[0028] The active patrol module is used to conduct a comprehensive evaluation of the relevant information of the target user when the asynchronous data and / or the data processing results meet the patrol conditions configured for the active patrol task being executed, and to punish the target user when it is determined that the target user has violated the rules based on the comprehensive evaluation results.

[0029] The present application also provides a computer-readable storage medium, which stores computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors execute the steps of the active patrol method described in any one of the above embodiments.

[0030] The present application also provides a computer device, comprising: one or more processors, and a memory;

[0031] The memory stores computer-readable instructions, and when the computer-readable instructions are executed by the one or more processors, the steps of the active inspection method described in any one of the above embodiments are performed.

[0032] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:

[0033] The active inspection method, device, storage medium and computer equipment provided by the present application can also determine whether the asynchronous data and / or data processing results meet the inspection conditions configured for the active inspection task being executed when the asynchronous data generated by the target user in at least one risk control list of the target application and the data processing results after processing the asynchronous data according to the preset processing strategy are obtained. If so, the relevant information of the target user can be comprehensively evaluated, and when it is determined that the target user has violated the rules based on the comprehensive evaluation results, the target user can be punished. This ensures that the illegal content generated by the subject and the illegal behavior of the subject itself can be effectively handled, thereby effectively preventing the illegal content and the illegal subject from being exposed, achieving the real-time capture and governance of the subject's risky behavior, and avoiding the omission of violations. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0035] Figure 1 A flowchart of an active inspection method provided in an embodiment of the present application;

[0036] Figure 2 A schematic diagram of the configuration page for the active inspection task provided in an embodiment of the present application;

[0037] Figure 3 A diagram showing the inspection condition configuration page provided in an embodiment of the present application;

[0038] Figure 4 This is a page display diagram of the active inspection workbench provided in an embodiment of the present application;

[0039] Figure 5 A schematic structural diagram of an active inspection device provided in an embodiment of the present application;

[0040] Figure 6 A schematic diagram of the internal structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0041] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0042] In one embodiment, Figure 1 As shown, Figure 1 A flowchart of an active inspection method provided in an embodiment of the present application is provided; the present application provides an active inspection method, which may include:

[0043] S110: Acquire asynchronous data generated in a target application by a target user in at least one risk control list of the target application, and a data processing result after processing the asynchronous data according to a preset processing strategy.

[0044] In this step, when risk control is performed on the high-risk, high-exposure, and frequent and multiple-violation groups in the target application, the risk control list of the target application can be obtained. Since the group portrait corresponding to the user group in the risk control list is a subject portrait covering various characteristics formed after multi-dimensional data evaluation, the target users in the risk control list are one or more of the above-mentioned high-risk, high-exposure, and frequent and multiple-violation groups. This application can monitor the data generated by the target users in the risk control list and the target user subjects, thereby ensuring that the illegal content generated by the subjects and the illegal behavior of the subjects themselves can be effectively handled.

[0045] Furthermore, the target application's risk control list in this application can be one or more lists, with the target users on each list corresponding to one or more categories of people with high-risk characteristics, such as user attributes, user behaviors, and behavior sequences that meet violation criteria. Therefore, after obtaining at least one risk control list for a target application, this application can obtain the asynchronous data generated by the target users on that list in the target application, allowing for appropriate processing of the target users and the asynchronous data generated by them.

[0046] Furthermore, in order to decouple timing dependencies and further optimize risk management efficiency, this application can obtain asynchronous data when acquiring relevant data generated by the target user in the target application. The core feature of this asynchronous data is non-blocking: the sender does not need to wait for the receiver's response after sending the data, and can continue to perform other tasks, while the receiver processes the data when it is ready. Among them, the asynchronous data acquired by this application mainly refers to the data content generated by the subject in the target application, such as the user's nickname, user signature, user avatar, user album, square posting, or the room's public screen message, room name, room welcome, room topic, room topic content, etc. The specific data content acquired and the data generation period can be set according to the actual situation and are not restricted here.

[0047] After this application obtains the asynchronous data generated by the target users in at least one risk control list of the target application in the target application, this application can also process the asynchronous data according to the preset processing strategy. For example, this application can first determine the policy link corresponding to the asynchronous data, and process the asynchronous data according to the policy link to obtain the final data processing result.

[0048] It is understandable that in order to carry out differentiated treatment of asynchronous data generated by different target users, this application can pre-set different policy links for different business scenarios. The policy link refers to the data processing flow when processing the asynchronous data. Different asynchronous data corresponds to different policy links, which can be set according to application, subject type, audit scenario, policy type, risk control list and other conditions. After the setting is completed, the platform will carry out layered treatment with different intensities for different applications, different scenarios, different risk control list users, and set conditions. For example, when it is identified that the message sent by the user on the risk control list A in the voice live broadcast platform hits a certain violation label in the room, the room message of this user can be checked according to the corresponding policy link.

[0049] Furthermore, when different asynchronous data in this application are processed according to the corresponding policy links, the data processing results obtained may be the same or different. Among them, the data processing results of this application include but are not limited to machine review passed, machine review failed, assigned human review, simulated human review and marking, suspected risk, simulated human review passed, retrieval, human review passed, human review marked, etc. Specifically, "machine review passed" and "human review passed" refer to sending a "PASS" result to the business application, indicating that the content can be released; "machine review failed" refers to sending a "REJECT" result to the business application, indicating that the content is blocked and cannot be released; "human review assignment" refers to assigning the content to a reviewer for review, and selecting the corresponding review round, review mode, and corresponding review role. When there are multiple review roles, the assigned weight ratio can be configured, and multi-role weight ratio allocation is supported; "simulated human review labeling" refers to selecting the human review label configuration, the system simulates human review labeling, and sends the human review labeling results to the business application, which then blocks the content; "human review labeling" refers to labeling the data by the reviewer and sending it to the business application, which then blocks the content; "suspected risk" refers to sending a "REVIEW" result to the business application, which blocks the content and cannot be released; "simulated human review passed" refers to sending the human review pass result to the business application, which then releases the content; "recall" refers to querying the data that has passed the machine review but not pushed for human review in the specified scenario based on the ID of the risk control list and the business scenario, and then recalling it for human review. This application processes different asynchronous data differently and outputs the same or different data processing results, which can not only improve the accuracy of data processing but also avoid illegal omissions.

[0050] S120: When the asynchronous data and / or data processing results meet the inspection conditions configured for the active inspection task being executed, a comprehensive evaluation is performed on the relevant information of the target user, and when it is determined that the target user has violated the regulations based on the comprehensive evaluation results, the target user is punished.

[0051] In this step, after obtaining the asynchronous data generated by the target user in at least one risk control list of the target application in the target application through S110, as well as the data processing results after processing the asynchronous data according to the preset processing strategy, the present application can also determine whether the asynchronous data and / or data processing results meet the inspection conditions configured for the active inspection task being executed. If so, the relevant information of the target user can be comprehensively evaluated, and when it is determined that the target user has violated the rules based on the comprehensive evaluation results, the target user will be punished.

[0052] Specifically, this application can not only perform differentiated processing on the asynchronous data of the target user, but also create active patrol tasks and set the task execution time of the active patrol tasks. In this way, when the platform monitors the active patrol task being executed, it can compare the asynchronous data and / or data processing results of the target user with the patrol conditions configured for the active patrol task. If the asynchronous data and / or data processing results meet the patrol conditions configured for the active patrol task being executed, the relevant information of the target user can be obtained and the relevant information can be comprehensively evaluated to determine whether the target user has violated the rules. If it is determined that the target user has violated the rules, the target user can be punished to ensure that the illegal content generated by the subject and the illegal behavior of the subject itself can be effectively dealt with.

[0053] It is understandable that in order to improve the control and management strength and scope of users who violate regulations, this application can pre-create active patrol tasks and configure the execution time and patrol conditions of active patrol tasks. The patrol conditions can be set with risk control lists, subject types, review scenarios, asynchronous text keywords, historical machine review violations, historical human review violations and other conditions. Active patrol tasks can set tasks for specified time periods and cyclic periods to facilitate dealing with various situations. For example, this application can set an active patrol task that is executed on May 17, 2025. If a user who meets the risk control list A sends a message in the room and hits the patrol conditions configured by the active patrol task, the subject can be patrolled and monitored. If there is a violation, it will be dealt with, so as to achieve real-time capture and governance of the subject's risky behavior.

[0054] In the above embodiment, when the asynchronous data generated by the target user in at least one risk control list of the target application in the target application and the data processing results after processing the asynchronous data according to the preset processing strategy are obtained, the present application can also determine whether the asynchronous data and / or data processing results meet the inspection conditions configured for the active inspection task being executed. If so, a comprehensive evaluation can be performed on the relevant information of the target user, and when it is determined that the target user has violated the rules based on the comprehensive evaluation results, the target user will be punished. This ensures that the illegal content generated by the subject and the illegal behavior of the subject itself can be effectively handled, thereby effectively preventing the illegal content and the illegal subject from being exposed, achieving the real-time capture and governance of the subject's risky behavior, and avoiding the omission of violations.

[0055] In one embodiment, determining whether the asynchronous data and / or the data processing result satisfies the inspection condition configured for the active inspection task being executed in S120 may include:

[0056] S121: Determine an active patrol strategy associated with the active patrol task being executed, and determine patrol conditions configured for the active patrol strategy.

[0057] S122: Match the asynchronous data and / or the data processing result with the inspection condition, and determine whether the asynchronous data and / or the data processing result meets the inspection condition according to the matching result.

[0058] In this embodiment, when determining whether the asynchronous data and / or data processing results meet the inspection conditions configured for the active inspection task being executed, the active inspection strategy associated with the active inspection task being executed can be determined first, and the inspection conditions configured for the active inspection strategy can be determined. Then, the asynchronous data and / or data processing results can be matched with the inspection conditions to obtain a matching result. Then, the present application can determine whether the asynchronous data and / or data processing results meet the inspection conditions based on the matching result.

[0059] It is understandable that when setting an active inspection task, the application can configure the inspection time of the active inspection task, such as Figure 2 As shown, Figure 2 A schematic diagram of the configuration page for the active inspection task provided in an embodiment of the present application; Figure 2 In the task configuration page, you can configure the task name, task type, execution strategy, and execution frequency. The execution frequency can be a specified period or a recurring period, and the task type can be a scheduled task or a real-time task. Therefore, when this application configures an active patrol task, it can be executed in the corresponding period based on the execution frequency of the active patrol task.

[0060] Furthermore, this application can also configure inspection conditions corresponding to the active inspection strategy. The inspection conditions include but are not limited to subject status, audit scenario, machine review results, human review results, machine review labels, human review labels, number of people in the room, historical events, recent days, historical number of human review violations, historical number of machine review violations, user ID, asynchronous text keywords, risk control, and list (user portrait). If risk control and list are configured, the user ID that hits the list will be included in the active patrol monitoring list. The above inspection conditions correspond to the types of asynchronous data obtained and the types of data processing results. Therefore, when the inspection conditions of the active inspection policy set by the user are only related to abnormal data, only the abnormal data can be matched with the inspection conditions. When the inspection conditions set by the user are only related to the data processing results, only the data processing results can be matched with the inspection conditions. When the inspection conditions set by the user are related to both abnormal data and data processing results, both the abnormal data and the data processing results can be matched with the inspection conditions, and whether the inspection conditions are met can be determined based on the matching results. When the inspection conditions are met, the corresponding subjects can be monitored so as to clean up the illegal content and illegal subjects in a timely manner.

[0061] In one embodiment, the active patrol strategy includes at least one patrol condition group, and each patrol condition group includes at least one patrol condition.

[0062] Determining whether the asynchronous data and / or the data processing result meets the inspection condition according to the matching result in S122 may include:

[0063] S1221: When there is one inspection condition group and the matching result is that the asynchronous data and / or the data processing result matches all the inspection conditions in the inspection condition group, it is determined that the asynchronous data and / or the data processing result meets the inspection condition.

[0064] S1222: When there are multiple inspection condition groups, determine whether the asynchronous data and / or the data processing result meets the inspection condition according to the satisfaction conditions of the inspection condition groups and the matching results.

[0065] In this embodiment, Figure 3 As shown, Figure 3 This is a diagram showing the inspection condition configuration page provided in the embodiment of the present application; Figure 3 It can be seen that the configuration information of the active patrol strategy of this application includes basic information and policy configuration, among which the basic information includes policy name, policy type, patrol time range, application and subject type, and the policy configuration includes policy condition group, policy condition item and satisfaction condition, among which, in order to distinguish the policy condition group of machine review strategy and human review strategy, the policy condition group here refers to the patrol condition group. This application can set one or more patrol condition groups for each active patrol strategy, and one or more patrol conditions can be set in each patrol condition group. The policy condition item can configure more detailed features for the corresponding patrol conditions, such as configuring the specific scenario of the patrol condition of the audit scenario, configuring the specific keywords under the patrol condition of asynchronous text keywords, etc. The specific settings can be made according to the actual situation and are not restricted here.

[0066] Furthermore, when there is only one inspection condition group in this application, and the matching result is that the asynchronous data and / or data processing result matches all the inspection conditions in the inspection condition group, it means that the asynchronous data and / or data processing result meets the inspection conditions; when there are multiple inspection condition groups in this application, it is necessary to jointly determine whether the asynchronous data and / or data processing results meet the inspection conditions based on the satisfaction conditions of the inspection condition group and the matching results, so that a variety of business scenarios can be met.

[0067] In one embodiment, determining whether the asynchronous data and / or the data processing result satisfies the inspection condition according to the satisfaction condition of the inspection condition group and the matching result in S1222 may include:

[0068] S12221: When the satisfaction condition of the inspection condition group is to satisfy all the inspection conditions of any inspection condition group, if the matching result is that the asynchronous data and / or the data processing result matches all the inspection conditions in one of the inspection condition groups, it is determined that the asynchronous data and / or the data processing result meets the inspection condition.

[0069] S12222: When the satisfaction condition of the inspection condition group is to satisfy all the inspection conditions of all the inspection condition groups, if the matching result is that the asynchronous data and / or the data processing result matches all the inspection conditions in all the inspection condition groups, it is determined that the asynchronous data and / or the data processing result meets the inspection condition.

[0070] In this embodiment, when there are multiple inspection condition groups of this application, it is necessary to jointly determine whether the asynchronous data and / or data processing results meet the inspection conditions based on the satisfaction conditions and matching results of the inspection condition groups.

[0071] Specifically, when there are multiple inspection conditions, the conditions for satisfying the inspection condition groups can be determined first. When the conditions for satisfying all inspection conditions of any inspection condition group are met, if the matching result is that the asynchronous data and / or data processing results match all inspection conditions in one of the inspection condition groups, then the asynchronous data and / or data processing results are determined to satisfy the inspection conditions. When the conditions for satisfying all inspection conditions of all inspection condition groups are met, if the matching result is that the asynchronous data and / or data processing results match all inspection conditions in all inspection condition groups, then the asynchronous data and / or data processing results are determined to satisfy the inspection conditions. At this point, the subject will be included in the active inspection ledger for monitoring, and if violations are detected, they will be punished.

[0072] In one embodiment, the relevant information includes at least the subject information, real-time interactive content, and subject attributes of the target user.

[0073] In S120, comprehensive evaluation is performed on the relevant information of the target user to obtain a comprehensive evaluation result, which may include:

[0074] The subject information, real-time interactive content and subject attributes of the target user are evaluated respectively through a plurality of pre-set risk assessment mechanisms, and the comprehensive assessment results are obtained after reviewing the assessment results.

[0075] In this embodiment, when the asynchronous data and / or data processing results meet the inspection conditions, relevant information of the target user can be obtained and comprehensively evaluated to confirm whether the target user has violated the regulations based on the comprehensive evaluation results.

[0076] Among them, the relevant information obtained by this application includes but is not limited to the subject information, real-time interactive content and subject attributes of the target user. This application can evaluate the subject information, real-time interactive content and subject attributes of the target user respectively through a plurality of pre-set risk assessment mechanisms, and obtain a comprehensive assessment result after reviewing the assessment results.

[0077] In a specific implementation, Figure 4 As shown, Figure 4 This is a page display diagram of the active inspection workbench provided in an embodiment of this application. In this application, when a user subject is included in the ledger due to triggering an inspection condition, the auditor must "check in" at the workbench, that is, log in to the system and then mark the start of processing the task. This operation ensures the allocation of audit responsibilities (such as designated processing personnel), records the audit time, and allows the auditor to retrieve relevant information about the subject (such as historical records, real-time data, etc.) for verification. The audit content includes but is not limited to: subject information, real-time interactive content (such as voice on the microphone, IM messages, ASR on the microphone, etc.), and the user's recent violations.

[0078] Next, this application can use the three-layer mechanism of "rules + machine review + manual" to determine whether the target user has violated the rules, as follows:

[0079] 1. Preset rule base: clearly define violation criteria, for example:

[0080] Content rules: including banned words, external link advertisements, etc.

[0081] Behavioral rules: Frequent private chats, screen swiping, abnormal logins and other high-risk operations;

[0082] 2. Machine-assisted identification:

[0083] Natural Language Processing (NLP): identifying semantic violations (e.g., cryptic insults, homophonic words);

[0084] User behavior risk identification: Detects historical behaviors of the subject (such as multiple reports, multiple illegal content sent, abnormal behavior within the terminal, etc.), and increases the judgment weight based on the subject's historical behavior;

[0085] 3. Manual review and judgment: Suspicious cases marked by the system are ultimately confirmed by auditors, especially for gray area content (such as ambiguous sentences that depend on the context).

[0086] For example, when this application determines whether the subject information of the target user violates the regulations, it can make a judgment through static data (such as the latest subject information records and historical subject information violation records); when determining whether real-time audio information violates the regulations, it can convert the voice into text through voice recognition technology (ASR), and combine semantic analysis to detect sensitive content (such as insults, advertisements); when determining whether IM messages violate the regulations, it can scan the text chat content in real time, use keyword filtering and spam models to identify and mark illegal text (such as screen swiping, inducing transactions); when determining whether the ASR information on the microphone violates the regulations, it can dynamically analyze the real-time translated text in the voice interaction to capture the intention of violation (such as violation hints, etc.); when determining whether the subject attributes violate the regulations, it can combine user type (such as ordinary user / anchor), behavior pattern (such as high-frequency speech) and other attributes to assess the subject risk by calling the risk control platform (machine review).

[0087] After judging through the above identification capabilities, various risks can be marked on the workbench, and then reviewed and determined by manual reviewers, and finally dealt with accordingly based on the risk level of the violation.

[0088] In one embodiment, when it is determined in S120 that the target user has violated a rule based on the comprehensive evaluation result, punishing the target user may include:

[0089] When it is determined that the target user has violated the rules based on the comprehensive evaluation results, the violation level of the target user is determined, and the target user is punished based on the violation level.

[0090] In this embodiment, when the target user is judged to have violated the rules based on the comprehensive evaluation results, the application may first determine the violation level of the target user and then punish the target user based on the violation level.

[0091] For example, when this application determines that the target user has violated the rules based on the comprehensive evaluation results, it can also confirm the violation level. The violation level can be set according to the actual situation and there is no specific restriction. After determining the violation level, this application can impose corresponding penalties on the target user, such as a mild warning, account ban, microphone ban, room entry ban, account blocking, etc. The severity of the penalty is positively correlated with the violation level, that is, the higher the violation level, the stronger the penalty, so as to achieve a warning effect.

[0092] In one embodiment, the method may further include:

[0093] S130: Count the completed active inspection tasks to obtain statistical results.

[0094] S140: Classify and summarize the statistical results.

[0095] In this embodiment, since this application is configured with different active patrol tasks, this application can also count the active patrol tasks that have been executed, and classify and summarize the statistical results and then display them visually, so that the execution status of each current active query task can be intuitively understood.

[0096] Among them, this application can count the active inspection tasks that have been completed based on the subject type, review, and inspection task dimensions. The data statistics results may include date, application, inspection volume, human review volume, Class A label volume, Class B label volume, Class C label volume, and average review time.

[0097] This application quantifies the algorithm model's recognition accuracy and efficiency for complex scenarios through multi-dimensional statistics (such as the number of classification labels and review time), thereby proving the system's innovation in reducing missed judgment rates (A / B / C classification) and improving the utilization of human review resources (reducing manual workload). In addition, this application can also proactively conduct inspections, statistics, and decisions to verify business effectiveness in a closed loop, such as verifying the interception rate of high-risk work orders, thereby forming a data-driven risk control method and effectively improving risk control efficiency and accuracy.

[0098] The active patrol device provided in an embodiment of the present application is described below. The active patrol device described below and the active patrol method described above can be referenced to each other.

[0099] In one embodiment, Figure 5 As shown, Figure 5 This is a schematic diagram of the structure of an active patrol device provided in an embodiment of the present application. The present application also provides an active patrol device, which may include a data acquisition module 210 and an active patrol module 220, specifically including the following:

[0100] The data acquisition module 210 is used to acquire asynchronous data generated by target users in at least one risk control list of the target application in the target application, and a data processing result after processing the asynchronous data according to a preset processing strategy.

[0101] The active patrol module 220 is used to comprehensively evaluate the relevant information of the target user when the asynchronous data and / or the data processing results meet the patrol conditions configured for the active patrol task being executed, and to punish the target user when it is determined that the target user has violated the rules based on the comprehensive evaluation results.

[0102] In the above embodiment, when the asynchronous data generated by the target user in at least one risk control list of the target application in the target application and the data processing results after processing the asynchronous data according to the preset processing strategy are obtained, the present application can also determine whether the asynchronous data and / or data processing results meet the inspection conditions configured for the active inspection task being executed. If so, a comprehensive evaluation can be performed on the relevant information of the target user, and when it is determined that the target user has violated the rules based on the comprehensive evaluation results, the target user will be punished. This ensures that the illegal content generated by the subject and the illegal behavior of the subject itself can be effectively handled, thereby effectively preventing the illegal content and the illegal subject from being exposed, achieving the real-time capture and governance of the subject's risky behavior, and avoiding the omission of violations.

[0103] In one embodiment, the present application also provides a computer-readable storage medium, which stores computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors execute the steps of the active patrol method described in any of the above embodiments.

[0104] In one embodiment, the present application further provides a computer device, including: one or more processors, and a memory.

[0105] The memory stores computer-readable instructions, and when the computer-readable instructions are executed by the one or more processors, the steps of the active inspection method described in any one of the above embodiments are performed.

[0106] Schematically, as Figure 6 As shown, Figure 6 This is a schematic diagram of the internal structure of a computer device provided in an embodiment of the present application. The computer device 300 can be provided as a server. Figure 6 Computer device 300 includes a processing component 302, which further includes one or more processors, and memory resources represented by memory 301 for storing instructions executable by processing component 302, such as applications. The applications stored in memory 301 may include one or more modules, each corresponding to a set of instructions. In addition, processing component 302 is configured to execute the instructions to perform the active inspection method of any of the above-described embodiments.

[0107] The computer device 300 may further include a power supply component 303 configured to perform power management of the computer device 300, a wired or wireless network interface 304 configured to connect the computer device 300 to a network, and an input / output (I / O) interface 305. The computer device 300 may operate based on an operating system stored in the memory 301, such as Windows Server™, Mac OS X™, Unix™, Linux™, Free BSD™, or the like.

[0108] Those skilled in the art will understand that Figure 6 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0109] Finally, it should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or device comprising the element.

[0110] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The various embodiments can be combined as needed, and the same or similar parts can be referenced to each other.

[0111] The above description of the disclosed embodiments is intended to enable one skilled in the art to implement or use the present application. Various modifications to these embodiments will be readily apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application is not limited to the embodiments shown herein, but is intended to conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An active inspection method, characterized in that: The method comprises: Acquire asynchronous data generated in the target application by a target user in at least one risk control list of the target application, and a data processing result after processing the asynchronous data according to a preset processing strategy; When the asynchronous data and / or the data processing result meets the inspection conditions configured for the active inspection task being executed, a comprehensive evaluation is performed on the relevant information of the target user, and when it is determined that the target user has violated the rules based on the comprehensive evaluation result, the target user is punished.

2. The active inspection method according to claim 1, characterized in that: The determining whether the asynchronous data and / or the data processing result meets the inspection conditions configured for the active inspection task being executed includes: Determining an active patrol strategy associated with the active patrol task being executed, and determining patrol conditions configured for the active patrol strategy; The asynchronous data and / or the data processing result are matched with the inspection condition, and it is determined whether the asynchronous data and / or the data processing result meet the inspection condition according to the matching result.

3. The active inspection method according to claim 2, characterized in that: The active inspection strategy includes at least one inspection condition group, and each inspection condition group includes at least one inspection condition; The determining, based on the matching result, whether the asynchronous data and / or the data processing result satisfies the inspection condition includes: When there is one inspection condition group, and the matching result is that the asynchronous data and / or the data processing result matches all the inspection conditions in the inspection condition group, determining that the asynchronous data and / or the data processing result meets the inspection condition; When there are multiple inspection condition groups, it is determined whether the asynchronous data and / or the data processing result meets the inspection conditions according to the satisfaction conditions of the inspection condition groups and the matching results.

4. The active inspection method according to claim 3, characterized in that: The determining whether the asynchronous data and / or the data processing result satisfies the inspection condition according to the satisfaction condition of the inspection condition group and the matching result includes: When the satisfaction condition of the inspection condition group is to satisfy all inspection conditions of any inspection condition group, if the matching result is that the asynchronous data and / or the data processing result matches all inspection conditions in one of the inspection condition groups, it is determined that the asynchronous data and / or the data processing result satisfies the inspection condition; When the satisfaction condition of the inspection condition group is to satisfy all the inspection conditions of all the inspection condition groups, if the matching result is that the asynchronous data and / or the data processing result matches all the inspection conditions in all the inspection condition groups, it is determined that the asynchronous data and / or the data processing result meets the inspection condition.

5. The active inspection method according to claim 1, characterized in that: The relevant information includes at least the subject information, real-time interactive content and subject attributes of the target user; The comprehensive evaluation of the relevant information of the target user to obtain a comprehensive evaluation result includes: The subject information, real-time interactive content and subject attributes of the target user are evaluated respectively through a plurality of pre-set risk assessment mechanisms, and the comprehensive assessment results are obtained after reviewing the assessment results.

6. The active inspection method according to claim 1, characterized in that: When the target user is determined to have violated the rules based on the comprehensive evaluation results, the target user is punished, including: When it is determined that the target user has violated the rules based on the comprehensive evaluation results, the violation level of the target user is determined, and the target user is punished based on the violation level.

7. The active inspection method according to any one of claims 1 to 6, characterized in that: The method further comprises: Count the completed active inspection tasks and obtain statistical results; The statistical results are classified and summarized.

8. An active inspection device, characterized in that: include: a data acquisition module, configured to acquire asynchronous data generated in a target application by a target user in at least one risk control list of the target application, and a data processing result after processing the asynchronous data according to a preset processing strategy; The active patrol module is used to conduct a comprehensive evaluation of the relevant information of the target user when the asynchronous data and / or the data processing results meet the patrol conditions configured for the active patrol task being executed, and to punish the target user when it is determined that the target user has violated the rules based on the comprehensive evaluation results.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-readable instructions, and when the computer-readable instructions are executed by one or more processors, the one or more processors execute the steps of the active inspection method according to any one of claims 1 to 7.

10. A computer device, characterized in that: include: one or more processors, and memory; The memory stores computer-readable instructions, and when the computer-readable instructions are executed by the one or more processors, the steps of the active patrol method according to any one of claims 1 to 7 are performed.

Images