Video call method and electronic device
By implementing active and passive detection methods in video calls, and triggering face-swapping detection and alerts based on different conditions, the problem of financial loss caused by AI face-swapping in video calls is solved, achieving efficient face-swapping risk protection.
Patent Information
- Application Number
- PCT/CN2025/095224
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-07-30
- Filing Date
- 2025-05-15
- Publication Date
- 2026-01-02
AI Technical Summary
During video calls, there are instances where users with ulterior motives use AI face-swapping technology to replace the faces of acquaintances with those of others in order to gain the trust of the other party, resulting in financial losses.
By implementing active and passive detection methods in electronic devices, face-swapping detection is triggered and prompts are provided based on different conditions, offering different detection experiences. This includes automatic detection and prompting when the first condition is met, and passive detection after user confirmation when the second condition is met, with the detection process and results displayed during the process.
It improves the targeting of face-swapping detection, reduces invalid detections, enhances users' understanding of the detection process and results, and prevents financial losses.
Smart Images

Figure CN2025095224_02012026_PF_FP_ABST
Abstract
Description
A video call method and electronic device
[0001] This application claims priority to the Chinese Patent Application No. 202410841170.6, filed on June 26, 2024, entitled "A Video Call Method and Electronic Device", and the Chinese Patent Application No. 202411044507.7, filed on July 30, 2024, entitled "A Video Call Method and Electronic Device", the contents of which are incorporated herein by reference in their entirety. TECHNICAL FIELD
[0002] Embodiments of the present application relate to the technical field of terminal, and in particular, to a video call method and electronic device. BACKGROUND
[0003] Electronic devices such as mobile phones and tablets usually provide a video call function. For example, a social chat application is installed in the electronic device, and the electronic device can provide a video call function through the social chat application.
[0004] During a video call, the two parties participating in the call can see each other's faces, which makes it easier to confirm the identity of the other party and easily gain each other's trust. However, some people with improper purposes take advantage of this point and use artificial intelligence (AI) face swapping technology to swap faces with the other party's "acquaintances", such as family members, friends, and leaders, to gain the other party's trust, and then make demands such as transferring money or helping with payments, which can easily cause property loss and bring a bad experience to the user. SUMMARY
[0005] The present application provides a video call method and electronic device, which can detect face swapping risks during a video call, and further trigger face swapping detection and prompt in different ways under different conditions, thereby providing different detection experiences.
[0006] To achieve the above-mentioned purpose, embodiments of the present application adopt the following technical solutions:
[0007] In a first aspect, the present application provides a video call method applied to an electronic device, specifically: adding a first user as a friend, such as adding the first user as a friend through a social chat application, and the first friend can be any added friend. Video call with the first user. It should be understood that the essence of video calling with the first user is that the electronic device establishes a video call with a device logged in with an account of the first user.
[0008] In a case where the first condition (detection condition in active detection below) is met, whether the face of the first user in the video call has face swapping risk is detected, and after detecting that there is face swapping risk, the first prompt (prompt e below) is displayed. That is, in a case where the first condition is met, whether there is face swapping risk is actively detected, and a prompt is given when there is risk. It can be seen that, in the active detection manner, no impact on the video call is caused except in a case where there is face swapping risk.
[0009] In a case where the second condition (push condition of prompt g or prompt h below) is met, the second prompt (prompt g or prompt h below) for detecting face swapping risk is displayed, a confirmation detection operation (such as a trigger operation on a detection control) on the second prompt is detected, whether there is face swapping risk is detected, a detection process is prompted, and after obtaining a detection result, the third prompt (prompt j below) is displayed, the detection result including whether there is face swapping risk or not. That is, in a case where the second condition is met, a prompt for detecting face swapping risk is given first, and then passive detection of whether there is face swapping risk is triggered after confirmation by the user. In the process of passive detection, the detection process is prompted, such as a detection-in-progress animation being displayed, and a prompt is given in a case where there is risk or not. It can be seen that, in the passive detection manner, the detection process and the detection result are both visible, so that the user can understand the detection process and the detection result after confirming the detection.
[0010] The first condition and the second condition are different, and in general, the first condition has a lower requirement and the second condition has a higher requirement. In other words, the first condition is easier to meet and the second condition is more difficult to meet. In this way, in most cases, the automatic detection manner can be used to detect face swapping risk, reducing the impact on the video call, and in a few cases, the passive detection manner can be used to detect face swapping risk, so that the user can understand the detection process and the detection result.
[0011] In summary, by using the present application, in a case where different conditions are met, face swapping detection can be triggered and prompted in different manners, so that different detection experiences can be provided, such as no perception in the active detection manner if there is no face swapping risk, and full perception in the passive detection manner.
[0012] In a possible design manner of the first aspect, the first condition or the second condition includes at least one of the following:
[0013] A time difference between a moment when the first user is added as a friend and a starting moment of the video call is within a first time length (time length 5 or time length 6 below), that is, the first user is a friend added for a short time.
[0014] The first user is the first added friend. For example, the electronic device adds the first friend after installing the chat application.
[0015] The video call is the first video call with the first user.
[0016] The video call is a video call actively initiated by the first user.
[0017] The first user is in a detection list (List 1 below) of the electronic device, and the detection list records a first number (Number 1 below) of user names that are newly added to the electronic device by the first user, that is, the first user is one of a certain number of friends newly added to the electronic device.
[0018] The electronic device has a risk event, such as receiving risk information, receiving an overseas call, downloading an unknown application, and performing operations such as entering a bank account, transferring money, and sharing a screen.
[0019] That is, the electronic device detects or prompts to detect face swapping risks for some video calls that may have face swapping risks, so as to improve the pertinence of face swapping detection and avoid a large number of invalid detections.
[0020] In a possible design manner of the first aspect, the first prompt is displayed as follows: when the video call is not ended after the face swapping risk is detected, the first prompt is displayed on the video call interface, and the first prompt includes the re-detection control and / or the screen recording control. When the video call is ended after the face swapping risk is detected, the first prompt is displayed on the interface after the video call is ended, and the first prompt does not include the re-detection control and the screen recording control.
[0021] In this way, the first prompt is displayed whenever the face swapping risk is detected, so as to prompt the face swapping risk. Further, since the re-detection and screen recording cannot be implemented after the video call is ended, the re-detection control and the screen recording control are not provided in the first prompt when the video call is ended after the face swapping risk is detected, so as to avoid providing invalid controls.
[0022] In a possible design manner of the first aspect, the detection result is that there is no face swapping risk. The third prompt is displayed after the detection result is obtained, and the third prompt includes the re-detection control and / or the screen recording control. For details, refer to the related description of the first prompt.
[0023] In a possible design of the first aspect, the method further includes: in a case where the number of times of detecting whether the video call has the face swapping risk exceeds the first number of times (e.g., the number of times 1), displaying, on the video call interface, a prompt that does not include the re-detection control.
[0024] In a possible design of the first aspect, the method further includes: in a case where the number of times of detecting whether the video call has the face swapping risk exceeds the first number of times (e.g., the number of times 1), displaying, on the video call interface, a prompt that does not include the re-detection control.
[0025] In a possible design of the first aspect, after displaying, on the video call interface, the prompt that includes the re-detection control (e.g., the first prompt or the third prompt), the method further includes: in response to a triggering operation on the re-detection control, detecting whether the video call has the face swapping risk, prompting a detection process, and displaying a fourth prompt after obtaining a detection result, the detection result including that the video call has the face swapping risk or does not have the face swapping risk.
[0026] That is, the triggering operation on the re-detection control can also trigger passive detection, such as prompting the detection process and displaying the prompt that the video call has the face swapping risk or does not have the face swapping risk.
[0027] In a possible design of the first aspect, after displaying, on the video call interface, the prompt that includes the screen recording control, the method further includes: in response to a triggering operation on the screen recording control, recording a screen of the video call interface until the video call ends, and then ending the recording and saving the recorded video. In this way, the screen recording of the video call that has the face swapping risk can be saved, to serve as evidence when necessary, or to update the detection model for face swapping detection.
[0028] In a possible design of the first aspect, the method further includes: in a case where the second condition is met and the face of the first user is not detected, displaying a prompt that the detection is not completed; or in a case where the second condition is met and the video call ends before the image frame of the video call used for detection is acquired, displaying, on an interface where the video call ends, the prompt that the detection is not completed. That is, in the passive detection manner, for an abnormal case that the detection cannot be completed due to that the face is not detected or the image frame is not acquired, the prompt that the detection is not completed can be displayed, so that the user can be explicitly aware of the abnormality.
[0029] Conversely, in the case where the first condition is met and no face is detected, or in the case where the video call ends before the image frame is acquired, the prompt for incomplete detection is not displayed. That is, in the active detection mode, for abnormal situations such as no face being detected, no image frame being acquired, etc., which result in the detection being unable to be completed, no prompt is displayed to avoid disturbing the user.
[0030] In a possible design manner of the first aspect, the prompt detection process comprises: displaying at least one of the following information: a prompt for starting detection (such as a prompt “Start detection”), a prompt for detection (such as a prompt “Detecting”), and a detection animation effect.
[0031] In a possible design manner of the first aspect, the second condition comprises a first sub-condition and a second sub-condition. In the case where the second condition is met, the second prompt for detecting the face swap risk is displayed, comprising: in the case where the first sub-condition (a push condition of the prompt g below) is met, the second prompt (the prompt g below) for detecting the face swap risk is displayed, and the first sub-condition comprises the face swap detection switch of the electronic device being turned on. In the case where the second sub-condition (a push condition of the prompt h below) is met, the second prompt (the prompt h below) for turning on the face swap detection function and detection is displayed, and the second sub-condition comprises the face swap detection switch of the electronic device being turned off.
[0032] In addition, the requirement of the first sub-condition is lower, and the requirement of the second sub-condition is higher. In other words, the first sub-condition is easier to meet, and the second sub-condition is more difficult to meet. In practice, the electronic device defaults to turn on the risk protection, and the face swap detection function is turned on by default in response. If the face swap detection switch is turned off, that is, the face swap detection function is not turned on, it indicates that it is very likely that the user manually turned off the face swap detection function. In this case, through the second sub-condition, the face swap detection function can be prompted to be turned on at a lower frequency, avoiding the user from being disturbed by frequent prompts for a function that the user does not need. After the face swap detection function is turned on, through the first sub-condition, the face swap detection function can be prompted to detect the face swap risk at a slightly higher frequency, so as to improve the use rate of the face swap detection function.
[0033] In a possible design manner of the first aspect, after the second prompt for turning on the face swap detection function and detection is displayed, in response to a confirmation detection operation on the second prompt, it is detected whether there is a face swap risk, comprising: in response to the confirmation detection operation on the second prompt, the face swap detection function is turned on and it is detected whether there is a face swap risk.
[0034] In the case where the user performs the confirmation detection operation on the second prompt, it indicates that the user wants to use the face swap detection function to detect the face swap risk, and accordingly, the face swap detection function can be turned on and used to detect the face swap risk, so as to meet the user's demand.
[0035] In a possible design of the first aspect, the second prompt for displaying the face swapping risk includes: in a case where the second prompt is displayed for the first to Nth times, the second prompt is displayed in a card form, and the card form second prompt includes a function introduction of the face swapping detection function and / or a detection confirmation control (such as a detection control, an opening and detection control, and the like in the following). In a case where the second prompt is displayed for the (N+1)th time, the second prompt is displayed in a capsule form, and the capsule form second prompt does not include the function introduction of the face swapping detection function and the detection confirmation control. N is a natural number greater than 1, for example, N=3.
[0036] In this way, the user can be presented with details of the prompt in the first few times of displaying the second prompt, so as to make the user clear the content of the prompt, and the user can be presented with a capsule in the subsequent display of the second prompt, thereby reducing the impact on the call.
[0037] In a possible design of the first aspect, in a case where it is detected that there is a face swapping risk, for example, a prompt (the first prompt or the third prompt displayed after it is detected that there is a face swapping risk) that there is a face swapping risk is displayed, the user can be made to pay attention to the face swapping risk by using the following response strategies.
[0038] Strategy 1 (corresponding to the response strategy one in the following), after the prompt that there is a face swapping risk is displayed on the video call interface, the prompt that there is a face swapping risk is kept displayed before the video call is ended. In this way, the face swapping risk can be always prompted during the video call.
[0039] Different from the above strategy 1, in a case where it is detected that there is no face swapping risk, for example, after the third prompt that there is no face swapping risk is displayed, the third prompt is cancelled after the display time of the third prompt reaches a third time length. That is, the user will not be always prompted that there is no face swapping risk, but the display of the prompt will be automatically cancelled, thereby avoiding interference to the user.
[0040] Strategy 2 (corresponding to the response strategy three in the following), after the prompt that there is a face swapping risk is displayed on the video call interface, the method further includes: displaying a detection record entry (such as the detection record entry in the notification 2 in the following) after the video call is ended. In response to a triggering operation on the detection record entry, a detection record of the face swapping risk detection is displayed. In this way, after it is detected that there is a face swapping risk and the video call is ended, a quick entry to a record interface of the face swapping detection can be provided, so as to enable the user to view the risk record of this time.
[0041] Strategy 3 (corresponding to the response strategy two below), after displaying the prompt of the face changing risk in the video call interface, the method further includes: in response to the operation of sliding down into the pull-down notification center in the video call interface, displaying the pull-down notification center, the pull-down notification center including a first notification (Notification 1 below), the content of the first notification being consistent with the third prompt. Thereby, after entering the pull-down notification center, the prompt of the face changing risk can be continued.
[0042] Strategy 4 (corresponding to the response strategy four below), within a fourth time length (Time Length 9 below) after detecting the face changing risk, detecting a risk behavior, and displaying a fifth prompt of the face changing risk. Wherein, the risk behavior includes entering a transfer interface, receiving a website link from a friend in the video call with the face changing risk, etc. In this way, the prompt can be strengthened after the risk behavior occurs.
[0043] In a possible design manner of the first aspect, the second sub-condition further includes that the risk protection switch of the electronic device is turned on, and the face changing detection function is one of the sub-functions of the risk protection. That is, in the case that the risk protection switch is turned on but the face changing detection switch is turned off, the face changing detection is prompted to be turned on.
[0044] In a possible design manner of the first aspect, before adding the first user as a friend, the method further includes: in the case that a third condition (the push condition of prompt a below) is met, displaying a sixth prompt (Prompt a below) of turning on the risk protection function. The third condition includes that the risk protection switch is turned off and the face changing detection switch is turned off, that is, the risk protection function is turned off, and correspondingly, the face changing detection function is also turned off. That is, in the case that the risk protection function is not turned on, the face changing detection is not prompted to be turned on and detected, but the risk protection function is prompted to be turned on.
[0045] Further, in response to the triggering operation on the sixth prompt, a setting interface of the risk protection is displayed, the setting interface of the risk protection including the risk protection switch in the off state. In response to the turning on operation on the risk protection switch, the risk protection function and the face changing detection function are turned on. That is, in the case that the risk protection is not turned on, the sixth prompt is pushed to provide a shortcut entrance to the setting interface of the risk protection, so that the risk protection function can be turned on quickly, and the face changing detection function under the risk protection function can be turned on.
[0046] In a possible design manner of the first aspect, before adding the first user as a friend, the method further includes: in the case that a fourth condition (the push condition of prompt d below) is met, a seventh prompt (Prompt d below) of understanding the face changing detection function is displayed, and the fourth condition includes that the face changing detection switch is turned on, that is, the face changing detection function is turned on, and correspondingly, the risk protection function is also turned on.
[0047] Further, in response to the triggering operation of the seventh prompt, a face swapping detection setting interface is displayed, and the face swapping detection setting interface includes a face swapping detection switch in an enabled state and a function introduction of the face swapping detection function. That is, in the case of enabling the face swapping detection, a shortcut entry into the face swapping detection setting interface is provided by pushing the seventh prompt, so that the face swapping detection function can be quickly understood.
[0048] In a possible design of the first aspect, the face swapping detection function is a sub-function of the risk protection. Before the first user is added as a friend, the method further includes: in response to an enabling operation of a risk protection switch (i.e., a risk protection switch in a risk protection setting interface) in a settings application or an enabling operation of the face swapping detection switch, enabling the face swapping detection function.
[0049] In a possible design of the first aspect, in response to the enabling operation of the face swapping detection switch in the settings application, the enabling of the face swapping detection function includes: in the case where the risk protection switch is not enabled, in response to the enabling operation of the face swapping detection switch, displaying a prompt to enable the risk protection. That is, in the case where the risk protection is not enabled, if the face swapping detection is to be enabled, the risk protection is first prompted to be enabled. In response to a confirmation enabling operation of the prompt to enable the risk protection, the risk protection and the face swapping detection function are enabled.
[0050] In a possible design of the first aspect, the risk protection is provided by a system manager service in the electronic device. In response to the confirmation enabling operation of the prompt to enable the risk protection, the enabling of the risk protection and the face swapping detection function includes: in the case where the system manager service is not enabled, in response to the confirmation enabling operation of the prompt to enable the risk protection, displaying a prompt to enable the system manager service. That is, in the case where the system manager service is not enabled, if the risk protection is to be enabled, the system manager service is first prompted to be enabled. In response to a confirmation enabling operation of the prompt to enable the system manager service, the system manager service, the risk protection and the face swapping detection function are enabled.
[0051] It can be understood that, in the case where the system manager service is not enabled, in response to the enabling operation of the risk protection switch in the settings application, the prompt to enable the system manager service can also be displayed first. Subsequently, in response to a confirmation enabling operation of the prompt to enable the system manager service, the system manager service and the risk protection are enabled.
[0052] In the second aspect, the present application further provides an electronic device, which includes a display screen, a memory and one or more processors. The display screen, the memory and the processors are coupled. The memory is configured to store computer program codes, and the computer program codes include computer instructions, which, when executed by the processors, cause the electronic device to perform the method in the first aspect and any possible design thereof.
[0053] In a third aspect, the present application provides a chip system, which is applied to an electronic device including a display screen and a memory; the chip system includes one or more interface circuits and one or more processors; the interface circuits and the processors are interconnected through lines; the interface circuits are configured to receive signals from the memory of the electronic device and send signals to the processors, the signals including computer instructions stored in the memory; when the processors execute the computer instructions, the electronic device performs the method according to the first aspect and any possible design of the first aspect.
[0054] In a fourth aspect, the present application provides a computer readable storage medium, which includes computer instructions, when the computer instructions are executed on an electronic device, the electronic device performs the method according to the first aspect and any possible design of the first aspect.
[0055] In a fifth aspect, the present application provides a computer program product, when the computer program product is executed on a computer, the computer performs the method according to the first aspect and any possible design of the first aspect.
[0056] It can be understood that the electronic device provided in the second aspect, the chip system provided in the third aspect, the computer readable storage medium provided in the fourth aspect, and the computer program product provided in the fifth aspect can achieve the beneficial effects as described in the first aspect and any possible design of the first aspect, which will not be described here. BRIEF DESCRIPTION OF DRAWINGS
[0057] FIG. 1A is a hardware structure diagram of a mobile phone according to an embodiment of the present application;
[0058] FIG. 1B is a schematic diagram of an interface for starting face changing detection according to an embodiment of the present application;
[0059] FIG. 2 is a schematic diagram of another interface for starting face changing detection according to an embodiment of the present application;
[0060] FIG. 3 is a schematic diagram of an interface for starting system manager service according to an embodiment of the present application;
[0061] FIG. 4 is a schematic diagram of an interface for understanding face changing detection details according to an embodiment of the present application;
[0062] FIG. 5 is a schematic diagram of an interface for viewing face changing detection records according to an embodiment of the present application;
[0063] FIG. 6 is a schematic diagram of an interface for security settings according to an embodiment of the present application;
[0064] FIG. 7 is a schematic diagram of a third interface for starting face changing detection according to an embodiment of the present application;
[0065] FIG. 8 is a schematic diagram of a prompt a and its interface response according to an embodiment of the present application;
[0066] FIG. 9 is an interface diagram of a disappearance process of prompt a according to an embodiment of the present application;
[0067] FIG. 10 is a diagram of prompt d and interface response thereof according to an embodiment of the present application;
[0068] FIG. 11 is a principle diagram of an active detection scheme according to an embodiment of the present application;
[0069] FIG. 12 is an interface diagram of the active detection scheme according to an embodiment of the present application;
[0070] FIG. 13 is an interface diagram of adding a friend and starting a video call according to an embodiment of the present application;
[0071] FIG. 14 is an interface diagram of prompting to use face swapping detection in a video call according to an embodiment of the present application;
[0072] FIG. 15 is an interface diagram of prompting to start face swapping detection in a video call according to an embodiment of the present application;
[0073] FIG. 16 is a principle diagram of a passive detection scheme according to an embodiment of the present application;
[0074] FIG. 17 is an interface diagram of the passive detection scheme according to an embodiment of the present application;
[0075] FIG. 18 is an interface diagram of the passive detection scheme according to an embodiment of the present application;
[0076] FIG. 19 is an interface diagram of the passive detection scheme according to an embodiment of the present application;
[0077] FIG. 20 is an interface diagram of the passive detection scheme according to an embodiment of the present application;
[0078] FIG. 21 is an interface diagram of the passive detection scheme according to an embodiment of the present application;
[0079] FIG. 22 is an interface diagram of the passive detection scheme according to an embodiment of the present application;
[0080] FIG. 23 is an interface diagram for a case of existing face swapping risk according to an embodiment of the present application;
[0081] FIG. 24 is an interface diagram for the case of existing face swapping risk according to an embodiment of the present application;
[0082] FIG. 25A is an interface diagram for the case of existing face swapping risk according to an embodiment of the present application;
[0083] FIG. 25B is an interface diagram for the case of existing face swapping risk according to an embodiment of the present application;
[0084] FIG. 26 is one of interface diagrams provided by embodiments of the present application for closing face swapping detection;
[0085] FIG. 27 is another of interface diagrams provided by embodiments of the present application for closing face swapping detection;
[0086] FIG. 28 is one of interface diagrams provided by embodiments of the present application for installing a detection model for face swapping detection;
[0087] FIG. 29A is another of interface diagrams provided by embodiments of the present application for installing a detection model for face swapping detection;
[0088] FIG. 29B is an interface diagram provided by embodiments of the present application for a storage space shortage when installing face swapping detection;
[0089] FIG. 30 is an interface diagram provided by embodiments of the present application for updating a detection model for face swapping detection;
[0090] FIG. 31 is an interface diagram provided by embodiments of the present application for a user manually updating a detection model;
[0091] FIG. 32 is an introduction entry diagram of face swapping detection function provided by embodiments of the present application. DETAILED DESCRIPTION
[0092] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing the specific embodiments and are not intended to be limiting on the present application. As used in the specification and the appended claims of the present application, the singular expressions "a", "said", "the above", "the", and "this" are intended to also include expressions such as "one or more", unless there is clear indication to the contrary in the context. It should also be understood that in the following embodiments of the present application, "at least one" and "one or more" refer to one or more than two (including two). The term "and / or" is used to describe the association relationship of the associated objects, which means that there can be three relationships; for example, A and / or B can represent the following three cases: A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after it.
[0093] Reference within the specification to "one embodiment" or "some embodiments" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. The appearances of the phrase "in one embodiment" or "in some embodiments" in various places within specified
[0094] In the present application, the word "exemplarily" or "for example" is used to represent as an example, illustration or description. Any embodiment or design scheme described as "exemplarily" or "for example" in the present application should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. In fact, the word "exemplarily" or "for example" is used to present the relevant concept in a specific way.
[0095] The video call method provided by the embodiments of the present application can be applied to the scene of video call. Exemplarily, the electronic device is installed with an application (APP) supporting video call, such as WeChat TM , DingDing TM , etc., and the electronic device can realize video call through these APPs. The scene of video call further includes the scene of actively initiating and entering video call and the scene of passively receiving and joining video call.
[0096] In the above-mentioned scene of video call, the video call method provided by the embodiments of the present application can detect the face changing risk in the video call and give a prompt.
[0097] It should be noted that the specific means of detecting the face changing risk is not limited in the present application. Exemplarily, the electronic device can detect whether there is a face changing risk based on an AI model. Exemplarily, the electronic device can compare the face with the white list face library of the user to detect whether there is a face changing risk. Exemplarily, the electronic device can detect whether there is a face changing risk by analyzing the facial expression and body movement of the face.
[0098] Exemplarily, the electronic device can be a mobile phone, a tablet, a desktop, a laptop, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) \ virtual reality (VR) device, or the like, which can provide a video call function, such as an electronic device installed with an APP supporting a video call. Embodiments of the present application do not specially limit the specific form of the electronic device. Hereinafter, the electronic device is taken as an example of a mobile phone to illustrate the solutions of the present application.
[0099] Referring to FIG. 1A, the mobile phone can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, and the like.
[0100] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the mobile phone. In other embodiments of the present application, the mobile phone can include more or fewer components than those illustrated, or combine certain components, or split certain components, or different arrangement of components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.
[0101] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices, or can be integrated in one or more processors.
[0102] In some embodiments, the mobile phone can complete the video call method through the processor 110, so as to detect the face changing risk and give a prompt in the process of video call.
[0103] The wireless communication function of the mobile phone can be realized through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor, etc.
[0104] The mobile phone realizes the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, connected with the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.
[0105] The display screen 194 is used to display images, videos, etc. In some embodiments, the mobile phone can display the interface of the video call, the prompt information of the face changing risk, etc. through the display screen 194.
[0106] The mobile phone can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194 and the application processor, etc.
[0107] The mobile phone can realize the audio function through the audio module 170, the loudspeaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor, etc. For example, music playing, recording, etc.
[0108] The key 190 can include a power-on key, a volume key, and the like. The key 190 can be a mechanical key. It can also be a touch key. The mobile phone can receive key input and generate key signal input related to user settings and function control of the mobile phone. The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts and also for touch vibration feedback. The indicator 192 can be an indicator light and can be used to indicate a charging state, a power change, and also to indicate a message, a missed call, a notification, and the like. The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the mobile phone.
[0109] The software system of the mobile phone can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. Embodiments of the present application do not make specific limitations in this regard.
[0110] The video call method provided by the embodiments of the present application can be implemented in a mobile phone with the above-mentioned software and hardware structure. The video call method provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings.
[0111] In some embodiments, the mobile phone can start the face swapping detection function after detecting an opening event of the face swapping detection. In the case of starting the face swapping detection function, the mobile phone can detect face swapping risks and give a prompt during the video call. Wherein, the detection of the opening event indicates that the user allows the opening of the permissions and data required for face swapping detection. In this way, the mobile phone can execute the corresponding permissions and obtain data under the permission of the user.
[0112] Wherein, the opening event can be an operation event of confirming the opening of risk protection in the out-of-box experience (OOBE) (hereinafter referred to as method one), an operation event of opening the risk protection switch in the settings application (hereinafter referred to as method two), an operation event of opening the face swapping detection switch in the settings application (hereinafter referred to as method three), an operation event of executing opening detection on a prompt a for opening risk protection (hereinafter referred to as method four), and the like. Embodiments of the present application do not make specific limitations in this regard.
[0113] The following will specifically describe the above-mentioned several opening events and the process of triggering the opening of the face swapping detection function.
[0114] Method one, the opening event is an operation event of confirming the opening of risk protection in the OOBE.
[0115] OOBE refers to the process of configuring the mobile phone after it leaves the factory and is started for the first time, such as configuring the language, region, network, and the like. OOBE can also be interpreted as boot-up wizard, boot-up guide, and the like.
[0116] In the OOBE, the mobile phone is usually set to open the risk protection by default. The risk protection provides various risk detection functions, such as a risk call detection function, a risk information detection function, a face changing detection function, and the like. After the risk protection is opened, various risk detection functions under the risk protection are opened.
[0117] In the OOBE, the mobile phone detects an operation event of confirming to open the risk protection by the user, which indicates that the user supports to open the risk protection, and the mobile phone can open the risk protection, thereby opening the face changing detection function under the risk protection.
[0118] Referring to FIG. 1B, the configuration interface of the risk protection in the OOBE is an interface 101 shown in FIG. 1B. A switch 1011 of the risk protection in the interface 101 is set to an open state by default, that is, the risk protection is set to be opened by default. The operation event of confirming to open the risk protection can be an event of not closing the switch 1011, but directly triggering the operation of “next step” 1012 in the interface 101. That is, in the case that the mobile phone does not receive the operation of closing the switch 1011 by the user, the mobile phone can confirm to open the risk protection in response to the triggering operation of “next step” 1012 in the interface 101 by the user.
[0119] Of course, the risk protection can also be set to be closed by default in the OOBE. For example, the switch 1011 in the interface 101 can also be set to a closed state by default. In this case, the operation event of confirming to open the risk protection can be an operation event of opening the switch 1011. In this paper, the risk protection is mainly taken as an example to be opened by default.
[0120] In the second mode, the opening event is an operation event of opening the risk protection switch in the setting application.
[0121] In the setting application of the mobile phone, a setting item 1 of the risk protection is provided. In a specific implementation mode, the mobile phone further provides the setting item 1 in the security and / or privacy setting item of the setting application.
[0122] Referring to FIG. 2, the mobile phone can display an interface 201, which is an application interface of the setting application. “Security” 2011 of the interface 201 is a security setting item. In response to the triggering operation of “security” 2011 by the user, the mobile phone can display an interface 202. The interface 202 is a setting interface of the security setting item. “Risk protection” 2021 in the interface 202 is the setting item 1 of the risk protection. That is, the setting item 1 is provided in the security setting item.
[0123] In the setting interface of the security setting item shown in the interface 202, “risk protection” 2021 is located in a region close to the top of the interface, and is larger than other setting items such as “SOS emergency help” 2022 and “emergency warning notification” 2023, so that the setting item 1 can be located in a more eye-catching position.
[0124] The mobile phone detects an operation event of turning on the risk protection switch in setting item 1, such as detecting a triggering operation on the risk protection switch in the off state, and can turn on the risk protection, thereby turning on the face swapping detection function under the risk protection.
[0125] Continuing to refer to FIG. 2, in response to a triggering operation of the user on the “risk protection” 2021, the mobile phone can display an interface 203, which is a setting interface of the risk protection. The “risk detection” switch 2031 in the interface 203 is a risk protection switch, and the “risk detection” switch 2031 in the interface 203 is in the off state, indicating that the risk protection is not turned on.
[0126] In response to a triggering operation of the user on the “risk detection” switch 2031 in the interface 203, the mobile phone can turn on the risk protection. For example, after turning on the risk protection, the mobile phone can display an interface 204, which is also a setting interface of the risk protection. The interface 204 also includes the “risk detection” switch 2031, and the “risk detection” switch 2031 in the interface 204 is in the on state, indicating that the risk protection has been turned on.
[0127] In a specific implementation, the risk protection is provided by a system manager service in the mobile phone.
[0128] If the mobile phone does not turn on the system manager service, and detects an operation event of turning on the risk protection switch in setting item 1, the mobile phone can first prompt the user to turn on the system manager service (denoted as prompt b), and in response to an operation of the user in prompt b to turn on the system manager service, such as a triggering operation on a confirmation opening control in prompt b, the mobile phone can turn on the system manager service and further turn on the risk protection.
[0129] Continuing to refer to FIG. 2, in the case where the system manager service is not turned on, in response to a triggering operation of the user on the “risk detection” switch 2031 in the interface 203, the mobile phone can display an interface 205, which adds a prompt 2051 in the setting interface of the risk protection. The prompt 2051 is prompt a. For example, the prompt 2051 includes the text “When the anti-fraud detection is turned on, the “system manager service” needs to be turned on simultaneously”, prompting to turn on the system manager service. The “agree” 2052 in the prompt 2051 is a control for confirming to turn on the system manager service, and in response to a triggering operation of the user on the “agree” 2052, the mobile phone can turn on the system manager service and the risk protection, such as displaying the interface 204.
[0130] In response to an operation of the user in prompt b to cancel turning on the system manager service, such as a triggering operation on a confirmation cancel control (such as the “cancel” 2053 in the interface 205) in prompt b, the mobile phone can cancel turning on the system manager service, and accordingly, the risk protection cannot be turned on.
[0131] If the phone has started the system manager service, and detects an operation event of turning on the risk protection switch in the setting item 1, the risk protection can be turned on, as shown in the response process from the interface 203 to the interface 204.
[0132] In general, the system manager service is turned on by default in the OOBE. Alternatively, in the case where the system manager service is not turned on, the phone can display a prompt b of turning on the system manager service in response to starting the system manager service, and turn on the system manager service in response to the user's turning-on operation on the prompt b.
[0133] Referring to FIG. 3, in the case where the system manager service is not turned on, the phone can display an interface 301 in response to starting the system manager application. The prompt 3011 in the interface 301 is the prompt b. The prompt 3011 prompts various capabilities provided by the system manager service, such as "the system manager service can provide notification management, battery management, privacy security, application startup management, permission management, cleaning and acceleration, traffic management, harassment interception, virus detection, and risk protection functions." In addition, the prompt 3011 includes a control "Agree" 3012 of turning on the system manager service, and the phone can turn on the system manager service in response to the user's triggering operation on the "Agree" 3012.
[0134] In addition, the setting interface of the risk protection can further include setting items of a plurality of risk detection functions, and the setting items include switch states of the corresponding risk detection functions.
[0135] In the case where the risk protection is turned off, the switch states of the plurality of risk detection functions are all in the default off state. For example, the interface 203 includes: a setting item "Risk phone interception" 2032 of risk phone detection, a setting item "Risk information interception" 2033 of risk information detection, and a setting item "AI face changing reminder" 2034 of face changing detection, and the switch states are all in the unturned-on state.
[0136] In the case where the risk protection is turned on, the switch states of the plurality of risk detection functions are all in the default on state. For example, the interface 204 includes: the "Risk phone interception" 2032, the "Risk information interception" 2033, and the "AI face changing reminder" 2034, and the corresponding switch states are all in the "turned-on" state.
[0137] Further, the phone can display a setting interface of the risk detection function in response to the user's triggering operation on any risk detection function in the setting interface of the risk protection.
[0138] For example, after the risk protection is turned on, in response to a user triggering the "AI face changing reminder" 2034 in the interface 204 shown in FIG. 2, the phone can display the interface 401 shown in FIG. 4, which is a setting interface of the face changing detection. The "AI face changing detection" 4011 in the interface 401 is a face changing detection switch. Since the risk protection is turned on at this time, the switch state of the "AI face changing detection" 4011 is an on state.
[0139] In the setting interface of the face changing detection, a function introduction of the face changing detection can also be included, such as the text introduction "During a video call, the system can detect in real time whether the other party is an AI face changing, to prevent the risk of face changing" in the interface 401, so that the user can understand the function of the face changing detection.
[0140] In the setting interface of the face changing detection, a detail entry can also be included, such as the "Learn more" 4012 in the interface 401. In response to a user triggering the detail entry, the phone can display more detailed information of the face changing detection, such as the scene of the face changing and the formula for being vigilant about the risk of face changing, so that the user can understand the face changing detection in more detail. Referring back to FIG. 4, in response to a user triggering the "Learn more" 4012 in the interface 401, the phone can display the interface 402, which includes the scene of the face changing 4021, the formula for being vigilant about the risk of face changing 4022, and the like.
[0141] In addition, in the setting interface of the risk protection, the protection records of multiple risk detection functions in a recent preset time period (such as 60 days or 1 month) can also be included, such as the number of risks. Referring to FIG. 5, the phone can display the interface 501 (which is the same as the interface 204 described above), and the face changing detection protection records, such as the number of risks, are recorded in the area 5011 of the interface 501.
[0142] In response to a user triggering the protection record of any risk detection function, the phone can display the detailed detection record of the risk detection function. Referring to FIG. 5, in response to a user triggering the area 5011 in the interface 501, the phone can display the interface 502, which is a record interface of the face changing detection, and records the detailed detection record of the face changing detection. However, since the number of risks is 0 at this time, there is no detailed detection record in the interface 502.
[0143] It should be noted that the names and layouts of the setting items in the settings application shown in FIGS. 2-5 are merely exemplary. In actual implementation, they are not limited thereto. For example, the setting interface of the security setting item can also be as shown in interface 601 in FIG. 6, where "risk protection" 6011 is the setting item 1 of risk protection. The interface 601 is quite different from the layout of the setting items in the interface 202 in the foregoing description, such as the display position and size of "risk protection" 6011 in the interface 601, which are different from "risk protection" 2021 in the interface 202.
[0144] In a third mode, the opening event is an operation event of opening the face swapping detection switch in the settings application.
[0145] The setting item 2 of face swapping detection is provided in the settings of the mobile phone. The mobile phone detects an operation event of opening the face swapping detection switch in the setting item 2, such as detecting a triggering operation on the face swapping detection switch in the closed state, and the mobile phone can open the face swapping detection.
[0146] Referring to FIG. 7, in the case where the risk protection is not opened, the mobile phone can display the interface 701 (the same as the interface 203 in the foregoing description), where "AI face swapping reminder" 7011 is the setting item 2. In response to a triggering operation of the user on "AI face swapping reminder" 7011, the mobile phone can display the setting interface of face swapping detection as shown in interface 702, where "AI face swapping detection" switch 7021 is the face swapping detection switch. Since the risk protection is not opened at this time, the switch state of "AI face swapping detection" switch 7021 in interface 702 is in the closed state. In response to a triggering operation of the user on "AI face swapping detection" switch 7021, the mobile phone can open the face swapping detection, such as displaying the interface 703 (the same as the interface 401 in the foregoing description), where "AI face swapping detection" switch 7021 is in the opened state, indicating that the face swapping detection has been opened.
[0147] Based on the foregoing description, the risk protection provides the face swapping detection function. Based on this, if the mobile phone does not open the risk protection, the mobile phone detects a triggering operation on the setting item 2, and can first prompt the user to open the risk protection (denoted as prompt c), and in response to an operation of opening the risk protection on prompt c, the mobile phone can open the risk protection and the face swapping detection.
[0148] Continuing to refer to FIG. 7, in response to the user triggering the "AI face changing reminder" 7011 in the interface 701, the phone can first display the interface 704. The prompt 7041 in the interface 704 is prompt c, which includes the prompt text "When AI face changing detection is turned on, the "risk detection" switch will be turned on simultaneously", which is used to prompt the user to turn on the risk protection. The prompt 7041 also includes the control "Turn on" 7042 for turning on the risk protection. The operation of turning on the risk protection can be a triggering operation on the "Turn on" 7042. In response to the user triggering the "Turn on" 7042, the phone can turn on the face changing detection, such as displaying the interface 703.
[0149] If the phone has turned on the risk protection, the phone can turn on the face changing detection without displaying the prompt c after detecting the operation event of turning on the face changing detection switch in the setting item 2. It should be noted that in the case of turning on the risk protection, the face changing detection is turned on by default, but the phone can turn off the face changing detection separately in response to the operation event of the user turning off the face changing detection separately. Therefore, there can be a case where the risk protection is turned on but the face changing detection is not turned on. For specific implementation of turning off the face changing detection separately, please refer to the description of mode 3 below, which will not be described in detail here.
[0150] As in the above mode two, the risk protection is provided by the system manager service in the phone. Based on this, if the phone has not turned on the system manager service, the phone can first prompt the user to turn on the system manager service (referred to as prompt d) after detecting the operation event of turning on the face changing detection switch in the setting item 2. In response to the user turning on the system manager service in the prompt d, the phone can turn on the system manager service and the face changing detection.
[0151] Continuing to refer to FIG. 7, in the case where the system manager service is not turned on, in response to the user triggering the "AI face changing reminder" 7011 in the interface 701, the phone can display the interface 705, and the prompt 7051 in the interface 705 is prompt d. The prompt 7051 includes the text prompt "When face changing detection is turned on, the "system manager service" needs to be turned on simultaneously", which prompts the user to turn on the system manager service. The prompt 7051 includes the control "Agree" 7052 for turning on the system manager service. The operation of turning on the system manager service can be a triggering operation on the "Agree" 7052. In response to the user triggering the "Agree" 7052, the phone can turn on the system manager service and the face changing detection, such as displaying the interface 703.
[0152] If the phone turns on the system manager service, the phone can turn on the face changing detection without displaying the prompt d after detecting the operation event of turning on the face changing detection switch in the setting item 2, as shown in the response process of the above interface 702 to the interface 703.
[0153] In practice, if the system manager service is not started, it means that the risk protection is not started as well. Therefore, in the case that the system manager service is not started, the response process of the mobile phone can be interface 701, interface 705, interface 704 and interface 703, so as to ensure that the face changing detection is started on the premise that the system manager service and the risk protection are started. In the case that the system manager service is started, the risk protection can not be started. In this case, the response process of the mobile phone can be interface 701, interface 704 and interface 703.
[0154] In the fourth mode, the starting event is an operation event of starting detection on the prompt a.
[0155] In the case that the risk protection is not started, for example, in the case that the switch 1011 in the interface 101 is turned off in the OOBE, the mobile phone can push the prompt a for prompting to start the face changing detection. Referring to FIG. 8, in the case that the risk protection is not started, the mobile phone can display an interface 801. The prompt 8011 in the interface 801 is the prompt a. The prompt 8011 includes the prompt text “Add “AI face changing detection” to detect whether AI face changing in video call”, which prompts that the face changing detection function is added. The prompt 8011 also includes “Start risk detection” 8012, which prompts the user to start the risk protection, that is, the prompt 8011 can prompt the user to start the risk protection.
[0156] In response to the operation event of starting detection on the prompt a by the user, the mobile phone can display a setting interface of the risk protection. In an embodiment, the prompt a includes a control for starting the risk protection, such as the “Start risk detection” 8012 in the interface 801. The operation event of starting detection can be a trigger operation on the control for starting the risk protection.
[0157] Continuing to refer to FIG. 8, taking the control for starting the risk protection as the “Start risk detection” 8012 in the interface 801, in response to the trigger operation of the user on the “Start risk detection” 8012, the mobile phone can display an interface 802 (which is the same as the interface 203 described above), which is the setting interface of the risk protection.
[0158] After the setting interface of the risk protection, the mobile phone can start the risk protection in response to the operation event of the starting risk protection switch, so as to start the face changing detection. For details, refer to the description of the second mode above, which will not be repeated here.
[0159] Of course, if the risk protection is turned on and only the face changing detection is not turned on, in response to the operation event of the user performing the turning-on detection operation on the prompt a, the switch of the risk protection in the setting interface of the risk protection displayed by the mobile phone is in the turned-on state instead of the turned-off state in the interface 801, but the switch state corresponding to the setting item of the face changing detection is also in the turned-off state. In this case, the mobile phone can turn on the face changing detection in response to the operation event of turning on the face changing detection switch. For details, refer to the description in the third mode above, which will not be described here.
[0160] After displaying the prompt a, in response to the operation event of turning on the detection, or in response to the triggering operation of the user on the region other than the prompt a, or in response to the display time length of the prompt a reaching the time length 1 (such as 10s), the mobile phone can cancel the display of the prompt a.
[0161] Continuing to refer to FIG. 8, in response to the triggering operation of the user on the “turn on risk detection” 8012, the interface 802 displayed by the mobile phone no longer includes the prompt 8011.
[0162] Further, the prompt a can be in the form of the card shown in the prompt 8011 described above. After the display time length of the prompt a reaches the time length 2, such as 5s, the mobile phone can first shrink the prompt a into the capsule 1 to avoid interfering with the user using the mobile phone. After the display time length of the capsule 1 reaches the time length 3, the mobile phone can cancel the display of the capsule 1, thereby canceling the display of the prompt a.
[0163] Taking the time length 2 as 5s and the time length 3 as 10s as an example, after the display time length of the prompt 8011 in the interface 801 reaches 5s, the mobile phone can shrink the prompt 8011 into the capsule 9011 in the interface 901 shown in FIG. 9, that is, the capsule 9011 is the capsule 1. After the display time length of the capsule 9011 reaches 10s, the mobile phone can cancel the display of the capsule 9011, such as the display interface 902.
[0164] After shrinking the prompt a into the capsule 1, in response to the triggering operation of the user on the capsule 1, the mobile phone can restore the display of the prompt a. For example, in response to the triggering operation of the user on the capsule 9011 in the interface 901, the mobile phone can restore the display of the interface 801 shown in FIG. 8.
[0165] At this point, it should be noted that in the foregoing introduction of the fourth mode, the mobile phone is mainly taken as an example to display the prompt a on the desktop. In actuality, the mobile phone can also display the prompt a on other interfaces. For example, when the mobile phone detects that the push condition of the prompt a is met, the mobile phone displays the prompt a in the current interface of the mobile phone.
[0166] The application examples herein exemplarily illustrate the push condition of the prompt a:
[0167] Push condition one, in the case of not starting the risk protection, detecting entering the aforementioned setting item 1.
[0168] The mobile phone can push the prompt a when detecting entering the setting item 1, such as entering the aforementioned interface 202. In this way, the prompt a can be pushed after not starting the risk protection and viewing the setting item 1 of the risk protection.
[0169] Push condition two, detecting that there is a risk event.
[0170] The risk event includes receiving a risk phone, receiving a risk information, receiving an overseas phone, downloading an unknown application, and performing an operation of inputting a bank account, transferring, sharing a screen, etc.
[0171] The mobile phone can push the prompt a when detecting that there is a risk event. In this way, the user can be reminded to start the face changing detection in time in the case of the mobile phone having a security risk.
[0172] Push condition three, not starting the face changing detection, and after the interval time length 4, such as 7 days, 20 days, 60 days, etc., from the last time of displaying the prompt a.
[0173] The mobile phone will not start the face changing detection when not detecting the operation event of starting the detection after displaying the prompt a. If the face changing detection has not been started and a long time has passed from the last time of displaying the prompt a, the mobile phone can display the prompt a again to remind the user again.
[0174] In actual implementation, the above-mentioned multiple push conditions can be combined.
[0175] For example, the mobile phone can display the prompt a for the first time when any one of the push condition one and the push condition two is reached first, and then display the prompt a again when the push condition three is reached.
[0176] For another example, the mobile phone can display the prompt a for the first time when any one of the push condition one and the push condition two is reached first, and then display the prompt a again when the push condition three is reached and the push condition one or the push condition two is met.
[0177] In addition, in the case of starting the risk protection in the OOBE, the mobile phone can push the prompt d for reminding to understand the face changing detection. Based on the foregoing description about the first mode, it can be known that the risk protection is started by default in the OOBE. If the risk protection is started in the OOBE, the user is most likely to not understand the risk protection and the multiple risk detection functions. In this case, after the OOBE is completed, the mobile phone can remind the user to understand the face changing detection through the prompt d.
[0178] Referring to FIG. 10, in the case of starting risk protection in OOBE, the mobile phone can display interface 1001, and prompt 10011 of interface 1001 is prompt d. Prompt 10011 includes prompt text "Add 'AI face changing detection' to detect whether AI face changing in video call", which prompts the addition of face changing detection function, and prompt 10011 also includes text "Learn more" 10012, prompting the user to learn more, that is, prompt 10011 can prompt to learn more about face changing detection.
[0179] In response to the user performing a learn more operation on prompt d, such as triggering the learn more control in prompt d, the mobile phone can display a face changing detection setting interface for the user to learn about face changing detection. Referring to FIG. 10, taking the "Learn more" 10012 in interface 1001 as an example, in response to the user triggering the "Learn more" 10012, the mobile phone can display interface 1002 (which is the same as interface 401 described above), which is a face changing detection setting interface.
[0180] The mobile phone can display a face changing detection function introduction in the face changing detection setting interface. In addition, the face changing detection setting interface includes a details entry for triggering the mobile phone to display detailed information of face changing detection. Thus, the user can learn about face changing detection. For details, refer to the description in mode two above, which will not be repeated here.
[0181] The disappearance, contraction, push condition, etc. of prompt d can refer to the related description of prompt a above, which will not be repeated here.
[0182] After starting face changing detection, the mobile phone can perform face changing detection and give a prompt during a video call.
[0183] Further, the mobile phone can actively or passively perform face changing detection. Active detection means that the mobile phone can start detection without the user triggering the detection. Passive detection means that the mobile phone can start detection based on the user's detection operation. The following will be described respectively:
[0184] Scheme one, active detection.
[0185] In response to starting a video call, the mobile phone can actively start face changing detection.
[0186] In the case of detecting face changing risk, the mobile phone displays prompt e for prompting the existence of face changing risk, that is, to realize risk feedback. In the case of detecting no face changing risk, no prompt can be given. In this way, the mobile phone can only prompt in the case of face changing risk, and can reduce the interference of face changing detection on the video call as much as possible.
[0187] Referring to FIG. 11, for the active detection mode: in the no-risk (i.e., no face-swapping risk) scenario, the user is completely unaware before, during and after detection. In the at-risk (i.e., face-swapping risk) scenario, the user is unaware before and during detection, and only after detection, the phone displays a prompt e, achieving risk feedback, and the user is aware of the process.
[0188] After detecting a face-swapping risk, the phone can display a prompt e in the video call interface. Referring to FIG. 12, during a video call, the phone can display interface 1201. In the case of detecting a face-swapping risk, the phone can display interface 1202, and the prompt 12021 in interface 1202 is a prompt e, which includes the prompt text "the other party is suspected of AI face-swapping and identity fraud" to prompt the existence of a face-swapping risk.
[0189] Among them, the prompt e can include information indicating a security risk, such as the prompt text "the other party is suspected of AI face-swapping and identity fraud" in prompt 12021.
[0190] Further, the prompt e can also include information indicating the degree of risk, such as the text "AI face-swapping synthesis probability 95%" in prompt 12021, which is used to prompt the degree of risk.
[0191] Further, the prompt e can also include information indicating the verification of the other party's identity, such as the text "please verify the authenticity of its identity through other channels" in prompt 12021, which is used to prompt the verification of the identity.
[0192] Further, the prompt e can also include an entry to understand face-swapping detection, such as the entry "further understand AI face-swapping risk" 12022 in prompt 12021, which is used to trigger the display of the face-swapping detection setting interface. In response to the user's triggering operation on the entry to understand face-swapping detection, the phone can display the face-swapping detection setting interface, such as the interface 401 in the foregoing.
[0193] Further, the prompt e can also include a re-detection control, such as "re-detection" 12023 in prompt 12021, which is used to trigger the phone to re-execute face-swapping detection. In response to the user's triggering operation on the re-detection control, the phone can re-execute face-swapping detection. It should be noted that the phone triggers face-swapping detection due to the user's triggering operation on the re-detection control, which belongs to a case of the phone passively executing face-swapping detection, and the details of this part will be described in the part about the phone passively executing face-swapping detection below, which will not be described in detail here.
[0194] Further, the prompt e can further include a screen recording control, such as the "record and save video" 12024 in the prompt 12021, for triggering the phone to record the screen of the video call. In response to the user triggering the screen recording control, the phone can record the screen of the video call until the video call ends, and then stop recording and save the screen recording to the phone.
[0195] In a possible implementation, the phone can have ended the video call after detecting the face swapping risk. In this case, the phone can display the prompt f in an interface after ending the video call, such as a chat list interface, for prompting the face swapping risk.
[0196] Continuing to refer to FIG. 12, during the video call, the phone can display the interface 1201. After detecting the face swapping risk and exiting the video call, the phone can display the interface 1203, and the prompt 12031 in the interface 1203 is the prompt f. The prompt 12031 includes the prompt text "the opposite party is suspected to be an AI face swapping and identity impersonation", for prompting the face swapping risk.
[0197] Similar to the prompt e, the prompt f can also include information indicating the security risk, information indicating the risk level,
[0198] information indicating the verification of the opposite party's identity, an entry for understanding the face swapping detection, and the like. For details, refer to the related description of the prompt e.
[0199] It should be noted that the prompt f is displayed after exiting the video call, and at this time, the video call screen cannot be re-detected and recorded. Accordingly, the prompt f usually does not include the re-detection control and the screen recording control.
[0200] Further, the prompt f can include a control for canceling the display, such as the "I know" 12032 in the prompt 12031, for triggering the phone to cancel the display of the prompt f. In response to the user triggering the control for canceling the display, the phone can cancel the display of the control 6.
[0201] In a possible implementation, the phone can intercept a picture of the video call for face swapping detection. In some cases, the phone can have not intercepted the picture for face swapping detection before the video call ends. In this case, the phone cannot obtain the detection result. However, since the phone initiates the detection, the phone does not prompt the incomplete detection, thereby avoiding interference to the user.
[0202] In a possible implementation, the phone can not detect the face and cannot obtain the detection result. Similarly, since the phone initiates the detection, the phone does not prompt the undetected face, thereby avoiding interference to the user.
[0203] Further, in response to starting the video call, the phone can start to detect the face swapping risk actively in a case that the detection condition of the face swapping risk is met. In this way, the face swapping risk can be detected selectively, instead of performing the face swapping detection for each video call, so as to reduce the power consumption of the phone.
[0204] The following lists several typical detection conditions:
[0205] Detection condition 1
[0206] The opposite party of the video call is a friend added within a time length of 5. Among them, for the same newly added friend, if the video call is performed with the friend within the time length of 5 after adding the friend, the phone performs the face swapping detection; if the video call is performed with the friend after the time length of 5, the phone does not perform the face swapping detection.
[0207] Referring to FIG. 13, the phone can display an interface 1301, which is a management interface of a new friend addition request in a chat application. The interface 1301 includes an addition request 13011 of Amy. In response to a trigger operation of the user on the “accept” 13012 in the addition request 13011, the phone can add Amy as a friend. For example, after adding, the phone can display an interface 1302 back to the chat list interface. The interface 1302 includes a conversation option 13021 of the newly added friend Amy.
[0208] Continuing to refer to FIG. 13, within the time length of 5 after adding Amy as a friend, the phone receives a video invitation from Amy, and can display an interface 1303, which includes a receiving control 13031. In response to a trigger operation of the user on the receiving control 13031, the phone can start the video call, such as displaying the interface 1201 in the foregoing FIG. 12. At this time, the phone can start the face swapping detection.
[0209] On the contrary, within the time length of 5 after adding Amy as a friend, no call is performed with Amy, but after the time length of 5, a video invitation from Amy is received, the interface 1303 can also be displayed, and after starting the video call, the phone can not perform the face swapping detection.
[0210] Generally, the face swapping risk occurs in the video call with a newly added friend. In this way, the phone can perform the face swapping detection for the video call with the newly added friend, so as to detect the video call with the face swapping risk more possibly.
[0211] Detection condition 2
[0212] The video call is performed with the opposite party for the first time. Among them, for the same friend, if the video call is performed with the friend for the first time, the phone performs the face swapping detection; if the video call is performed with the friend for the second time, the phone does not perform the face swapping detection.
[0213] Generally, the face changing risk appears in the first video call with a certain friend. If there is no face changing risk in the first video call, there is probably no face changing risk in the subsequent video call with the friend. In this way, the mobile phone can detect whether there is a face changing risk in the video call with the friend by detecting whether there is a face changing risk in the first video call with the friend.
[0214] Detection condition 3
[0215] The opposite party of the video call is in the list 1, and the list 1 records the newly added quantity 1 of friends. Among them, if the opposite party of the video call is in the list 1, the mobile phone performs face changing detection, and if the opposite party of the video call is not in the list 1, the mobile phone does not perform face changing detection.
[0216] In practice, for newly added friends, the mobile phone can store related information such as name, place of origin, etc. in a specific area for face changing detection. At the same time, some users may add a large number of friends in a short period of time due to the special nature of their profession, such as adding dozens of friends in a day. Correspondingly, the storage space required by the mobile phone to store related information is very large.
[0217] For this situation, the mobile phone can store at most the related information of quantity 1 of friends. Among them, after storing the related information of quantity 1 of friends, if a newly added friend, the mobile phone can delete the information stored in the specific area in the form of first-in first-out, and then store the related information of the newly added friend. Correspondingly, the list 1 is the list of friends whose related information is stored in the specific area. The mobile phone can perform face changing detection on the stored friends. In this way, the mobile phone always performs face changing detection on the newly added quantity 1 of friends while avoiding the large occupation of storage space.
[0218] Detection condition 4
[0219] The detection condition of the face changing risk includes that the opposite party initiates the video call. Generally, people with improper purposes usually initiate video calls to gain the trust of the mobile phone owner and then guide the owner to perform some operations that may cause property loss or information leakage. Therefore, the mobile phone can perform face changing detection on the video call initiated by the opposite party, which can more likely detect the video call with face changing risk.
[0220] In a possible implementation, at least two of the above detection conditions can be combined. For example, the above detection conditions 1-4 can be combined, so that the mobile phone can perform face changing detection in the video call initiated by the newly added friend in the list 1 within the time length 5. For another example, the above detection conditions 2-4 can be combined, so that the mobile phone can perform face changing detection in the video call initiated by the newly added friend in the list 1.
[0221] Of course, in actual implementation, the detection condition of active detection is not limited to the above-listed detection conditions. For example, the detection condition can also include a risk event of the mobile phone. For details, refer to the description of the second push condition above.
[0222] Option two, passive detection.
[0223] During the video call, the mobile phone can passively start face swapping detection based on a detection operation of the user in the video call interface. In this way, the mobile phone can detect whether there is a face swapping risk based on the detection needs of the user.
[0224] The possible cases of the detection operation include at least one of the following:
[0225] Case one, the detection operation is a triggering operation of the user on the re-detection control in the aforementioned prompt e.
[0226] Taking the prompt e as the prompt 12021 in the interface 1202 shown in FIG. 12 and the re-detection control as the “re-detection” 12023 in the prompt 12021 as an example, the detection operation can be a triggering operation of the user on the “re-detection” 12023.
[0227] Case two, in the case where face swapping detection has been started, the mobile phone can display a prompt g in the video call interface to prompt the use of the face swapping detection function. Correspondingly, the detection operation can be a triggering operation of the user on the prompt g.
[0228] In a specific implementation manner, the prompt g includes a detection control, and the detection operation can be a triggering operation of the user on the detection control.
[0229] Referring to FIG. 14, the mobile phone can display an interface 1401. The switch state of the setting item “AI face swapping reminder” 14011 of face swapping detection in the interface 1401 is “started”, indicating that face swapping detection has been started. In this case, during the video call, the mobile phone can display an interface 1402, which is a video call interface. The prompt 14021 in the interface 1402 is the prompt g. The prompt 14021 includes the prompt text “AI face swapping detection can detect whether the video call opponent's face is impersonated” and the “immediate detection” 14022, thereby prompting the use of face swapping detection. The “immediate detection” 14022 is a detection control, and the detection operation can be a triggering operation of the user on the “immediate detection” 14022.
[0230] Further, in addition to having started face swapping detection, the push condition of the prompt g can also include one or more of the aforementioned second push condition, detection condition 1, detection condition 2, detection condition 3, and detection condition 4. The present application does not make a specific limitation in this regard.
[0231] The mobile phone can present the different forms when presenting the prompt g in different times.
[0232] In the first to N (N>1, N is an integer) times of displaying the prompt g, the mobile phone can present the prompt g in the card form, such as the prompt 14021 in the interface 1402. In the N+1 and subsequent times of displaying the prompt g, the mobile phone can present the prompt g in the capsule form, such as the capsule 14031 in the interface 1403.
[0233] In this way, the mobile phone can present the details of the prompt g to the user in the first few times of displaying the prompt g, so that the user can clearly understand the content of the prompt g, and the mobile phone can present the capsule to the user in the subsequent times of displaying the prompt g, thereby reducing the influence on the call.
[0234] Further, the card form and the capsule form can be switched to each other.
[0235] In the card form of the prompt g, the mobile phone can shrink the prompt g into the capsule form after the display time of the prompt g reaches the time length 7, such as 5s. Continuing to refer to FIG. 14, the mobile phone can shrink the prompt 14021 in the interface 1402 into the capsule 14031 in the interface 1403 after 5s of displaying the interface 1402, that is, the capsule 14031 is the shrunk prompt g.
[0236] In response to the click operation of the user on the prompt g in the capsule form, the mobile phone can expand the prompt g into the card form. Continuing to refer to FIG. 14, in response to the click operation of the user on the capsule 14031 after displaying the interface 1403, the mobile phone can expand the capsule 14031 into the prompt 14021 in the interface 1402.
[0237] In case three, in the case where the face changing detection is not started, the mobile phone can display a prompt h in the video call interface, to prompt the user to start and use the face changing detection function. Correspondingly, the detection operation can be the trigger operation of the user on the prompt h.
[0238] In a specific implementation, the prompt h includes a start detection control, and the detection operation can be the trigger operation of the user on the start detection control.
[0239] Referring to FIG. 15, the mobile phone can display an interface 1501, in which the switch state of the setting item "AI face changing reminder" 15011 of the face changing detection is "not started", indicating that the face changing detection is not started. In this case, during the process of the video call, the mobile phone can display an interface 1502, which is a video call interface, and the prompt 15021 in the interface 1502 is prompt h. The prompt 15021 includes the prompt text "Start "AI face changing detection" to detect whether the video opposite party's face is impersonated" and "Start and detect" 15022, so as to prompt to start and use the face changing detection. The "start and detect" 15022 is a start and detection control, and the detection operation can be a trigger operation of the user on the "start and detect" 15022.
[0240] At this point, it should be noted that after the mobile phone starts the risk protection, the multiple risk detection functions under the risk protection will be started by default. Thereafter, the user can individually trigger to close one or more of the multiple risk detection functions, such as individually triggering to close the face changing detection. At this time, the situation shown in the interface 1501 described above will occur, i.e., the risk protection has been started, but the face changing detection has not been started. For details, please refer to the description of mode 3 below, which will not be described in detail here. In this way, the mobile phone can push the prompt h to specifically prompt the user to start and use the face changing detection in the case that the user individually closes the face changing detection.
[0241] It should be noted that if the face changing detection is not started due to the risk protection not being started, i.e., both the risk protection and the face changing detection are not started, the mobile phone will usually push the aforementioned prompt a, and will not push the prompt h. For details, please refer to the related description of mode 4 in the foregoing, which will not be described here.
[0242] In addition, similar to the prompt g described above, the mobile phone can use different forms (such as card form and capsule form) when pushing the prompt h. Further, the card form and the capsule form can be switched with each other. For details, please refer to the related description of the prompt g in the foregoing, which will not be described here.
[0243] Further, in addition to not starting the face changing detection, the push condition of the prompt h can also include one or more of the aforementioned push condition two, detection condition 1, detection condition 2, detection condition 3, and detection condition 4. The present application does not make specific limitations in this regard.
[0244] Generally, the push condition of the prompt h is more stringent than that of the prompt g. In this way, the mobile phone can push the prompt h at a low frequency in the case that the face changing detection is not started, reducing the impact on the user; and the mobile phone can push the prompt g at a high frequency in the case that the face changing detection is started, improving the usage rate of the face changing detection.
[0245] Further, the detection condition triggering the aforementioned active detection is usually more relaxed than the push condition of prompt g and prompt h. In this way, the mobile phone can be triggered to perform the active detection with a lower degree of awareness (only visual when the face-swapping risk is detected) at a higher frequency, and the passive detection with a higher degree of awareness (full visual display) at a lower frequency to avoid excessive impact on the call.
[0246] For example, a set of typical detection conditions triggering the active detection, the push condition of prompt g and the push condition of prompt h are as follows:
[0247] The detection conditions triggering the active detection include that the opposite party of the video call is a friend added within a time length of 5 (i.e., detection condition 1), the first video call with the opposite party of the video call (i.e., detection condition 2), and the opposite party of the video call is in list 1 (i.e., detection condition 3).
[0248] The push condition of prompt g further includes the existence of a security risk (i.e., push condition two) on the basis of the aforementioned detection conditions triggering the active detection.
[0249] The push condition of prompt h includes the existence of a security risk (i.e., push condition two), the opposite party of the video call is the first added friend, the opposite party of the video call is a friend added within a time length of 6, and the active initiation of the video call by the opposite party (i.e., detection condition 4).
[0250] For another example, a set of typical detection conditions triggering the active detection, the push condition of prompt g and the push condition of prompt h are as follows:
[0251] The detection conditions triggering the active detection include that the opposite party of the video call is a friend added within a time length of 5 (i.e., detection condition 1), and the first video call with the opposite party of the video call (i.e., detection condition 2).
[0252] The push condition of prompt g further includes the existence of a security risk (i.e., push condition two) on the basis of the aforementioned detection conditions triggering the active detection.
[0253] The push condition of prompt h includes the existence of a security risk (i.e., push condition two), the opposite party of the video call is a friend added within a time length of 5 (i.e., detection condition 1), the first video call with the opposite party of the video call (i.e., detection condition 2), and the active initiation of the video call by the opposite party (i.e., detection condition 4).
[0254] In the passive detection scheme, the mobile phone can perform full visual display in response to the detection operation, so that the user can clearly know the detection process.
[0255] Referring to FIG. 16, in the passive detection scheme: before detection, the phone can prompt to start detection. During detection, the phone can show the detection process. After detection, the phone can feedback the detection result. Among them, the visualization before detection and during detection can make the user clearly perceive that the phone is in detection, so that the user has a sense of certainty. The visualization after detection can make the user obtain the result of face swapping risk, so that the user has a sense of control.
[0256] The response processes before, during and after detection are introduced as follows:
[0257] First, before detection. Before detection can be understood as the stage before the phone obtains data for face swapping detection. For example, the phone needs to obtain at least 10 frames of screenshots of video call for face swapping detection, and before obtaining at least 10 frames of screenshots, it belongs to the stage before detection.
[0258] Before detection, the phone can display prompt i for prompting to start detection.
[0259] Referring to FIG. 17, in response to the detection operation, the phone can display interface 1701, which is a video call interface. The capsule 17011 in the interface 1701 is prompt i, which includes the prompt text "start detection" for prompting to start detection.
[0260] Second, during detection. During detection can be understood as the stage from after the phone obtains data for face swapping detection to before the detection result is obtained.
[0261] During detection, the phone can display prompt j and detection animation, and prompt j is used to prompt that detection is in progress.
[0262] Continuing to refer to FIG. 17, after displaying the interface 1701, the phone can then display the interface 1702, which is still a video call interface. The capsule 17021 in the interface 1702 is prompt j, which includes the prompt text "detection in progress" for prompting that detection is in progress. In addition, the interface 1702 also includes a detection animation of scanning from top to bottom (as shown by the arrow in the interface 1702).
[0263] It should be noted that the form of the detection animation can be various, and is not limited to that shown in the interface 1702. Further, in a detection process, multiple effects can be included, such as the detection animation of scanning from top to bottom in the interface 1702, and the animation of scanning the face region of the opposite party (represented by the dot matrix on the face 17031 in the figure) can also be displayed.
[0264] Third, after detection. After detection can be understood as the stage after the mobile phone detects the detection result. The detection result includes the existence of face swapping risk and the non-existence of face swapping risk.
[0265] After detection, the mobile phone can display prompt j, which is used to prompt that the detection has been completed.
[0266] Continuing to refer to FIG. 17, after the mobile phone displays interface 1702 and obtains the detection result, the mobile phone can then display interface 1704, which is still a video call interface. Capsule 17041 in interface 1704 is prompt j, which includes the prompt text "detection completed" and is used to prompt that the detection has been completed.
[0267] It should be noted that in the passive detection scheme, whether the face swapping risk exists or does not exist, the mobile phone can display prompt j, so that the user can obtain all the detection results.
[0268] In the above introduction of the visualization display before detection, during detection and after detection, the prompts in the form of capsules are mainly taken as examples for illustration, such as prompt h, prompt i and prompt j, which are all capsules. In actual implementation, this is not limited thereto.
[0269] For example, prompt h-prompt j can also be in the form of a card. Referring to FIG. 18, prompt h can also be prompt 18011 in interface 1801, and prompt i can also be prompt 18021 in interface 1802.
[0270] Among them, the card-form prompt j can be divided into two cases: the existence of face swapping risk and the non-existence of face swapping risk.
[0271] Continuing to refer to FIG. 18, in the case of the existence of face swapping risk, prompt j can be prompt 18031 in interface 1803, which is used to prompt the existence of face swapping risk. The specific content of prompt j in the case of the existence of face swapping risk is basically the same as the content included in prompt e, and specific reference can be made to the related description of prompt e in the foregoing, which will not be described here again.
[0272] In a possible implementation, in order to avoid malicious detection, if the number of times of repeatedly performing face swapping detection by the mobile phone for the video call does not reach number 1 (such as 3 times, 5 times, etc.), the mobile phone can provide a re-detection control in the card-form prompt j, such as "re-detection" 18032 in prompt 18031 in interface 1803. If the number of times of repeatedly performing face swapping detection by the mobile phone for the video call reaches number 1, the mobile phone can not provide a re-detection control in the card-form prompt j, such as the fact that prompt 18041 in interface 1804 does not include a re-detection control.
[0273] Continuing to refer to FIG. 18, in the case where there is no face swapping risk, the prompt j can also be a prompt 18051 in the interface 1805, and the prompt 18051 includes the prompt text “No AI face swapping risk detected” for prompting that there is no face swapping risk. Further, in the case where there is no security risk, the prompt j in the form of a card can also include a control for re-detection, a control for screen recording, etc., which are not limited in the present application.
[0274] In a specific implementation manner, the mobile phone can present the prompts h-j in the form of capsules by default. Subsequently, in response to a click operation of the user on the capsule-form prompt, the mobile phone can switch to present in the form of a card.
[0275] In another specific implementation manner, the mobile phone can present the prompts h and i in the form of capsules by default, and present the prompt j in the form of a card by default, so as to facilitate viewing of specific detection results.
[0276] If the detection result is that there is no face swapping risk, the mobile phone can automatically shrink the prompt j into a capsule form after the display duration of the prompt j in the form of a card reaches a duration 8 (such as 5s), such as shrinking the card prompt 19011 in the interface 1901 shown in FIG. 19 into the capsule 19021 in the interface 1902. Subsequently, after the display duration of the prompt j in the form of a capsule reaches a duration 9 (such as 5s), the mobile phone can automatically cancel display of the prompt j, such as automatically canceling display of the capsule 19021 in the interface 1902 and displaying the interface 1903. In this way, in the case where there is no face swapping risk, the mobile phone can automatically first shrink and then cancel display of the prompt j, thereby avoiding affecting the call.
[0277] Of course, in the case where the prompt j is displayed in the form of a card, in response to an upward swipe operation of the user on the prompt j or a click operation on an area other than the prompt j, the mobile phone can also passively shrink the prompt j into a capsule form.
[0278] In a possible implementation manner, when the detection result is obtained, the mobile phone can have ended the video call. For this case, the mobile phone can display a prompt k in an interface after ending the video call, such as a chat list interface, for prompting that the detection has been completed.
[0279] Similar to the prompt j in the foregoing, the prompt k can also be in the form of a capsule or a card, and corresponding to the two cases of existing face swapping risk and non-existing face swapping risk, the content of the prompt k in the form of a card is also different, and can further prompt the detection result, such as existing face swapping risk or non-existing face swapping risk.
[0280] Referring to FIG. 20, after ending the video call, the phone gets the detection result, and an interface 2001 can be displayed. A prompt 20011 in the interface 2001 is the capsule-form prompt k. The prompt 20011 includes the prompt text "detection completed", which is used to prompt that the detection has been completed.
[0281] In the case of face-changing risk, continuing to refer to FIG. 20, after ending the video call, the phone detects the face-changing risk, and an interface 2002 can be displayed. A prompt 20021 in the interface 2002 is the card-form prompt k, and the prompt 20021 includes the prompt text "the opposite party is suspected of AI face-changing and false identity", which is used to prompt that the detection has been completed and the detection result is the face-changing risk.
[0282] In the case of no face-changing risk, continuing to refer to FIG. 20, after ending the video call, the phone detects no face-changing risk, and an interface 2003 can be displayed. A prompt 20031 in the interface 2003 is the card-form prompt k, and the prompt 20031 includes the prompt text "no AI face-changing risk detected", which is used to prompt that the detection has been completed and the detection result is no face-changing risk.
[0283] Regarding the specific content included in the prompt k. Please refer to the previous description of the prompt j, which will not be repeated here.
[0284] At this point, it should be noted that the prompt k is displayed after exiting the video call, at which time it is no longer possible to re-detect and record the screen of the video call. Accordingly, the prompt k usually does not include the re-detection control and the screen recording control.
[0285] In one possible implementation, the phone can intercept pictures of the video call for face-changing detection. In some cases, the phone may not have intercepted the pictures for face-changing detection before the video call ends. In this case, the phone cannot get the detection result. Moreover, considering the passive detection scheme, the user needs to be given feedback, and the phone can prompt that the detection has not been completed. Similarly, the phone can prompt that the detection has not been completed in the form of a capsule or a card.
[0286] Referring to FIG. 21, after ending the video call, the phone has not obtained the pictures for face-changing detection, and the phone can display the chat list interface shown in interface 2101, which includes a prompt 21011 that includes the prompt text "detection not completed", which is used to prompt that the detection has not been completed. Alternatively, the phone can display the chat list interface shown in interface 2102, which includes a prompt 21021 that includes the prompt text "not completed", which is used to prompt that the detection has not been completed.
[0287] In a possible implementation, the phone can also not detect the face of the opposite party, in which case, the detection result cannot be obtained. Moreover, considering the passive detection scheme, feedback needs to be given to the user, and the phone can also prompt that the detection is not completed. Similarly, the phone can prompt that the detection is not completed in the form of a capsule or a card, and in the card form of the prompt, it can further prompt that the face is not detected, resulting in the detection not being completed.
[0288] It should be noted that if the face is not detected during the video call, the phone can prompt in the video call interface, and if the face is not detected after the video call is ended, the phone can prompt in the interface after the video call is ended, such as the chat list interface.
[0289] Taking the prompt in the video call interface as an example, referring to FIG. 22, during the video call, the phone detects that there is no face of the opposite party, and the phone can display the video call interface shown in interface 2201, which includes prompt 22011, and prompt 22011 includes prompt text “detection not completed”, which is used to prompt that the detection is not completed. Alternatively, the phone can display the chat list interface shown in interface 2202, which includes prompt 22021, and prompt 22021 includes prompt text “not completed”, which is used to prompt that the face is not detected, resulting in the detection not being completed.
[0290] For the above-mentioned scheme one and scheme two, in the case where the face swapping risk exists, the phone can adopt at least one of the following response strategies, so that the user can pay attention to the face swapping risk.
[0291] Response strategy one, during the video call, the phone does not cancel the display of the prompt that the face swapping risk exists, such as the prompt e in the active detection and the prompt j in the passive detection, which is the same below. In this way, the phone can always prompt that the face swapping risk exists during the video call.
[0292] In the active detection scheme, during the video call, the phone can always keep displaying prompt e.
[0293] In the passive detection scheme, during the video call, the phone can switch between the capsule form of prompt j and the card form of prompt j in response to the operation of the user, but the phone will always keep displaying prompt j. For example, in response to the upslide operation of the user on prompt j or the click operation on the area outside prompt j, the phone can passively shrink prompt j into the capsule form, but will always keep displaying prompt j in the capsule form. Unlike the case where the face swapping risk does not exist as shown in FIG. 19, the phone will not actively shrink prompt j from the card form to the capsule form and finally cancel the display.
[0294] Of course, in response to the user's cancel display operation, the mobile phone can passively cancel the display of the prompt indicating the face-swapping risk. The cancel display operation can be a swipe-up operation on the prompt indicating the face-swapping risk, a triggering operation on an area outside the prompt indicating the face-swapping risk, and the like.
[0295] In response to the second response strategy, in the case where the prompt indicating the face-swapping risk is displayed during the video call, in response to triggering the entry into the pull-down notification center, the mobile phone can display notification 1 in the pull-down notification center, and notification 1 is used to notify that the face-swapping risk is detected. In this way, even if the mobile phone enters the pull-down notification center, the face-swapping risk can still be prompted.
[0296] Taking the passive detection scheme as an example, referring to FIG. 23, after detecting the face-swapping risk, the mobile phone can display interface 2301, and prompt 23011 in interface 2301 is prompt j. In response to the user's swipe-down operation in interface 2301, such as the swipe operation in the direction of the arrow in interface 2301, the mobile phone can display interface 2302. Interface 2302 is the pull-down notification center, and interface 2302 includes various notifications (not shown in the figure) received by the mobile phone, and notification 23021 in interface 2302 is notification 1. Notification 23021 includes the text “Opponent suspected AI face-swapping fake identity”, thereby notifying that the face-swapping risk is detected.
[0297] In addition, the content in notification 1 can be consistent with the content in prompt j, for example, the control for re-detection, the control for screen recording, and the like can also be included in notification 1, thereby facilitating the user to trigger the re-detection, screen recording, and the like in the pull-down notification center.
[0298] In response to the third response strategy, the mobile phone can display notification 2 in the interface after ending the video call, such as the chat list interface. Notification 2 can again prompt that the face-swapping risk is detected and provide an entry for detecting the face-swapping risk, and in response to the user's triggering operation on the detection record entry, the mobile phone can display the record interface of the face-swapping detection. In this way, after detecting the face-swapping risk and ending the video call, the mobile phone can provide a shortcut entry to the record interface of the face-swapping detection, so as to enable the user to view the risk record this time.
[0299] Still taking the passive detection scheme as an example, referring to FIG. 24, after detecting the face-swap risk, the phone can display an interface 2401, and the prompt 24011 in the interface 2401 is the prompt j. After ending the video call, the phone can display an interface 2402, and the interface 2402 includes a prompt 24021, and the prompt 24021 is the notification 2. The prompt 24021 includes the prompt text “The video call partner is suspected to be AI face-swap by others, please verify the identity authenticity through other channels”, so as to again prompt the face-swap risk. In addition, the prompt 24021 also includes “Learn more” 24022, and the “Learn more” 24022 is the detection record entry. In response to the user's triggering operation on the “Learn more” 24022, the phone can display an interface 2403, and the interface 2403 is the record interface of the face-swap detection, and the interface 2403 includes a detection record 24031.
[0300] In addition, in the case of displaying the notification 2 in the interface after ending the video call, in response to triggering the entry into the pull-down notification center, the phone can display the notification 2 in the pull-down notification center. In this way, even if the phone enters the pull-down notification center, the face-swap risk can still be prompted, and a shortcut entry to the record interface of the face-swap detection is provided.
[0301] Continuing to refer to FIG. 24, in response to the user's downward sliding operation in the interface 2402, the phone can display an interface 2404. The interface 2404 is the pull-down notification center, and the interface 2404 includes a notification 24041, and the notification 24041 is the notification 2, and the “Learn more” 24042 in the notification 24041 is the detection record entry. In response to the user's triggering operation on the “Learn more” 24042, the phone can also display the interface 2403.
[0302] The fourth response strategy is that within a time length 9 (such as 12 hours, 24 hours, etc.) after detecting the face-swap risk, the phone detects a risk behavior associated with the face-swap risk, and the face-swap risk can be prompted again. In this way, the prompt can be strengthened after the risk behavior occurs.
[0303] The associated risk behavior includes entering a transfer interface, receiving a website link from a friend in a video call with a face-swap risk, etc.
[0304] Still taking the passive detection scheme as an example, referring to FIG. 25A, after detecting the face-swap risk, the phone can display an interface 2501, and the prompt 25011 in the interface 2501 is the prompt j. Within a subsequent time length 9, the phone enters a transfer interface, and the interface 2502 can be displayed. The interface 2502 includes the prompt text “The system detects that the video call you just made has an AI face-swap risk, and continuing to pay may cause financial loss”, so as to again prompt the face-swap risk.
[0305] In addition, after detecting the face-swap risk or the risk degree of the face-swap risk reaching a preset degree value, the mobile phone can also send the risk information to the guardian device. For example, the mobile phone can provide a setting entry of the guardian device (e.g., in the setting interface of the risk protection) and send the risk information to the set guardian device.
[0306] Referring to FIG. 25B, the mobile phone can display an interface 2511, which is a setting interface of the risk protection. The interface 2511 includes a “send information to guardian” 25111 and a “remote guardian reminder” 25112. The “send information to guardian” 25111 is a switch item for sending the face-swap risk to the guardian device. The “remote guardian reminder” 25112 is a setting entry of the guardian device. After the switch of the “send information to guardian” 25112 is turned on, the mobile phone can send the risk information to the guardian device set in the “remote guardian reminder” 25112 after detecting the face-swap risk or the risk degree of the face-swap risk reaching a preset degree value.
[0307] Further, the guardian device can display a risk prompt after receiving the risk information. Referring to FIG. 25B, the guardian device can display an interface 2512 after receiving the risk information. The interface 2512 includes a risk prompt 25121, which prompts the received risk information of the face-swap risk.
[0308] Corresponding to the foregoing turning on of the face-swap detection function, the user can also turn off the face-swap detection function when there is no need for the face-swap detection. Specifically, the mobile phone can turn off the face-swap detection function after detecting a turning-off event of the face-swap detection. In the case of turning off the face-swap detection function, the mobile phone does not detect the face-swap risk and give a prompt during the video call.
[0309] The turning-off event can be an operation event of turning off the risk protection setting in the OOBE, an operation event of turning off the risk protection switch in the setting application, an operation event of turning off the face-swap detection switch in the setting application, and the like. The embodiments of the present application do not make a specific limitation on this.
[0310] The processes of triggering the turning on of the face-swap detection function by the foregoing listed several turning-on events will be described below.
[0311] Method 1: The turning-off event is an operation event of turning off the risk protection setting in the OOBE.
[0312] In the OOBE, the mobile phone usually turns on the risk protection by default. After detecting an operation event of turning off the risk protection setting in the OOBE, such as the operation event of turning off the switch 1011 in the interface 101 in FIG. 1B, it is indicated that the user does not support turning on the risk protection, and the mobile phone can turn off the risk protection.
[0313] The closing event is an operation event of closing the risk protection switch in the settings application.
[0314] The mobile phone detects the triggering operation on the risk protection switch in the open state, and can close the risk protection, thereby closing the face changing detection function under the risk protection.
[0315] Referring to FIG. 26, in the case of opening the risk protection, the mobile phone can display an interface 2601, which is a setting interface of the risk protection, and the risk protection switch 26011 in the interface 2601 is in the open state. In response to the triggering operation of the user on the risk protection switch 26011 in the interface 2601, the mobile phone can display an interface 2602. The risk protection switch 26011 in the interface 2602 is in the closed state, that is, the risk protection has been closed. At this time, the switch state of the setting item "AI face changing reminder" 26021 of the face changing detection in the interface 2602 is not opened, indicating that the face changing detection function is also closed.
[0316] Further, closing the risk protection will close various risk detection functions under the risk protection. Based on this, in response to the triggering operation of the user on the risk protection switch in the open state, the mobile phone can first display a prompt m, such as the prompt 26031 in the interface 2603, for prompting that closing the risk protection will cause various risk detection functions to be unavailable. In response to the confirmation operation of the user on the prompt m, such as the triggering operation on the "still close" 26032 in the prompt 26031, the mobile phone closes the risk protection, thereby closing the face changing detection, such as displaying the interface 2602 after closing.
[0317] The closing event is an operation event of closing the risk protection switch in the settings application.
[0318] The mobile phone detects the triggering operation on the risk protection switch in the open state, and can close the risk protection, thereby closing the face changing detection function under the risk protection.
[0319] Referring to FIG. 27, in the case of opening the face changing detection function, the mobile phone can display an interface 2701, which is a setting interface of the face changing detection, and the face changing detection switch 27011 in the interface 2701 is in the open state. In response to the triggering operation of the user on the switch 27011 in the interface 2701, the mobile phone can display an interface 2702. The face changing detection switch 27011 in the interface 2702 is in the closed state, that is, the face changing detection has been closed.
[0320] It should be noted that, by using the third mode, only the face changing detection function is closed, and the risk protection function is still opened, so that the risk protection is opened and the face changing detection function is closed. For example, in the setting interface of the risk protection, the risk protection switch is in the open state, but the switch state of the setting item of the face changing detection is in the closed state.
[0321] Continuing to refer to FIG. 27, in response to a triggering operation on the return control 27021 in the interface 2702, the phone can display an interface 2703 (the same as the interface 1501 described above), which is a setting interface of the risk protection. In the interface 2703, the risk protection switch 27031 is in an open state, indicating that the risk protection is turned on, and the switch state of the setting item "AI face changing reminder" 27032 of the face changing detection is not turned on, indicating that the face changing detection is not turned on.
[0322] The face changing detection function described above needs the support of a detection model of the face changing detection. In some embodiments, the phone can push a download and installation prompt of the detection model, for prompting to download and install an installation package of the face changing detection. Subsequently, in response to a confirmation operation of the user on the download and installation prompt, such as a triggering operation on a control for confirming the download and installation, the phone downloads and installs the detection model, and turns on the face changing detection after the installation.
[0323] In addition, in response to a cancel operation of the user on the download and installation prompt, the phone does not download and install the detection model, and does not turn on the face changing detection. The cancel operation can be a triggering operation of the user on a control for canceling the download and installation in the download and installation prompt.
[0324] The present application embodiment exemplarily introduces several occasions for pushing the download and installation prompt:
[0325] Occasion 1: When detecting an operation event of turning on the risk protection switch in the setting application, such as the operation event of turning on the risk protection switch in the manners two and four described above, the phone can push the download and installation prompt.
[0326] Exemplarily, in response to a triggering operation of the user on the risk protection switch in the closed state in the setting interface of the risk protection, such as shown in the interface 203 described above, the phone can turn on the risk protection and display an interface 2801 shown in FIG. 28, and the prompt 28011 in the interface 2801 is a download and installation prompt.
[0327] The "install and turn on" 28012 in the prompt 28011 is a control for confirming the download and installation. In response to a triggering operation of the user on the "install and turn on" 28012, the phone can download and install the detection model of the face changing detection, and successfully turn on the face changing detection after the installation is completed, such as displaying the interface 204 described above.
[0328] It should be noted that in occasion 1, in response to a cancel operation on the download and installation prompt, the phone can turn on the risk protection, but not turn on the face changing detection under the risk protection.
[0329] Continuing to refer to FIG. 28, the interface 2801 further includes “later” 28013, which is a control for canceling the download and installation. In response to a user triggering operation on the “later” 28013, the phone can start the risk protection, but not start the face changing detection under the risk protection, such as displaying the interface 2703 described above.
[0330] With the timing 1, the phone can prompt to download and install the detection model when starting the risk protection, so that the face changing detection can be successfully started after installing the detection model, and the availability of the face changing detection function after starting the risk protection is ensured.
[0331] Timing 2, in the case where the risk protection is not started, the triggering operation on the setting item 2 of the face changing detection in the setting application is detected, such as the triggering operation on the setting item 2 in the setting interface of the risk protection in the manner three described above, the phone can push the download and installation prompt.
[0332] For example, in the case where the risk protection is not started, in response to the user triggering operation on the setting item 2 of the face changing detection in the setting interface of the risk protection, such as shown in the interface 701 described above, the phone can display the interface 2802 shown in FIG. 28, and the prompt 28021 in the interface 2802 is a download and installation prompt.
[0333] Among them, “install and start” 28022 in prompt 28021 is a control for confirming the download and installation. In response to the user triggering operation on “install and start” 28022, the phone can download and install the detection model of the face changing detection, and start the face changing detection after installation is completed, such as displaying the interface 703 described above.
[0334] Based on the description of the manner three described above, in the case where the risk protection is not started, in response to the user triggering operation on the setting item 2 of the face changing detection in the setting interface of the risk protection, the phone can display the prompt c, and in response to the confirmation operation on the prompt c, the phone can start the risk protection. On this basis, the phone can then push the download and installation prompt. In this implementation manner, in response to the user canceling operation on the download and installation prompt, the phone will not start the face changing detection, but the risk protection has been successfully started.
[0335] With the timing 2, the phone can prompt to download and install the detection model when entering the setting interface of the face changing detection, so that the download, installation and starting can be quickly completed.
[0336] Timing 3, in the case where the risk protection is started and the face changing detection function is not started, the triggering operation of entering the setting interface of the risk protection is detected, and the phone can push the download and installation prompt, such as displaying the interface 2801 described above.
[0337] In the case of timing 3, when the risk protection is turned on and the face changing detection function is not turned on, the mobile phone can predict that the user enters the setting interface of the risk protection to turn on the face changing detection function when entering the setting interface of the risk protection, and can timely prompt to download and install the detection model.
[0338] In the case of timing 4, in the process of the video call, the mobile phone can push the download and installation prompt. The further pushing timing can be consistent with the pushing condition of prompt a in the fourth mode.
[0339] For example, in the process of the video call, the mobile phone can display the interface 2901 shown in FIG. 29A. The prompt 29011 in the interface 2901 is a download and installation prompt.
[0340] In timing 4, in order to avoid affecting the call, the mobile phone can hide the download and installation control in the download and installation prompt by default, such as not including the download and installation control in the prompt 29011 in the interface 2901. In response to the user's expansion operation, such as a click operation, on the download and installation prompt, the mobile phone can display the download and installation control in the download and installation prompt for the user to operate. Continue to refer to FIG. 29A. In response to the user's click operation on the prompt 29011 in the interface 2901, the mobile phone can display the interface 2902. The "install and turn on" 29021 in the prompt 29011 in the interface 2902 is a download and installation control.
[0341] Further, considering that the user may not be convenient to operate the download and installation prompt in the process of the video call, in actual implementation, if the mobile phone does not detect the user's triggering operation on the download and installation prompt, the mobile phone can always display the download and installation prompt in the process of the video call, and display the corresponding download and installation notification in the notification center to facilitate the user to trigger the download and installation detection model and turn on the face changing detection after ending the video call through the download and installation notification in the notification center.
[0342] Continue to refer to FIG. 29A. The mobile phone can display the interface 2903, which is a notification center. The interface 2903 includes a download and installation notification 29031 for notifying the download and installation detection model.
[0343] Similarly, in response to the user's expansion operation, such as a click operation, on the download and installation notification, the mobile phone can display the download and installation control in the download and installation notification. Continue to refer to FIG. 29A. In response to the user's click operation on the download and installation notification 29031 in the interface 2903, the mobile phone can display the interface 2904. The "install and turn on" 29041 in the download and installation notification 29031 in the interface 2904 is a download and installation control.
[0344] With the timing 4, the mobile phone can push a download and installation prompt in the video call, so as to facilitate the application to the current video call in time after the download and installation.
[0345] In addition, during the download and installation, the mobile phone can also prompt that the download and installation is in progress. Taking the timing 1 above as an example, continuing to refer to FIG. 28, in response to the triggering operation of the user on “Install and start” 28012 in interface 2801, the mobile phone can display interface 2803, which includes the prompt text “Background download and installation in progress, progress can be viewed in the notification bar”, for prompting that the download and installation is in progress.
[0346] It should be noted that during the download and installation, the face changing detection has not been successfully started, for example, the switch state corresponding to the setting item “AI face changing reminder” 28031 of the face changing detection in interface 2803 is not started. At this time, the user cannot start the face changing detection through the operation, for example, the user cannot start the face changing detection through the triggering operation of the face changing detection switch. Based on this, in a specific implementation manner, the mobile phone can prompt that the download and installation is in progress only when it is identified that there is an intention to start the face changing detection, for example, when it is detected that the user triggers the setting item of the face changing detection or it is detected that the user triggers the face changing detection switch in the off state, so as to make the user clear that the detection model is currently being downloaded and installed.
[0347] Taking the detection of the triggering operation of the user on the setting item of the face changing detection as an example, continuing to refer to FIG. 28, in response to the triggering operation of the user on “Install and start” 28012 in interface 2801, the mobile phone can first display interface 2804, in which the switch state corresponding to the setting item “AI face changing reminder” 28031 of the face changing detection is not started. At this time, in response to the triggering operation of the user on “AI face changing reminder” 28031 in interface 2804, the mobile phone identifies that there is an intention to start the face changing detection, and can display the above-mentioned interface 2803, thereby prompting that the download and installation is in progress.
[0348] Further, the remaining storage space in the mobile phone can be less than the target storage space required by the detection model. Based on this, in some embodiments, after displaying the download and installation prompt, in response to the confirmation operation of the user on the download and installation prompt, the mobile phone can detect whether the remaining storage space of the mobile phone is greater than the target storage space required by the detection model. If the remaining storage space is greater than the target storage space, the mobile phone can download the detection model and start the face changing detection. If the remaining storage space is less than the target storage space, the mobile phone can display a prompt for cleaning the storage space, thereby prompting the user to clean the storage space.
[0349] For example, in response to the user triggering the "Install and start" 28022 in the interface 2802, if it is detected that the remaining storage space is greater than the target storage space, the phone can display interface 2803, that is, download the detection model. Otherwise, the interface 2911 shown in FIG. 29B, the prompt 29111 in the interface 2911 is a prompt for cleaning up the storage space. The prompt 29111 includes the prompt text "System storage space is insufficient, cannot download and install …", prompting to clean up the storage space.
[0350] Further, in the prompt for cleaning up the storage space, the size of the storage space required to be cleaned up can also be prompted, such as "XXGB" in the prompt 29111 described above.
[0351] Further, in the prompt for cleaning up the storage space, a control for confirming cleaning can also be included, such as "Go to clean up" 29112 in the prompt 29111 described above. In response to the user triggering the control for confirming cleaning, the phone can clean up the storage space, such as entering the system manager service to clean up the storage space.
[0352] After cleaning up the storage space, in response to the user's confirmation operation of downloading and installing the prompt again, the remaining storage space will be detected again whether it is greater than the target storage space, until it is detected that the remaining storage space is greater than the target storage space, then the detection model can be downloaded and the face swapping detection is started.
[0353] It can be understood that the detection model of the face swapping detection function can be updated, in order to realize the timely updating of the detection model, the phone can also push the update prompt of the detection model after the detection model is updated, for prompting to update the installation package of the face swapping detection. Subsequently, in response to the user's confirmation operation of the update prompt, such as triggering the control for confirming the update, the phone updates the detection model.
[0354] Regarding the process of pushing the update prompt and realizing the response process of updating, the process of pushing the download and installation prompt and downloading and installing the detection model in the foregoing is similar, mainly replacing the download and installation prompt in the foregoing with the update prompt, and replacing the control for confirming the download and installation with the control for confirming the update. Here, no longer be repeated.
[0355] For example, the update prompt can be the prompt 30011 in the interface 3001 shown in FIG. 30, the prompt 30011 includes the prompt text "AI face swapping detection model updates the following content, it is recommended that you upgrade the experience immediately …", for prompting to update the detection model. The "Update immediately" 30012 in the prompt 30011 is the control for confirming the update.
[0356] Only the differences will be briefly described below:
[0357] The update is usually performed for a mobile phone that has enabled the face changing detection function, and the push timing of the update prompt should be after the mobile phone enables the face changing detection function.
[0358] Correspondingly, the timing 1 of pushing the download and installation prompt is not applicable to pushing the update prompt.
[0359] The timing 2 of pushing the download and installation prompt corresponds to the timing 2A of pushing the update prompt: in the case where the face changing detection function is enabled, the mobile phone can push the update prompt after detecting the trigger operation of the setting item 2 of the face changing detection in the setting application.
[0360] The timing 3 of pushing the download and installation prompt corresponds to the timing 3A of pushing the update prompt: in the case where the face changing detection function is enabled, the mobile phone can push the update prompt after detecting the entering of the setting interface of the risk protection.
[0361] The timing 3 of pushing the download and installation prompt corresponds to the timing 4A of pushing the update prompt: in the case where the face changing detection function is enabled, the mobile phone can push the update prompt during the process of the video call.
[0362] In addition, the mobile phone can also push the update prompt in the current interface in the case where the face changing detection function is enabled and the aforementioned second push condition is met. For example, the current interface is the desktop, and the mobile phone can display the interface 3001 shown in FIG. 30, that is, display the update prompt in the desktop.
[0363] In addition, the user can also manually update the detection model. In a specific implementation manner, the mobile phone can provide a model update entrance in the voice assistant application, and in response to the trigger operation of the model update entrance by the user, the mobile phone can detect whether there is an updated version, and update the detection model in the case where there is an updated version.
[0364] Referring to FIG. 31, the mobile phone can display an interface 3101 of the voice assistant application. In response to a click operation of a control 31011 in the interface 3101, the mobile phone can display an interface 3102, which adds an extended function entry to the interface 3101. The "local model update" 31021 is a model update entry. In response to a click operation of the "local model update" 31021, the mobile phone can display an interface 3103, which provides a plurality of model options, such as "large language model" 31031, "image understanding large model" 31032, and "voice large model" 31033. The detection model of face swapping detection belongs to the image understanding large model. In response to a selection operation of the "image understanding large model" 31032, the mobile phone can display an interface 3104, which includes a check update option, i.e., "check update" 31041, and an update log option, i.e., "update log" 31042. In response to a selection operation of the "check update" 31041, the mobile phone can detect whether there is an updated detection model. During the detection process, the mobile phone can display an indication of being checked (not shown in the figure) in the "check update" 31041. After detecting an updated version, the mobile phone can display an interface 3105, which includes information of the new version, such as model name, model size, details, etc. The interface 3105 also includes a control for confirming the update, such as "update immediately" 31051. In response to a click operation of the "update immediately" 31051, the mobile phone can update the detection model, such as displaying an interface 3106 during the update process, prompting "updating……".
[0365] In addition, after the face swapping detection function is configured in the mobile phone, the mobile phone can introduce the face swapping detection function in a plurality of interfaces. The following lists several possible introduction forms.
[0366] The mobile phone can introduce the face swapping detection function in a mobile phone skill application. For example, in the application interface of the mobile phone skill application shown in (a) of FIG. 32, a privacy security option "privacy security" 3201 can be provided. In response to a trigger operation of the "privacy security" 3201, the mobile phone can display a privacy security skill page shown in (b) of FIG. 32, which includes function introduction, setting and use method introduction information of the face swapping detection function.
[0367] The mobile phone can present the detection record of the face swapping detection in a privacy report, thereby introducing the face swapping detection function. For example, the mobile phone can display a privacy report page shown in (c) of FIG. 32, which includes a detection record 3202 of the face swapping detection.
[0368] The mobile phone can introduce the face swapping detection function in the system manager service. For example, the mobile phone can display the interface of the system manager service shown in (d) of FIG. 32, which includes the introduction 3203 of the face swapping detection function.
[0369] The electronic device can include a display screen, a memory, and one or more processors (such as a CPU, a GPU, an NPU, etc.). The display screen, the memory, and the processor are coupled. The memory is configured to store computer program codes, which include computer instructions. When the processor executes the computer instructions, the electronic device can perform various functions or steps performed by the device in the above method embodiments.
[0370] The electronic device can include a display screen, a memory, and one or more processors (such as a CPU, a GPU, an NPU, etc.). The display screen, the memory, and the processor are coupled. The memory is configured to store computer program codes, which include computer instructions. When the processor executes the computer instructions, the electronic device can perform various functions or steps performed by the device in the above method embodiments.
[0371] The electronic device can include a display screen, a memory, and one or more processors (such as a CPU, a GPU, an NPU, etc.). The display screen, the memory, and the processor are coupled. The memory is configured to store computer program codes, which include computer instructions. When the processor executes the computer instructions, the electronic device can perform various functions or steps performed by the device in the above method embodiments.
[0372] The electronic device can include a display screen, a memory, and one or more processors (such as a CPU, a GPU, an NPU, etc.). The display screen, the memory, and the processor are coupled. The memory is configured to store computer program codes, which include computer instructions. When the processor executes the computer instructions, the electronic device can perform various functions or steps performed by the device in the above method embodiments.
[0373] In addition, the embodiments of the present application also provide a device, which can be a chip, a component or a module. The device can include a processor and a memory connected to each other. When the device is running, the processor can execute the computer execution instructions stored in the memory, so that the chip performs the image processing method in the above method embodiments.
[0374] The electronic device, the computer readable storage medium, the computer program product or the chip provided by the embodiments of the present application are used to execute the corresponding methods provided above, and thus the beneficial effects achieved thereby can refer to the beneficial effects in the corresponding methods provided above, which will not be described herein again.
[0375] Those skilled in the art can clearly understand the above-mentioned technical solutions from the description of the above-embodiment, and for the convenience and brevity of description, only the above-mentioned division of functional modules is taken as an example, and in actual application, the above-mentioned functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.
[0376] In several embodiments provided in the present application, it should be understood that the disclosed device and method can be implemented in other ways. For example, the device embodiment described above is only illustrative, for example, the division of the module or unit is only a logical function division, and in actual implementation, there can be another division way, for example, a plurality of units or components can be combined or integrated into another device, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units or components shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.
[0377] The unit described as a separate component can or can not be physically separated, and the component shown as a unit can be one physical unit or multiple physical units, that is, it can be located in one place or distributed to multiple different places. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.
[0378] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.
[0379] The integrated unit, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application essentially or say the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product, which is stored in a storage medium and includes a plurality of instructions to make a device (which can be a single-chip microcomputer, a chip, etc.) or a processor execute all or part of the steps of the method of the embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and various program code storage media.
[0380] Finally, it should be noted that the above examples are only used to illustrate the technical solutions of the present application and are not limiting. Although the present application has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present application can be modified or equivalently replaced without departing from the spirit and scope of the technical solutions of the present application.
Claims
1. A video call method, characterized in that, Applied to electronic devices, including: Add the first user as a friend; Video call with the first user; If the first condition is met, detect whether there is a risk of face swapping on the face of the first user in the video call; if a face swapping risk is detected, display the first prompt. If the second condition is met, a second prompt is displayed to detect the risk of face swapping. In response to the confirmation detection operation of the second prompt, the presence of face swapping risk is detected and the detection process is prompted. After obtaining the detection result, a third prompt is displayed. The detection result includes whether there is a risk of face swapping or whether there is no risk of face swapping. The first condition and the second condition are different.
2. The method according to claim 1, characterized in that, The first condition or the second condition includes at least one of the following: The time difference between the moment the first user is added as a friend and the start time of the video call is within a first duration. The first user is the first friend added; The video call is the first video call with the first user; The video call is a video call initiated by the first user. The first user is in the detection list of the electronic device, which records the first number of users recently added to the electronic device; as well as, The electronic device is subject to a risk event.
3. The method according to claim 1 or 2, characterized in that, The display of the first prompt includes: If the video call has not ended when a risk of face swapping is detected, the first prompt is displayed on the video call interface. The first prompt includes a re-detection control and / or a screen recording control. If the video call has ended when a risk of face swapping is detected, the first prompt will be displayed on the interface after the video call ends. The first prompt does not include the re-detection control or the screen recording control.
4. The method according to any one of claims 1-3, characterized in that, The test results indicate that there is no risk of face swapping. After receiving the test results, a third prompt will be displayed, including: If the video call has not ended when the detection result is obtained, the third prompt is displayed on the video call interface. The third prompt includes a re-detection control and / or a screen recording control. If the video call has ended when the detection result is obtained, the third prompt is displayed on the interface after the video call ends. The third prompt does not include the re-detection control or the screen recording control.
5. The method according to claim 3 or 4, characterized in that, The video call interface displays a prompt including a re-detection of controls, including: If the number of times the video call is checked for face-swapping risk does not exceed the first time, a prompt including a re-check control will be displayed on the video call interface.
6. The method according to claim 5, characterized in that, If the number of times the video call is checked for face-swapping risk exceeds the first number, a prompt without a re-detection control will be displayed on the video call interface.
7. The method according to any one of claims 3-6, characterized in that, After the video call interface displays a prompt including a re-detection control, the method further includes: In response to the triggering operation of the re-detection control, the system detects whether there is a risk of face swapping and prompts the detection process. After obtaining the detection result, a fourth prompt is displayed, and the detection result includes whether there is a risk of face swapping or not.
8. The method according to any one of claims 3-7, characterized in that, After displaying a prompt including screen recording controls on the video call interface, the method further includes: In response to a trigger operation on the screen recording control, the screen of the video call interface is recorded until the video call ends, at which point the recording ends and the recorded video is saved.
9. The method according to any one of claims 1-8, characterized in that, The method further includes: If the second condition is met and the first user's face is not detected, a message indicating that the detection was incomplete is displayed; or, If the second condition is met, and the video call ends before the image frame of the video call used for detection is acquired, a prompt indicating that the detection was not completed is displayed on the interface for ending the video call. Specifically, if the first condition is met and no face is detected, or if the video call ends before an image frame is acquired, no message indicating that the detection is incomplete will be displayed.
10. The method according to any one of claims 1-9, characterized in that, The notification detection process includes: Display at least one of the following messages: a prompt to start detection, a prompt that is detecting, and a detection animation.
11. The method according to any one of claims 1-10, characterized in that, The second condition includes the first sub-condition and the second sub-condition; If the second condition is met, a second warning will be displayed indicating the risk of face swapping, including: If the first sub-condition is met, a second prompt indicating the risk of face swapping is displayed. The first sub-condition includes turning on the face swapping detection switch of the electronic device. If the second sub-condition is met, a second prompt will be displayed to enable the face-swapping detection function and perform detection. The second sub-condition includes turning off the face-swapping detection switch of the electronic device.
12. The method according to claim 11, characterized in that, After displaying the second prompt indicating that the face-swapping detection function is enabled and detection is initiated, in response to the confirmation detection operation of the second prompt, the system detects whether there is a risk of face-swapping, including: In response to the confirmation check operation of the second prompt, the face-swapping detection function is enabled and the risk of face-swapping is detected.
13. The method according to any one of claims 1-12, characterized in that, The second warning displayed to detect the risk of face swapping includes: When the second prompt is displayed from the 1st to the Nth time, the second prompt is displayed in the form of a card, which includes a description of the face-swapping detection function and / or a control to confirm the detection. When the second prompt is displayed for the N+1th time, the second prompt is displayed in capsule form, wherein the capsule-form second prompt does not include a function introduction of the face-swapping detection function or a control for confirming the detection; Where N is a natural number greater than 1.
14. The method according to any one of claims 1-13, characterized in that, The test results indicate that there is a risk of face swapping. The display of the third prompt includes: The third prompt is displayed on the video call interface and remains displayed until the video call ends.
15. The method according to any one of claims 1-13, characterized in that, The test results indicate that there is no risk of face swapping. After displaying the third prompt, the method further includes: After the third prompt has been displayed for a certain duration, the third prompt will be removed from display.
16. The method according to claim 14, characterized in that, After the third prompt is displayed on the video call interface, the method further includes: After the video call ends, a details entry will be displayed; In response to the triggering operation of the details entry, the detection record of face-swapping risk detection is displayed.
17. The method according to claim 14, characterized in that, After the third prompt is displayed on the video call interface, the method further includes: In response to the operation of swiping down to enter the pull-down notification center in the video call interface, the pull-down notification center is displayed, the pull-down notification center includes a first notification, the content of the first notification being consistent with the third prompt.
18. The method according to any one of claims 1-17, characterized in that, The test results indicate that there is a risk of face swapping. After displaying the third prompt, the method further includes: Within four hours after detecting the risk of face-swapping, a risky behavior was detected, and a fifth warning of face-swapping risk was displayed.
19. The method according to claim 11, characterized in that, The second sub-condition also includes turning on the risk protection switch of the electronic device, and the face-swapping detection function is a sub-function of risk protection.
20. The method according to any one of claims 1-19, characterized in that, Before adding the first user as a friend, the method further includes: If the third condition is met, a sixth prompt to enable the risk protection function will be displayed. The third condition includes the risk protection switch being turned off and the face-swapping detection switch being turned off. In response to the triggering operation of the sixth prompt, the risk protection settings interface is displayed, which includes a risk protection switch that is turned off. In response to the activation of the risk protection switch, the risk protection function and the face-swapping detection function are activated.
21. The method according to any one of claims 1-20, characterized in that, Before adding the first user as a friend, the method further includes: If the fourth condition is met, a seventh prompt will be displayed to enable the face-swapping detection function, wherein the fourth condition includes turning on the face-swapping detection switch. In response to the triggering operation of the seventh prompt, the face-swapping detection settings interface is displayed, which includes a face-swapping detection switch in the enabled state and a function description of the face-swapping detection function.
22. The method according to any one of claims 1-21, characterized in that, The face-swapping detection function is a sub-function of risk protection; Before adding the first user as a friend, the method further includes: In response to the activation of the risk protection switch or the face-swapping detection switch in the settings application, the face-swapping detection function is enabled.
23. The method according to claim 22, characterized in that, In response to the action of turning on the face-swapping detection switch in the settings app, enable the face-swapping detection function, including: If the risk protection switch is not turned on, a prompt to turn on the risk protection will be displayed in response to the operation of turning on the face swap detection switch; In response to the confirmation prompt to enable risk protection, the risk protection and face-swapping detection functions are enabled.
24. The method according to claim 23, characterized in that, The risk protection is provided by the system management service in the electronic device; The operation of confirming the activation of risk protection in response to the prompt includes activating the risk protection and face-swapping detection functions, including: If the System Manager service is not enabled, in response to the confirmation of the prompt to enable risk protection, a prompt to enable the System Manager service will be displayed. In response to the confirmation prompt to enable the system manager service, the system manager service, risk protection, and face-swapping detection functions are enabled.
25. An electronic device, characterized in that, include: A display screen, one or more processors, and one or more memories; the one or more processors are coupled to the display screen and the one or more memories; the one or more memories are used to store computer program code, the computer program code including computer instructions, which, when executed by the one or more processors, cause the electronic device to perform the method as described in any one of claims 1-24.
26. A computer-readable storage medium storing computer instructions thereon, characterized in that, When the computer instructions are executed on the electronic device, the electronic device causes the electronic device to perform the method as described in any one of claims 1-24.
27. A computer program product comprising computer instructions, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 1-24.
Citation Information
Patent Citations
Detection method, device and equipment and computer storage medium
CN111783644A
Communication terminal information acquisition method and system
CN117176858A
Anti-AI fraud method and electronic device
CN117951673A
Double-recording real-time risk identification method and device based on AI, equipment and medium
CN118135498A
Method and apparatus for detecting abnormality of caller
US20200228648A1