Communication object recognition method

Abstract

Provided in the embodiments of the present disclosure is a communication object recognition method, comprising: collecting, by means of a first terminal, first feature information of a communication object in communication with the first terminal, and determining whether the communication object is a target object according to the first feature information; under the condition that it is determined that the communication object is a target object, sending a first instruction to a second terminal associated with the target object, wherein the first instruction is used for acquiring communication state information of the second terminal; and determining whether the current communication terminal in communication with the first terminal is a second terminal according to the acquired communication state information of the second terminal.

Description

A method for identifying a caller

[0001] Cross-references to related publications

[0002] This disclosure is based on Chinese Patent Publication No. 2023116375942, filed on November 30, 2023, entitled “A Method for Identifying Calling Parties”, and claims the priority of that patent disclosure, all of whose disclosed contents are incorporated into this disclosure by reference. Technical Field

[0003] The present disclosure relates to the field of communications, and in particular to a method for identifying a call recipient. Background Art

[0004] When users are making voice or video calls, some cybercriminals may use the voices or images of users' relatives through artificial intelligence (AI) to change their voices or faces, deceiving them by pretending to be their relatives. Some cybercriminals also disguise phone numbers as those of relatives, misleading users into thinking they are actually calling a family member.

[0005] Regarding the problem that users cannot accurately identify the person they are talking to by pretending to be a relative during a call, no effective solution has been proposed in the relevant technology.

[0006] Summary of the Invention

[0007] An embodiment of the present disclosure provides a method for identifying a call recipient.

[0008] According to one embodiment of the present disclosure, a method for identifying a call object is provided, including: a first terminal collecting first feature information of a call object with which the call object is in conversation, and determining whether the call object is a target object based on the first feature information; when it is determined that the call object is a target object, sending a first instruction to a second terminal associated with the target object, wherein the first instruction is used to obtain call status information of the second terminal; and determining whether the current call terminal in conversation with the first terminal is the second terminal based on the obtained call status information of the second terminal.

[0009] According to another embodiment of the present disclosure, a computer-readable storage medium is provided, in which a computer program is stored. The computer program is configured to execute the steps of any one of the above method embodiments when running.

[0010] According to another embodiment of the present disclosure, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any one of the above method embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] FIG1 is a hardware structure block diagram of a mobile terminal according to a method for identifying a call object according to an embodiment of the present disclosure;

[0012] FIG2 is a flow chart of a method for identifying a call recipient according to an embodiment of the present disclosure;

[0013] 3 is a flowchart of determining whether the current user of the second terminal is the target object through method 1 according to an embodiment of the present disclosure;

[0014] 4 is a flowchart of determining whether the current user of the second terminal is the target object through method 2 according to an embodiment of the present disclosure;

[0015] 5 is a flowchart of determining whether the current user of the second terminal is the target object through mode 3 according to an embodiment of the present disclosure;

[0016] FIG6 is an overall flow chart of a method for identifying a call partner according to an embodiment of the present disclosure;

[0017] FIG7 is a block diagram of a device structure of a method for identifying a call partner according to an embodiment of the present disclosure;

[0018] FIG8 is a flow chart of a method for identifying a call recipient in a specific application scenario according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0019] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings and in conjunction with embodiments.

[0020] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0021] The method embodiments provided in the embodiments of the present disclosure can be executed in a mobile terminal, a computer terminal, or a similar computing device. Taking operation on a mobile terminal as an example, FIG1 is a hardware structure block diagram of a mobile terminal according to a method for identifying a caller in accordance with an embodiment of the present disclosure. As shown in FIG1 , the mobile terminal may include one or more (only one is shown in FIG1 ) processors 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 configured to store data, wherein the mobile terminal may also include a transmission device 106 configured to have a communication function and an input / output device 108. It will be understood by those skilled in the art that the structure shown in FIG1 is merely illustrative and does not limit the structure of the mobile terminal. For example, the mobile terminal may also include more or fewer components than those shown in FIG1 , or have a configuration different from that shown in FIG1 .

[0022] The memory 104 can be configured to store computer programs, such as software programs and modules of application software, such as a computer program corresponding to a caller identification method in an embodiment of the present disclosure. The processor 102 executes the computer program stored in the memory 104 to perform various functional applications and data processing, thereby implementing the above-mentioned method. The memory 104 may include a high-speed random access memory and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely located relative to the processor 102, and these remote memories may be connected to the mobile terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0023] The transmission device 106 is configured to receive or transmit data via a network. A specific example of the aforementioned network may include a wireless network provided by the mobile terminal's telecommunications provider. In one embodiment, the transmission device 106 includes a network interface controller (NIC), which can be connected to other network devices via a base station to enable communication with the Internet. In another embodiment, the transmission device 106 may be a radio frequency (RF) module configured to communicate with the Internet wirelessly.

[0024] In this embodiment, a method for identifying a call recipient is provided. FIG2 is a flow chart of a method for identifying a call recipient according to an embodiment of the present disclosure. As shown in FIG2 , the flow chart includes the following steps:

[0025] Step S202: The first terminal collects first characteristic information of the call partner with which the first terminal is communicating, and determines whether the call partner is a target partner based on the first characteristic information;

[0026] Step S204: If it is determined that the call object is the target object, a first instruction is sent to a second terminal associated with the target object, wherein the first instruction is used to obtain call status information of the second terminal;

[0027] Step S206: Determine whether the current calling terminal in the call with the first terminal is the second terminal according to the acquired call status information of the second terminal.

[0028] Through the above steps, users may be deceived by network personnel who have changed their faces and voices. When receiving a call, the user terminal sends instructions to the terminal of the real relative, and obtains the call status information of the real relative's terminal through the instructions, thereby verifying whether the call terminal is the terminal of the real relative. Obviously, the network personnel disguised as relatives cannot change the call status of the real relative's terminal, and then it can be identified whether the current call object terminal is the terminal of the real relative, thereby improving the efficiency and accuracy of identifying the call object.

[0029] In an exemplary embodiment, determining whether the call object is a target object according to the acquired first feature information includes:

[0030] The first feature information is compared with the pre-stored feature data of the target object to determine whether the call object is the target object, wherein the first feature information includes at least one of the following: the mobile phone number of the call object, the image information of the call object, and the voiceprint information of the call object; the feature data includes at least one of the following: the appearance feature data of the target object, the voiceprint feature data, and the mobile phone number associated with the target object.

[0031] In an exemplary embodiment, comparing the first feature information with pre-stored feature data of the target object to determine whether the call object is the target object includes one of the following:

[0032] In the case where the current call is a video call, the collected image information and / or voiceprint information of the call object is compared with the appearance feature data and / or voiceprint feature data in the pre-stored feature data of the target object to determine whether the call object is the target object;

[0033] When the current call is a voice call, the collected mobile phone number and / or voiceprint information of the call object is compared with the mobile phone number and / or voiceprint feature data in the pre-stored feature data of the target object to determine whether the call object is the target object.

[0034] In an exemplary embodiment, step S206 includes:

[0035] determining whether the current calling terminal is the second terminal based on whether the acquired call status information of the second terminal is consistent with the call status information of the current calling terminal in the call with the first terminal, wherein the call status information of the second terminal includes a factory identification of the second terminal;

[0036] In the case where the current call is a video call, the call status information of the second terminal further includes one of the following: call connection status, an application in the call;

[0037] In the case that the current call is a voice call, the call status information of the second terminal further includes one of the following: a call connection status, and a mobile phone number of the current call partner of the second terminal.

[0038] In an optional embodiment, after step S206, the following steps are further included:

[0039] When the factory identity of the second terminal is inconsistent with the current call status, and the remaining call status information of the second terminal is consistent with the current call status, verification information is sent to the mobile phone number of the target object, and feedback information based on the verification information is provided based on the received mobile phone number of the target object to determine again whether the call object is the target object.

[0040] In the case where it is determined that the conversation object is not the target object, a prompt indicating that the current conversation object is a non-target object is displayed on the first terminal.

[0041] In an exemplary embodiment, the verification information includes one of the following: a temporary verification code, a key window.

[0042] In an optional embodiment, the method further includes:

[0043] Step S208: When it is determined that the current call terminal is the second terminal, determine whether the current user of the second terminal is the target object by the following three methods, and any one of the three methods can be selected.

[0044] FIG3 is a flow chart of determining whether the current user of the second terminal is the target object through method 1 according to an embodiment of the present disclosure. As shown in FIG3 , method 1 includes the following steps:

[0045] Step S301: If it is determined that the current calling terminal is the second terminal, a second instruction is sent to the second terminal, wherein the second instruction is used to instruct the second terminal to collect second feature information and provide feedback to the first terminal;

[0046] Step S302: determining whether the current user of the second terminal is the target object based on the fed-back second characteristic information.

[0047] FIG4 is a flow chart of determining whether the current user of the second terminal is the target object through method 2 according to an embodiment of the present disclosure. As shown in FIG4 , method 2 includes the following steps:

[0048] S401, if it is determined that the current call terminal is the second terminal, sending a third instruction via the second terminal to a third terminal associated with the target object, wherein the third terminal is a device that is paired with and successfully connected to the second terminal, and the third instruction is used to instruct the third terminal to collect second feature information and provide feedback to the first terminal;

[0049] S402: Determine whether the current user of the second terminal is the target object according to the fed-back second characteristic information.

[0050] FIG5 is a flowchart of determining whether the current user of the second terminal is the target object through method 3 according to an embodiment of the present disclosure. As shown in FIG5 , method 3 includes the following steps:

[0051] Step S501, when it is determined that the current call terminal is the second terminal, determine whether the current user of the second terminal is the target object based on the connection status between the second terminal and a fourth terminal associated with the target object, wherein the fourth terminal is a device that is paired with the second terminal and has been successfully connected, and the connection status is obtained through the first instruction.

[0052] In an exemplary embodiment, determining whether a current user of the second terminal is the target object according to a connection state between the second terminal and a fourth terminal associated with the target object includes:

[0053] When the second terminal and a fourth terminal associated with the target object are not connected, sending a fourth instruction to the second terminal, wherein the fourth instruction is used to instruct the second terminal to collect second feature information and provide feedback to the first terminal;

[0054] Determine whether the current user of the second terminal is the target object according to the fed-back second characteristic information.

[0055] In an exemplary embodiment, the second characteristic information includes at least one of the following: image information, voiceprint information, and surrounding environment information of the current user of the second terminal.

[0056] The following describes the overall process of a method for identifying an object according to an embodiment of the present disclosure. FIG6 is an overall flow chart of a method for identifying a call object according to an embodiment of the present disclosure. As shown in FIG6 , the overall process is as follows:

[0057] When users are alone, some cybercriminals will use AI to change the voice or face of a user's relatives, then use the processed voice or image to make voice or video calls with the user, thereby deceiving them. Some cybercriminals will also use technical means to disguise the phone number as a virtual number of a user's relatives, misleading the user into thinking that the person they are calling is a relative, thereby deceiving the user.

[0058] Before adopting the method of this embodiment, the user terminal adds a family module, which can store information about the user's relatives, including their mobile phone numbers, appearance feature data, voiceprint feature data, and the factory identification of the mobile phone.

[0059] The present embodiment adopts the following steps to identify the call recipient:

[0060] Step S1: A first terminal collects first characteristic information of a caller, wherein the first characteristic information includes at least one of the following: a mobile phone number of the caller, an image of the caller, or a voiceprint of the caller.

[0061] For example, when a user connects to a video call, an application (APP) on the user's mobile phone collects image information on the call interface and voice information of the call partner.

[0062] Step S2: compare the first feature information with the pre-stored feature data of the target object to determine whether the call object is the target object. If yes, proceed to step S3; if not, do nothing.

[0063] The calling modes in the embodiments of the present disclosure are divided into video calls and voice calls. Under different calling modes, the specific comparison methods are as follows: when the current call is a video call, the collected image information and / or voiceprint information of the calling party is compared with the appearance feature data and / or voiceprint feature data in the pre-stored feature data of the target object to determine whether the calling party is the target object; when the current call is a voice call, the collected mobile phone number and / or voiceprint information of the calling party is compared with the mobile phone number and / or voiceprint feature data in the pre-stored feature data of the target object to determine whether the calling party is the target object.

[0064] The characteristic data includes at least one of the following: appearance characteristic data of the target object, voiceprint characteristic data, and a mobile phone number associated with the target object. The characteristic data is pre-stored in the family module.

[0065] For example, taking a video call as an example, after collecting image information, the user APP compares it with the appearance data features in the family module (face recognition) to determine which relative it is. If the face recognition determines that the current caller is relative A, step S3 is executed. If it is not a relative, no processing is performed. In addition to using image information for comparison, voiceprint information can also be used for comparison. The two can be used separately or in combination, and there is no limitation here. In the case of a voice call, the collected information can also be the mobile phone number of the caller.

[0066] Step S3: If the call recipient is determined to be the target recipient, a first instruction is sent to a second terminal associated with the target recipient. The first instruction is used to obtain call status information of the second terminal; the call status information of the second terminal includes the factory identification of the second terminal and one of the following: call connection status and the application in the call.

[0067] For example, when the user APP determines that the call partner is relative A, it sends a command to relative A's mobile phone (the user's relatives, including relative A, have pre-installed the same APP and can send and receive commands through the Internet). The command is used to obtain the factory identity of relative A's mobile phone, the call connection status, and the application in the call.

[0068] Step S4: Determine whether the current calling terminal is the second terminal based on whether the acquired call status information of the second terminal is consistent with the call status information of the current calling terminal of the call with the first terminal. If not, execute step S51; if so, execute step S52.

[0069] The acquired call status information of the second terminal and the call status information of the current call terminal of the call with the first terminal are in the following situations:

[0070] Scenario 1: The factory identification of the second terminal is inconsistent with the current call status, and the remaining call status information of the second terminal is consistent with the current call status; then step S51 is executed to further identify the call partner.

[0071] For example, in the case of a video call, if the factory ID of the device is inconsistent, the call status is in the video call state, and the video call application name is the same, this situation may be that relative A has replaced the phone with the same app installed on the new phone, and this situation requires further verification. In the case of a voice call, if the factory ID of the device is inconsistent, the call status is in the voice call state, and the number of the voice call recipient is the same as the user's number, this situation may be that relative A has replaced the phone with the original phone number installed on the new phone, and further verification is also required.

[0072] In case 2, the factory identity of the second terminal is inconsistent with the current call status, and the rest of the call status information of the second terminal is inconsistent with the current call status. It can be determined that the terminal of the current call object is not the terminal of relative A, but a network person who disguises himself as relative A to deceive.

[0073] Scenario 3: The call status information of the second terminal is consistent with the call status information of the current call terminal of the call with the first terminal; then step S52 is executed to further identify the call object.

[0074] In this case, further identification is needed because the network personnel obtained the mobile phone of relative A and used the mobile phone of relative A to pretend to be relative A and talk to the user. Therefore, it is necessary to further identify whether the current call object is the real relative A himself.

[0075] Step S51: Determine again whether the call recipient is the target recipient using method 1. Method 1 includes the following sub-steps:

[0076] Sub-step S511: If the factory identification of the second terminal is inconsistent with the current call status, and the remaining call status information of the second terminal is consistent with the current call status, sending verification information to the mobile phone number of the target object, and re-determining whether the call object is the target object based on feedback information of the verification information received from the mobile phone number of the target object; wherein the verification information includes one of the following: a temporary verification code, a key window;

[0077] For example, corresponding to the above situation 1, it can be determined that the mobile phone of the current call is not the mobile phone of relative A, but the current call object may be relative A. The reason is that relative A may have changed to a new mobile phone, and the new mobile phone also has the same APP and the original mobile phone number installed. At this time, further verification is required. The verification information is sent to relative A through the mobile phone number of relative A pre-stored in the user's family module, and it is determined whether the current call object is relative A based on the feedback information.

[0078] The method of sending verification information can be to use the 5G data channel to send a verification code temporarily input by the user to the mobile phone number of relative A, and require the current call party to orally recite the verification code, or the family module pre-stores a pre-made key, and sends a family key window to the APP on the terminal of relative A, requiring the current call party to enter the key.

[0079] Sub-step S512: When it is determined that the call object is not the target object, a prompt indicating that the current call object is a non-target object is displayed on the first terminal.

[0080] For example, if the verification code or key verification cannot be entered correctly, the user will be reminded that the identity of the other party cannot be verified and the user may be scammed by a fake number. The next step is to record the call time and notify relative A through the APP that the user may be scammed by a fake number and provide care to the user.

[0081] Step S52: Determine again whether the call recipient is the target recipient using method 2. Method 2 includes the following three optional methods, one of which can be selected during execution.

[0082] Method 1 includes the following sub-steps:

[0083] Sub-step 1: When it is determined that the current calling terminal is the second terminal, a second instruction is sent to the second terminal, wherein the second instruction is used to instruct the second terminal to collect second feature information and provide feedback to the first terminal; wherein the second feature information includes at least one of the following: image information, voiceprint information, and surrounding environment information of the current user of the second terminal.

[0084] For example, when it is determined that the call is from relative A's mobile phone, the user APP sends a second instruction to relative A's mobile phone APP via the Internet. The instruction is used to instruct relative A's mobile phone to collect relative A's image information, voiceprint information, and surrounding environment information.

[0085] Sub-step 2: determining whether the current user of the second terminal is the target object based on the fed-back second characteristic information.

[0086] Exemplarily, the user APP determines whether the image information and voiceprint information fed back by the relative A APP are consistent with the appearance feature data and voiceprint feature data of relative A stored in the user's relative module. If they are consistent, it can be determined that relative A's personal mobile phone is being used by relative A himself. In addition to the image information and voiceprint information collected by relative A's personal mobile phone, the second feature information can also be the environment around his mobile phone collected by relative A's personal mobile phone. For example, by comparing the collected surrounding environment with the environmental information stored in the user's relative module, if it is determined to be a trustworthy environment (relative A's home), it can be determined that relative A's personal mobile phone is being used by relative A himself. If it is an unfamiliar environment, other methods are used for confirmation.

[0087] Method 2 includes the following sub-steps:

[0088] Sub-step 1: When it is determined that the current call terminal is the second terminal, a third instruction is sent to a third terminal associated with the target object through the second terminal, wherein the third terminal is a device paired with and successfully connected to the second terminal, and the third instruction is used to instruct the third terminal to collect second feature information and provide feedback to the first terminal; wherein the second feature information includes at least one of the following: image information, voiceprint information, and surrounding environment information of the current user of the second terminal.

[0089] For example, if it is determined that the call is from Relative A's mobile phone, the user app uses the Internet to send a third instruction through Relative A's mobile phone app to its associated devices, such as its smart wearable device, smart home, etc. The third instruction is used to instruct the smart wearable device or smart home to collect the image information, voiceprint information, and surrounding environment information of the current user of Relative A's mobile phone and provide feedback. Among them, the smart wearable device and smart home are devices that are successfully paired and connected with Relative A's mobile phone. If Relative A's mobile phone is always connected to the smart watch via Bluetooth, after receiving the third instruction, the smart watch uses the camera to collect Relative A's current image information, voiceprint information, and surrounding environment information, and feedback to the user app.

[0090] Sub-step 2: determining whether the current user of the second terminal is the target object based on the fed-back second characteristic information.

[0091] Method 3 includes the following sub-steps:

[0092] Sub-step 1: upon determining that the current calling terminal is the second terminal, determining whether the current user of the second terminal is the target object based on a connection status between the second terminal and a fourth terminal associated with the target object, wherein the fourth terminal is a device that has been paired with and successfully connected to the second terminal, and the connection status is obtained via the first instruction;

[0093] For example, when it is determined that the call is made by relative A's mobile phone, the connection status between relative A's mobile phone and its associated devices such as smart wearable devices and smart home devices is obtained to determine that relative A's mobile phone is being used by relative A himself, and the connection status is obtained through the first instruction.

[0094] For example, when the user sends a first instruction, the instruction also includes obtaining the connection status of the Bluetooth watch paired with the mobile phone of relative A. The user APP obtains feedback information of the first instruction. When the Bluetooth watch and the mobile phone of relative A in the feedback information are in a connected state, it can be determined that the mobile phone of relative A is being used by relative A. This is because the Bluetooth watch and relative A can only be connected when they are in close range. Therefore, when they are in a connected state, it can be confirmed that relative A is in a close range of his mobile phone, and further it can be determined that the mobile phone of relative A is being used by relative A.

[0095] Sub-step 2: When the second terminal and a fourth terminal associated with the target object are disconnected, sending a fourth instruction to the second terminal, wherein the fourth instruction is used to instruct the second terminal to collect second feature information and provide feedback to the first terminal;

[0096] For example, when the Bluetooth watch in the feedback information is disconnected from the mobile phone of relative A, the user APP sends a fourth instruction to the mobile phone of relative A, which is used to instruct the mobile phone of relative A to collect the image information, voiceprint information or surrounding environment information of relative A.

[0097] Sub-step 3: determining whether the current user of the second terminal is the target object based on the fed-back second characteristic information.

[0098] For example, the user app determines whether the image information, voiceprint information, or surrounding environmental information fed back by the app on relative A's phone is consistent with relative A's appearance, voiceprint, and environmental characteristic data stored in the user's family module. If they are consistent, it can be determined that relative A's personal phone is being used by relative A himself. If they are inconsistent, it is determined that the current call recipient is not the real relative A.

[0099] Figure 7 is a structural block diagram of a device for identifying a call partner according to an embodiment of the present disclosure, including a family module, a recorder module, an image processing module and an intelligent application APP.

[0100] The family module collects and saves data of the user's relatives and other relevant personnel (including phone numbers, voiceprints, and portraits, etc.) in advance.

[0101] The recorder module collects the other party's voiceprint during a voice call or video call and sends it to the family module for processing.

[0102] The image processing module collects the portraits of people on the call interface and sends them to the family module for processing.

[0103] Smart application APP, users wear wearable handheld peripherals or connect to smart home, and install the corresponding smart application APP on their mobile terminal. The user APP activates the recorder and image processing module during each video call, collects the portrait and audio of the call interface, and compares the collected data with the data in the preset family module. If it is determined to be a family member, the following technical solution is then used to determine whether the call is from a family member. The details are as follows:

[0104] The solution for determining whether the call is from a relative's local machine: the user APP (the family number is set in advance with each relative) sends a command to the corresponding relative-side APP, checks the call status, call object number and application name of the relative terminal APP, and transmits it back to the user-side APP through the Internet to determine whether the call application and call status are consistent. If they are consistent, it is determined that it is a relative's local machine, otherwise it is determined that it is not a relative's local machine call.

[0105] Anti-spoofing measures after determining that the call is not from a family member: If the call is from the user's own number, a temporary verification code is sent to the family member's phone number via the 5G data channel, requiring the caller to verbally provide the verification code. Alternatively, if the family module stores a pre-set key, a family key window is sent to the terminal with the family member's number, requiring the caller to enter the key. The call time is then recorded, and the family member is notified through the app. Users may be scammed by AI-powered face-swapping to impersonate a family member.

[0106] After confirming that the call is from a relative, anti-spoofing measures are implemented: the user app sends commands to the relative's terminal app via the Internet. The relative's terminal app receives the command and calls the local recorder and camera, or its smart wearable device or smart home device, to collect a second piece of information (voiceprint, portrait, surrounding environment, or relative's biometrics). The collected information is then transmitted back to the user app via the Internet. The collected information is compared with the information reserved in the family module to determine whether it is the relative. If it is not the relative, the user terminal or call interface will prompt the user that the other party is not the relative and the call will be terminated.

[0107] FIG8 is a flow chart of a method for identifying a call recipient in a specific application scenario according to an embodiment of the present disclosure.

[0108] When elderly people are home alone, network operators may use the voices or images of their loved ones to perform artificial intelligence (AI) voice or face changes, then use the processed voices or images to make voice or video calls with them, thereby deceiving them. Some network operators also use technical means to disguise phone numbers as virtual numbers of relatives, misleading users into believing they are calling a relative, thereby deceiving them. Managing the terminal security of these groups of users is a problem that needs to be solved. Smart terminals are becoming increasingly popular, including wearable devices and smart homes. The application scenario is that the user wears a wearable device and the terminal is connected to some small IoT devices such as smart furniture. As shown in Figure 8, the specific steps include the following:

[0109] Step S01: The family module pre-stores family information.

[0110] Step S02: The intelligent application calls the recording machine and the image processing module.

[0111] Step S03: Collect the portrait and voiceprint of the call interface.

[0112] Step S04: The family module determines whether the person being called is a relative.

[0113] Specifically, a family anti-fraud module is added to the user's mobile phone. The data of the family anti-fraud module is the data of the user's relatives (including phone number, mobile phone identifier emmcid, voiceprint and image, etc.) collected and preset in advance. The user wears a wearable watch and the mobile terminal has the corresponding smart watch APP installed. After the user receives a call, the first thing to do is to determine what kind of call it is. If it is a video call, the user's local APP collects the image and sound of the interface during the video call; if it is a voice call, the call number and sound information are collected. The collected information is compared with the data in the preset family anti-fraud module. If it is determined to be a relative, the following technical solution is used to determine whether it is a call from the user's relatives.

[0114] Step S05: Determine whether the call is from a relative.

[0115] Specifically, the technical solution for determining whether the call is with the user's relatives is as follows: the user's smartwatch APP pre-sets a family number with each of the user's relatives, and sends a command to the same APP on the relative terminal. The same APP on the relative terminal has pre-set relevant permissions and can check the call status information of the relative terminal, including the call status, the number of the call object, and the name of the application in the call. The relative terminal APP then feeds back the call status information of the relative terminal to the user's smartwatch APP via the Internet. If it is determined that the call status of the relative terminal is consistent with the user's call status, that is, it is in a call state, the number of the call object is consistent with the user's number, and the application in the call is the same as the user's application name, then it is determined that the terminal the user is calling is the relative's own terminal; if they are inconsistent, then it is determined that the terminal the user is calling is not the relative's own terminal. In addition, if the smart peripheral and the relative terminal are in a connected state, it can be directly determined that it is a relative's local call.

[0116] Step S051: Use non-familiar anti-fraud measures.

[0117] Specifically, if it is determined that the call is not from a relative on the user's phone, but from a relative's real number, the 5G data channel can be used to send a verification code temporarily entered by the user to the other party's phone number, requiring the other party to orally recite the verification code. Alternatively, a new family module with a pre-made key can be added, and a family key window will be sent to the other party's terminal, requiring the other party to enter the key. If the verification code or key verification cannot be completed, the user will be reminded that the identity of the other party cannot be verified and may be a scam with a fake number. The next step is to record the call time and notify the relative through the app that the user may have been scammed with a fake number, providing care for the user.

[0118] Step S052: Use anti-fraud measures on the local machine of relatives.

[0119] Specifically, when it is determined that the call is from a relative of the user, there are two identification methods: automatic identification and manual assisted identification.

[0120] If the call is between relatives, they will send commands to each other through the network APP. The relative's APP receives the command and calls the relative's local recorder and camera or their smart wear or smart home to collect information (voiceprint and portrait) for the second time. The information is transmitted back to the user's APP through the network. The second collected information is compared with the information reserved in the family module to determine whether the smart watch worn by the user uses voice broadcast or call interface to prompt the user to verify that the other party is not a relative, and the call will be terminated immediately. If it is determined to be a relative, no processing will be done. (This is automatic identification)

[0121] If you're using a local call, you can still do this. First, verify that the smart peripheral is connected to the other party's terminal. Combined with the location information obtained by the smart peripheral app, the user can determine if the caller is a relative. If the other party's app reports that the smart peripheral is connected to the other party's terminal and the GPS address, IP address, or hotspot name of the smart peripheral are familiar to the user, the user can directly determine that the caller is the relative. If the other party's app reports that the smart peripheral is not connected, and the user's app has previously paired with the smart device, the user's app can simply send a command to the relative's smart peripheral (such as a home camera or Bluetooth watch) to take a photo. The camera angle can be adjusted to capture unique features of the relative (such as scars on the hands, birthmarks on the arms, or jewelry on the chest), or nearby large furniture items or landmarks, allowing the user to manually identify the caller as a relative and handle the call with caution. (This is manual identification.)

[0122] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus the necessary general hardware platform, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present disclosure is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present disclosure.

[0123] An embodiment of the present disclosure further provides a computer-readable storage medium, in which a computer program is stored. The computer program is configured to execute the steps of any one of the above method embodiments when run.

[0124] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk.

[0125] An embodiment of the present disclosure further provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.

[0126] In an exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0127] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail here.

[0128] Obviously, those skilled in the art should understand that the modules or steps of the present disclosure described above can be implemented using a general-purpose computing device, they can be concentrated on a single computing device, or distributed across a network composed of multiple computing devices, they can be implemented using program code executable by the computing device, and thus, they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be performed in a different order than herein, or they can be fabricated into separate integrated circuit modules, or multiple modules or steps can be fabricated into a single integrated circuit module for implementation. Thus, the present disclosure is not limited to any particular combination of hardware and software.

[0129] The foregoing description is merely a preferred embodiment of the present disclosure and is not intended to limit the present disclosure. Those skilled in the art will readily appreciate that various modifications and variations of the present disclosure are possible. Any modifications, equivalent substitutions, or improvements made within the principles of the present disclosure shall be included within the scope of protection of the present disclosure.

Claims

1. A method for identifying a caller, comprising: The first terminal collects first characteristic information of a call object with which the first terminal is communicating, and determines whether the call object is a target object according to the first characteristic information; In the case where it is determined that the call object is the target object, sending a first instruction to a second terminal associated with the target object, wherein the first instruction is used to obtain call status information of the second terminal; Determine whether the current calling terminal in the call with the first terminal is the second terminal according to the acquired call status information of the second terminal.

2. The method according to claim 1, wherein: After determining whether the current calling terminal in conversation with the first terminal is the second terminal according to the acquired call status information of the second terminal, the method further includes: In the case where it is determined that the current call terminal is the second terminal, sending a second instruction to the second terminal, wherein the second instruction is used to instruct the second terminal to collect second feature information and provide feedback to the first terminal; Determine whether the current user of the second terminal is the target object according to the fed-back second characteristic information.

3. The method according to claim 1, wherein: After determining whether the current calling terminal in conversation with the first terminal is the second terminal according to the acquired call status information of the second terminal, the method further includes: In the case where it is determined that the current call terminal is the second terminal, sending a third instruction to a third terminal associated with the target object through the second terminal, wherein the third terminal is a device that is paired with the second terminal and successfully connected, and the third instruction is used to instruct the third terminal to collect second feature information and provide feedback to the first terminal; Determine whether the current user of the second terminal is the target object according to the fed-back second characteristic information.

4. The method according to claim 1, wherein: Determining whether the call object is a target object according to the acquired first feature information includes: The first feature information is compared with the pre-stored feature data of the target object to determine whether the call object is the target object, wherein the first feature information includes at least one of the following: the call object's mobile phone number, the call object's image information, and the call object's voiceprint information; and the feature data includes at least one of the following: the target object's appearance feature data, voiceprint feature data, and the mobile phone number associated with the target object.

5. The method according to claim 4, wherein: Comparing the first feature information with pre-stored feature data of the target object to determine whether the call object is the target object includes one of the following: In the case where the current call is a video call, the collected image information and / or voiceprint information of the call object is compared with the appearance feature data and / or voiceprint feature data in the pre-stored feature data of the target object to determine whether the call object is the target object; When the current call is a voice call, the collected mobile phone number and / or voiceprint information of the call object is compared with the mobile phone number and / or voiceprint feature data in the pre-stored feature data of the target object to determine whether the call object is the target object.

6. The method according to claim 1, wherein: Determining whether the current calling terminal in conversation with the first terminal is the second terminal according to the acquired call status information of the second terminal includes: determining whether the current call terminal is the second terminal according to whether the acquired call state information of the second terminal is consistent with the call state information of the current call terminal in call with the first terminal, wherein the call state information of the second terminal includes a factory identification of the second terminal; In the case where the current call is a video call, the call status information of the second terminal further includes one of the following: call connection status, an application in the call; In the case that the current call is a voice call, the call status information of the second terminal further includes one of the following: call connection status, and a mobile phone number of the current call partner of the second terminal.

7. The method according to claim 6, wherein: Also includes: When the factory identity of the second terminal is inconsistent with the current call status, and the rest of the call status information of the second terminal is consistent with the current call status, verification information is sent to the mobile phone number of the target object, and feedback information based on the verification information is used to determine again whether the call object is the target object based on the received mobile phone number of the target object.

8. The method according to claim 7, wherein: The verification information includes one of the following: a temporary verification code, a key window.

9. The method according to claim 7 or 8, wherein: Also includes: In the case where it is determined that the call object is not the target object, a prompt indicating that the current call object is a non-target object is displayed on the first terminal.

10. The method according to claim 1, wherein: After determining whether the current calling terminal in conversation with the first terminal is the second terminal according to the acquired call status information of the second terminal, the method further includes: When it is determined that the current call terminal is the second terminal, whether the current user of the second terminal is the target object is determined based on the connection status between the second terminal and a fourth terminal associated with the target object, wherein the fourth terminal is a device that is paired with the second terminal and successfully connected, and the connection status is obtained through the first instruction.

11. The method according to claim 10, wherein: Determining whether a current user of the second terminal is the target object according to a connection state between the second terminal and a fourth terminal associated with the target object comprises: When the second terminal and a fourth terminal associated with the target object are in a disconnected state, sending a fourth instruction to the second terminal, wherein the fourth instruction is used to instruct the second terminal to collect second feature information and provide feedback to the first terminal; Determine whether the current user of the second terminal is the target object according to the fed-back second characteristic information.

12. The method according to any one of claims 2, 3 and 11, wherein: The second characteristic information includes at least one of the following: image information, voiceprint information and surrounding environment information of the current user of the second terminal.

13. A computer-readable storage medium having a computer program stored therein, wherein: When the computer program is executed by a processor, the steps of the method described in any one of claims 1 to 12 are implemented.

14. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method described in any one of claims 1 to 12 when executing the computer program.

Images