Video call method and device, equipment and storage medium

Abstract

The invention provides a video call method and device, equipment and a storage medium, and the implementation scheme is as follows: determining a target permission level corresponding to a first user under the condition of obtaining a video call request sent by terminal equipment of the first user; determining a target video call function corresponding to the target permission level; and performing a video call with the first user based on the target video call function. Therefore, different users correspond to different permission levels, and different permission levels correspond to different video call functions, for example, when the user is a stranger and the permission level is the lowest, the video call function is a virtual character, that is, when the stranger requests a video call, the virtual character is used for carrying out the video call, so that the video call is realized. Therefore, the privacy of the user can be protected.

Description

Technical Field

[0001] The present application belongs to the field of video call technology, and in particular, relates to a video call method, device, equipment and storage medium. Background Art

[0002] With the update and iteration of communication technology, the idea of ​​the Internet of Things, where everything is connected, has entered all aspects of home life. In the field of smart homes, as smart products in furniture become increasingly popular, the comprehensive and humanized management of many smart home products has gradually become a pain point for users. As a result, the whole-house smart system centered on the smart central control screen has gradually become the first choice for smart home management equipment. The whole-house smart system can intelligently manage and control smart products in users' homes in batches, giving users a better operating experience. At present, the smart central control screens on the market often have the function of video calls, and video calls can be made with mobile users through the smart central control screen, but the existing smart central control screens cannot guarantee the privacy and security of users when making video calls. Summary of the invention

[0003] The embodiments of the present application provide a video call method, device, electronic device and storage medium, which can execute different target video call functions according to different users and ensure the privacy and security of users.

[0004] According to a first aspect of the present application, an embodiment of the present application provides a video calling method, including:

[0005] In the case of obtaining a video call request sent by a terminal device of a first user, determining a target permission level corresponding to the first user;

[0006] Determine a target video call function corresponding to the target permission level;

[0007] Conduct a video call with the first user based on the target video call function.

[0008] In some embodiments, upon obtaining a video call request sent by a terminal device of a first user, determining a target permission level corresponding to the first user includes:

[0009] In the case of obtaining a video call request sent by a terminal device of the first user, determining whether identification information of the first user is obtained;

[0010] When the identification information of the first user is obtained, identifying the first user based on the identification information;

[0011] A target permission level corresponding to the first user is determined based on a result obtained by the identification.

[0012] In some embodiments, when a video call request sent by a terminal device of the first user is obtained, determining whether identification information of the first user is obtained includes:

[0013] When a video call request sent by a terminal device of the first user is obtained, requesting the terminal device of the first user to enable permission of a collection device;

[0014] When the terminal device enables permission for the collection device, obtaining target information of the first user collected by the collection device;

[0015] It is determined whether identification information of the first user is acquired based on the target information of the first user.

[0016] In some embodiments, the identification information further includes: identity information, and the method further includes:

[0017] If it is determined based on the target information that the identification information of the first user has not been obtained, outputting first prompt information, where the first prompt information is used to prompt the first user to enter identity information;

[0018] Whether the identification information of the first user is obtained is determined based on whether the first user enters identity information.

[0019] In some embodiments, the identification information includes: at least one of: facial information and voiceprint information. When the identification information is facial information, the acquisition device includes: a camera. When the identification information is voiceprint information, the acquisition device includes: a microphone. When the identification information includes: facial information and voiceprint information, the acquisition device includes: a camera and a microphone. The target information includes: image information and sound information.

[0020] In some embodiments, the method further comprises:

[0021] When the preset trigger information is obtained, outputting second prompt information, wherein the second prompt information is used to prompt the second user to enter identification information;

[0022] When the identification information entered by the second user is obtained, a setting interface is output;

[0023] Acquiring setting information input through the setting interface, the setting information including the permission level corresponding to the identification information of the second user, and the video call function corresponding to the permission level;

[0024] Determine a target video call function corresponding to the target permission level based on the first corresponding relationship;

[0025] A target permission level corresponding to the first user is determined based on the second corresponding relationship.

[0026] In some embodiments, determining a target permission level corresponding to the first user based on the result obtained by the identification includes:

[0027] When the result of the identification is that the first user is a stranger, the target authority level of the first user is determined to be a minimum authority level, wherein the video call function corresponding to the minimum authority level includes: using a virtual image, using voice changing, and / or blurring the indoor environment during a video call.

[0028] According to a second aspect of the present application, an embodiment of the present application provides a video call device, including:

[0029] A first determination module is used to determine a target permission level corresponding to the first user when a video call request sent by a terminal device of the first user is obtained;

[0030] A second determination module is used to determine the target video call function corresponding to the target permission level;

[0031] A call module is used to make a video call with the first user based on the target video call function.

[0032] According to the third aspect of the present application, an embodiment of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the methods described above when executing the computer program.

[0033] According to a fourth aspect of the present application, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in any one of the above is implemented.

[0034] According to a fifth aspect of the present application, an embodiment of the present application provides a computer program product, which, when executed on a terminal device, enables the electronic device to execute any of the methods described above.

[0035] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0036] The video call method provided in the embodiment of the present application determines the target permission level corresponding to the first user when a video call request sent by the terminal device of the first user is obtained; determines the target video call function corresponding to the target permission level; and makes a video call with the first user based on the target video call function. Thus, by setting different permission levels for different users, different permission levels correspond to different video call functions. For example, when the user is a stranger, the permission level is the lowest. At this time, the video call function is a virtual character, that is, when a stranger requests a video call, a virtual character is used to make a video call, thereby protecting the user's privacy.

[0037] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0039] Figure 1 A schematic diagram of a video call implementation method provided for the implementation of this application;

[0040] Figure 2 A schematic diagram of the structure of a video call device provided in an embodiment of the present application;

[0041] Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0042] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0043] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or combinations thereof.

[0044] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0045] As used in the specification of this application and the appended claims, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to the video call arriving" depending on the context. Similarly, the phrases "if it is determined" or "if the video call is arrived" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce the video call is arrived" or "in response to the video call arriving" depending on the context.

[0046] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0047] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways.

[0048] Based on the technical problems of the related art, the embodiment of the present application provides a video call method that can be applied to mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), central control screens and other electronic devices. The embodiment of the present application does not impose any restrictions on the specific types of electronic devices. The functions implemented by the video call method provided in the embodiment of the present application can be implemented by calling program codes by the processor of the electronic device, wherein the program codes can be stored in a computer storage medium.

[0049] It should be noted that the following content will take the smart central control screen as an example to describe in detail the solution of the embodiment of the present application for easy understanding. The solution of the embodiment of the present application is not limited to only applicable to the smart central control screen.

[0050] The embodiment of the present application provides a video calling method. Figure 1 A schematic diagram of a video call implementation method provided for the implementation of this application, such as Figure 1 As shown, the video call method includes:

[0051] Step S101: upon obtaining a video call request sent by a terminal device of a first user, determining a target authority level corresponding to the first user.

[0052] In some embodiments of the present application, the electronic device may be a smart central control screen, and the first user is a user who sends a video call request to the electronic device. The first user's terminal device may include a smart phone, a tablet computer, etc., and the first user's terminal device may send a video call request to the smart central control screen of the electronic device through a network. This request may include the user identifier of the initiator of the call (such as a user name, device ID, etc.) and basic information for requesting to establish a video call.

[0053] In some embodiments of the present application, the smart central control screen will immediately start the identity authentication process after receiving the video call request. Specifically, request the camera and / or microphone permissions of the user's mobile device to capture the user's facial image and / or voice information in real time. As an example, facial feature extraction technology can be used to process the user's facial image to extract key feature points or feature vectors. Alternatively, voice voiceprint recognition technology can be used to compare and analyze the user's voice information to obtain the user's voiceprint features. It should be noted that if the automatic recognition fails due to poor environmental conditions (such as insufficient light or excessive noise), the electronic device can also prompt the user to manually enter a preset identity identification code or perform other forms of identity authentication.

[0054] In some embodiments of the present application, after completing the user identity verification, the electronic device will search for the corresponding user information in the database according to the verification result (such as user ID, facial features, voiceprint features or identity identification code). The user information includes the user's permission level setting, and the database includes user information associated with the holder of the electronic device.

[0055] In some embodiments of the present application, the electronic device can determine the target permission level corresponding to the first user. As an example, if the electronic device cannot identify the identity of the first user (for example, a stranger), or the identified user does not have the corresponding video call permission (such as being set as a blacklisted user), at this time, the user level is the lowest, and the electronic device may reject the video call request and send a corresponding prompt message to the first user. If the electronic device can identify the identity of the first user (friend or relative), the electronic device can determine the target permission level corresponding to the first user based on the user information. For example, relatives can have a high-level permission level, friends have a relatively low permission level, and different permission levels have different video call functions.

[0056] In the embodiment of the present application, through this step, it is possible to ensure that the target permission level corresponding to the first user is accurately determined when a video call request is received, providing a basis for subsequent video call function selection and privacy policy application.

[0057] Step S102, determining a target video call function corresponding to a target permission level.

[0058] In some embodiments of the present application, the electronic device stores a correspondence between permission levels and video call functions, and this correspondence can be stored in a database or configuration file of the electronic device so that it can be quickly retrieved when needed. The correspondence may include a set of multiple permission levels (such as family, friends, strangers, etc.) and the video call functions corresponding to each level.

[0059] In some embodiments of the present application, there is a one-to-one correspondence between the target permission level and the target video call function, and the electronic device can select and determine the corresponding target video call function based on the determined target permission level. Among them, the video call function may include but is not limited to: unlimited video calls, blurred indoor environment, use of Q-version images, voice change, etc., and the target video call function is one or more of the video call functions. It should be noted that if there are multiple function options, the electronic device can further screen and determine according to the preset priority or user preference.

[0060] In the embodiment of the present application, through this step, it is possible to ensure that the corresponding video call function is selected and determined according to the target authority level of the first user, providing necessary support and guarantee for the subsequent call process.

[0061] Step S103: Conduct a video call with the first user based on the target video call function.

[0062] In some embodiments of the present application, after determining the target video call function and configuring the corresponding call parameters, the electronic device will attempt to establish a video call connection with the terminal device of the first user. As an example, the electronic device can establish a video call connection with the terminal device of the first user by negotiating a network protocol, opening a port, establishing a data stream, etc. If the connection is successfully established, the electronic device will send a confirmation message to the first user and prepare to start the video call. Once the connection is established, the electronic device will apply the corresponding processing effect in real time according to the target video call function determined in step S102. For example, if the target function includes background blur, the electronic device will process the video stream sent by the first user to blur the environment behind it. If the target function involves audio processing, such as voice changing, the system will also adjust the audio stream accordingly.

[0063] The video call method provided in the embodiment of the present application determines the target permission level corresponding to the first user when a video call request sent by the terminal device of the first user is obtained; determines the target video call function corresponding to the target permission level; and makes a video call with the first user based on the target video call function. Thus, by setting different permission levels for different users, different permission levels correspond to different video call functions. For example, when the user is a stranger, the permission level is the lowest. At this time, the video call function is a virtual character, that is, when a stranger requests a video call, a virtual character is used to make a video call, thereby protecting the user's privacy.

[0064] According to some embodiments of the present application, through the above steps, the video call method provided by the present application can automatically select and execute the corresponding video call function according to the user's authority level, thereby ensuring a convenient video call experience while protecting the privacy of home users.

[0065] According to some embodiments of the present application, the following are some detailed descriptions of determining a target permission level corresponding to a first user.

[0066] In some embodiments, step S101, upon obtaining a video call request sent by a terminal device of a first user, determining a target permission level corresponding to the first user includes:

[0067] Step S1011, when a video call request sent by a terminal device of the first user is obtained, determining whether identification information of the first user is obtained.

[0068] In this step, taking the smart central control screen as an example, when the smart central control screen receives a video call request sent from the terminal device of the first user, it first checks whether the request contains the identification information of the first user. Such identification information can be user name, password, device ID, facial feature data, voiceprint feature data, or any other information that can uniquely identify the user.

[0069] In this step, if the identification information is not obtained, the electronic device may need to prompt the user to enter or authorize access to the information, or process the request according to preset default rules (for example, treating the user as an unauthorized user).

[0070] Step S1012: When the identification information of the first user is obtained, the first user is identified based on the identification information.

[0071] In this step, once the identification information of the first user is obtained, the electronic device will use the information to identify the user. As an example, the identification information can be compared and analyzed with the user information stored in the electronic device to identify the first user.

[0072] In this step, for biometric identification methods based on facial features or voiceprint features, the electronic device will use facial recognition or voiceprint recognition technology to authenticate the user. It should be noted that no matter which identification method is used, the electronic device needs to ensure the accuracy and security of the identification process to prevent unauthorized access.

[0073] Step S1013: determining a target authority level corresponding to the first user based on the result identified in step S012.

[0074] In this step, after completing the user identification, the electronic device will search the database for the corresponding permission level setting according to the identification result (ie, the user identity).

[0075] In this step, the permission level setting may include multiple levels (such as family, friends, visitors, etc.), each level corresponds to different video call functions and privacy policies.

[0076] In this step, the electronic device can determine the target permission level corresponding to the first user according to the found permission level setting, so as to apply corresponding functions and policies in the subsequent video call process.

[0077] In these embodiments, through the above steps, the electronic device can more accurately determine the target permission level corresponding to the first user, provide necessary support and guarantee for the subsequent video call process, and at the same time, protect the user's privacy and security.

[0078] According to the present application, determining the target permission level corresponding to the first user also includes a process of interacting with a collection device (such as a camera, microphone, etc.) on the first user's terminal device.

[0079] In some embodiments, step S1011, when a video call request sent by a terminal device of a first user is obtained, determining whether identification information of the first user is obtained includes:

[0080] Step S10111: upon receiving a video call request sent by a terminal device of the first user, request the terminal device of the first user to enable permission for the acquisition device.

[0081] In this step, when the electronic device receives a video call request sent from the terminal device of the first user, the electronic device can request access to the acquisition device (such as a camera and / or a microphone) on the terminal device of the first user. Specifically, the electronic device sends a request to the terminal device of the first user, requesting it to enable the permissions of these acquisition devices, and the first user can confirm on his terminal device whether to allow the electronic device to access.

[0082] Step S10112: When the terminal device enables the permission of the collection device, the target information of the first user collected by the collection device is obtained.

[0083] In this step, if the first user agrees to enable the collection device permission, the collection devices such as the camera and microphone on the terminal device will be activated and start to collect the target information of the first user. This information may include the user's facial image, sound data, etc. In this case, the electronic device will obtain this information from these collection devices in real time and prepare for subsequent identity verification or recognition processing.

[0084] Step S10113: determine whether the identification information of the first user is obtained based on the target information of the first user.

[0085] In this step, after acquiring the target information of the first user, the electronic device will analyze and process the information to determine whether the identification information of the first user has been successfully acquired.

[0086] In this step, the electronic device can compare the target information with the identification information of the user stored thereon (such as facial feature comparison, voiceprint comparison, etc.) to verify the identity of the first user. If the target information can match the identification information of the user in the electronic device, then it can be considered that the identification information of the first user has been obtained.

[0087] In this step, a similarity threshold can be set (this threshold can be adjusted according to actual conditions). If the comparison result reaches a certain similarity threshold, the electronic device can determine that the user's identification information has been successfully obtained and continue to perform subsequent steps (such as determining the user's authority level). If the comparison result does not meet the similarity threshold, the electronic device will determine that the recognition has failed and may require the user to re-provide identification information or take other identity authentication measures.

[0088] In these embodiments, through the above steps, the process of obtaining user identification information during the video call request can be handled more carefully, ensuring that the electronic device can legally and securely access the acquisition device on the user terminal device and effectively obtain the user's identification information, thereby providing support for subsequent identity authentication and authority determination.

[0089] According to this application, identification information includes facial information and voiceprint information. Different identification information has corresponding collection devices and target information. The following is a detailed explanation based on this information:

[0090] In some embodiments, the identification information includes: at least one of: facial information and voiceprint information. When the identification information is facial information, the collection device includes: a camera. When the identification information is voiceprint information, the collection device includes: a microphone. When the identification information includes: facial information and voiceprint information, the collection device includes: a camera and a microphone. The target information includes: image information and sound information.

[0091] In this step, facial information refers to the facial image of the user captured by the camera. Voiceprint information refers to the voice data of the user captured by the microphone. When the identification information is facial information, the acquisition device mainly includes a camera. The camera is responsible for capturing the facial image of the user and converting it into a digital signal for system processing. When the identification information is voiceprint information, the acquisition device mainly includes a microphone. The microphone is responsible for capturing the voice data of the user and converting it into an audio signal for system analysis. When the identification information includes both facial information and voiceprint information, the acquisition device needs to include both a camera and a microphone. These two devices work together to capture the facial image and voice data of the user, respectively, to provide more comprehensive user identification information.

[0092] Correspondingly, target information refers to the specific data obtained through the acquisition device for user identification. When the acquisition device is a camera, the target information mainly includes image information. These image information records the user's facial features and is the basis of facial recognition technology. When the acquisition device is a microphone, the target information mainly includes sound information. These sound information contains the user's voice features and is the key to voiceprint recognition technology. When the acquisition device includes both a camera and a microphone, the target information includes both image information and sound information, providing the system with a richer user identification dimension.

[0093] In these embodiments, by clarifying the type of identification information, the corresponding collection device, and the specific content of the target information, the system can more accurately obtain and process the user identification information, thereby improving the accuracy and security of identity verification. At the same time, this also provides a reliable basis for subsequent authority determination and video call process.

[0094] According to this application, the identification information may include identity information in addition to facial information and voiceprint information, so that it can cope with the situation where the user's identity cannot be directly identified based on image information and sound information. The following is a detailed explanation of these steps:

[0095] In some embodiments, the identification information further includes identity information, and the video call method further includes:

[0096] Step S104: when it is determined based on the target information that the identification information of the first user has not been obtained, output first prompt information, where the first prompt information is used to prompt the first user to enter identity information.

[0097] In this step, when the electronic device cannot determine the identification information of the first user based on the target information (such as the image information and sound information collected by the camera and the microphone), the electronic device can output the first prompt information, wherein the first prompt information is used to inform the first user that the current identification process has failed, and prompt the user to enter the identity information for identity verification.

[0098] In this step, the identity information may include but is not limited to information that can uniquely identify the user, such as ID card number, mobile phone number, etc. By entering this information, the user can complete identity verification without relying on biometric technology.

[0099] Step S105: determining whether the identification information of the first user is obtained based on whether the first user enters the identity information.

[0100] In this step, after outputting the first prompt message, the electronic device will wait for the response of the first user. If the first user enters the identity information as prompted, the electronic device will verify the information. The verification process may include checking the integrity and accuracy of the information and whether it matches the user information stored in the system. If the verification is successful, the electronic device will determine that it has successfully obtained the identification information of the first user (this time through identity information rather than biometric information), and can continue to perform subsequent steps (such as determining the user's authority level). If the verification fails (for example, because the user entered incorrect information or the information does not exist in the system), the electronic device may output another prompt message, requiring the user to re-enter the information or take other identity authentication measures.

[0101] In these embodiments, by introducing the steps of entering and verifying identity information, the electronic device can provide an alternative authentication method when biometric technology cannot directly identify the user's identity. This helps to improve the flexibility of the system and user experience, ensuring that identity authentication and permission control can be completed even under certain conditions (such as user face obstruction, unclear voice, etc.).

[0102] According to the present application, the video call method also includes the process of user management and permission control, especially the joining and permission setting of the second user. The following is a detailed explanation:

[0103] In some embodiments, the video call method further includes:

[0104] Step S106, when the preset trigger information is obtained, outputting second prompt information, the second prompt information is used to prompt the second user to enter identification information;

[0105] In this step, when the electronic device receives the preset trigger information (this trigger information may be triggered by the administrator, the system internal logic or other users), the electronic device will output the second prompt information. This prompt information is used to inform the second user (i.e., the newly added user or the user who needs to update the permissions) that the identification information needs to be entered for identity authentication and permission setting.

[0106] Step S107: when the identification information entered by the second user is obtained, a setting interface is output.

[0107] Step S108, obtaining setting information input through the setting interface, the setting information including the permission level corresponding to the identification information of the second user, and the video call function corresponding to the permission level.

[0108] In the above steps, after successfully acquiring the identification information entered by the second user, the electronic device will output a setting interface. This setting interface allows the administrator or a user with corresponding authority to set the permission level corresponding to the identification information for the second user, and set the video call functions corresponding to different permission levels. For example, the administrator can assign different video call quality, time limit, and permission to access a specific video call room to users of different levels.

[0109] Step S109, when the setting information is obtained, a first correspondence between the permission level and the video call function is established, and a second correspondence between the second user and the permission level is established.

[0110] Step S110: determining a target video call function corresponding to the target authority level based on the first corresponding relationship.

[0111] Step S111: determining a target authority level corresponding to the first user based on the second corresponding relationship.

[0112] In the above steps, after obtaining the setting information (these setting information include the correspondence between the permission level and the video call function, and the correspondence between the second user and the permission level), the electronic device will establish these correspondences and store them in a database for subsequent use.

[0113] In the above steps, the first correspondence relationship is the correspondence relationship between the permission level and the video call function. This correspondence relationship defines the video call functions that users of different permission levels can use.

[0114] In the above steps, the second corresponding relationship is the corresponding relationship between the second user and the authority level. This corresponding relationship determines the authority level to which each user belongs.

[0115] In this step, based on these correspondences, when the first user (or any other user) initiates a video call request, the electronic device can first determine the target permission level corresponding to the user based on the second correspondence, and then determine the target video call function corresponding to the target permission level based on the first correspondence. In this way, the system can restrict or allow the user to use a specific video call function based on the user's permission level.

[0116] In these embodiments, through these steps, the system can flexibly manage the relationship between the user's identification information, permission level, and video call function, thereby ensuring the security and controllability of the video call process.

[0117] In some embodiments, step S1013, determining a target permission level corresponding to the first user based on the result identified in step S1012, includes:

[0118] Step S10131, when the identification result shows that the first user is a stranger, determine the target authority level of the first user as the lowest authority level, wherein the video call functions corresponding to the lowest authority level include: using a virtual image, using voice changer, and / or blurring the indoor environment during a video call.

[0119] In this step, when the electronic device determines through an identification process (which may include facial recognition, voiceprint recognition or other biometric technologies) that the first user is an unfamiliar user, that is, the user's identification information does not match any information of registered users in the system, the electronic device will adopt a conservative strategy to protect the security and privacy of the system.

[0120] In this case, the electronic device automatically determines the target permission level of the first user as the minimum permission level. The minimum permission level is a preset, limited permission level that limits the video call functions that the user can use to reduce potential risks and adverse consequences.

[0121] In this step, the video call function corresponding to the lowest permission level does not disclose the user's real identity or sensitive information. For example, the video call function corresponding to the lowest permission level can use a virtual image, use voice changer, and / or blur the indoor environment.

[0122] In this step, the use of virtual images allows users to use preset virtual images instead of real facial images during video calls. This can protect the privacy of users and avoid identity leakage.

[0123] In this step, voice changing is used, which allows users to change their voice characteristics during video calls, making it difficult for others to recognize the user's real voice. This also helps protect the user's privacy.

[0124] In this step, the indoor environment is blurred, that is, during a video call, the user's indoor environment is blurred to hide the specific details and layout of the room. This can prevent others from obtaining the user's personal information or living habits by observing the indoor environment.

[0125] In these embodiments, by limiting unfamiliar users to use only these limited video call functions, the electronic device can still allow them to conduct basic video communications while protecting user privacy and security. This strategy helps balance the openness and security requirements of the system.

[0126] Based on the aforementioned embodiments, the embodiments of the present application further provide a video call method, in which the smart central control screen can extract the identity recognition features of the target user through the facial feature extraction function and the voice and voiceprint recognition auxiliary function, and bind to the target user. When a mobile user needs to make a video call with the smart central control screen, the mobile terminal can assist in identifying whether the user's identity information matches the target user, thereby determining the identity authority of the mobile user and executing the corresponding video call privacy and security policy. Through the above, the smart central control screen not only realizes the accurate identity recognition and binding of the target user, but also can perform effective identity authentication and privacy protection when the mobile user makes a video call with the central control screen. In this way, it can provide users with a more secure, convenient and personalized video communication experience.

[0127] Another video calling method provided in an embodiment of the present application includes:

[0128] S01: Enter home user information.

[0129] Hardware equipment preparation: The home smart central control screen integrates necessary hardware equipment such as microphones, cameras, speakers, etc., providing basic conditions for video calls and identity authentication.

[0130] Image recognition and voice recording: When a user turns on the video call function, the system will guide the user to record a video, which is for the subsequent facial feature extraction and to verify the authenticity of the user. At the same time, the user is also required to record a fixed sentence in the video for voice and voiceprint recognition.

[0131] Multi-platform entry: Considering user convenience, this operation can not only be completed on the central control screen, but also on mobile devices through the corresponding application.

[0132] S02: User feature information recording and permission setting.

[0133] Facial feature and voiceprint recognition: The system uses advanced facial feature extraction technology and voiceprint recognition technology to extract facial features and voiceprint information from the user's recorded video as the user's unique identification mark.

[0134] Identity labeling and identification code generation: Users can manually label the identity of the entrant (such as family, friends, etc.) on the central control screen, and the system will generate a unique identification code for each user based on this information.

[0135] Privacy permission classification: Users can set different video call privacy permissions for users of different identities according to their needs. For example, family members can enjoy the highest level of permissions, including unlimited video call functions; friends are second, and strangers may have their permissions restricted.

[0136] Users can set up video call functions with different permission levels on the smart central control screen (for example, when video calling with strangers, use a Q-version image, change the voice, blur the indoor environment, etc.; when video calling with family members, the above restrictions are not required).

[0137] S03: Mobile user video call identity authentication and permission judgment.

[0138] When other users initiate a video call to the home smart central control screen through a video call on a mobile device, the cloud platform will request the camera and microphone permissions of the user's mobile device, record a video of the mobile user's use during the video call, and intelligently determine the mobile user's permission level by comparing the facial features and voiceprint information of the user whose identity information has been entered. If the mobile user's environment is noisy or the lighting is poor, the mobile user can also manually enter the identity identification code to determine the permission. If the mobile user's facial features and voiceprint information cannot be matched with the entered user feature information, or the user refuses to enter the identity identification code, the mobile user's identity permission level will be determined to be the lowest permission level (stranger), and a low-level video call function setting will be performed to protect the privacy and security of home users under the video call function.

[0139] The method provided in the embodiment of the present application provides intelligence, personalization and security of the home smart central control screen during video calls, which provides users with a convenient and efficient communication experience while ensuring the privacy and security of the home environment.

[0140] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0141] According to the aforementioned embodiments, the embodiments of the present application provide a video call device, and the modules included in the device, as well as the units included in the modules, can be implemented by a processor in a computer device; of course, they can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU, Central Processing Unit), a microprocessor (MPU, Microprocessor Unit), a digital signal processor (DSP, Digital Signal Processing) or a field programmable gate array (FPGA, Field Programmable Gate Array), etc.

[0142] The embodiment of the present application provides a video call device, Figure 2 A schematic diagram of the structure of a video call device provided in an embodiment of the present application is shown in FIG. Figure 2 As shown, the video call device 300 includes:

[0143] A first determination module 301 is used to determine a target permission level corresponding to a first user when a video call request sent by a terminal device of the first user is obtained;

[0144] A second determination module 302 is used to determine a target video call function corresponding to the target permission level;

[0145] The call module 303 is used to make a video call with the first user based on the target video call function.

[0146] In some embodiments, upon obtaining a video call request sent by a terminal device of a first user, determining a target permission level corresponding to the first user includes:

[0147] In the case of obtaining a video call request sent by a terminal device of the first user, determining whether identification information of the first user is obtained;

[0148] When the identification information of the first user is obtained, identifying the first user based on the identification information;

[0149] A target permission level corresponding to the first user is determined based on the identification result.

[0150] In some embodiments, when a video call request sent by a terminal device of the first user is obtained, determining whether identification information of the first user is obtained includes:

[0151] When a video call request sent by a terminal device of the first user is obtained, requesting the terminal device of the first user to enable permission of a collection device;

[0152] When the terminal device enables permission for the collection device, obtaining target information of the first user collected by the collection device;

[0153] It is determined whether identification information of the first user is acquired based on the target information of the first user.

[0154] In some embodiments, the identification information includes: at least one of: facial information and voiceprint information. When the identification information is facial information, the acquisition device includes: a camera. When the identification information is voiceprint information, the acquisition device includes: a microphone. When the identification information includes: facial information and voiceprint information, the acquisition device includes: a camera and a microphone. The target information includes: image information and sound information.

[0155] In some embodiments, the identification information further includes: identity information, and the video calling device 300 is further used to:

[0156] If it is determined based on the target information that the identification information of the first user has not been obtained, outputting first prompt information, where the first prompt information is used to prompt the first user to enter identity information;

[0157] Whether the identification information of the first user is obtained is determined based on whether the first user enters identity information.

[0158] In some embodiments, the video calling device 300 is further configured to:

[0159] When the preset trigger information is obtained, outputting second prompt information, wherein the second prompt information is used to prompt the second user to enter identification information;

[0160] When the identification information entered by the second user is obtained, a setting interface is output, wherein the setting interface is used to set the permission level corresponding to the identification information of the second user and the video call function corresponding to the permission level;

[0161] Acquiring setting information input through the setting interface, the setting information including the permission level corresponding to the identification information of the second user, and the video call function corresponding to the permission level;

[0162] In case of acquiring the setting information, establishing a first correspondence between the permission level and the video call function, and establishing a second correspondence between the second user and the permission level;

[0163] Based on the first corresponding relationship, the target video call function corresponding to the target authority level is determined; based on the second corresponding relationship, the target authority level corresponding to the first user is determined.

[0164] In some embodiments, determining a target permission level corresponding to the first user based on the result obtained by the identification includes:

[0165] When the result of the identification is that the first user is a stranger, the target authority level of the first user is determined to be a minimum authority level, wherein the video call function corresponding to the minimum authority level includes: using a virtual image, using voice changing, and / or blurring the indoor environment during a video call.

[0166] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0167] in addition, Figure 2 The video call device shown can be a software unit, a hardware unit, or a combination of software and hardware units built into an existing electronic device, or can be integrated into the electronic device as an independent pendant, or can exist as an independent terminal device.

[0168] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0169] In the scheme of this application, the collection, storage, use, processing, transmission and disclosure of user personal information involved are in compliance with the relevant laws and regulations and do not hinder social morality and public interests.

[0170] Figure 3 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 3 As shown, the electronic device 3 of this embodiment may include: at least one processor 30 ( Figure 3Only one processor 30 is shown in the figure), a memory 31, and a computer program 32 stored in the memory 31 and executable on at least one processor 30. When the processor 30 executes the computer program 32, the steps in any of the above-mentioned method embodiments are implemented. For example, Figure 1 Steps S101 to S103 in the illustrated embodiment. Alternatively, when the processor 30 executes the computer program 32, the functions of each module / unit in the above-mentioned device embodiments are realized, for example Figure 2 Functions of modules 301 to 303 are shown.

[0171] Exemplarily, the computer program 32 may be divided into one or more modules / units, one or more modules / units are stored in the memory 31, and are executed by the processor 30 to complete the solution in the embodiment of the present application. One or more modules / units may be a series of computer program 32 instruction segments that can complete specific functions, and the instruction segments are used to describe the execution process of the computer program 32 in the electronic device 3.

[0172] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0173] An embodiment of the present application provides a computer program product. When the computer program product runs on an electronic device, the electronic device can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0174] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. According to this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device capable of carrying the computer program code to the terminal, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0175] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0176] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0177] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0178] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0179] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A video calling method, characterized in that: include: In the case of obtaining a video call request sent by a terminal device of a first user, determining a target permission level corresponding to the first user; Determine a target video call function corresponding to the target permission level; Conduct a video call with the first user based on the target video call function.

2. The method according to claim 1, characterized in that The step of determining a target permission level corresponding to the first user upon obtaining a video call request sent by a terminal device of the first user includes: In the case of obtaining a video call request sent by a terminal device of the first user, determining whether identification information of the first user is obtained; When the identification information of the first user is obtained, identifying the first user based on the identification information; A target permission level corresponding to the first user is determined based on a result obtained by the identification.

3. The method according to claim 2, characterized in that The step of determining whether identification information of the first user is obtained when a video call request sent by a terminal device of the first user is obtained includes: When a video call request sent by a terminal device of the first user is obtained, requesting the terminal device of the first user to enable permission of a collection device; When the terminal device enables permission for the collection device, obtaining target information of the first user collected by the collection device; It is determined whether identification information of the first user is acquired based on the target information of the first user.

4. The method according to claim 3, characterized in that The identification information includes: identity information, and the method further includes: If it is determined based on the target information that the identification information of the first user has not been obtained, outputting first prompt information, where the first prompt information is used to prompt the first user to enter identity information; Whether the identification information of the first user is obtained is determined based on whether the first user enters identity information.

5. The method according to any one of claims 2 to 4, characterized in that: The identification information includes: at least one of: facial information and voiceprint information. When the identification information is facial information, the acquisition device includes: a camera. When the identification information is voiceprint information, the acquisition device includes: a microphone. When the identification information includes: facial information and voiceprint information, the acquisition device includes: a camera and a microphone. The target information includes: image information and sound information.

6. The method according to any one of claims 2 to 4, characterized in that: The method further comprises: When the preset trigger information is obtained, outputting second prompt information, wherein the second prompt information is used to prompt the second user to enter identification information; When the identification information entered by the second user is obtained, a setting interface is output; Acquiring setting information input through the setting interface, the setting information including the permission level corresponding to the identification information of the second user, and the video call function corresponding to the permission level; In case of acquiring the setting information, establishing a first correspondence between the permission level and the video call function, and establishing a second correspondence between the second user and the permission level; Based on the first corresponding relationship, the target video call function corresponding to the target authority level is determined; based on the second corresponding relationship, the target authority level corresponding to the first user is determined.

7. The method according to any one of claims 2 to 4, characterized in that: The determining a target permission level corresponding to the first user based on the result obtained by the identification includes: When the result of the identification is that the first user is a stranger, the target authority level of the first user is determined to be a minimum authority level, wherein the video call function corresponding to the minimum authority level includes: using a virtual image, using voice changing, and / or blurring the indoor environment during a video call.

8. A video call device, characterized in that: include: A first determination module is used to determine a target permission level corresponding to the first user when a video call request sent by a terminal device of the first user is obtained; A second determination module is used to determine the target video call function corresponding to the target permission level; A call module is used to make a video call with the first user based on the target video call function.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images