Voiceprint unlocking method, electronic device, chip, storage medium and program product

Abstract

The present application discloses a voiceprint unlocking method, electronic device, chip, storage medium and program product, which relates to the technical field of electronic devices, including: when the electronic device is in a functionally restricted state, obtaining an unlocking voice. The functionally restricted state includes the functional restriction of system services in the electronic device or the functional restriction of applications in the electronic device. If the electronic device obtains the unlocking voices of at least two users within a first time period, voiceprint recognition is performed on the unlocking voices of each user respectively to determine the predicted age of each user. If the predicted age of two of the at least two users meets the unlocking condition, the electronic device exits the functionally restricted state. In this solution, at least two users participate in voiceprint unlocking, which avoids the problem of poor supervision when a single user unlocks by himself, and can play a role in mutual supervision; the two users who perform voiceprint unlocking are both users whose ages meet the unlocking condition, which can further improve the reliability of voiceprint unlocking.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of electronic devices, and in particular to a voiceprint unlocking method, electronic device, chip, storage medium, and program product. Background Art

[0002] With the development of electronic devices, youth mode (also known as underage mode) has been set for some electronic device usage scenarios to prevent minors from using them for extended periods of time. Youth mode is a network protection mechanism that provides a time-limited, safe, and healthy online environment for minors. When youth mode is enabled on an electronic device, all or some functions in that usage scenario are locked, and these locked functions are unavailable.

[0003] After exiting the youth mode, that is, unlocking the youth mode, all or part of the functions of the electronic device are updated from a locked state to an unlocked state, thereby enabling the use of corresponding functions of the electronic device in the locked state.

[0004] Existing methods for unlocking the youth mode, such as digital password verification, are easily cracked, rendering the youth mode's supervisory function ineffective. Therefore, a more reliable method for unlocking the youth mode is urgently needed. Summary of the Invention

[0005] The embodiments of the present application provide a voiceprint unlocking method, electronic device, chip, storage medium, and program product. When unlocking an electronic device from a restricted state, at least two users participate in the voiceprint unlocking process, avoiding the problem of insufficient supervision when a single user unlocks the device on their own and ensuring mutual supervision. Both users performing voiceprint unlocking are users whose ages meet the unlocking requirements, further improving the reliability of voiceprint unlocking. Furthermore, the voiceprint unlocking method of this solution is used to identify users of different age groups and determine whether to perform voiceprint unlocking based on age. This eliminates the need for voiceprint registration in advance to establish a voiceprint identity database for identity verification. This simplifies the voiceprint unlocking process while avoiding the limitations of using registered voiceprints for voiceprint unlocking.

[0006] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions.

[0007] In a first aspect, a voiceprint unlocking method is provided, the method comprising:

[0008] When the electronic device is in a function-restricted state, obtain the unlocking voice.

[0009] The function-limited state includes the function-limited system service in the electronic device or the function-limited application in the electronic device.

[0010] If the electronic device obtains unlocking voices of at least two users within the first time period, voiceprint recognition is performed on the unlocking voices of each user to determine the predicted age of each user.

[0011] If the predicted ages of two of the at least two users meet the unlocking condition, the electronic device exits the function-restricted state.

[0012] In this application, when removing the restricted function state of an electronic device, at least two users participate in voiceprint unlocking, avoiding the problem of insufficient supervision when a single user unlocks the device on their own and ensuring mutual supervision. Both users performing voiceprint unlocking are users whose ages meet the unlocking requirements, further improving the reliability of voiceprint unlocking. Furthermore, the voiceprint unlocking method in this solution is used to identify users of different age groups and determine whether to perform voiceprint unlocking based on age. There is no need to register voiceprints in advance to establish a voiceprint identity database for identity verification. This simplifies the voiceprint unlocking process while avoiding the limitations of using registered voiceprints for voiceprint unlocking.

[0013] In a possible implementation of the first aspect, the predicted ages of the two users satisfy the unlocking condition, including:

[0014] The age difference between the predicted ages of the two users is greater than or equal to the difference threshold.

[0015] Alternatively, the predicted age of one of the two users is within a first age range, and the predicted age of the other of the two users is within a second age range; the first age range and the second age range do not overlap.

[0016] In this application, the ages of the two users meet the unlocking conditions, which means that there is an adult and a minor among the two users. Taking into account the situation when the electronic device is in a functionally restricted state, including the situation for minors, also includes the situation for adults. When performing voiceprint unlocking, ensuring that at least one minor and at least one adult are present to participate in the unlocking together can achieve the purpose of mutual supervision of voiceprint unlocking. Regardless of whether the target of the electronic device in a functionally restricted state is an adult or a minor, the reliability of voiceprint unlocking is improved to a certain extent. Especially for some unlocking scenarios that require the protection of privacy information, it can further ensure that the device is unlocked under mutual supervision, reducing the risk of privacy leakage.

[0017] In another possible implementation of the first aspect, the method further includes:

[0018] When the electronic device is in a function-restricted state, if a first unlocking voice of a first user is acquired within a first time period, a first prompt message is output, wherein the first prompt message is used to prompt a user whose age meets the unlocking condition to participate in the unlocking.

[0019] If the electronic device receives a second unlocking voice of the second user within the second time period, the electronic device performs voiceprint recognition on the second unlocking voice to determine the predicted age of the second user.

[0020] If the predicted age of the first user and the predicted age of the second user meet the unlocking condition, the electronic device exits the function-restricted state.

[0021] In the present application, for the situation where the electronic device may only receive the unlocking voice of one user within the first period of time, the electronic device can output a prompt message to prompt the user that other users whose ages meet the unlocking conditions need to participate in the unlocking. This can more intuitively express to the user the requirement that at least two users work together to perform voiceprint unlocking. The voiceprint unlocking by at least two users has the effect of joint supervision, making the unlocking of the electronic device in a function-restricted state more reliable.

[0022] In another possible implementation of the first aspect, the electronic device includes multiple function-restricted states, and the function-restricted states correspond to target users of age groups with unlocking authority.

[0023] The method further includes:

[0024] When the electronic device is in a function-restricted state, if a third unlocking voice of a third user is obtained within a first time period, and the third user is determined to be a target user corresponding to the function-restricted state based on the predicted age of the third user, the electronic device exits the function-restricted state.

[0025] In this application, each restricted function state corresponds to a target user class with unlocking permission. For example, if the electronic device is a smart TV and is in a restricted function state in youth mode, and the user targeted by the restricted function state is a minor, then the target user class for the restricted function state is an adult. For example, if the electronic device is a private device owned by a minor and is in a restricted function state, and the user targeted by the restricted function state is another adult, then the target user class for the restricted function state is the owner of the electronic device (the minor).

[0026] In this application, for the situation where the electronic device may only receive the unlocking voice of one user within the first period of time, if the electronic device determines that the one user is a target user in a function-restricted state, the electronic device directly performs voiceprint unlocking, which can improve the efficiency of voiceprint unlocking, save the time of voiceprint unlocking, and further optimize the limitation of requiring two users to participate in voiceprint unlocking in some special scenarios.

[0027] In another possible implementation of the first aspect, the method further includes:

[0028] If the electronic device determines the target user corresponding to the third user's non-function-restricted state based on the predicted age of the third user, the electronic device outputs a second prompt message, wherein the second prompt message is used to prompt the target user whose age matches that of the third user to participate in unlocking.

[0029] If the electronic device receives a fourth unlocking voice of the fourth user within the third time period, the electronic device performs voiceprint recognition on the fourth unlocking voice to determine the predicted age of the fourth user.

[0030] If the predicted age of the third user and the predicted age of the fourth user meet the unlocking condition, the electronic device exits the function-restricted state.

[0031] In the present application, for the situation where the electronic device may only receive the unlocking voice of one user within the first period of time, if the electronic device determines that the one user is not the target user in the function-restricted state, the electronic device outputs a prompt message to prompt the user that other users whose ages meet the unlocking conditions need to participate in the unlocking. This can more intuitively express to the user the requirement that at least two users work together to perform voiceprint unlocking. The voiceprint unlocking by at least two users has the effect of joint supervision, making the unlocking of the function-restricted state of the electronic device more reliable.

[0032] In another possible implementation of the first aspect, the electronic device includes multiple function-restricted states, and the function-restricted states correspond to target users of age groups with unlocking authority.

[0033] The method further includes:

[0034] When the electronic device is in a restricted function state, if a fifth unlocking voice message from a fifth user is received within a first time period, and the fifth user is determined to be a target user for the restricted function state based on the predicted age of the fifth user, the electronic device performs security verification on the fifth user, including password verification.

[0035] When the fifth user passes the security verification, the electronic device exits the function-restricted state.

[0036] In this application, if the electronic device receives only one user's unlocking voice within a first time period and determines that the user is a target user in a function-restricted state, the electronic device can further perform security verification on the target user in the function-restricted state. If the security verification is passed, the electronic device performs voiceprint unlocking. Since the target user is a user with unlocking authority in the function-restricted state, the electronic device determines that the user corresponding to the unlocking voice is the target user, and if the target user passes the security verification, the electronic device performs voiceprint unlocking, further improving the reliability of unlocking the electronic device in the function-restricted state.

[0037] In another possible implementation of the first aspect, the method further includes:

[0038] When the electronic device is in a function-restricted state, the electronic device obtains the question voice of the sixth user in response to the interactive unlocking operation.

[0039] The electronic device performs voiceprint recognition on the questioning voice to determine the predicted age of the sixth user.

[0040] If the predicted age of the sixth user is within the first age range, the electronic device performs content recognition on the question voice to obtain a first question content corresponding to the question voice.

[0041] If the electronic device receives the answer voice of the seventh user within the fourth time period, the electronic device performs content recognition on the answer voice to obtain the first answer content.

[0042] If the first answer content matches the first question content, the electronic device exits the function-restricted state.

[0043] In this application, in interactive unlocking mode, the voice of a parent whose age is predicted to be in the first age range is used as the question voice, and the voice of another user is used as the answer voice. Voiceprint unlocking in interactive unlocking mode based on the question voice and the answer voice allows users to learn different types of knowledge in a relaxed and enjoyable atmosphere while performing voiceprint unlocking. It can also effectively enhance communication between parents and children, reduce children's resistance to youth mode (the functional limited state of electronic devices), and improve the user experience.

[0044] In another possible implementation of the first aspect, after the electronic device receives the seventh user's answer voice within the fourth duration, the electronic device further includes:

[0045] The electronic device performs voiceprint recognition on the answering voice to determine the predicted age of the seventh user.

[0046] The electronic device performs content recognition on the answering voice and obtains the first answer content, including:

[0047] If the predicted age of the seventh user is within the second age range, the electronic device performs content recognition on the answering voice to obtain the first answer content.

[0048] In this application, in the interactive unlocking mode, users participating in voiceprint unlocking include parents whose predicted age is in the first age range and children whose predicted age is in the second age range. When unlocking, the interacting parents and children can learn different types of knowledge in a relaxed and pleasant atmosphere, which can also effectively enhance communication between parents and children, reduce children’s resistance to the youth mode (the functional limited state of electronic devices), and improve the user experience.

[0049] In another possible implementation of the first aspect, the method further includes:

[0050] When the electronic device is in a function-restricted state, the electronic device obtains the question voice of the eighth user in response to the interactive unlocking operation.

[0051] The electronic device performs content recognition on the question voice and obtains a second question content corresponding to the question voice.

[0052] If the electronic device receives the ninth user's answer voice within the fifth time period, the electronic device performs content recognition on the answer voice to obtain the second answer content.

[0053] The electronic device performs voiceprint recognition on the question voice and the answer voice respectively to determine the predicted age of the eighth user and the predicted age of the ninth user.

[0054] When the second question content matches the second answer content, and the predicted age of the eighth user and the predicted age of the ninth user meet the unlocking condition, the electronic device exits the function-restricted state.

[0055] Among them, the predicted age of the eighth user and the predicted age of the ninth user meet the unlocking conditions, including: the age difference between the predicted age of the eighth user and the predicted age of the ninth user is greater than or equal to the difference threshold; or, the predicted age of the eighth user is in the first age range.

[0056] In this application, the electronic device does not need to specifically distinguish which user is an adult, whose corresponding voice is the question voice, and which user is a minor, whose corresponding voice is the answer voice. In this embodiment, the electronic device only needs to determine that the predicted ages of two people meet the unlocking conditions, that is, one adult and one minor, and that the content corresponding to the two users' voices matches, to exit the restricted function state. In terms of actual underlying calculations, some data processing steps of the electronic device can be reduced, improving the efficiency of voiceprint unlocking of the electronic device.

[0057] In another possible implementation of the first aspect, the method further includes:

[0058] The electronic device displays a question-and-answer interface; the question-and-answer interface includes fields related to the question content.

[0059] In this application, the electronic device can display a question-and-answer interface to make the question-and-answer interaction in the interactive unlocking mode more intuitive and enhance the interactive fun between users.

[0060] In another possible implementation of the first aspect, the method further includes:

[0061] The electronic device displays an interactive unlocking interface, wherein the interactive unlocking interface includes a first control and a second control.

[0062] If the electronic device receives an interactive unlocking operation on the first control, the electronic device performs a step of obtaining the question voice of the sixth user, or performs a step of obtaining the question voice of the eighth user.

[0063] If the electronic device receives a direct unlocking operation acting on the second control, the electronic device performs a step of acquiring an unlocking voice.

[0064] In this application, electronic devices can be unlocked with voiceprints in different unlocking modes by displaying different controls. These include direct voiceprint unlocking mode and interactive voiceprint unlocking mode. Different voiceprint unlocking modes can be adapted to current unlocking scenarios. For example, if you have plenty of time, you can use the first control to unlock with interactive voiceprint unlocking mode, which can make the voiceprint unlocking process more interesting. If you want to unlock directly with your voiceprint, you can use the second control to perform a direct unlocking operation, which can shorten the time it takes to unlock with your voiceprint.

[0065] In another possible implementation of the first aspect, the electronic device performs voiceprint recognition on each user's unlocking voice to determine the predicted age of each user, including:

[0066] The electronic device inputs each user's unlocking voice into the voiceprint recognition model for feature extraction and age classification to determine the predicted age of each user.

[0067] In this application, electronic devices use voiceprint recognition models for feature extraction and age classification. The voiceprint recognition model can be used to identify individuals at different age stages. The voiceprint recognition model in this case is not used for voiceprint identity verification, and the entire solution does not involve voiceprint registration. This avoids the limitations and complexities of voiceprint verification methods based on voiceprint registration.

[0068] In a second aspect, an electronic device is provided, which includes an audio acquisition device, a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of any one of the methods described in the first aspect.

[0069] In a third aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores instructions, and when the computer program / instructions are executed by a processor, the steps of the method described in any one of the first aspects are implemented.

[0070] In a fourth aspect, a computer program product comprising instructions is provided, including a computer program / instruction, which, when executed by a processor, implements the steps of any one of the methods described in the first aspect.

[0071] In a fifth aspect, an embodiment of the present application provides a chip, the chip including a processor, the processor being used to call a computer program in a memory to execute a method as described in any one of the first aspects.

[0072] It can be understood that the beneficial effects that can be achieved by the electronic device described in the second aspect, the computer-readable storage medium described in the third aspect, the computer program product described in the fourth aspect, and the chip described in the fifth aspect provided above can refer to the beneficial effects in the first aspect and any possible design method thereof, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0073] Figure 1 A flow chart of a voiceprint unlocking method based on voiceprint identity authentication;

[0074] Figure 2 A flow chart of a voiceprint unlocking method provided in an embodiment of the present application;

[0075] Figure 3 A flowchart of another voiceprint unlocking method provided in an embodiment of the present application;

[0076] Figure 4 A schematic diagram of a scenario of voiceprint unlocking of an electronic device provided in an embodiment of the present application;

[0077] Figure 5 A schematic diagram of another scenario of voiceprint unlocking of an electronic device provided in an embodiment of the present application;

[0078] Figure 6 A schematic diagram of another scenario of voiceprint unlocking of an electronic device provided in an embodiment of the present application;

[0079] Figure 7 A schematic diagram of another scenario of voiceprint unlocking of an electronic device provided in an embodiment of the present application;

[0080] Figure 8 A schematic diagram of another scenario of voiceprint unlocking of an electronic device provided in an embodiment of the present application;

[0081] Figure 9 A schematic diagram of another scenario of voiceprint unlocking of an electronic device provided in an embodiment of the present application;

[0082] Figure 10 A schematic diagram of a voiceprint unlocking process including an interactive unlocking mode provided in an embodiment of the present application;

[0083] Figure 11 A schematic diagram of another scenario of voiceprint unlocking of an electronic device provided in an embodiment of the present application;

[0084] Figure 12 A schematic diagram of a scene of a display interface of a smart TV provided in an embodiment of the present application;

[0085] Figure 13 Schematic diagrams of several interactive unlocking interfaces provided in embodiments of the present application;

[0086] Figure 14 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0087] Figure 15 A schematic structural diagram of another electronic device provided in an embodiment of the present application;

[0088] Figure 16 A schematic structural diagram of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0089] In the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification of the present application and the appended claims, the singular expressions "a", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two). The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship.

[0090] References to "one embodiment" or "some embodiments" etc. described in this specification mean that the specific features, structures or characteristics described in conjunction with the embodiment are included in one or more embodiments of the present application. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in another way. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in another way. The term "connected" includes direct and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

[0091] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0092] With the development of electronic devices, youth mode (also known as "minor mode") has been set up on electronic devices to prevent minors from becoming addicted to them. Youth mode is a network protection mechanism designed to provide a time-limited, safe, and healthy online environment for minors. When youth mode is enabled on an electronic device, the device is placed in a restricted state. All or selected functions of the device are locked, unavailable, and usage time is limited.

[0093] In one example, when the electronic device is a mobile phone, the operating system of the mobile phone has a youth mode. When the youth mode is turned on, designated functions provided by the mobile phone's operating system are locked. Specifically, the designated function may be an Internet connection function. When the youth mode is turned on, the Internet connection function of the mobile phone is locked. In another example, when the electronic device is a mobile phone, an application on the mobile phone has a youth mode. When the youth mode of the application is turned on, all or designated functions of the application are locked. Specifically, the application may be a social application, a video application, a game application, etc. For example, when the youth mode of a game application is turned on, the usage time of the game application is changed from unlimited to limited, and the pull-up payment function of the game application is locked. In another example, when the electronic device is a smart TV, the smart TV has a youth mode. When the youth mode of the smart TV is turned on, all or some functions of the smart TV are locked. Specifically, the designated function may be an Internet connection function. When the youth mode of the smart TV is turned on, the Internet connection status of the smart TV is locked, and the smart TV cannot connect to the Internet.

[0094] Similar to the youth mode, the child lock mode also has the effect of restricting all or specific functions. The original intention of setting the child lock mode is to prevent children from accidentally touching the electronic device and causing the electronic device to malfunction, or to prevent children from being injured by accidental touch. The child lock mode is usually used in smart home devices. Smart home devices such as smart TVs, smart washing machines, smart ovens, and smart water dispensers can all be set with a child lock mode. In one example, when the smart home device is a smart washing machine, when the child lock mode of the smart TV is turned on, all function buttons of the smart washing machine are locked to prevent children from accidentally touching the function buttons and causing injuries or malfunctions of the washing machine.

[0095] When an electronic device turns on youth mode or child lock mode, all or specified functions of the electronic device are locked. This state of function restriction is hereinafter referred to as the electronic device being in a function-restricted state. When an electronic device is in a function-restricted state, it can prevent teenagers from using the electronic device without supervision. When an adult uses the electronic device or an adult accompanies a teenager in using the electronic device, the electronic device can exit youth mode or child lock mode, and the electronic device exits the function-restricted state, and the corresponding function of the electronic device is updated to the use state. The operations of exiting the function-restricted state involved in this embodiment, such as exiting youth mode or child lock mode, can be collectively referred to as unlocking operations.

[0096] There are many common methods for unlocking electronic devices. In one example, the electronic device can be unlocked using a digital password. Specifically, when the electronic device is in a restricted functionality state, the electronic device may display a password verification interface in response to the user's unlocking operation. After receiving the digital password entered by the user, the electronic device verifies the password and, if the verification is successful, exits the restricted functionality state.

[0097] This specific implementation method for unlocking electronic devices has certain limitations. For example, when unlocking electronic devices using a digital password, the digital password setting rules are relatively simple. Without parental permission, teenagers can easily crack the digital password and disable the youth mode on their own, rendering the supervisory function of the youth mode ineffective and unable to achieve effective supervision. In other aspects, digital passwords are easy to forget, and retrieving the digital password to disable the youth mode may complicate the operation process.

[0098] Alternatively, in another example, a common electronic device unlocking operation includes unlocking the electronic device by verifying the user's identity through voiceprint. Specifically, when the electronic device is in a function-restricted state, the electronic device responds to the user's unlocking operation by performing voiceprint recognition on the unlocking audio input by the user. When the user identity corresponding to the unlocking audio is confirmed to be a legitimate user in the voiceprint registration database based on the voiceprint registration database, the electronic device exits the function-restricted state.

[0099] Figure 1 A flow chart of a voiceprint unlocking method based on voiceprint authentication is given. Figure 1 ,This method includes two stages, the first stage is the user voiceprint ,registration stage, and the second stage is the user voiceprint ,unlocking stage.

[0100] The process of user voiceprint registration includes:

[0101] Step 1: The electronic device collects the registration audio of the user to be registered.

[0102] Voiceprint registration has certain requirements for the registered audio to ensure the validity and integrity of the user's voiceprint data corresponding to the registered audio. For example, the duration of the registered audio must be greater than a preset time; or the content of the registered audio must include specific repeated phrases or sentences, etc.

[0103] Step 2: The electronic device performs voiceprint recognition on the registered audio and extracts the standard feature vector corresponding to the registered audio.

[0104] The standard feature vector represents the voiceprint feature vector of the user to be registered. The electronic device can use the voiceprint recognition model to perform voiceprint recognition to obtain the standard feature vector corresponding to the registration audio.

[0105] After obtaining the standard feature vector corresponding to the registration audio, the electronic device can store it in the voiceprint database. After multiple users register their voiceprints, the voiceprint database will contain standard feature vectors corresponding to multiple users. These multiple standard feature vectors in the voiceprint database are used to match and verify user identities during the voiceprint unlocking phase.

[0106] The process of user voiceprint unlocking includes:

[0107] Step 3: When the electronic device receives the user's unlocking instruction, it obtains the user's unlocking audio.

[0108] In step 4, the electronic device performs voiceprint recognition on the unlocking audio and extracts a test feature vector corresponding to the unlocking audio.

[0109] Step 5: The electronic device calculates the similarity between the test feature vector and each standard feature vector in the voiceprint database.

[0110] If there is a standard feature vector in the voiceprint database whose similarity is greater than the similarity threshold, the electronic device responds to the user's unlocking instruction and performs a corresponding unlocking operation.

[0111] If there is a standard feature vector in the voiceprint database with a similarity greater than the similarity threshold, it means that the test feature vector matches the standard feature vector, and the test feature vector and the corresponding user may be the user corresponding to the matched standard feature vector. That is, the user corresponding to the unlocking audio has registered the voiceprint, and the standard feature vector corresponding to the user already exists in the voiceprint registration database. The user's identity authentication is passed, and the electronic device can respond to the user's unlocking instruction and execute the unlocking operation of the electronic device.

[0112] Specifically, in some examples, if application A of an electronic device is in youth mode, then the electronic device performing a corresponding unlocking operation may be an operation to release the youth mode of application A, so that application A is in normal mode and all functions are in an unlocked state. If system service B of an electronic device is in a locked state, then the electronic device performing a corresponding unlocking operation may be an operation to release the lock of system service B, so that system service B of the electronic device is in an unlocked state and can be used by all users. If the electronic device is in a locked state, for example, the electronic device is in a standby lock state, a screen-off lock state, etc., the electronic device performing a corresponding unlocking operation may be an operation to release the lock of the electronic device, so that the electronic device is in an unlocked state and all services and functions provided by the electronic device can be used by all users.

[0113] On the contrary: if there is no standard feature vector in the voiceprint database with a similarity greater than the similarity threshold, the electronic device does not respond to the user's unlocking instruction.

[0114] If there is no standard feature vector in the voiceprint database with a similarity greater than the similarity threshold, it means that the test feature vector does not match any standard feature vector in the voiceprint database. The test feature vector and the corresponding user have not been registered for voiceprints, and there is no standard feature vector corresponding to the user in the voiceprint registration database. Therefore, the user's identity verification fails. In this case, the electronic device may not respond to the user's unlock command and remain locked.

[0115] Depend on Figure 1 As shown in the detailed process of the commonly used voiceprint unlocking method, if a user has not registered their voiceprint in advance, the voiceprint database will not contain the user's corresponding standard feature vector. This user will be unable to pass voiceprint recognition authentication and unlock the electronic device. This method, which requires prior voiceprint registration, complicates the voiceprint unlocking process and limits the users who can unlock the device. Furthermore, matching voiceprint feature vectors requires a relatively reliable voiceprint recognition model. If the voiceprint recognition model is not reliable, the accuracy of the voiceprint feature vector extracted by the voiceprint recognition model will be low, and the accuracy of voiceprint feature vector matching will also be low. This may lead to the voiceprint corresponding to fake audio (such as audio generated by artificial intelligence or audio with imitation timbre) being mistakenly matched as a registered voiceprint, thus performing the unlock operation even for fake audio, reducing the reliability and accuracy of the unlocking operation.

[0116] Based on this, there is an urgent need for a reliable and effective unlocking method to solve the problem of poor supervision under the above unlocking operation.

[0117] An embodiment of the present application provides a voiceprint unlocking method. When an electronic device is in a restricted functionality state and receives an unlocking voice, the electronic device can perform voiceprint recognition on the unlocking voice and determine the age of the user corresponding to the unlocking voice. If the unlocking voice contains the unlocking voices of at least two users, and the user ages corresponding to the unlocking voices of the two users meet the unlocking conditions, the electronic device exits the restricted functionality state. In this solution, exiting the restricted functionality state requires the participation of at least two users whose ages meet the unlocking conditions. This avoids the problem of inadequate supervision when a single user independently exits the restricted functionality state. The participation of at least two users in the unlocking process provides mutual supervision, further improving the reliability of exiting the restricted functionality state. Furthermore, the voiceprint unlocking method of this solution can identify users of different ages and determine whether to perform voiceprint unlocking based on the user's age. This solution does not require prior voiceprint registration to establish a voiceprint identity database for identity verification, simplifying the voiceprint unlocking process while avoiding the limitation that electronic devices cannot be unlocked without voiceprint registration.

[0118] The following describes the voiceprint unlocking method provided by the embodiments of the present application through specific examples. Figure 2 A flow chart of a voiceprint unlocking method provided in this embodiment is provided, including:

[0119] S101: When the electronic device is in a function-restricted state, the electronic device obtains an unlocking voice.

[0120] The electronic device being in a functionally restricted state includes the electronic device's applications being in a functionally restricted state, the electronic device's system services being in a functionally restricted state, or the entire electronic device being in a functionally restricted state. From another perspective, being in a functionally restricted state can include all functions being in an authorized state, or some functions being in a restricted state. This creates a variety of functionally restricted states for electronic devices.

[0121] In one example, a function-restricted state of an electronic device may be an application in youth mode. When an application is in youth mode, all or some of the application's functions are locked. Specifically, when the application is a social networking application, the payment and publishing functions of the social networking application are locked in youth mode, and the usage time of the social networking application is limited.

[0122] In another example, a functionally restricted state of an electronic device may be when the electronic device is in youth mode. When the electronic device is in youth mode, some system services provided by the electronic device, or some applications deployed in the electronic device, are locked. For example, when the electronic device is in youth mode, the electronic device's networking and payment functions are locked, and social applications, communication applications, video applications, and game applications deployed in the electronic device are also locked.

[0123] In another example, a function-restricted state of an electronic device may be that the electronic device is in child lock mode. When the electronic device is in child lock mode, all or some system services provided by the electronic device are locked. For example, when the electronic device is a smart washing machine, all system services of the electronic device are locked when the electronic device is in child lock mode.

[0124] When an electronic device is in a function-restricted state, the electronic device can be unlocked by voiceprint based on the user's unlocking voice.

[0125] In this embodiment, the unlocking voice is a voice for exiting the restricted function state, and the unlocking voice contains keywords related to unlocking. The keywords required to be included in the unlocking voice corresponding to each restricted function state may be different. For example, when the electronic device is in youth mode, the unlocking voice may be an unlocking voice containing keywords such as "exit youth mode". When the electronic device is in child lock mode, the unlocking voice may contain an unlocking voice containing keywords such as "exit child lock mode".

[0126] There are various ways for the electronic device to determine that the acquired voice is the unlocking voice corresponding to the function-limited state of the electronic device.

[0127] In one example, the electronic device can perform content recognition on the received voice. If the voice contains keywords corresponding to exiting the restricted function state, the electronic device determines that the voice is the unlocking voice, and the electronic device determines and responds to the voiceprint unlocking based on the unlocking voice.

[0128] In another example, the electronic device may receive a user-triggered unlock operation before acquiring the unlock voice. If the electronic device receives any voice from two users within a preset period of time after receiving the unlock operation, the electronic device can still perform the voiceprint unlock operation based on these two voices. That is, even if at least one of the two users' voices does not contain any unlocking keywords, if the unlock operation has been received and any of the two users' voices can be used as voices that trigger the voiceprint unlock function, the electronic device can perform voiceprint unlocking using the method provided in this embodiment. For example, if the electronic device is in youth mode and receives any voice from two users within a preset period of time after exiting youth mode via a preset gesture or function, the electronic device can determine and respond to voiceprint unlock based on these two users' voices. Alternatively, when the electronic device receives the youth mode exit operation, it can output a prompt message "Enter unlock voice," determine the acquired voice as the voice for unlocking, and determine and respond to voiceprint unlocking based on the unlock voice.

[0129] Alternatively, in other feasible implementations, the electronic device may also obtain the unlocking voice in other ways, and this implementation does not limit the specific way of obtaining the unlocking voice.

[0130] S102: If the electronic device obtains unlocking voices of at least two users within the first time period, the electronic device performs voiceprint recognition on the unlocking voices of each user to determine the predicted age of each user.

[0131] The first duration may be a preset shorter duration. Specifically, the first duration may be 1 minute, 2 minutes, 3 minutes, etc.

[0132] In this embodiment, the electronic device can perform speaker recognition on the unlocking voice acquired within the first duration to preliminarily determine the number of speakers (users) of the unlocking voice. Based on the number of speakers corresponding to the unlocking voice, the electronic device can then respond with a corresponding voiceprint unlocking method.

[0133] Specifically, there are multiple methods for the electronic device to determine the number of speakers of the unlocking voice received within the first time period. In a feasible embodiment, if the electronic device obtains a segment of unlocking voice within the first time period, the segment of unlocking voice may include the voices of one or more users. In this case, the electronic device can use voiceprint detection technology and separation technology to separate the voiceprints of the users contained in the unlocking voice, thereby determining the number of users contained in the segment of unlocking voice. Among them, the voiceprint detection and separation technology can be implemented using traditional voiceprint detection technology and separation technology, and this embodiment does not limit the specific implementation method. After performing speaker recognition of the unlocking voice in the above manner, if the electronic device determines that the unlocking voices of two or more users have been obtained, the electronic device performs voiceprint recognition on the unlocking voice of each user based on the unlocking voice corresponding to each user after separation, and determines the predicted age of the user corresponding to each unlocking voice.

[0134] In another feasible embodiment, the electronic device may successively acquire multiple unlocking voice segments within a first time period, each of which includes the unlocking voice of one user. The electronic device may use voiceprint detection technology to identify whether the user corresponding to each unlocking voice segment is from the same user. After the electronic device determines that the multiple unlocking voice segments come from two or more different users, the electronic device performs voiceprint recognition on each user's unlocking voice segment to determine the predicted age of the user corresponding to each unlocking voice segment. The voiceprint detection technology here can also be implemented using traditional voiceprint detection technology. This embodiment does not limit the specific method for identifying whether the speaker of multiple unlocking voice segments is the same speaker.

[0135] Electronic devices can use voiceprint extraction technology and age classification technology to perform voiceprint recognition on each user's unlocking voice and determine the predicted age of each user.

[0136] In this embodiment, for each user's corresponding unlocking voice, the electronic device may employ a voiceprint feature extraction method to extract a voiceprint feature vector corresponding to the unlocking voice. For example, the electronic device may extract features from the unlocking voice, such as mel-frequency cepstral coefficients (MFCC), linear prediction cepstral coefficients (LPCC), short-term zero-crossing rate, short-term energy spectrum, and pitch period. These features reflect the acoustic characteristics of each person's voice, which also include information related to age. For example, as people age, their vocal cords change, affecting characteristics such as voice timbre and pitch. These characteristics are reflected in the extracted voiceprint feature vector. Based on this, after extracting the voiceprint feature vector for the unlocking voice, the voiceprint feature vector can be classified using age classification techniques to determine the predicted age of the user corresponding to the voiceprint feature vector.

[0137] In a specific embodiment, the electronic device can use a preset voiceprint recognition model to perform voiceprint recognition of the unlocking voice and determine the predicted age of the user corresponding to the unlocking voice. The voiceprint recognition model can include at least a feature extraction network and an age classification network.

[0138] The feature extraction network is used to extract voiceprint features from the unlocking speech input to the voiceprint recognition model, obtaining a voiceprint feature vector corresponding to the unlocking speech. The voiceprint feature vector output by the feature extraction network serves as the input to the age classification network. The age classification network can classify the voiceprint feature vector into an age class and determine the predicted age corresponding to the voiceprint feature vector. The age classification network can be based on common classification networks such as traditional machine learning classification networks or deep learning classification networks.

[0139] In the specific implementation method of determining the predicted age of the user corresponding to the unlocking voice based on the voiceprint recognition model, the accuracy of age classification can be improved by training the voiceprint recognition model.

[0140] Specifically, the voiceprint recognition model can be trained using a large number of sample speech annotated with age information. Age information can be divided into multiple age groups, such as children, adolescents, adults, and adults. The number of age groups can be determined based on actual conditions. The higher the granularity of age classification required, the greater the number of age groups that can be divided. During training based on sample speech, the voiceprint recognition model can learn the differences and patterns in speech characteristics of different age groups. During training, the voiceprint recognition model continuously adjusts model parameters to improve the accuracy of age recognition. In this embodiment, the training method for the voiceprint recognition model can adopt conventional model training methods. For example, the voiceprint recognition model can be trained using sample speech until the loss value is less than a loss threshold, thereby obtaining a trained voiceprint recognition model. Alternatively, the voiceprint recognition model can be trained using sample speech until the number of model training times reaches a threshold, thereby obtaining a trained voiceprint recognition model. The specific process of model training is not described in detail in this embodiment.

[0141] The voiceprint recognition model in this embodiment is used to determine the predicted age of the user corresponding to the unlocking voice, and does not perform user identity verification for the unlocking voice. Based on this, the voiceprint recognition model in this embodiment is not used for voiceprint registration.

[0142] In some other optional implementations, before training the voiceprint recognition model based on the sample speech, data preprocessing may be performed on the collected sample speech. For example, data preprocessing may include operations such as framing, windowing, and pre-emphasis on the sample speech. The specific implementation of data preprocessing can refer to common data preprocessing methods and is not limited in this embodiment.

[0143] S103: If the predicted ages of two of the at least two users meet the unlocking condition, the electronic device exits the function-restricted state.

[0144] After the electronic device performs voiceprint recognition on multiple users' unlocking voices and obtains the predicted age of the user corresponding to each unlocking voice, it can determine the voiceprint unlocking based on the predicted age of each user and the unlocking conditions. If the predicted age of two users meets the unlocking conditions, the electronic device exits the restricted function state.

[0145] In this embodiment, the unlocking condition includes a condition requiring the predicted ages of the two users.

[0146] In one example, the predicted ages of the two users satisfying the unlocking condition includes the age difference between the predicted ages of the two users being greater than or equal to an age difference threshold.

[0147] The age difference between the predicted ages of the two users is greater than or equal to the age difference threshold, which can indicate to a certain extent that at least one of the two users is an adult.

[0148] In one scenario, when exiting a restricted function state, such as exiting youth mode or child lock mode, it is necessary to ensure that at least one adult is present to supervise the electronic device's exit from the restricted function state, making voiceprint unlocking more effective. Considering that the purpose of the unlocking condition is to determine the presence of at least one adult, the age difference threshold in this embodiment can be a natural number greater than or equal to 18. The specific value can be determined based on actual circumstances and is not limited in this embodiment.

[0149] For example, the age difference threshold is 18 (in years, units are omitted in the following embodiments). Voiceprint recognition determines that user A's predicted age is 12, and user B's predicted age is 38. The age difference between user A's predicted age and user B's predicted age is 26, which is greater than the age difference threshold of 20. Therefore, it is determined that the predicted ages of user A and user B meet the unlocking condition.

[0150] In another example, the predicted ages of two users satisfying the unlocking condition include one user's predicted age being in a first age range and the other user's predicted age being in a second age range. The first age range and the second age range are two non-overlapping age ranges.

[0151] In a specific example, considering that the unlocking condition is intended to determine the presence of at least one adult, the first age range can represent the age range corresponding to adults, for example, the first age range can be (20, 50); the second age range can represent the age range corresponding to adults, for example, the second age range can be (2, 17). The specific value ranges of the first and second age ranges can be determined based on actual circumstances and are not limited in this embodiment.

[0152] For example, after voiceprint recognition, it is determined that the predicted age of user A is 12, and the predicted age of this user is in the second age range; the predicted age of user B is 38, and the predicted age of this user is in the first age range. It is determined that the predicted age of user A and the predicted age of user B meet the unlocking conditions.

[0153] In some other scenarios, for example, when the electronic device is a private device of user C, the electronic device is in a restricted function state. If user D wants to release the restricted function state of the electronic device, he needs the consent of user C. When user C is a minor, the purpose of the unlocking condition is to determine the presence of at least one minor. In other words, when an adult uses the voiceprint to unlock the electronic device in use, the owner of the electronic device (the minor) needs to participate in the unlocking; adults cannot use the voiceprint to unlock the electronic device on their own without the consent of the owner of the electronic device (the minor), which improves the reliability of voiceprint unlocking and, to a certain extent, protects the privacy of the owner of the electronic device (the minor) from being easily leaked. Among them, when the electronic device is a private device of a certain user, the restricted function state of the electronic device can be some applications containing private information that are in a restricted function state, or system services containing private information that are in a restricted function state, etc.

[0154] Based on the unlocking conditions provided in this embodiment, voiceprint unlocking can also be determined in this scenario. For example, during the specific unlocking condition determination process, the electronic device can further determine that at least one of the two users is a minor. Then, the unlocking condition can be that the age difference between the two users is greater than or equal to an age difference threshold, and the predicted age of the user with the younger age is less than an age threshold. For example, the age threshold is 18.

[0155] Specifically, if the age difference threshold is 18, and voiceprint recognition determines that user D's predicted age is 38, and user C's predicted age is 12. User C, whose predicted age is younger, has a predicted age lower than the age threshold of 18, and the age difference between user D's predicted age and user C's predicted age is greater than or equal to the age difference threshold of 18, the electronic device can determine that the predicted ages of users C and D meet the unlocking conditions for this scenario. For example, if voiceprint recognition determines that user E's predicted age is 20, and user F's predicted age is 40, and the predicted age of user E, whose predicted age is younger, is greater than the age threshold of 18, the electronic device will determine that the predicted ages of users C and D do not meet the unlocking conditions for this scenario, even if the age difference between user E's predicted age and user F's predicted age is greater than or equal to the age difference threshold of 18. In this scenario, where a minor is the owner of the electronic device, voiceprint unlocking in the presence of the minor serves as a supervisory mechanism, making voiceprint unlocking more effective.

[0156] Figure 3 A flow chart of another voiceprint unlocking method provided by this embodiment is given. Figure 3As shown, if the electronic device receives a child's unlock voice, it can determine the child's predicted age by performing voiceprint recognition and age prediction on the unlock voice. Similarly, if the electronic device receives a parent's unlock voice, it can also perform voiceprint recognition and age prediction on the unlock voice to obtain the parent's predicted age. The electronic device compares the child's predicted age with the parent's predicted age to determine the age difference and obtain a determination result. If the age difference between the child's predicted age and the parent's predicted age is greater than or equal to an age difference threshold, it is determined that the child and the parent meet the unlocking conditions for the electronic device, and the electronic device exits the restricted function state.

[0157] Furthermore, the unlocking condition may also include the predicted age of one of the two users being within a first age range and the predicted age of the other user being within a second age range. When the first age range represents an age range corresponding to adults and the second age range represents an age range corresponding to minors, the determination of whether the unlocking condition is met in the scenario where the minor is the owner of the electronic device is similar to the determination of whether the unlocking condition is met when exiting a function-restricted state of the electronic device, and is not further described here.

[0158] In some optional embodiments, regardless of whether the user's predicted age meets the unlocking conditions, the electronic device can store the received user's unlocking voice in a designated storage space, and the unlocking voice stored in the designated storage space can be viewed by the relevant user. In some subsequent situations that may involve privacy leakage verification or unlocking verification, the unlocking voice stored in the designated storage space can be retrieved for unlocking back. The multiple unlocking voices stored in this embodiment can serve as supporting data for other subsequent scenarios, further improving the security and privacy protection of voiceprint unlocking.

[0159] The voiceprint unlocking method based on unlocking conditions in this embodiment is applicable to a variety of different scenarios. When the unlocking conditions are met, at least two users can work together to unlock the device using their voiceprint. This provides a joint supervision effect for both minors and adults, making unlocking the electronic device in a restricted function state more reliable. In addition, compared to traditional voiceprint verification identity unlocking methods, the voiceprint unlocking method provided in this embodiment does not require users to register their voiceprints in advance to establish a voiceprint identity database for identity verification. Users of electronic devices can switch freely, simplifying the voiceprint unlocking process while avoiding the limitation of being unable to unlock the electronic device without voiceprint registration. This improves the flexibility and convenience of users in unlocking the electronic device.

[0160] The following uses some specific usage scenarios to illustrate the above Figure 2 and Figure 3 Provided voiceprint unlocking method.

[0161] In one example, let's take a smart TV as an example. The smart TV has a youth mode. When youth mode is enabled, some of the smart TV's functions are restricted. For example, the internet TV function provided by the smart TV is restricted. In this embodiment, enabling youth mode on the smart TV can be understood as a restricted state where internet TV applications are restricted; correspondingly, exiting youth mode on the smart TV can be understood as releasing the restrictions on internet TV applications.

[0162] In combination with this application scenario, Figure 4 A schematic diagram of a scenario of voiceprint unlocking of an electronic device is given.

[0163] When the smart TV turns on the youth mode, the smart TV is in a limited function state. In one example, if the smart TV receives an operation triggered by the user to exit the youth mode, such as Figure 4 As shown, the smart TV can display a prompt message on the display screen to prompt the user to input the unlocking voice.

[0164] The smart TV acquires the unlocking voice and performs speaker recognition on the acquired unlocking voice, separating unlocking voice 1 corresponding to user 1 and unlocking voice 2 corresponding to user 2. The smart TV then performs voiceprint recognition on unlocking voice 1 to determine the predicted age 1 of user 1 corresponding to unlocking voice 1; and performs voiceprint recognition on unlocking voice 2 to determine the predicted age 2 of user 2 corresponding to unlocking voice 2. The process of the smart TV performing voiceprint recognition to determine the predicted age of the user corresponding to the unlocking voice can be found in S102 above and will not be further described here.

[0165] In a specific example, if predicted age 1 is 12 and predicted age 2 is 30, the unlocking condition is that the age difference between the predicted ages of the two users is greater than or equal to an age difference threshold, where the age difference threshold is 18. The smart TV determines that the age difference (18) between predicted age 1 and predicted age 2 is equal to the age difference threshold (18), and the unlocking condition of the smart TV is satisfied, and the smart TV exits the youth mode. In one example, the smart TV may output a prompt message to prompt the user that the youth mode has been exited.

[0166] In this embodiment, when Teen Mode is enabled on a smart TV, it can restrict the length and content of television viewing for minors. To unlock the smart TV's Teen Mode, two users must jointly participate in voiceprint unlocking. In particular, if one of the two users is a minor, both the minor and the adult must jointly participate in voiceprint unlocking. This ensures voiceprint unlocking under adult supervision, making voiceprint unlocking more reliable and effectively preventing minors from independently unlocking the smart TV's Teen Mode and viewing inappropriate content without adult supervision. Furthermore, since smart TVs are often used by multiple users, who may include both frequent users (such as family members) and less frequent users (such as visitors), conventional voiceprint-based unlocking methods would require visitors to re-register their voiceprints before unlocking the smart TV. In this embodiment, since voiceprint-based identity verification is not performed, user voiceprint registration is not required. Users seeking to unlock the restricted smart TV function, whether frequent or infrequent users, can unlock the smart TV's function using voiceprints if their predicted age meets the unlocking conditions, significantly simplifying the voiceprint unlocking process. In addition, due to the significant age difference between adults and minors, the method of judging whether the unlocking conditions are met based on the age difference between the users' predicted ages is relatively easy to implement and will not cause excessive computing power problems for smart TVs (electronic devices).

[0167] In another example, taking a mobile phone as an example, when the owner of the mobile phone is a minor and the gallery application of the mobile phone is in a locked state, the voiceprint unlocking method provided in this embodiment can be used to unlock the phone.

[0168] In combination with this application scenario, Figure 5 A schematic diagram of another scenario of voiceprint unlocking of an electronic device is given.

[0169] When the phone's Gallery app is locked, if the phone receives a user-triggered operation to open the Gallery app, such as Figure 5 As shown, the mobile phone can display the lock interface of the gallery application on the display screen and output a prompt message for prompting the user to input an unlocking voice.

[0170] The mobile phone obtains the unlocking voice and performs speaker recognition on the obtained unlocking voice, separating unlocking voice 3 corresponding to user 3 and unlocking voice 4 corresponding to user 4. The mobile phone performs voiceprint recognition on unlocking voice 3 to determine the predicted age 3 of user 3 corresponding to unlocking voice 3; and performs voiceprint recognition on unlocking voice 4 to determine the predicted age 4 of user 4 corresponding to unlocking voice 4. The process of determining the predicted age of the user corresponding to the unlocking voice by performing voiceprint recognition on the mobile phone can be referred to above in S102 and will not be repeated here.

[0171] In a specific example, if the predicted age 3 is 14, the predicted age 4 is 37, and the age difference threshold is 18, the age threshold is 18. The unlocking condition is that the age difference between the predicted ages of the two users is greater than or equal to the age difference threshold, where the age difference threshold is 18. The smart TV determines that the age difference (23) between the predicted age 3 and the predicted age 4 is greater than the age difference threshold (18), and the smaller predicted age 3 is less than the age threshold (18), satisfying the unlocking condition of the mobile phone's gallery application, and the mobile phone exits the gallery application from the restricted function state. In one example, the smart TV can directly display the main interface of the gallery application.

[0172] In this embodiment, the minor's mobile phone contains the minor's privacy. For example, the mobile phone's gallery application contains the minor's private pictures or videos. When the mobile phone's gallery application is in a restricted function state, it can restrict other people (such as adults) from privately viewing the content of the gallery application without the minor's consent. When unlocking the gallery application, two users, including the minor (the device owner), are required to jointly participate in voiceprint unlocking. This achieves voiceprint unlocking with the consent of the minor (the device owner) and under joint supervision, making the unlocking of the mobile phone's gallery application more reliable and effectively preventing adults from privately removing the restricted function state of the mobile phone's gallery application without the consent of the minor (the device owner).

[0173] The above embodiments all provide examples of voiceprint unlocking methods when an electronic device receives unlocking voices from two users. In some practical scenarios, the electronic device may first receive the unlocking voice of one user, and then implement the voiceprint unlocking method in other further ways based on the unlocking voice of the first user.

[0174] Combine Figure 6 A schematic diagram of another scenario of voiceprint unlocking of an electronic device is given to introduce another voiceprint unlocking method provided by this embodiment. Figure 6 Taking the electronic device as a smart TV as an example, the electronic device being in a restricted function state includes the smart TV being in youth mode, and the electronic device exiting the restricted function state includes the smart TV exiting youth mode. Specifically, it includes:

[0175] S201: When the electronic device is in a function-restricted state, the electronic device obtains an unlocking voice.

[0176] In one example, if the smart TV receives an operation triggered by the user to exit the youth mode, the smart TV may display a prompt message on the display screen to prompt the user to input the unlocking voice. The specific method for the smart TV to obtain the unlocking voice can refer to the above S101 and Figure 3 The given embodiments are not described in detail here.

[0177] S202: If the electronic device obtains a first unlocking voice of a first user within a first time period, the electronic device outputs a first prompt message.

[0178] The first prompt information is used to prompt users whose ages meet the unlocking conditions to participate in unlocking.

[0179] In this embodiment, a single user cannot unlock the device with a voiceprint. If the electronic device only receives the first unlocking voice of a first user within a first time period, the electronic device can output a prompt message, reminding the first user that other users who meet the unlocking conditions and are of the same age need to jointly unlock the device. The certain time period can be a shorter time period such as 1 minute or 2 minutes.

[0180] In some specific implementations, the electronic device may output the audio corresponding to the first prompt information through voice output; or the electronic device may display the first prompt information on a display interface.

[0181] In a specific implementation, after the electronic device obtains the first unlocking voice in S201, it may first perform voiceprint recognition on the first unlocking voice to determine the predicted age of the first user.

[0182] In the case where the electronic device first determines the predicted age of the first user, if the electronic device determines that the predicted age of the first user is less than an age threshold, the content of the first prompt information output by the electronic device can be further refined to indicate that an adult is required to jointly unlock the device. Correspondingly, if the electronic device determines that the predicted age of the first user is greater than the age threshold, the content of the first prompt information output by the electronic device can be further refined to indicate that the joint participation of relevant users is required to jointly unlock the device.

[0183] In another specific embodiment, the electronic device can also simultaneously perform voiceprint recognition of the first unlocking voice and output the first prompt information. Alternatively, the electronic device first outputs the first prompt information and then performs voiceprint recognition of the first unlocking voice. In both cases, the content of the first prompt information output by the electronic device may include the requirement that other users who meet the unlocking conditions participate in the unlocking process.

[0184] S203: If the electronic device receives a second unlocking voice of the second user within the second time period, the electronic device performs voiceprint recognition on the second unlocking voice to determine the predicted age of the second user.

[0185] The second duration may be a preset time period after receiving the first user's unlock voice. The second duration may be a shorter time period, for example, 30 seconds, 50 seconds, 1 minute, etc. In some other feasible settings, the second duration may also be the same as the first duration.

[0186] Within the second time period, the electronic device receives the second unlocking voice of the second user, which means that after the first prompt information is prompted, the first user invites a user who may meet the unlocking conditions to participate in the voiceprint unlocking operation of the electronic device.

[0187] If the electronic device acquires the second unlocking voice of the second user, the electronic device performs voiceprint recognition on the second unlocking voice to determine the predicted age of the second user. The specific method for the electronic device to perform voiceprint recognition on the unlocking voice to determine the predicted age of the user corresponding to the unlocking voice can be referred to the implementation provided in S102 and will not be described in detail here.

[0188] In some other cases, if the electronic device does not receive the second unlocking voice of the second user within the second time period, the electronic device can exit from the voiceprint unlocking environment and return to an environment where the electronic device is in a function-restricted state.

[0189] S204: If the predicted age of the first user and the predicted age of the second user meet the unlocking condition, the electronic device exits the function-restricted state.

[0190] After the electronic device receives the second unlocking voice of the second user and performs voiceprint recognition to determine the predicted age of the second user, it can determine whether the unlocking conditions of the functionally restricted state of the electronic device are met based on the predicted age of the second user and the predicted age of the first user.

[0191] For example, in this embodiment, after obtaining the predicted ages of the first user and the second user, the smart TV determines whether the unlocking conditions for the smart TV's youth mode are met based on the predicted ages of the second user and the first user. The specific methods for determining whether the unlocking conditions are met and performing the corresponding operations can be found in the specific implementation provided in S103 and are not described in detail here.

[0192] like Figure 6 As shown, when the predicted age of the second user and the predicted age of the first user meet the unlocking condition of the youth mode of the smart TV, the smart TV exits the youth mode.

[0193] In this embodiment, if the electronic device only receives the unlocking voice of one user within the first time period, the electronic device can output a first prompt message, prompting the first user that other users whose ages meet the unlocking conditions need to participate in voiceprint unlocking. By interacting with the user, the requirement that at least two users work together to perform voiceprint unlocking can be expressed to the user more intuitively. The voiceprint unlocking by at least two users has the effect of joint supervision, making the unlocking of the electronic device in a function-restricted state more reliable.

[0194] An electronic device in a functionally restricted state may include multiple functionally restricted states, and each functionally restricted state corresponds to a target user of an age group with unlocking authority. For example, when the electronic device is a smart TV, and the smart TV is in a functionally restricted state in youth mode, the user targeted by the functionally restricted state is a minor. For example, when the electronic device is a private device of a minor, if the electronic device is in a functionally restricted state, the user targeted by the functionally restricted state is other adults. Based on the age group of the user targeted by the functionally restricted state, the target user of an age group with unlocking authority corresponding to each functionally restricted state can be set. For example, when the smart TV is in a functionally restricted state in youth mode, the target user of the functionally restricted state is an adult. For example, when the electronic device is a private device of a minor, and the private device is in a functionally restricted state, the target user of the functionally restricted state is the owner of the electronic device (a minor).

[0195] The electronic device identifies the target user in a functionally restricted state by comparing the corresponding age of the target user in the functionally restricted state with the obtained predicted age of the user. For example, when the smart TV is in a functionally restricted state in the youth mode, the target user is a user whose age is greater than the first scene threshold. The first scene threshold can be set to a natural number greater than 18, specifically, the first scene threshold can be 20. After receiving the unlocking voice of a user within the first time period, the unlocking voice is subjected to voiceprint recognition to determine the predicted age of the user. If the predicted age of the user is greater than or equal to the first scene threshold, the user is considered to be the target user of the smart TV in the youth mode. Conversely, if the predicted age of the user is less than the first scene threshold, the user is considered not to be the target user of the smart TV in the youth mode.

[0196] Based on this actual situation, Figure 7 and Figure 8 Here is another scenario diagram of voiceprint unlocking of an electronic device. Figure 7 、 Figure 8 and Figure 6 The scenario is the same as above, so I will not go into details here.

[0197] like Figure 7 In one scenario shown, when the smart TV receives a third unlocking voice from a third user within a first time period, if it is determined that the third user is a target user in the youth mode of the smart TV, since the target user is a user with unlocking authority when the smart TV is in youth mode, the smart TV can directly execute the voiceprint unlocking operation to exit the youth mode. In another case, Figure 8In another scenario shown, when the smart TV receives a third unlocking voice from a third user within a first duration, if the smart TV determines that the third user is not the target user for the smart TV's youth mode, the smart TV can execute the method provided in the above-mentioned embodiments of S202-S204, outputting a prompt message indicating that other users whose ages meet the unlocking conditions are required to participate in the voiceprint unlocking. When the smart TV receives a fourth unlocking voice from a fourth user within a third duration, the smart TV performs voiceprint recognition on the fourth unlocking voice and determines the fourth user's predicted age. The smart TV determines the unlocking conditions based on the third user's predicted age and the fourth user's predicted age. If the third user's predicted age and the fourth user's predicted age meet the unlocking conditions for the electronic device's restricted function state, the smart TV exits youth mode and exits the restricted function state.

[0198] The third duration may be a shorter preset duration, for example, the third duration may be 30 seconds, 50 seconds, 1 minute, etc. In some feasible examples, the third duration may be equal to the second duration.

[0199] In this embodiment, the electronic device only receives the unlocking voice of one user within the first time period, and when it is determined that the one user is a target user in a function-restricted state, the target user has the unlocking authority adapted to the function-restricted state. The electronic device can directly perform voiceprint unlocking, which can improve the efficiency of voiceprint unlocking, save the time of voiceprint unlocking, and further optimize the limitation that two users must participate in voiceprint unlocking in some special scenarios.

[0200] If the electronic device receives only one user's unlocking voice within the first time period and determines that the user is a target user with restricted functionality, the electronic device directly uses voiceprint unlocking. This may cause misinterpretation in some scenarios. To further improve the reliability of voiceprint unlocking, in this embodiment, if the electronic device receives only one user's unlocking voice within the first time period and determines that the user is a target user with restricted functionality, the electronic device may perform security verification on the user. If the user passes the security verification, voiceprint unlocking is performed.

[0201] Figure 9 Here is another scenario diagram of voiceprint unlocking of an electronic device. Figure 9 and Figure 6 The scenario is the same as above, so I will not go into details here.

[0202] like Figure 9As shown, when the smart TV receives a fifth unlocking voice of a fifth user within the first time period, if it is determined that the fifth user is a target user of the smart TV in the youth mode, the smart TV can perform security verification on the fifth user.

[0203] There are many ways for smart TVs to perform security verification. For example, security verification can be digital password verification. The smart TV can display the input interface of the digital password on the display screen and receive the digital password entered by the fifth user. When the digital password entered by the fifth user matches the registered password, it is determined that the fifth user has passed the security verification, and the smart TV exits the youth mode and the functionally restricted state. In some other feasible implementations, the smart TV can also perform security verification on the fifth application through the user identity. If the smart TV determines that the fifth user is a user with a registered voiceprint, it is determined that the fifth user has passed the security verification, and the smart TV exits the youth mode and the functionally restricted state. Security verification can also be security verification in other dimensions, and this embodiment does not limit the specific implementation method of security verification.

[0204] If the smart TV determines that the fifth user is not the target user of the smart TV in youth mode, the smart TV can execute the method provided in the above S202-S204 embodiments, and output a prompt message to prompt that other users whose ages meet the unlocking conditions are required to participate in the voiceprint unlocking. Details will not be given here.

[0205] In this embodiment, if the electronic device receives only one user's unlocking voice within the first time period and determines that the user is a target user in a restricted function state, the electronic device may further perform security verification on the target user in a restricted function state. If the security verification passes, the electronic device performs voiceprint unlocking. Because the target user is a user with unlocking permission in a restricted function state, the electronic device determines that the user corresponding to the unlocking voice is the target user, and if the target user passes security verification, the electronic device performs voiceprint unlocking, further improving the reliability of unlocking the electronic device in a restricted function state.

[0206] The above embodiments introduce various scenarios where voiceprint unlocking requires the participation of at least two people. Since the at least two people participating in voiceprint unlocking often include minors, in order to make voiceprint unlocking more interesting for minors, in some scenarios, electronic devices can also provide multiple interactive unlocking modes to increase the fun and knowledge of the voiceprint unlocking process.

[0207] In some specific embodiments, for example, in response to an interactive unlocking operation, an electronic device can unlock a restricted function state using a specific interactive unlocking mode. During the process of unlocking the restricted function state using the interactive unlocking mode, the electronic device can obtain voice questions and voice answers input by different users, enabling an engaging quiz experience to unlock the restricted function state. An interactive unlocking mode is a mode that uses questions and answers to conduct fun verification. Questions and answers can be interactive about different types of content. Each type of content interaction forms an interactive unlocking mode. For example, one interactive unlocking mode might involve questions and answers about poetry; another might involve questions and answers about mathematical operations; and yet another might involve questions and answers about common sense conversations. Different interactive unlocking modes correspond to different knowledge bases. The electronic device can store the knowledge base corresponding to different interactive unlocking modes in a local database. Alternatively, the knowledge base corresponding to different interactive unlocking modes can be stored in a cloud database, with the electronic device accessing the cloud database to obtain answers to questions. The purpose of voiceprint unlocking in the interactive unlocking mode is to provide both educational and entertaining experiences. To this end, the interactive unlocking mode can be any mode that enhances educational interaction with minors.

[0208] Figure 10 A flow chart of voiceprint unlocking with interactive unlocking mode is given. The voiceprint unlocking method includes:

[0209] S301: When the electronic device is in a function-restricted state, the electronic device obtains a question voice of a sixth user in response to an interactive unlocking operation.

[0210] The interactive unlocking operation is used to instruct the electronic device to activate the interactive unlocking mode and perform voiceprint unlocking in the interactive unlocking mode. The interactive unlocking operation can be the electronic device receiving a user's voice command regarding "interactive unlocking"; or the interactive unlocking operation can also be the electronic device receiving a user's selection operation of the interactive unlocking mode. For example, the electronic device can display an operation control for selecting voiceprint unlocking in the interactive unlocking mode on the display interface. When the user operates the operation control, the voiceprint unlocking is performed in the interactive unlocking mode, and the voice of the sixth user's question is obtained.

[0211] Then correspondingly, if the user does not trigger the interactive unlocking operation, for example, the electronic device receives the user's selection of voiceprint unlocking in direct unlocking mode, then the electronic device adopts the following method: Figure 3-Figure 9 Any of the provided voiceprint unlocking methods can be used to directly unlock multiple people's voiceprints.

[0212] S302: The electronic device performs voiceprint recognition on the questioning voice to determine the predicted age of the sixth user.

[0213] The specific method of performing voiceprint recognition on speech to obtain predicted age can refer to the above embodiment S102 or S203.

[0214] S303: If the predicted age of the sixth user is within the first age range, the electronic device performs content recognition on the question voice to obtain a first question content corresponding to the question voice.

[0215] In this embodiment, the first age range may be an area greater than an age threshold. For example, the age threshold may be 18. The first age range is used to indicate the age range corresponding to adults. The predicted age of the sixth user is in the first age range, which means that the sixth user may be an adult. When the user is an adult, the voice input by the user is used as a question voice. The question voice refers to a voice that contains content keywords of the type corresponding to the interactive unlocking mode. The electronic device can perform content recognition on the voice of the sixth user, and when the voice contains content keywords of the type corresponding to the interactive unlocking mode, it is determined to be a question voice. At the same time, the electronic device performs content recognition on the question voice and can obtain the first question content corresponding to the question voice. Among them, the electronic device can use the system automatic speech recognition model to perform content recognition on the question voice. For details, please refer to S102 in the above embodiment.

[0216] For example, in interactive unlocking mode, a question-and-answer session is held about poetry. When a question is uttered, "The moon shines brightly before my bed," the electronic device identifies it as a question after determining that the voice contains keywords related to poetry. Simultaneously, the electronic device performs content recognition on the question and obtains the first question content corresponding to the question ("The moon shines brightly before my bed").

[0217] For example, the interactive unlocking mode involves questions and answers about mathematical operations. When a voice asks, "What is 15 + 25?", the electronic device identifies the voice as a question after determining that the voice contains keywords related to mathematical operations. Simultaneously, the electronic device performs content recognition on the voice and obtains the first question content corresponding to the voice ("What is 15 + 25?").

[0218] For example, the interactive unlocking mode involves a question-and-answer session involving common sense. When a user asks, "Stop at a red light," the electronic device identifies the question as a question after determining that the voice contains common sense keywords. It then performs content recognition on the question and obtains the first question ("Stop at a red light") corresponding to the voice.

[0219] Optionally, in some embodiments, the electronic device may match the seventh user's answer based on the first question. Alternatively, the electronic device may first obtain a standard answer based on the first question and then match the seventh user's answer based on the standard answer.

[0220] In some embodiments,

[0221] S304: The electronic device obtains standard answer content based on the first question content.

[0222] In this embodiment, the electronic device may obtain the standard answer content corresponding to the first question content from a local database; or the electronic device may also access the cloud and obtain the standard answer content corresponding to the first question content from a cloud database.

[0223] For example, if the first question is "The moon shines brightly before my bed," the standard answer the electronic device might receive might be "I wonder if it's frost on the ground." For example, if the first question is "What's 15 + 25?" the standard answer the electronic device might receive might be "40." For example, if the first question is "Stop at a red light," the standard answer the electronic device might receive might be "Go at a green light."

[0224] The standard answer content can be used as reference data to verify the correctness of the first answer content corresponding to the answer voice received by the electronic device.

[0225] In some feasible embodiments, the electronic device may detect whether the answer voice of the seventh user is received within a preset fourth time period while obtaining the standard answer content or after obtaining the standard answer content.

[0226] In other feasible embodiments, after obtaining the standard answer content, the electronic device may display all or part of the fields of the standard answer content on the display interface. In the case where the electronic device displays all fields of the standard answer content, the purpose of the electronic device is to provide the seventh user with a known knowledge for learning. The seventh user can read aloud the standard answer content to form an answer voice. In the case where the electronic device displays part of the fields of the standard answer content, the purpose of the electronic device is to provide the seventh user with a question knowledge for learning. The seventh user can answer based on part of the fields of the standard answer content to form an answer voice. This embodiment does not limit whether to display the standard answer content, and whether to display all or part of the fields of the standard answer content.

[0227] S305: If the electronic device receives the answering voice of the seventh user within the fourth time period, it performs content recognition on the answering voice to obtain the first answer content.

[0228] The fourth duration may be a preset duration. In some feasible examples, the fourth duration may be equal to the third duration. After the electronic device receives the seventh user's reply voice, it may perform content recognition on the reply voice to obtain the first reply content corresponding to the reply voice. For example, the first reply content may be "I suspect it is frost on the ground." For example, the first reply content may be "50." For example, the first reply content may be "Green light, go."

[0229] In some optional embodiments, the electronic device may also perform voiceprint recognition on the seventh user to obtain a predicted age. If the predicted age of the seventh user is less than an age threshold, the seventh user is considered a minor. If the seventh user is a minor, the minor's voice is used as the reply. The electronic device performs content recognition on the reply to obtain the first reply content, thereby providing an interesting and interactive learning experience for minors.

[0230] S306: The electronic device performs content matching based on the first question content and the first answer content to obtain a verification result.

[0231] In this embodiment, if S304 is not executed, the electronic device can directly match the first question content with the first answer content; or, after executing S304, the electronic device can match the first answer content with the standard answer content to obtain a verification result.

[0232] The following example illustrates the verification result obtained by matching the first answer content with the standard answer content.

[0233] For example, if the first answer is "I suspect it's frost on the ground," and the standard answer is "I suspect it's frost on the ground," the first answer matches the standard answer, and the verification result can be "Passed."

[0234] For example, if the first answer is "50" and the standard answer is "40," the first answer does not match the standard answer, and the verification result may be verification failure / failed verification.

[0235] For example, if the first answer is "Green light, go", and the standard answer is "Green light, go", the first answer matches the standard answer, and the verification result can be "Passed".

[0236] If the verification result is passed, the electronic device can perform a voiceprint unlocking operation to exit the function-restricted state of the electronic device. If the verification result is failed / failed, the electronic device can output a prompt message to prompt the seventh user to re-enter the answer voice. Alternatively, in other possible scenarios, if the number of times the first answer does not match the standard answer exceeds a threshold, the electronic device can output a prompt message refusing to exit the function-restricted state. Alternatively, in other possible scenarios, the electronic device can output a prompt message to confirm whether to unlock, and after receiving the operation to confirm unlocking, perform a voiceprint unlocking operation to exit the function-restricted state of the electronic device.

[0237] In other feasible practical application scenarios, when the electronic device is in a limited function state, it may receive voice input from two users in succession. For example, the electronic device first receives the voice input from the eighth user and then receives the voice input from the ninth user within the fifth duration. Here, the fifth duration can be a preset duration. In some feasible examples, the fifth duration can be equal to the fourth duration.

[0238] In this embodiment, according to conventional questioning sequences, the first voice received by the electronic device is considered the question, and the second voice received is considered the answer. The electronic device can perform voiceprint recognition on both voices to determine the predicted ages of the two users. Furthermore, the electronic device can perform content recognition on both voices to match the content of the two voices (the question and the answer).

[0239] In this scenario, when the question content matches the answer content and the predicted ages of the two users meet the unlocking conditions, the electronic device can exit the function-restricted state.

[0240] In this implementation, the electronic device doesn't need to specifically distinguish which user is an adult (the adult's voice is the questioning voice) and which user is a minor (the minor's voice is the answering voice). In this embodiment, the electronic device only needs to determine that the predicted ages of two people (one adult and one minor) meet the unlocking conditions, and that the content corresponding to the two users' voices matches, to exit the restricted function state. In terms of actual underlying computation, some data processing steps can be reduced in the electronic device, improving the efficiency of voiceprint unlocking in the electronic device.

[0241] It is understandable that the purpose of question-and-answer interaction is to increase the fun of the voiceprint unlocking process. When the ages of the sixth user and the seventh user meet the unlocking conditions, the verification results of the first answer content and the standard answer content may not actually affect the result of whether voiceprint unlocking is performed.

[0242] In a specific embodiment, Figure 11 Given Figure 10 A schematic diagram of a scenario of the voiceprint unlocking method provided. Figure 11 and Figure 6 The scenario is the same as above, so I will not go into details here.

[0243] like Figure 11 As shown, when the smart TV is in youth mode, in one example, the smart TV responds to the interactive unlocking operation, which may be that the smart TV receives a user's voice instruction about "interactive unlocking"; or, Figure 11 As shown, the smart TV can display an interactive unlocking interface on the display screen. Optionally, the interactive unlocking interface includes a first control. If the smart TV receives a user operation on the first control, the smart TV responds to the operation and unlocks the function-restricted state in an interactive unlocking mode.

[0244] If the smart TV does not receive any operation from the user on the first lock control within a certain period of time, the smart TV will Figure 3-Figure 9 Alternatively, the interactive unlocking interface further includes a second control. When the smart TV receives the user's operation on the second control, the smart TV uses the following method: Figure 3-Figure 9 The voiceprint unlocking method provided in any of the embodiments is used to unlock the voiceprint, which will not be described here.

[0245] like Figure 11 The voiceprint unlocking method in the interactive unlocking mode shown is illustrated using one of the above-mentioned embodiments. When the smart TV is in a limited-function state, a prompt message prompting the user to ask a question can be displayed on the display interface. After receiving the voice of the sixth user, the smart TV performs voiceprint recognition on the voice. After determining that the predicted age of the sixth user is within the first age range, the sixth user is regarded as the questioner in the interactive unlocking mode. The voice corresponding to the sixth user is used as the question voice. The smart TV performs content recognition on the question voice and obtains the question content corresponding to the question voice. The smart TV can perform content recognition on the question voice through the system's automatic voice recognition model to obtain the question content corresponding to the question voice.

[0246] After the smart TV receives the question, it can query the local interactive database or cloud database for the standard answer corresponding to the question. After obtaining the standard answer, the smart TV can display all or part of the standard answer on the display screen. The smart TV displays all or part of the standard answer in order to obtain the seventh user's voice response to the standard answer. The smart TV performs content recognition on the voice response to obtain the response content. If the response content matches the standard answer content, the electronic device performs voiceprint unlocking in interactive unlocking mode.

[0247] Or, in some other embodiments, such as Figure 11 As shown, after the smart TV obtains the standard answer content, the electronic device can output a prompt message prompting the user to read the standard answer content aloud. The prompt message contains the question content and the standard answer content. The answer voice generated when the seventh user reads aloud is obtained. The smart TV performs content recognition on the answer voice and obtains the answer content of the answer voice. If the answer content contains the standard answer content, it can also be determined that the answer content matches the standard answer content, and the voiceprint unlocking of the electronic device in the interactive voiceprint unlocking scenario can be performed.

[0248] Let's take the interactive unlocking mode, which involves a question-and-answer session about poetry, as an example. For example, the smart TV needs to access the cloud to obtain standard responses. The cloud database contains a large number of poetry segments. The smart TV performs content recognition on the sixth user's question and obtains the first question, "Bright moonlight shines on the bed." The smart TV sends a query request containing "Bright moonlight shines on the bed" to the cloud to obtain the standard response corresponding to "Bright moonlight shines on the bed." For example, the standard response is "I suspect it's frost on the ground." The smart TV can display the full standard response, "I suspect it's frost on the ground," or a partial standard response, "I suspect it's __ __ frost." The smart TV displays the full standard response so that a seventh user (e.g., a minor) can input a spoken response by reading the first response aloud. The smart TV displays the partial standard response so that the seventh user (e.g., a minor) can test their knowledge of the standard response and obtain the spoken response while the seventh user recites the full standard response.

[0249] The smart TV performs content recognition on the voice response and obtains the response content. If the response content is "Bright moonlight in front of my bed," and the response content matches the standard response content, the smart TV performs voiceprint unlocking in the electronic device's interactive unlocking mode, and the smart TV exits youth mode and the restricted function state. If the response content does not match the standard response content, a prompt message may be output, prompting the seventh user to re-enter the voice response. If the response content does not match the standard response content more than a certain number of times, the smart TV may output a prompt message refusing to exit youth mode.

[0250] Let's take a more specific example to illustrate. Figure 12The diagram shows a scene of a display interface of a smart TV. For example, when the smart TV is in youth mode, the interactive unlocking interface displayed is the "Poetry Answering Interface". The Poetry Answering Interface includes the first control and the second control of the "Poetry Answering" mode. When the smart TV receives the user's operation on the second control, the smart TV adopts the following method: Figure 3-Figure 9 When the smart TV receives the user's operation on the first control, the smart TV loads the automatic speech recognition model and displays a prompt message on the display interface prompting the user to input a question voice.

[0251] When the smart TV receives a question from a parent, it recognizes the question and obtains the question content. For example, the question content is "The moon shines brightly before the bed". The smart TV uses the question content as the previous sentence of the poem (the question sentence) and sends a query request with the question content to the cloud to obtain the standard answer content returned by the cloud. The smart TV can display all or part of the fields of the standard answer content on the display interface to prompt the user to give a voice answer. For example, Figure 12 The smart TV obtains the minor's answer voice, performs content recognition on the answer voice, and uses the minor's answer as the answer content. The smart TV can match the standard answer content with the answer content, and if they match, it can determine a successful verification result. Figure 12 In the example, if the authentication is successful, the smart TV can exit the youth mode. Otherwise, it is determined that the authentication has failed.

[0252] Figure 13 Several schematic diagrams of smart TV interactive unlocking interfaces are given. Figure 13 As shown in (a), after the smart TV obtains the standard answer content, it may not display the standard answer content. The smart TV may display the question information about the first question content in the interactive unlocking interface. For example, the question information of the first question content may be "What is the next sentence of the moonlight in front of the bed?" or, Figure 13 As shown in (b), after the smart TV obtains the standard answer content, the electronic device can output a prompt message prompting reading aloud. The prompt message includes the first question content and the standard answer content.

[0253] In this embodiment, whether the minor's answer is verified is not a strong basis for voiceprint unlocking. Essentially, as long as two users who meet the unlocking requirements participate in voiceprint unlocking, the electronic device can be unlocked with the voiceprint. The interactive unlocking scenario aims to make the unlocking process more engaging. Parents and children can interact during the unlocking process, learning different types of knowledge in a relaxed and enjoyable atmosphere. This can effectively enhance parent-child communication, reduce children's resistance to youth mode (where the electronic device is in a limited functionality state), and enhance the user experience. This embodiment does not limit the specific implementation details of the interactive interaction.

[0254] It should be noted that the personal information used in the technical solution of this application is limited to information for which the individual's separate consent has been obtained, including but not limited to notifying and reminding the user to read the relevant user agreement (notification) and sign the agreement (authorization) including authorization of relevant user information before the user uses the function.

[0255] In the technical solutions disclosed in this application, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0256] The voiceprint unlocking method provided in the embodiments of this application can be applied to electronic devices with a youth mode. For example, the electronic device can be a portable computer (such as a mobile phone), a tablet computer, a laptop computer, a personal computer (PC), a wearable electronic device (such as a smartwatch), an augmented reality (AR) or virtual reality (VR) device, and so on. For example, when the electronic device is a mobile phone, the voiceprint unlocking method can be applied to unlocking the youth mode of the mobile phone (the device itself). Alternatively, the voiceprint unlocking method can also be applied to unlocking the youth mode of various applications / functions in the mobile phone that have a youth mode. Specifically, the voiceprint unlocking method can be applied to unlocking the youth mode of gallery applications, social applications, game applications, and so on in the mobile phone.

[0257] In addition, the child lock mode is similar to the youth mode, both of which restrict the functions or partial functions of electronic devices. Therefore, the voiceprint unlocking method provided in the embodiments of this application can also be applied to smart home devices with child lock mode. For example, smart home devices can be smart washing machines / dryers, smart TVs, smart refrigerators, smart ovens, smart dishwashers, smart garment steamers, etc. The following embodiments do not specifically limit the specific form of these electronic devices.

[0258] Figure 14 A schematic structural diagram of the electronic device 100 is shown.

[0259] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a display screen 194, etc.

[0260] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0261] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0262] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0263] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0264] In this embodiment, the processor 110 may serve as the execution entity of the voiceprint unlocking method.

[0265] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0266] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0267] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.

[0268] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be provided in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be provided in the same device.

[0269] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0270] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals.

[0271] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter, amplify and other processing on the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0272] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0273] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0274] In this embodiment, for example, Figure 10 and Figure 11 In the provided embodiment, the electronic device can send a first question to a cloud server through wireless communication to obtain a first answer corresponding to the first question. Based on the matching result of the second answer and the first answer, a voiceprint unlocking operation in an interactive voiceprint unlocking scenario is performed.

[0275] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0276] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0277] In this embodiment, the electronic device may display the first answer or a partial field of the first answer on the display screen.

[0278] In addition, when the user age corresponding to the user's voice data does not meet the unlocking conditions, the electronic device can display a prompt message on the display screen.

[0279] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0280] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0281] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, speakers, microphones, and application processors. Optionally, the audio module 170 may also include other devices such as an earphone interface and a receiver.

[0282] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0283] The speaker, also called a "horn", is used to convert audio electrical signals into sound signals. The electronic device 100 can play audio through the speaker.

[0284] A microphone, also known as a "microphone" or "microphone", is used to convert sound signals into electrical signals. A microphone can also be understood as an audio collection device.

[0285] In this embodiment, the electronic device can collect the sound signal input by the user through the microphone, and the audio module 170 converts the user's sound signal into an electrical signal, and digitizes the electrical signal to obtain a digital audio signal. The audio module 170 can send the digital audio signal to the processor 110. The processor 110 uses the voiceprint unlocking method provided in the embodiment of the present application to perform voiceprint recognition and other processing on the digital audio signal. Specifically, the processor 110 can perform voiceprint recognition on the digital audio signal using a preset voiceprint recognition model, the processor 110 can perform content recognition on the digital audio signal using an automatic voice recognition model, and so on. The processor 110 can also store the digital audio signal in a designated storage space.

[0286] Figure 15 A possible structural diagram of the electronic device involved in the above embodiments is shown. Figure 15 The electronic device 1500 shown includes a processing module 1501, an audio acquisition module 1502, and a storage module 1503. In some optional embodiments, the electronic device 1500 may further include a display module 1504.

[0287] The processing module 1501 may be a central processing unit (CPU), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. The processor may include an application processor and a baseband processor. It may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and so on.

[0288] For example, the processing module 1501 may be as follows Figure 14 The processor 110 shown; the audio acquisition module 1502 can be as follows Figure 14 The microphone in the audio module 170 shown; the storage module 1503 can be as shown Figure 14 The internal memory 121 shown; the display module 1504 can be as follows Figure 14 The electronic device provided in the embodiment of the present application can be Figure 14 The electronic device 100 is shown.

[0289] The present application also provides a chip system (eg, a system on a chip (SoC)), such as Figure 16 As shown, the chip system includes at least one processor 1601 and at least one interface circuit 1602. The processor 1601 and the interface circuit 1602 can be interconnected via lines. For example, the interface circuit 1602 can be used to receive signals from other devices (such as a memory of an electronic device). For another example, the interface circuit 1602 can be used to send signals to other devices (such as the processor 1601 or a camera of an electronic device). Exemplarily, the interface circuit 1602 can read instructions stored in the memory and send the instructions to the processor 1601. When the instructions are executed by the processor 1601, the electronic device can execute the various steps in the above embodiments. Of course, the chip system can also include other discrete components, which are not specifically limited in the embodiments of the present application.

[0290] An embodiment of the present application also provides a computer-readable storage medium, which includes computer instructions. When the computer instructions are executed on the above-mentioned electronic device, the electronic device executes the various functions or steps executed by the electronic device 100 in the above-mentioned method embodiment.

[0291] The present application also provides a computer program product, which, when executed on a computer, enables the computer to execute the functions or steps executed by the electronic device 100 in the above method embodiment. For example, the computer may be the above electronic device 100.

[0292] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0293] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0294] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0295] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0296] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, and other media that can store program code.

[0297] The above content is only a specific embodiment of this application, but the scope of protection of this application is not limited to this. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A voiceprint unlocking method, characterized in that: The method comprises: When the electronic device is in a function-restricted state, acquiring an unlocking voice; the function-restricted state includes function-restricted system services in the electronic device or function-restricted applications in the electronic device; When the electronic device does not receive an interactive unlocking operation and the electronic device obtains unlocking voices of at least two users within a first time period, the electronic device performs voiceprint recognition on the unlocking voices of each of the users to determine the predicted age of each of the users; If the predicted ages of two of the at least two users meet the unlocking condition, the electronic device exits the function-restricted state; When the electronic device receives the interactive unlocking operation, the electronic device obtains the question voice and answer voice of the at least two users, and performs voiceprint recognition and content recognition on the question voice and the answer voice respectively. When the predicted ages of the at least two users meet the unlocking conditions and the question content corresponding to the question voice matches the answer content corresponding to the answer voice, the electronic device exits the function-restricted state.

2. The method according to claim 1, characterized in that The predicted ages of the two users meet the unlocking conditions, including: The age difference between the predicted ages of the two users is greater than or equal to a difference threshold; Alternatively, the predicted age of one of the two users is within a first age range, and the predicted age of the other of the two users is within a second age range; the first age range and the second age range do not overlap.

3. The method according to claim 1 or 2, characterized in that The method further comprises: When the electronic device is in the function-restricted state, if a first unlocking voice of a first user is acquired within the first time period, a first prompt message is output; the first prompt message is used to prompt a user whose age meets the unlocking condition to jointly participate in unlocking; If the electronic device receives a second unlocking voice of the second user within the second time period, performing voiceprint recognition on the second unlocking voice to determine the predicted age of the second user; If the predicted age of the first user and the predicted age of the second user satisfy the unlocking condition, the electronic device exits the function-restricted state.

4. The method according to claim 1 or 2, characterized in that The electronic device includes multiple function-restricted states, each of which corresponds to a target user of an age group with unlocking authority; The method further comprises: When the electronic device is in the function-restricted state, if a third unlocking voice of a third user is obtained within the first time period, and the third user is determined to be a target user corresponding to the function-restricted state based on the predicted age of the third user, the electronic device exits the function-restricted state.

5. The method according to claim 4, characterized in that The method further comprises: If the electronic device determines, based on the predicted age of the third user, that the third user is not a target user corresponding to the function-restricted state, the electronic device outputs a second prompt message; the second prompt message is used to prompt a target user whose age matches that of the third user to participate in unlocking the function; If the electronic device receives a fourth unlocking voice of a fourth user within a third time period, performing voiceprint recognition on the fourth unlocking voice to determine the predicted age of the fourth user; If the predicted age of the third user and the predicted age of the fourth user satisfy the unlocking condition, the electronic device exits the function-restricted state.

6. The method according to claim 1 or 2, characterized in that The electronic device includes multiple function-restricted states, each of which corresponds to a target user of an age group with unlocking authority; The method further comprises: When the electronic device is in the function-restricted state, if a fifth unlocking voice of a fifth user is acquired within the first time period, and the fifth user is determined to be a target user corresponding to the function-restricted state based on the predicted age of the fifth user, the electronic device performs security verification on the fifth user; the security verification includes password verification; When the fifth user passes the security verification, the electronic device exits the function-restricted state.

7. The method according to claim 1, characterized in that When the electronic device receives the interactive unlocking operation, the electronic device obtains the questioning voice and the answering voice of the at least two users, and performs voiceprint recognition and content recognition on the questioning voice and the answering voice respectively. When the predicted ages of the at least two users meet the unlocking condition and the question content corresponding to the questioning voice matches the answer content corresponding to the answering voice, the electronic device exits the function-restricted state, including: The electronic device obtains a question voice of a sixth user in response to the interactive unlocking operation; The electronic device performs voiceprint recognition on the question voice to determine the predicted age of the sixth user; If the predicted age of the sixth user is within the first age range, the electronic device performs content recognition on the question voice to obtain a first question content corresponding to the question voice; If the electronic device receives a reply voice from the seventh user within the fourth time period, the electronic device performs content recognition on the reply voice to obtain a first reply content; If the first answer content matches the first question content, the electronic device exits the function-restricted state.

8. The method according to claim 7, characterized in that After the electronic device receives the seventh user's answer voice within the fourth time period, the method further includes: The electronic device performs voiceprint recognition on the answering voice to determine the predicted age of the seventh user; The electronic device performs content recognition on the answer voice to obtain first answer content, including: If the predicted age of the seventh user is within the second age range, the electronic device performs content recognition on the answer voice to obtain the first answer content.

9. The method according to claim 1, characterized in that When the electronic device receives the interactive unlocking operation, the electronic device obtains the questioning voice and the answering voice of the at least two users, and performs voiceprint recognition and content recognition on the questioning voice and the answering voice respectively. When the predicted ages of the at least two users meet the unlocking condition and the question content corresponding to the questioning voice matches the answer content corresponding to the answering voice, the electronic device exits the function-restricted state, including: The electronic device obtains a question voice of an eighth user in response to the interactive unlocking operation; The electronic device performs content recognition on the question voice to obtain a second question content corresponding to the question voice; If the electronic device receives a ninth user's answer voice within the fifth time period, the electronic device performs content recognition on the answer voice to obtain a second answer content; The electronic device performs voiceprint recognition on the question voice and the answer voice respectively to determine the predicted age of the eighth user and the predicted age of the ninth user; When the second question content matches the second answer content, and the predicted age of the eighth user and the predicted age of the ninth user meet the unlocking condition, the electronic device exits the function-restricted state; Among them, the predicted age of the eighth user and the predicted age of the ninth user meet the unlocking condition, including: the age difference between the predicted age of the eighth user and the predicted age of the ninth user is greater than or equal to a difference threshold; or, the predicted age of the eighth user is in the first age range.

10. The method according to claim 7 or 9, characterized in that The method further comprises: The electronic device displays a question-and-answer interface; the question-and-answer interface includes fields related to question content.

11. The method according to claim 7 or 9, characterized in that The method further comprises: The electronic device displays an interactive unlocking interface; the interactive unlocking interface includes a first control and a second control; If the electronic device receives the interactive unlocking operation acting on the first control, the electronic device performs a step of acquiring a question voice of a sixth user, or performs a step of acquiring a question voice of an eighth user; If the electronic device receives a direct unlocking operation acting on the second control, the electronic device performs a step of acquiring an unlocking voice.

12. The method according to claim 1 or 2, characterized in that The electronic device performs voiceprint recognition on each user's unlocking voice to determine the predicted age of each user, including: The electronic device inputs the unlocking voice of each user into a voiceprint recognition model for feature extraction and age classification to determine the predicted age of each user.

13. An electronic device comprising an audio acquisition device, a memory, a processor, and a computer program stored in the memory, characterized in that: The processor executes the computer program to implement the steps of the method according to any one of claims 1 to 12.

14. A chip comprising a memory, a processor, and a computer program stored in the memory, wherein: The processor executes the computer program to perform the steps of implementing the method according to any one of claims 1 to 12.

15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 12 are implemented.

16. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 12 are implemented.

Images