Multi-user personalized interface switching control method and device for smart television

Abstract

The invention discloses a multi-user personalized interface switching control method and device for a smart television, and the method comprises the steps: collecting the facial information of a user, and recognizing the facial features of a current user; and / or collecting sound information of the user, and extracting voiceprint features of the current user; identifying the identity information of the current user of the smart television according to the facial features and / or voiceprint features of the current user; according to the identified identity information of the current user, calling a preset personalized interface corresponding to the identity information of the current user; and based on the personalized interface which is confirmed by the user and corresponds to the identity information of the current user, controlling the smart television to be automatically switched to the corresponding personalized interface, and automatically calling the corresponding personalized recommendation content to be recommended and displayed. According to the method, the current watching user can be intelligently recognized according to two modes of the camera and voice recognition, and the corresponding personalized interface and setting and personalized content recommendation are switched, so that convenience is provided for the use of the user.

Description

Technical Field

[0001] The present invention relates to the technical field of smart televisions, and in particular to a method and device for switching and controlling multiple user personalized interfaces of a smart television, a smart television and a storage medium. Background Art

[0002] With the development of science and technology and the continuous improvement of people's living standards, the use of smart TVs such as smart TVs is becoming more and more popular.

[0003] Most of the smart TVs in the prior art only support a single user interface and settings, and cannot automatically switch to their own personalized interfaces and recommended content according to different users. This design is not smart and convenient enough when used in a home environment, and is sometimes inconvenient for users to use.

[0004] Therefore, the existing technology still needs to be improved and developed. Summary of the invention

[0005] The technical problem to be solved by the present invention is that, in view of the above-mentioned defects of the prior art, a multi-user personalized interface switching control method, device, smart TV and storage medium are provided. The present invention provides a multi-user switching system and method, which can intelligently identify the current viewing user according to two methods: camera and voice recognition, and switch to the corresponding personalized interface and settings as well as personalized content recommendations, providing convenience for users.

[0006] The technical solution adopted by the present invention to solve the problem is as follows:

[0007] A method for switching and controlling a multi-user personalized interface of a smart television, comprising:

[0008] Control the collection of facial information of the user in front of the smart TV through the camera, and identify the facial features of the current user through the facial recognition algorithm;

[0009] And / or, controlling the collection of voice information of the user in front of the smart TV, and extracting the voiceprint features of the current user through a voiceprint recognition module;

[0010] Identify the identity information of the current user of the smart TV according to the facial features and / or voiceprint features of the current user;

[0011] According to the identified identity information of the current user, a personalized interface corresponding to the identity information of the current user is retrieved in advance;

[0012] Based on the personalized interface corresponding to the identity information of the current user confirmed by the user, the smart TV is controlled to automatically switch to the corresponding personalized interface, and the corresponding personalized recommended content is automatically retrieved for recommendation display.

[0013] The method for controlling the switching of multiple user personalized interfaces of a smart TV, wherein the control includes the following steps before the step of collecting facial information of the user in front of the smart TV through a camera and recognizing the facial features of the current user through a facial recognition algorithm:

[0014] The viewing behavior data of each user is collected in advance on the smart TV, and corresponding personalized recommendation content is generated based on the viewing behavior data of each user.

[0015] The method for controlling the switching of multiple user personalized interfaces of a smart TV, wherein the control collects facial information of the user in front of the smart TV through a camera and recognizes the facial features of the current user through a facial recognition algorithm, comprises:

[0016] Collect the viewing behavior data of each user on the smart TV in advance, and generate a personalized interface corresponding to the user's identity information based on the viewing behavior data and personal setting data of each user;

[0017] And receive the user's operation instructions, set up a personalized interface corresponding to the user's identity information, including: theme and layout settings, volume settings, screen brightness settings, language settings, subtitles, and playback speed settings.

[0018] The method for controlling the switching of multiple user personalized interfaces of a smart TV, wherein the control collects facial information of the user in front of the smart TV through a camera and recognizes the facial features of the current user through a facial recognition algorithm, comprises:

[0019] Control the camera to collect the facial image of the user in front of the smart TV, and use the deep learning algorithm based on the convolutional neural network to extract features and generate facial feature vectors;

[0020] Comparing the facial feature vector with a pre-stored user facial feature database, using Euclidean distance or cosine similarity as a matching measure;

[0021] When the matching degree exceeds the set facial feature threshold, the identity of the current user is recognized, otherwise it prompts that the recognition fails.

[0022] The multi-user personalized interface switching control method of the smart TV, wherein the step of controlling the acquisition of voice information of the user in front of the smart TV and extracting the voiceprint features of the current user through the voiceprint recognition module comprises:

[0023] Control the acquisition of voice information of the user in front of the smart TV through the microphone set on the smart TV;

[0024] Preprocessing the sound information, including noise removal and normalization;

[0025] After processing, the timbre features are extracted using the Mel-frequency cepstral coefficients of the sound information, and a voiceprint feature vector is generated;

[0026] Using dynamic time warping or Gaussian mixture model as a matching algorithm, the currently extracted voiceprint feature vector is compared with the pre-stored user timbre feature database;

[0027] If the matching degree exceeds the set voiceprint feature threshold, the identity of the current user is recognized, otherwise it prompts that the recognition failed.

[0028] The multi-user personalized interface switching control method of the smart TV, wherein the step of calling the pre-set personalized interface corresponding to the identity information of the current user according to the identified identity information of the current user comprises:

[0029] According to the identified identity information of the current multiple or single users, multiple or single personalized interfaces corresponding to the identity information of the current user that are preset are read from the data storage module for the user to select and confirm;

[0030] Receive the user's operation instruction to select and confirm the personalized interface corresponding to the current user's identity information.

[0031] The method for controlling the switching of multiple user personalized interfaces of a smart TV, wherein the steps of controlling the smart TV to automatically switch to the corresponding personalized interface based on the personalized interface corresponding to the identity information of the current user confirmed by the user, and automatically retrieving the corresponding personalized recommended content for recommendation display include:

[0032] Based on the personalized interface corresponding to the identity information of the current user confirmed by the user, controlling the smart TV to automatically switch to the corresponding personalized interface;

[0033] Obtain personalized recommended content corresponding to the current user's identity information from the data storage module for recommendation and display;

[0034] The personalized recommendation content includes:

[0035] Movie recommendations based on user viewing history and ratings;

[0036] Channel recommendations based on user viewing habits;

[0037] App recommendations based on user usage habits.

[0038] A multi-user personalized interface switching control device for a smart television, wherein the device comprises:

[0039] A first pre-setting module is used to collect viewing behavior data of each user on the smart TV in advance, and generate corresponding personalized recommendation content according to the viewing behavior data of each user;

[0040] A second pre-setting module is used to collect the viewing behavior data of each user on the smart TV in advance, and generate a personalized interface corresponding to the user's identity information one by one according to the viewing behavior data and personal setting data of each user;

[0041] The custom setting module is used to receive the user's operation instructions and set a personalized interface corresponding to the user's identity information, including: theme and layout settings, volume settings, screen brightness settings, language settings, subtitles, and playback speed settings;

[0042] The facial feature extraction module is used to control the collection of facial information of the user in front of the smart TV through the camera, and recognize the facial features of the current user through the facial recognition algorithm;

[0043] The voice feature extraction module is used to control the acquisition of voice information of the user in front of the smart TV, and extract the voiceprint features of the current user through the voiceprint recognition module;

[0044] A user identity confirmation module, used to identify the identity information of the current user of the smart TV based on the facial features and / or voiceprint features of the current user;

[0045] A personalized interface calling module, used to call a preset personalized interface corresponding to the identity information of the current user according to the identified identity information of the current user;

[0046] The personalized content recommendation module is used to control the smart TV to automatically switch to the corresponding personalized interface based on the personalized interface corresponding to the identity information of the current user confirmed by the user, and automatically retrieve the corresponding personalized recommended content for recommendation display.

[0047] A smart TV comprises a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, including the method for executing any one of the methods described above.

[0048] A non-transitory computer-readable storage medium, wherein when instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute any one of the methods described above.

[0049] Beneficial effects of the present invention: The present invention provides a method and device for switching a multi-user personalized interface of a smart TV, a smart TV and a storage medium. The present invention adds new functions to the smart TV: it has the functions of intelligently identifying the current user through a camera and voice recognition, switching to a corresponding personalized interface and settings, and personalized content recommendation, which provides convenience for users and improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0051] Figure 1 It is a flow chart of a method for switching and controlling multiple user personalized interfaces of a smart TV provided by an embodiment of the present invention.

[0052] Figure 2 It is a principle block diagram of an embodiment of a multi-user personalized interface switching control device for a smart television provided by the present invention.

[0053] Figure 3 It is a block diagram of the internal structure principle of the smart TV provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical solution and advantages of the present invention clearer and more specific, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0055] It should be noted that if the embodiments of the present invention involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0056] Most of the smart TVs in the prior art only support a single user interface and settings, and cannot automatically switch to their own personalized interfaces and recommended content according to different users. This design is not smart and convenient enough when used in a home environment, and sometimes it is inconvenient for users to use.

[0057] The present invention provides a multi-user switching method for a smart television, which intelligently identifies the current user through two modes: camera and voice recognition, and switches to a corresponding personalized interface and setting, as well as personalized content recommendation, thereby improving user experience.

[0058] Embodiment 1,

[0059] like Figure 1 As shown, a multi-user personalized interface switching control method for a smart TV according to Embodiment 1 of the present invention comprises the following steps:

[0060] Step S100, controlling the camera to collect facial information of the user in front of the smart TV, and identifying the facial features of the current user through a facial recognition algorithm;

[0061] In the embodiment of the present invention, a smart TV is used as an example for explanation, and a camera and a microphone are installed on the smart TV. Specifically, the smart TV has a built-in high-definition camera installed on the front panel of the smart TV to ensure that the user's facial image is captured. The camera has low-light adaptability to ensure that it can work normally under different lighting conditions.

[0062] In the present invention, when a user turns on a smart TV and the smart TV starts successfully, it controls the built-in high-definition camera to capture the facial image of the current user, uses a facial recognition algorithm to extract facial features, and compares the extracted facial features with pre-stored features in a database, and then determines the user identity based on the comparison results.

[0063] Furthermore, the step S100 specifically includes:

[0064] S101: Control the camera to collect the facial image of the user in front of the smart TV, and use the deep learning algorithm based on the convolutional neural network to extract features and generate a facial feature vector.

[0065] This step involves using the smart TV’s camera to capture an image of the user’s face. Next, deep learning algorithms such as convolutional neural networks (CNNs) are used to analyze the image and extract the user’s facial features. These features are converted into a vector format, making it easier for computers to compare and match.

[0066] S102: Compare the facial feature vector with a pre-stored user facial feature database, and use Euclidean distance or cosine similarity as a matching degree measurement standard.

[0067] In step S102, the extracted facial feature vector is compared with a pre-stored user facial feature database. Euclidean distance or cosine similarity is used to calculate the similarity between two feature vectors. These mathematical methods are used to quantify "similarity" to determine whether the current user matches a user in the database.

[0068] S103: When the matching degree exceeds the set facial feature threshold, the identity of the current user is recognized, otherwise it is prompted that the recognition fails.

[0069] When the comparison result shows that the similarity between the facial feature vector of the current user and a user in the database exceeds a preset threshold, the present invention can confirm the identity of the user. If the threshold is not reached, the present invention will issue a prompt indicating recognition failure.

[0070] For example, when there are four members in a family, they use the same smart TV. In the traditional mode, each user needs to enter his or her own login information, which is troublesome. However, after the facial recognition technology is introduced in the embodiment of the present invention, when any user walks in front of the TV, the camera will automatically capture their facial image and analyze it. If Xiao Ming is recognized, the subsequent steps of the present invention will automatically load Xiao Ming's personal interface and recommend his favorite programs, saving him the trouble of manual search. If the recognition fails, the TV will prompt "The user is not recognized, please try again", which effectively protects the privacy and security of family content.

[0071] The benefit of this step is that the use of facial recognition technology can effectively improve the security of smart TVs, ensuring that only authorized users can access certain functions or content, such as private accounts of family members. And users do not need to enter passwords or PIN codes, just stand in front of the TV, and the identity can be automatically identified, saving time and improving user experience. In the following steps, the present invention can also provide personalized content recommendations, preference settings and viewing history for different users based on the identified user identity, thereby improving user satisfaction.

[0072] Step S200, and / or, controlling the collection of voice information of the user in front of the smart TV, and extracting the voiceprint features of the current user through a voiceprint recognition module;

[0073] In the embodiment of the present invention, the smart TV includes a built-in microphone installed on the front panel of the smart TV to ensure that the user's voice information can be captured. In addition, the microphone in the embodiment of the present invention has a noise reduction function to ensure the voice collection effect in a noisy environment.

[0074] In the previous steps of the present invention, the identity of the user can be preliminarily identified through the facial features of the user in the camera; when the user is not facing the camera and only partial facial information of the user is collected, in the embodiment of this step, the collection of the user's voice information in front of the smart TV is further controlled, and then the user's voice information is preprocessed, the timbre features are extracted and a feature vector is generated; and the feature vector is compared with the pre-stored features in the database; and the user's identity is determined based on the comparison results.

[0075] Specifically, the step S200 includes:

[0076] S201: Controlling the acquisition of voice information of a user in front of the smart TV through a microphone arranged on the smart TV.

[0077] In this step, the microphone of the smart TV is used to capture the sound made by the user. This sound information can be a simple voice command or other voice communication of the user.

[0078] S202: Preprocessing the sound information, including noise removal and normalization.

[0079] Because the collected sound information is usually disturbed by background noise, this step will perform preprocessing. Noise removal will remove environmental noise, and normalization will ensure consistent volume levels for more accurate subsequent processing.

[0080] S203: extracting timbre features from the processed sound information using Mel-frequency cepstral coefficients, and generating a voiceprint feature vector.

[0081] In this step, the timbre features are extracted using the Mel Frequency Cepstral Coefficient (MFCC) method. MFCC is a commonly used audio feature extraction technology that can effectively capture the frequency characteristics of speech and generate voiceprint feature vectors for subsequent matching and recognition.

[0082] S204: Using dynamic time warping or Gaussian mixture model as a matching algorithm, the currently extracted voiceprint feature vector is compared with a pre-stored user timbre feature database.

[0083] This step compares the extracted voiceprint feature vector with the existing user timbre features in the database through dynamic time warping (DTW) or Gaussian mixture model (GMM) to determine the identity of the user.

[0084] S205: If the matching degree exceeds the set voiceprint feature threshold, the identity of the current user is identified, otherwise it is prompted that the identification fails.

[0085] In the present invention, if the comparison result shows that the similarity between the user's voice features and the voice features stored in the database exceeds a set threshold, the system will confirm the user's identity, otherwise, it will display a prompt that the recognition failed.

[0086] For example, in a family of four, the smart TV at home has a voiceprint recognition function. When Xiao Li walks to the TV and says, "Play my music," the microphone of the smart TV in the embodiment of the present invention will capture her voice, and then process the sound information, extract features, and compare it with the existing voiceprints in the database. If Xiao Li's voiceprint matches the database, the smart TV automatically recognizes that it is Xiao Li, and in the following steps, it can automatically load her personal music list and play it according to Xiao Li's daily usage habits. If it is her brother Xiao Zhang who is speaking, due to the different voice characteristics, the present invention may prompt "Unrecognized user, try to confirm identity again" according to the recognition failure. This method not only improves the convenience of use, but also maintains the personalized experience and privacy security of each family member.

[0087] The benefit of this step is that the present invention uses voiceprint recognition technology, so that each family member can authenticate their identity through their own voice, protect family privacy, and ensure that only authorized users can access certain specific functions or content. And users no longer need to remember or enter passwords, just simply say the command, and the system can immediately recognize it, thereby improving the overall user experience and efficiency. And by identifying different users, the present invention can make personalized recommendations and settings based on the user's preferences and history. For example, different users can get different interface layouts and program recommendations.

[0088] Step S300, identifying the identity information of the current user of the smart TV according to the facial features and / or voiceprint features of the current user;

[0089] In the embodiment of this step, the smart TV confirms the identity of the user by analyzing the facial features and / or voiceprint features of the user. In the embodiment of the present invention, the facial features and timbre features of the user are pre-stored. And the interface theme and layout configuration of the user corresponding to the user identity information are stored. Specifically, the present invention can use the facial features or voiceprint features of the user alone to confirm the identity of the user. That is, when the facial features of the user collected by the camera are clear and comprehensive, the facial features of the user can be used alone to identify the user's identity, or when the voiceprint features of the user collected by the microphone of the smart TV are clear, the voiceprint features of the user can be used alone to identify the user's identity, which is conducive to improving the recognition efficiency.

[0090] At the same time, the two identification methods can complement each other. That is, when the facial features of the user collected by the camera are only partial and can only preliminarily confirm the user's identity, the user's voiceprint features can be further collected through the microphone of the smart TV; the user's facial image and voice information are considered at the same time, and comprehensive judgment is made using advanced image processing and voice recognition technology. By comparing these features with the pre-stored user database, the system can accurately identify the user currently using the TV.

[0091] The benefit of this step is that it combines facial features and voiceprint features for identity recognition, providing a dual verification mechanism. This multi-factor authentication method significantly improves security, ensuring that only authorized users can access specific content or functions. And users do not need to manually enter passwords or perform tedious identity verification, they only need to stand in front of the TV or say a sentence to be automatically recognized. This convenience greatly improves the user's viewing experience, making it more smooth and natural.

[0092] Furthermore, by identifying the user identity, the smart TV can provide personalized content recommendations based on the viewing history and preferences of different users. For example, children can see programs suitable for them, while adults can get content that better suits their interests. The present invention allows each family member to have their own account and settings, avoiding content confusion and loss of personalized settings. Each user can find their favorite programs and applications on their own interface.

[0093] Step S400: according to the identified identity information of the current user, retrieve a pre-set personalized interface corresponding to the identity information of the current user;

[0094] Before this step is implemented, it is necessary to collect the viewing behavior data of each user on the smart TV in advance, and generate a personalized interface corresponding to the user's identity information one by one according to the viewing behavior data and personal setting data of each user;

[0095] And receive the user's operation instructions, set up a personalized interface corresponding to the user's identity information, including: theme and layout settings, volume settings, screen brightness settings, language settings, subtitles, and playback speed settings.

[0096] That is, the smart TV in the embodiment of the present invention will automatically record the viewing behavior data of each user when the user watches the program. This data includes the type of program watched, viewing time, viewing frequency, etc. At the same time, the system will also collect the user's personal setting data, such as their theme preference, volume, screen brightness, language selection, subtitle requirements and playback speed, etc.

[0097] According to the collected viewing behavior data and personal setting data, the smart TV of the present invention will generate a personalized interface for each user corresponding to his / her identity information, that is, each user will see the interface layout and content recommendations that suit his / her preferences when using the TV.

[0098] At the same time, the user of the present invention can adjust the personalized interface settings through the remote control or voice command when using the TV. The system can automatically apply these settings, including themes and layouts, volume, screen brightness, language, subtitles, and playback speed, according to the user's identity information.

[0099] The benefit of this step is that the personalized interface can be customized according to the user's preferences and habits, which improves the user's satisfaction and user experience. Users can find their favorite content faster and enjoy a smoother viewing experience. And by automatically recording and applying the user's settings, the user does not need to make cumbersome manual adjustments every time he uses the TV. This convenience saves time and allows users to focus more on watching content. And each family member of the present invention can have his or her own personalized interface, avoiding content confusion and setting conflicts. This design encourages interaction between family members and promotes opportunities for joint viewing and discussion.

[0100] For example, when there are four members in a family: parents and two children. Each member has different viewing habits and preferences. Smart TVs record their behavior data every time they watch. For example, the father likes to watch news and documentaries, the mother prefers romantic movies, and the two children like cartoons and children's programs.

[0101] When the father uses the TV, the present invention automatically loads his personalized interface, displays his frequently watched news channels and documentary recommendations, sets the volume to a level suitable for news viewing, adjusts the screen brightness to a state suitable for daytime viewing, sets the language to Chinese, and turns off subtitles.

[0102] When children use the TV, the present invention will switch to their personalized interface, recommend cartoons suitable for them, increase the volume to suit their viewing habits, adjust the screen brightness to a state suitable for evening viewing, set the language to a language they are familiar with, and turn on subtitles as needed.

[0103] This personalized experience not only allows every family member to enjoy their favorite content, but also effectively avoids the trouble caused by setting conflicts, improving the family's overall viewing experience.

[0104] Of course, in the embodiment of the present invention, users can also set their own personalized interface configurations; each user can select different interface themes, such as colors, background images, etc. Each user can customize the main interface layout, such as channel order, shortcut location, etc.

[0105] User personalization settings can also include:

[0106] Volume settings: Different users can save their volume preferences.

[0107] Screen Brightness: Different users can save their brightness preferences.

[0108] Language settings: Different users can save their language selections.

[0109] Other settings: such as subtitles, playback speed, etc.

[0110] In this step S400, based on the identified identity information of the current user, a personalized interface that is preset and corresponds to the identity information of the current user is retrieved.

[0111] In this step embodiment, the smart TV first confirms the identity of the current user through facial recognition or voiceprint recognition technology. Once the user's identity is identified, the present invention will immediately call up a personalized interface corresponding to the user's identity information. These personalized interfaces are pre-generated based on the user's viewing habits, preference settings, and historical behavior data.

[0112] Specifically, the present invention retrieves interface settings related to the current user from the database, including content recommendations, theme styles, layout designs, volume and brightness settings, etc. In this way, when the user turns on the TV, he can immediately see the interface that suits his preferences without any manual adjustments.

[0113] The benefit of this step is that by quickly calling up the personalized interface, the user can enjoy a customized viewing experience the moment the TV is turned on. This instant response improves user satisfaction and user experience. And users no longer need to manually set up the interface or find their favorite content. The present invention automatically provides them with personalized choices, simplifies the operation process, and lowers the threshold for use. The personalized interface of the present invention can recommend related content based on the user's interests and viewing history, ensuring that users can quickly find their favorite programs and increase the fun of watching. And when users experience personalized services, they are more likely to continue using the smart TV, thereby enhancing user stickiness and loyalty.

[0114] For example, in a family, a father, a mother, and two children all use the same smart TV. One day, the father returns home and his identity is confirmed through facial recognition technology. After the identification is completed, the smart TV of the present invention immediately calls up a personalized interface corresponding to the father's identity information. On this personalized interface, the father sees the news channels and documentary recommendations he often watches. The interface theme is simple style, the layout design is mainly based on information display, the volume is set to a level suitable for news viewing, and the screen brightness is adjusted to a state suitable for evening viewing.

[0115] At the same time, if the mother is using the same TV, the smart TV of the embodiment of the present invention will also confirm her identity through recognition and call up a personalized interface related to her. The mother's interface may show recommendations for romantic movies she likes, with a warm theme, a layout design that focuses more on visual beauty, and volume and brightness settings that are adjusted according to her preferences.

[0116] This personalized experience not only allows each family member to enjoy their favorite content, but also effectively avoids the trouble caused by setting conflicts, improving the family's overall viewing experience. In this way, smart TV can provide each user with a unique and enjoyable experience, enhancing the interactivity and fun of family entertainment.

[0117] In a further embodiment, the step S400 specifically includes:

[0118] S401, according to the identified identity information of multiple or one current user, read multiple or one personalized interfaces corresponding to the identity information of the current user from the data storage module for the user to select and confirm;

[0119] That is, in the embodiment of the present invention, when multiple people are watching TV in front of the TV, multiple user identity information can be identified, and if only one person is watching TV, only one user identity information can be identified.

[0120] In the embodiment of the present invention, when multiple people watch TV together, multiple user identity information is identified, and multiple personalized interfaces corresponding to the identity information of the current user are read from the data storage module for the user to select and confirm; the user is allowed to select which user interface to use as the main one, which provides convenience for the user and avoids the problem of multiple people randomly switching operation interfaces.

[0121] S402: Receive the user's operation instruction to select and confirm the personalized interface corresponding to the identity information of the current user.

[0122] In the embodiment of this step, when the user selects one of the personalized interfaces provided and confirms that it corresponds to the identity information of the current user, the process proceeds to S500.

[0123] Step S500: Based on the personalized interface corresponding to the identity information of the current user confirmed by the user, the smart TV is controlled to automatically switch to the corresponding personalized interface, and the corresponding personalized recommended content is automatically retrieved for recommendation display.

[0124] Before the present invention is implemented, the viewing behavior data of each user is collected on the smart TV in advance, and corresponding personalized recommendation content is generated according to the viewing behavior data of each user.

[0125] In the embodiment of the present invention, the viewing behavior data of each user is collected in advance on the smart TV, which means that the user's preferences and habits are understood by analyzing the programs, movies, channels and viewing time of the user on the TV. These data can be collected through the built-in functions of the smart TV or related applications. Based on these data, the present invention can generate personalized recommended content to better meet the needs of users.

[0126] Regarding data collection, the smart TV of the present invention can specifically record the user's viewing history, including the type of program watched (such as TV series, movies, sports, etc.), viewing frequency, viewing time period, etc. These data can be associated through the user's account to ensure that each user's viewing behavior is accurately recorded. Then, based on the collected viewing behavior data, the recommendation algorithm of the smart TV can analyze the user's preferences and generate personalized content recommendation storage.

[0127] For example, if a user named Xiao Li often watches suspense dramas and comedies at night, the smart TV of the present invention analyzes his viewing behavior and finds that he has a high interest in these types of programs. Therefore, the present invention generates recommended content for Xiao Li, such as recommending several new suspense dramas and a popular comedy as Xiao Li's personalized recommended content.

[0128] Personalized recommendations can help users find interesting content faster, reduce search time, and improve viewing satisfaction. And by recommending programs that users may like, it can effectively increase users' viewing time, thereby improving the activity of the platform.

[0129] In this step S500, based on the personalized interface corresponding to the identity information of the current user confirmed by the user, the smart TV is controlled to automatically switch to the corresponding personalized interface, and the corresponding personalized recommended content is automatically retrieved for recommendation display.

[0130] In this step embodiment, in a smart TV, a personalized interface is generated based on the identity information confirmed by the user, which means that the system can identify the identity of the current user and automatically adjust the TV interface and recommended content according to his or her preferences and historical behavior. This process involves the automation of user identity authentication, interface switching, and content recommendation.

[0131] Specifically, the smart TV confirms the identity of the current user through the user's account login, facial recognition or other identity verification methods. This step ensures that the system can accurately identify the user, thereby providing a personalized experience. Once the user's identity is confirmed, the smart TV of the present invention will automatically switch to a personalized interface exclusive to the user. This interface may include the user's frequently used applications, recently viewed content, and personalized recommendation columns. In the personalized interface of the present invention, recommended content related to user preferences will be automatically retrieved. For example, if the user likes to watch comedies and family programs, the system will give priority to displaying these types of content.

[0132] The benefit of this step is that the personalized interface can make users feel valued and provide content that is more in line with their interests, thereby improving overall satisfaction. Users do not need to manually search or adjust settings, the system automatically provides them with a personalized experience, saving time and energy. And by providing personalized content and interfaces, users are more likely to use smart TVs frequently, thereby increasing the platform's activity and user stickiness.

[0133] For example, when there are four members in a family, each member has his or her own viewing preferences. Xiao Zhang likes science fiction movies, Xiao Li prefers documentaries, Xiao Wang is keen on sports events, and Xiao Mei likes children's programs. In the embodiment of the present invention, when they each log in to the smart TV through facial recognition or voice recognition, the system will automatically switch to the corresponding personalized interface through user identity confirmation.

[0134] After Xiao Zhang logs in through facial or voice recognition, the TV interface displays the latest science fiction movies and related recommended programs.

[0135] After Xiao Li logs in through facial or voice recognition, the interface displays the latest documentaries and related viewing history.

[0136] After Xiao Wang logs in through facial or voice recognition, the interface shows upcoming sports events and his favorite sports channels.

[0137] After Xiaomei logs in through facial or voice recognition, the interface is filled with cartoons and educational programs suitable for children.

[0138] This personalized experience not only allows each family member to quickly find their favorite content, but also enhances their dependence on smart TVs and promotes interaction and shared viewing experience among family members.

[0139] Furthermore, the step S500 specifically includes:

[0140] S501, based on the personalized interface corresponding to the identity information of the current user confirmed by the user, controlling the smart TV to automatically switch to the corresponding personalized interface;

[0141] In this step, the smart TV first confirms the identity of the current user. This can be done through the user's account login, facial recognition or other authentication methods. Once the user's identity is confirmed, the system automatically switches to the user's exclusive personalized interface. This interface not only contains the user's commonly used applications, but also displays content layout related to the user's interests, allowing users to quickly find their favorite programs.

[0142] S502: Obtain personalized recommended content corresponding to the identity information of the current user from the data storage module for recommendation and display; wherein the personalized recommended content includes:

[0143] Movie recommendations based on user viewing history and ratings, such as recommending similar movies;

[0144] Channel recommendations based on user viewing habits, such as frequently watched channels;

[0145] Application recommendations based on user usage habits, such as recommendations for commonly used applications and games.

[0146] That is, after the user interface is switched, the present invention will extract personalized recommended content corresponding to the current user identity information from the data storage module. These recommended contents mainly include:

[0147] 1) Movie recommendations based on user viewing history and ratings: Specifically, the present invention analyzes the movies that the user has watched in the past and their ratings, and recommends movies of similar genres or themes. For example, if the user often watches highly rated romance movies, the system may recommend the latest romance movies.

[0148] 2) Channel recommendation content based on user viewing habits: Specifically, by analyzing the user's viewing habits, the system can recommend the user's most frequently watched channels or related channels. For example, if the user often watches news channels, the system may recommend other news-related channels.

[0149] 3) Application recommendation content based on user usage habits: Specifically, the system of the present invention will also recommend other applications that the user may be interested in based on the application programs used. For example, if the user often uses music streaming applications, the system may recommend other music-related applications.

[0150] For example, when user Xiao Wang logs in to the smart TV, the present invention confirms his identity through facial recognition and automatically switches to Xiao Wang's personalized interface. At this time, the following content is displayed on the interface:

[0151] Movie recommendation: Xiao Wang has watched and rated high-rated science fiction movies before, and the system recommends the latest science fiction movie "Ad Astra".

[0152] Channel recommendation: Xiao Wang is used to watching sports channels, and the system recommends the channel for the upcoming live football matches.

[0153] App recommendations: Xiao Wang frequently uses fitness apps. The system also recommends a new healthy diet app to help him better manage his diet.

[0154] Through this personalized recommendation mechanism, Xiao Wang can quickly find content that interests him, which improves his viewing experience and also increases the frequency of his use of smart TVs.

[0155] That is, in the present invention, by automatically switching to the personalized interface, users can find the content of interest more quickly, thereby improving the overall viewing experience. Moreover, users do not need to manually search or browse a large amount of content, and the system automatically provides personalized recommendations for them, saving time in finding content. Moreover, personalized recommendations ensure that the content received by users is highly relevant to their interests, thereby improving viewing satisfaction and participation.

[0156] Exemplary Devices

[0157] like Figure 2 As shown, an embodiment of the present invention provides a multi-user personalized interface switching control device for a smart TV, the device comprising:

[0158] The first presetting module 310 is used to collect the viewing behavior data of each user on the smart TV in advance, and generate corresponding personalized recommendation content according to the viewing behavior data of each user;

[0159] The second pre-setting module 320 is used to collect the viewing behavior data of each user on the smart TV in advance, and generate a personalized interface corresponding to the user's identity information one by one according to the viewing behavior data and personal setting data of each user;

[0160] The custom setting module 330 is used to receive the user's operation instructions and set a personalized interface corresponding to the user's identity information, including: theme and layout settings, volume settings, screen brightness settings, language settings, subtitles, and playback speed settings;

[0161] The facial feature extraction module 340 is used to control the collection of facial information of the user in front of the smart TV through the camera, and recognize the facial features of the current user through the facial recognition algorithm;

[0162] The voice feature extraction module 350 is used to control the acquisition of voice information of the user in front of the smart TV, and extract the voiceprint feature of the current user through the voiceprint recognition module;

[0163] The user identity confirmation module 360 ​​is used to identify the identity information of the current user of the smart TV according to the facial features and / or voiceprint features of the current user;

[0164] The personalized interface calling module 370 is used to call a preset personalized interface corresponding to the identity information of the current user according to the identified identity information of the current user;

[0165] The personalized content recommendation module 380 is used to control the smart TV to automatically switch to the corresponding personalized interface based on the personalized interface corresponding to the identity information of the current user confirmed by the user, and automatically retrieve the corresponding personalized recommended content for recommendation display, as described above.

[0166] Based on the above embodiments, the present invention further provides a smart TV, whose principle block diagram can be shown as follows: Figure 3 As shown. The smart TV includes a processor, a memory, a network interface, a display screen, and a database connected through a system bus. Among them, the processor of the smart TV is used to provide computing and control capabilities. The memory of the smart TV includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the smart TV is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a multi-user personalized interface switching control method of a smart TV is implemented. The database of the smart TV includes:

[0167] User database: used to store users' facial features and voice characteristics.

[0168] Interface configuration database: used to store user interface themes and layout configurations.

[0169] Settings database: used to store users' personalized system settings.

[0170] Content preference database: used to store users' viewing history, ratings, and content preferences.

[0171] Those skilled in the art will understand that Figure 3 The principle block diagram shown in the figure is only a block diagram of a partial structure related to the solution of the present invention, and does not constitute a limitation on the smart TV to which the solution of the present invention is applied. A specific smart TV may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0172] In one embodiment, a smart TV is provided, comprising a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, and the one or more programs include instructions for performing the following operations:

[0173] Control the collection of facial information of the user in front of the smart TV through the camera, and identify the facial features of the current user through the facial recognition algorithm;

[0174] And / or, controlling the collection of voice information of the user in front of the smart TV, and extracting the voiceprint features of the current user through a voiceprint recognition module;

[0175] Identify the identity information of the current user of the smart TV according to the facial features and / or voiceprint features of the current user;

[0176] According to the identified identity information of the current user, a personalized interface corresponding to the identity information of the current user is retrieved in advance;

[0177] Based on the personalized interface corresponding to the identity information of the current user confirmed by the user, the smart TV is controlled to automatically switch to the corresponding personalized interface, and the corresponding personalized recommended content is automatically retrieved for recommendation display, as described above.

[0178] The step of controlling the camera to collect facial information of the user in front of the smart TV and identifying the facial features of the current user through a facial recognition algorithm includes:

[0179] The viewing behavior data of each user is collected in advance on the smart TV, and corresponding personalized recommendation content is generated based on the viewing behavior data of each user.

[0180] The step of controlling the camera to collect facial information of the user in front of the smart TV and identifying the facial features of the current user through a facial recognition algorithm includes:

[0181] Collect the viewing behavior data of each user on the smart TV in advance, and generate a personalized interface corresponding to the user's identity information based on the viewing behavior data and personal setting data of each user;

[0182] And receive the user's operation instructions, set up a personalized interface corresponding to the user's identity information, including: theme and layout settings, volume settings, screen brightness settings, language settings, subtitles, and playback speed settings.

[0183] The step of controlling the camera to collect facial information of the user in front of the smart TV and identifying the facial features of the current user through a facial recognition algorithm includes:

[0184] Control the camera to collect the facial image of the user in front of the smart TV, and use the deep learning algorithm based on the convolutional neural network to extract features and generate facial feature vectors;

[0185] Comparing the facial feature vector with a pre-stored user facial feature database, using Euclidean distance or cosine similarity as a matching measure;

[0186] When the matching degree exceeds the set facial feature threshold, the identity of the current user is recognized, otherwise it prompts that the recognition fails.

[0187] The step of controlling the acquisition of voice information of the user in front of the smart TV and extracting the voiceprint features of the current user through the voiceprint recognition module includes:

[0188] Control the acquisition of voice information of the user in front of the smart TV through the microphone set on the smart TV;

[0189] Preprocessing the sound information, including noise removal and normalization;

[0190] After processing, the timbre features are extracted using the Mel-frequency cepstral coefficients of the sound information, and a voiceprint feature vector is generated;

[0191] Using dynamic time warping or Gaussian mixture model as a matching algorithm, the currently extracted voiceprint feature vector is compared with the pre-stored user timbre feature database;

[0192] If the matching degree exceeds the set voiceprint feature threshold, the identity of the current user is recognized, otherwise it prompts that the recognition failed.

[0193] The step of calling a preset personalized interface corresponding to the identity information of the current user according to the identified identity information of the current user includes:

[0194] According to the identified identity information of the current multiple or single users, multiple or single personalized interfaces corresponding to the identity information of the current user that are preset are read from the data storage module for the user to select and confirm;

[0195] Receive the user's operation instruction to select and confirm the personalized interface corresponding to the current user's identity information.

[0196] The step of controlling the smart TV to automatically switch to the corresponding personalized interface based on the personalized interface corresponding to the identity information of the current user confirmed by the user, and automatically retrieving the corresponding personalized recommended content for recommendation display includes:

[0197] Based on the personalized interface corresponding to the identity information of the current user confirmed by the user, controlling the smart TV to automatically switch to the corresponding personalized interface;

[0198] Obtain personalized recommended content corresponding to the current user's identity information from the data storage module for recommendation and display;

[0199] The personalized recommendation content includes:

[0200] Movie recommendations based on user viewing history and ratings;

[0201] Channel recommendations based on user viewing habits;

[0202] The application recommendation content based on the user's usage habits is as described above.

[0203] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided by the present invention can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0204] In summary, the present invention provides a method, device, smart TV and storage medium for switching control of multiple user personalized interfaces of smart TV, including: collecting user's facial information and identifying the facial features of the current user; and / or collecting user's voice information and extracting the voiceprint features of the current user; identifying the identity information of the current user of the smart TV according to the facial features and / or voiceprint features of the current user; calling the personalized interface corresponding to the identity information of the current user pre-set according to the identified identity information of the current user; based on the personalized interface corresponding to the identity information of the current user confirmed by the user, controlling the smart TV to automatically switch to the corresponding personalized interface, and automatically calling the corresponding personalized recommended content recommendation display. The present invention can intelligently identify the current viewing user according to the two methods of camera and voice recognition, and switch to the corresponding personalized interface and settings as well as personalized content recommendation, which provides convenience for users.

Claims

1. A method for switching and controlling a multi-user personalized interface of a smart TV, characterized in that: include: Control the collection of facial information of the user in front of the smart TV through the camera, and identify the facial features of the current user through the facial recognition algorithm; And / or, controlling the collection of voice information of the user in front of the smart TV, and extracting the voiceprint features of the current user through a voiceprint recognition module; Identify the identity information of the current user of the smart TV according to the facial features and / or voiceprint features of the current user; According to the identified identity information of the current user, a personalized interface corresponding to the identity information of the current user is retrieved in advance; Based on the personalized interface corresponding to the identity information of the current user confirmed by the user, the smart TV is controlled to automatically switch to the corresponding personalized interface, and the corresponding personalized recommended content is automatically retrieved for recommendation display.

2. The method for controlling switching of multiple user personalized interfaces of a smart TV according to claim 1, characterized in that: The step of controlling the camera to collect facial information of the user in front of the smart TV and identifying the facial features of the current user through a facial recognition algorithm includes: The viewing behavior data of each user is collected in advance on the smart TV, and corresponding personalized recommendation content is generated based on the viewing behavior data of each user.

3. The method for switching and controlling multiple user personalized interfaces of a smart TV according to claim 1, characterized in that: The step of controlling the camera to collect facial information of the user in front of the smart TV and identifying the facial features of the current user through a facial recognition algorithm comprises: Collect the viewing behavior data of each user on the smart TV in advance, and generate a personalized interface corresponding to the user's identity information based on the viewing behavior data and personal setting data of each user; And receive the user's operation instructions, set up a personalized interface corresponding to the user's identity information, including: theme and layout settings, volume settings, screen brightness settings, language settings, subtitles, and playback speed settings.

4. The method for switching and controlling multiple user personalized interfaces of a smart TV according to claim 1, characterized in that: The step of controlling the camera to collect facial information of the user in front of the smart TV and identifying the facial features of the current user through a facial recognition algorithm comprises: Control the camera to collect the facial image of the user in front of the smart TV, and use the deep learning algorithm based on the convolutional neural network to extract features and generate facial feature vectors; Comparing the facial feature vector with a pre-stored user facial feature database, using Euclidean distance or cosine similarity as a matching measure; When the matching degree exceeds the set facial feature threshold, the identity of the current user is recognized, otherwise it prompts that the recognition fails.

5. The method for switching and controlling multiple user personalized interfaces of a smart TV according to claim 1, characterized in that: The step of controlling the acquisition of voice information of the user in front of the smart TV and extracting the voiceprint features of the current user through the voiceprint recognition module includes: Control the acquisition of voice information of the user in front of the smart TV through the microphone set on the smart TV; Preprocessing the sound information, including noise removal and normalization; After processing, the timbre features are extracted using the Mel-frequency cepstral coefficients of the sound information, and a voiceprint feature vector is generated; Using dynamic time warping or Gaussian mixture model as a matching algorithm, the currently extracted voiceprint feature vector is compared with the pre-stored user timbre feature database; If the matching degree exceeds the set voiceprint feature threshold, the identity of the current user is recognized, otherwise it prompts that the recognition failed.

6. The method for switching and controlling multiple user personalized interfaces of a smart TV according to claim 1, characterized in that: The step of calling a preset personalized interface corresponding to the identity information of the current user according to the identified identity information of the current user comprises: According to the identified identity information of the current multiple or single users, multiple or single personalized interfaces corresponding to the identity information of the current user that are preset are read from the data storage module for the user to select and confirm; Receive the user's operation instruction to select and confirm the personalized interface corresponding to the current user's identity information.

7. The method for controlling switching of multiple user personalized interfaces of a smart TV according to claim 1, characterized in that: The step of controlling the smart TV to automatically switch to the corresponding personalized interface based on the personalized interface corresponding to the identity information of the current user confirmed by the user, and automatically retrieving the corresponding personalized recommended content for recommendation display comprises: Based on the personalized interface corresponding to the identity information of the current user confirmed by the user, controlling the smart TV to automatically switch to the corresponding personalized interface; Obtain personalized recommended content corresponding to the current user's identity information from the data storage module for recommendation and display; The personalized recommendation content includes: Movie recommendations based on user viewing history and ratings; Channel recommendations based on user viewing habits; App recommendations based on user usage habits.

8. A multi-user personalized interface switching control device for a smart TV, characterized in that: The device comprises: A first pre-setting module is used to collect viewing behavior data of each user on the smart TV in advance, and generate corresponding personalized recommendation content according to the viewing behavior data of each user; A second pre-setting module is used to collect the viewing behavior data of each user on the smart TV in advance, and generate a personalized interface corresponding to the user's identity information one by one according to the viewing behavior data and personal setting data of each user; The custom setting module is used to receive the user's operation instructions and set a personalized interface corresponding to the user's identity information, including: theme and layout settings, volume settings, screen brightness settings, language settings, subtitles, and playback speed settings; The facial feature extraction module is used to control the collection of facial information of the user in front of the smart TV through the camera, and recognize the facial features of the current user through the facial recognition algorithm; The voice feature extraction module is used to control the acquisition of voice information of the user in front of the smart TV, and extract the voiceprint features of the current user through the voiceprint recognition module; A user identity confirmation module, used to identify the identity information of the current user of the smart TV based on the facial features and / or voiceprint features of the current user; A personalized interface calling module, used to call a preset personalized interface corresponding to the identity information of the current user according to the identified identity information of the current user; The personalized content recommendation module is used to control the smart TV to automatically switch to the corresponding personalized interface based on the personalized interface corresponding to the identity information of the current user confirmed by the user, and automatically retrieve the corresponding personalized recommended content for recommendation display.

9. A smart TV, characterized in that: The device comprises a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, and the one or more programs include being used to execute the method according to any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method as described in any one of claims 1 to 7.

Images