Voice assistant interaction interface display method, medium and electronic device

Abstract

The invention discloses a voice assistant interaction interface display method, a medium and an electronic device, and relates to the technical field of smart home / smart home, and the method comprises the steps: firstly receiving a voice control instruction of a user for smart equipment, and then recognizing the identity of the user based on the voice control instruction under the condition that the voice control instruction cannot control the smart equipment, and finally, displaying the following preset voice control instruction operation guidance on the voice assistant interaction interface with the matched identity. According to the method, when it is determined that the user cannot control the intelligent device, the adaptive voice assistant interaction interface is matched according to the user identity, so that the user can conveniently use the device function through the operation interface without browsing a paper specification, and the use experience of the intelligent device is effectively improved.

Description

Technical Field

[0001] This application relates to the field of smart home / smart family technology, and more specifically, to a voice assistant interactive interface display method, medium, and electronic device. Background Technology

[0002] With the development of technology, smart devices are gradually becoming more and more popular among users due to their rich and diverse and practical functions.

[0003] Users often encounter problems such as complex operation and difficulty in understanding device functions when using smart devices. The current solution is to provide smart devices with paper instruction manuals, requiring users to consult these manuals to find relevant information when using the device's functions.

[0004] However, this paper instruction manual method has inconveniences such as difficulty in carrying it and time-consuming information retrieval, making it difficult to meet users' needs for convenient and personalized interaction with smart devices. Summary of the Invention

[0005] This application provides a method, medium, and electronic device for displaying a voice assistant interactive interface, in order to solve the problem that paper instruction manuals are not convenient to use.

[0006] In a first aspect, this application provides a method for displaying a voice assistant interactive interface, applied to a terminal device, comprising:

[0007] Receive user voice control commands for smart devices;

[0008] If the voice control commands fail to control the smart device, the user's identity is identified based on the voice control commands.

[0009] The identity-matched voice assistant interaction interface presents at least one of the following preset voice control command operation guidelines: preset voice control command operation guidelines matching keywords related to the voice control command, preset voice control command operation guidelines that the user has used frequently in the past, and high-frequency voice control command operation guidelines of the smart device obtained based on big data.

[0010] Optionally, during the process of displaying the voice assistant interaction interface on the screen of the terminal device, the method further includes:

[0011] If the system receives a trigger from the user on any preset voice control command displayed in the voice assistant's interface, it controls the smart device corresponding to that preset voice control command to execute the corresponding process; or,

[0012] If a new voice control command is received from the user, and the new voice control command matches the corresponding command in the preset voice control command operation guide in the voice assistant interaction interface, the smart device corresponding to the new voice control command will be controlled to execute the corresponding process.

[0013] Optionally, identifying the user's identity based on the voice control command includes:

[0014] The voice control commands are subjected to feature extraction processing to obtain voiceprint features;

[0015] The voiceprint features are matched with a preset user voiceprint feature database to determine the user's identity.

[0016] Optionally, the voice assistant interaction interface also presents a first control, which is used to enter the details interface upon receiving a trigger operation. The method further includes:

[0017] In response to the user's triggering of the first control, the user is redirected from the voice assistant interaction interface to the details interface, which displays the following: the name of the smart device, its installation location, and all preset voice control command operation instructions for the smart device. The details interface supports swiping to turn pages.

[0018] Optionally, the details interface also presents a first rating control and a second control, the second control being used to enter the rating details interface, and the method further includes:

[0019] In response to the user's triggering of the first rating control and the second control, the user is redirected from the details interface to the rating details interface, which displays a rating level receiving control and a rating content input control.

[0020] The user's evaluation result is obtained based on the evaluation level receiving control and the evaluation content input control.

[0021] Optionally, after obtaining the user's evaluation results, the method further includes:

[0022] Based on the evaluation results and the user's historical information, a user profile of the user is constructed;

[0023] Based on the user profile's functional preferences, generate the content for the next voice assistant interaction interface to be displayed to the user.

[0024] Optionally, after generating the content of the next voice assistant interaction interface to be displayed to the user, the method further includes:

[0025] Display the voice interaction entry point;

[0026] Based on the aforementioned voice interaction interface, supplementary voice control commands input by the user are received;

[0027] The supplementary voice control commands are integrated into the content of the next voice assistant interaction interface to obtain the integrated content of the next voice assistant interaction interface.

[0028] The integrated content of the next voice assistant interaction interface will be synchronized to the server.

[0029] Secondly, this application provides a voice assistant interactive interface display device, applied to a terminal device, comprising:

[0030] The receiving module is used to receive voice control commands from users to smart devices;

[0031] The recognition module is used to identify the user's identity based on the voice control command when the voice control command cannot control the smart device;

[0032] The presentation module is used to present at least one of the following preset voice control command operation guidelines on the identity-matched voice assistant interaction interface: preset voice control command operation guidelines matching keywords related to the voice control command, preset voice control command operation guidelines that the user has used frequently in the past, and high-frequency voice control command operation guidelines of the smart device obtained based on big data.

[0033] Optionally, the device further includes: a control module;

[0034] If the control module receives a trigger from the user on any preset voice control command displayed in the voice assistant's interactive interface, it controls the smart device corresponding to that preset voice control command to execute the corresponding process; or,

[0035] If the control module receives a new voice control command from the user, and the new voice control command matches the corresponding command in the preset voice control command operation guide in the voice assistant interaction interface, it is also used to control the smart device corresponding to the new voice control command to execute the corresponding process.

[0036] Optionally, the device further includes: a processing module;

[0037] The processing module is used to perform feature extraction processing on the voice control command to obtain voiceprint features;

[0038] The device further includes: a matching module;

[0039] The matching module is used to match the voiceprint features with a preset user voiceprint feature database to determine the user's identity.

[0040] Optionally, the device further includes: an entry module;

[0041] The entry module is used to respond to the user's triggering of the first control and jump from the voice assistant interaction interface to the details interface. The details interface presents the following content: the name of the smart device, the installation location, and all preset voice control command operation guides of the smart device. The details interface supports swiping to turn pages.

[0042] Optionally, the entry module is further configured to, in response to the user's triggering of the first rating control and the second control, jump from the details interface to the rating details interface, in which a rating level receiving control and a rating content input control are presented;

[0043] The device further includes: a determining module;

[0044] The determining module is used to obtain the user's evaluation result based on the evaluation level receiving control and the evaluation content input control.

[0045] Optionally, the device further includes: a construction module;

[0046] The construction module is used to construct a user profile of the user based on the evaluation results and the user's historical information;

[0047] The device further includes: a generation module;

[0048] The generation module is used to generate the content of the next voice assistant interaction interface to be displayed to the user based on the functional preferences in the user profile.

[0049] Optionally, the device further includes: a display module;

[0050] The display module is used to display the voice interaction entry point;

[0051] The receiving module is also used to receive supplementary voice control commands input by the user based on the voice interaction entry point;

[0052] The device further includes: an integration module;

[0053] The integration module is used to integrate the supplementary voice control commands into the content of the next voice assistant interaction interface to obtain the integrated content of the next voice assistant interaction interface.

[0054] The device further includes: a synchronization module;

[0055] The synchronization module is used to synchronize the content of the integrated next voice assistant interaction interface to the server.

[0056] Thirdly, this application provides an electronic device, including: a processor, and a memory communicatively connected to the processor;

[0057] The memory stores computer-executed instructions;

[0058] The processor executes computer execution instructions stored in the memory to implement the voice assistant interactive interface display method as described in the first aspect and various possible implementations of the first aspect above.

[0059] Fourthly, this application provides a computer-readable storage medium storing computer-executable instructions thereon, which, when executed by a processor, are used to implement the voice assistant interactive interface display method as described in the first aspect and various possible implementations of the first aspect.

[0060] Fifthly, this application provides a program product, including a computer program, which, when executed by a processor, implements the voice assistant interactive interface display method described above.

[0061] The voice assistant interaction interface display method, medium, and electronic device provided in this application first receive voice control commands from the user to the smart device. Then, if the voice control commands fail to control the smart device, the user's identity is identified based on the voice control commands. Finally, the following preset voice control command operation instructions are presented on the identity-matched voice assistant interaction interface. This method matches an adapted voice assistant interaction interface based on the user's identity, allowing the user to conveniently access device functions through the interface. It solves the problem in existing technologies where users need to consult paper manuals to find operation instructions when using smart devices, enabling users to efficiently control the device through the voice assistant interaction interface without consulting the manual, effectively improving the user experience. Attached Figure Description

[0062] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0063] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0064] Figure 1This is a schematic diagram of the hardware environment for a voice assistant interactive interface display method according to an embodiment of this application;

[0065] Figure 2 A schematic diagram illustrating a scenario for a voice assistant interactive interface display method provided in this application;

[0066] Figure 3 A flowchart illustrating a method for displaying a voice assistant interactive interface provided in this application. Figure 1 ;

[0067] Figure 4 A flowchart illustrating a method for displaying a voice assistant interactive interface provided in this application. Figure 2 ;

[0068] Figure 5 A schematic diagram of a voice assistant interaction interface display method provided in this application. Figure 1 ;

[0069] Figure 6 A schematic diagram of a voice assistant interaction interface display method provided in this application. Figure 2 ;

[0070] Figure 7 A schematic diagram of a voice assistant interaction interface display method provided in this application. Figure 3 ;

[0071] Figure 8 A schematic diagram of a voice assistant interaction interface display method provided in this application. Figure 4 ;

[0072] Figure 9 A schematic diagram of the structure of a voice assistant interactive interface display device provided in this application;

[0073] Figure 10 This is a schematic diagram of the structure of a voice assistant interactive interface display device provided in this application. Detailed Implementation

[0074] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0075] It should be noted that the terms "first," "second," etc., used in this application's specification are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0076] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0077] According to one aspect of the embodiments of this application, a method for displaying a voice assistant interactive interface is provided. This method is widely used in whole-house intelligent digital control application scenarios such as smart homes, smart home ecosystems, and intelligence house ecosystems. Optionally, in this embodiment, the above-mentioned voice assistant interactive interface display method can be applied to, for example... Figure 1 The hardware environment shown consists of terminal device 102 and server 104. For example... Figure 1 As shown, server 104 is connected to terminal device 102 via a network and can be used to provide services (such as application services) to the terminal or clients installed on the terminal. A database can be set up on the server or independently of the server to provide data storage services for server 104. Cloud computing and / or edge computing services can be configured on the server or independently of the server to provide data processing services for server 104.

[0078] The aforementioned network may include, but is not limited to, at least one of the following: wired network, wireless network. The aforementioned wired network may include, but is not limited to, at least one of the following: wide area network, metropolitan area network, local area network. The aforementioned wireless network may include, but is not limited to, at least one of the following: Wi-Fi (Wireless Fidelity), Bluetooth. The terminal device 102 may not be limited to PC, mobile phone, tablet computer, smart air conditioner, smart range hood, smart refrigerator, smart oven, smart stove, smart washing machine, smart water heater, smart washing equipment, smart dishwasher, smart projector, smart TV, smart clothes rack, smart curtains, smart audio-visual equipment, smart socket, smart speaker, smart speaker box, smart fresh air equipment, smart kitchen and bathroom equipment, smart bathroom equipment, smart robot vacuum cleaner, smart window cleaning robot, smart mopping robot, smart air purifier, smart steam oven, smart microwave oven, smart water heater, smart air purifier, smart water dispenser, smart door lock, etc.

[0079] With the rapid development of IoT and AI technologies, smart devices, with their convenient functions such as voice control, remote operation, and scene linkage, are gradually gaining popularity among more and more users and have been widely penetrated into various life scenarios such as home and office.

[0080] When users first use a new smart device, they often face problems such as complex operating logic, numerous functional modules, and difficulty in understanding instructions. The existing solution is to provide the device with a paper instruction manual. Users need to flip through the paper instruction manual page by page to find the corresponding operating steps and function descriptions when using the various functions of the new smart device.

[0081] However, this paper instruction manual method has inconveniences such as difficulty in carrying it and time-consuming information retrieval, making it difficult to meet users' needs for convenient and personalized interaction with smart devices.

[0082] Figure 2 A schematic diagram illustrating a scenario for a voice assistant interaction interface display method provided in this application, such as... Figure 2 As shown: When user A needs to control smart TV B, he can do so through handheld terminal device C. The interface of terminal device C will display a voice assistant interaction interface that matches user A's identity, in order to guide user A to operate smart TV B.

[0083] To address the aforementioned issues, this application provides a method for displaying a voice assistant interaction interface. The method receives voice control commands from a user to a smart device. If the voice control command fails to control the smart device, the user's identity is identified based on the voice control command. Subsequently, a preset voice control command operation guide is presented on the voice assistant interaction interface matching the identified user. This method automatically matches an appropriate voice assistant interaction interface based on the user's identity when it is determined that the user has a need for smart device functions, allowing the user to conveniently operate the device through the voice assistant interaction interface. This solves the problem in existing technologies where users need to consult paper manuals to find operation instructions, thereby effectively improving the user experience.

[0084] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will be described below with reference to the accompanying drawings.

[0085] Figure 3 A flowchart illustrating a method for displaying a voice assistant interactive interface provided in this application embodiment. Figure 1 Applied to terminal devices, such as Figure 3 As shown, the voice assistant interaction interface display method provided in this embodiment includes:

[0086] S101, Receive user voice control commands for smart devices.

[0087] Among them, smart devices include, but are not limited to: smart air conditioners, smart range hoods, smart refrigerators, smart ovens, smart stoves, smart washing machines, smart water heaters, smart washing equipment, smart dishwashers, smart projectors, smart TVs, smart clothes racks, smart curtains, smart audio-visual equipment, smart sockets, smart speakers, smart speakers, smart fresh air systems, smart kitchen and bathroom equipment, smart bathroom equipment, smart robot vacuum cleaners, smart window cleaning robots, smart mopping robots, smart air purifiers, smart steam ovens, smart microwave ovens, smart water heaters, smart air purifiers, smart water dispensers, and smart door locks.

[0088] The purpose of this step is to acquire voice information from the user controlling the smart device in real time.

[0089] The method of receiving this information could be, for example, through a microphone integrated into the terminal device, or through a voice recognition device integrated into the terminal device. This application does not impose any special limitations on this.

[0090] S102. When voice control commands cannot control the smart device, the user's identity is identified based on the voice control commands.

[0091] Understandably, when a user's voice control commands fail to operate a smart device, it means the voice control commands are ineffective. In this case, directly pushing general operation guidelines to the terminal device's interface may not match the usage habits of different users. Therefore, recognizing the user's identity through voice control commands can provide a basis for subsequently pushing personalized voice control operation guidelines that match the user's identity.

[0092] Optionally, this application provides a possible implementation method for identifying a user's identity based on voice control commands, including:

[0093] The first step is to perform feature extraction processing on the voice control commands to obtain voiceprint features.

[0094] It is understandable that different users have different functional needs and usage habits for smart devices. By collecting voiceprint features from voice information, the user's identity can be determined, which provides a basis for providing a voice assistant interaction interface that matches the user's identity.

[0095] This step of determining voiceprint features can be achieved, for example, using microphone array technology. A microphone array consists of multiple microphones arranged according to a specific rule, capable of receiving speech signals from different directions. Signal processing algorithms are then used to enhance and reduce noise in the speech, extracting clearer and more accurate speech information. Then, specialized voiceprint recognition algorithms, such as the Mel-frequency cepstral coefficient algorithm, are used to analyze and extract features from the processed speech signal. The Mel-frequency cepstral coefficient algorithm can simulate the human ear's perception of sound, converting the speech signal into a set of feature parameters; these parameters are the voiceprint features.

[0096] The second step is to match the voiceprint features with a pre-set user voiceprint feature database to determine the user's identity.

[0097] The purpose of this step is to verify the user's identity information.

[0098] Understandably, after collecting a user's voiceprint features, these features are compared and matched with a pre-set voiceprint feature database. The user's identity is determined by feature similarity.

[0099] S103. The voice assistant interaction interface with identity matching presents at least one of the following preset voice control command operation guidelines: preset voice control command operation guidelines matching keywords related to voice control commands, preset voice control command operation guidelines that the user has used frequently in the past, and high-frequency voice control command operation guidelines for smart devices obtained based on big data.

[0100] The purpose of this step is to provide users with targeted operation guidance by presenting preset voice control commands in the voice assistant interaction interface that matches the user's identity after the user identification is completed.

[0101] Understandably, given a clear understanding of the user's identity, at least one preset voice control command operation guide can be selected and presented to the user on the voice assistant's interface that matches the user's identity. These selectable guides fall into three categories: first, preset operation guides that match keywords from the user's original voice control commands, allowing the user to quickly find similar and effective control methods based on their existing commands; second, preset operation guides that the user has frequently used in the past, conforming to the user's long-established usage habits, making it convenient for the user to directly choose a familiar method to control the device; and third, high-frequency voice control command operation guides for the smart device derived from big data analysis, reflecting the common operations of most users on the device and providing a more universally applicable reference.

[0102] Optionally, this application provides possible implementation methods for displaying the voice assistant interaction interface on the screen of a terminal device, including:

[0103] The first step is to receive a user's trigger for any preset voice control command displayed in the voice assistant's interface, and then control the smart device corresponding to that preset voice control command to execute the corresponding process.

[0104] The purpose of this step is to respond to user actions and control the smart device to perform corresponding tasks.

[0105] Understandably, after receiving any preset voice control command displayed in the voice assistant's interface from the user, the system can respond to the user's triggering operation of the preset voice control command in the voice assistant's interface, drive the corresponding smart device to execute the functional process that matches the command, transform the command displayed on the interface into actual device control actions, and ultimately meet the user's needs for operating the smart device.

[0106] The second step is to receive a new voice control command from the user, and if the new voice control command matches the corresponding command in the preset voice control command operation guide in the voice assistant interaction interface, control the smart device corresponding to the new voice control command to execute the corresponding process.

[0107] The purpose of this step is to quickly respond to and control the corresponding smart devices to perform tasks based on the user's new instructions.

[0108] Understandably, after receiving a new voice control command from the user, the system can match this new command with the corresponding command in the preset voice control command operation guide in the voice assistant's interface. Once it's confirmed that the new command successfully matches the preset command, the corresponding smart device needs to be activated.

[0109] This embodiment provides a method for displaying a voice assistant interaction interface. It receives a user's voice control command for a smart device. If the voice control command cannot control the smart device, it identifies the user's identity based on the voice control command. Then, it presents a preset voice control command operation guide on the voice assistant interaction interface that matches the identity.

[0110] This method verifies user identity based on voice information and displays a voice assistant interface that matches the identity. It solves the problem that in existing technology scenarios, when users are faced with numerous functions of smart devices, they often have to rely on flipping through paper manuals to find the operating methods if they are not clear on how to operate them. This improves the convenience of operation and user experience.

[0111] Figure 4 A flowchart illustrating a method for displaying a voice assistant interactive interface provided in this application embodiment. Figure 2 .like Figure 4 As shown, based on the above embodiments, the implementation method of the voice assistant interaction interface display method is described in detail. The voice assistant interaction interface display method shown in this embodiment includes:

[0112] S201, Receive user voice control commands for smart devices.

[0113] The explanation of step S201 is the same as that in the above embodiments, and will not be repeated here.

[0114] S202. When voice control commands cannot control the smart device, the user's identity is identified based on the voice control commands.

[0115] The explanation of step S202 is the same as that in the above embodiments, and will not be repeated here.

[0116] S203. The voice assistant interaction interface with identity matching presents at least one of the following preset voice control command operation guidelines: preset voice control command operation guidelines matching keywords related to voice control commands, preset voice control command operation guidelines that the user has used frequently in the past, and high-frequency voice control command operation guidelines for smart devices obtained based on big data.

[0117] For an explanation of step S203, please refer to the explanation of the above embodiments, and this application will not repeat it here.

[0118] S204. In response to the user's triggering of the first control, the user jumps from the voice assistant interaction interface to the details interface. The details interface displays the following content: the name of the smart device, the installation location, and all preset voice control command operation guides for the smart device. The details interface supports swiping to turn pages. The voice assistant interaction interface also displays the first control, which is used to enter the details interface when a triggering operation is received.

[0119] The purpose of this step is to bring the user to the details screen when the user triggers the first control.

[0120] Understandably, firstly, the interface space of a terminal device is limited, making it difficult to fully present all the key information and preset voice control commands of the target smart device. By setting a first control to trigger access to the details interface, this detailed information can be displayed centrally on a dedicated page, allowing users to comprehensively and systematically understand the device's relevant content and avoiding misunderstandings about device functions and usage methods due to incomplete information display.

[0121] Secondly, when using smart devices, users may need to select different preset voice control commands based on different scenarios and needs. The details interface displays all operation instructions in one place and supports swiping to turn pages, making it convenient for users to quickly browse and find the required commands without having to switch back and forth between multiple interfaces, thus improving user efficiency.

[0122] For example, Figure 5 Provide a schematic diagram of the voice assistant interaction interface display method. Figure 1 ,like Figure 5 As shown, module 501 displays some preset voice control command operation instructions for the target smart device. For example, module 502 can be used as the first control, allowing the user to access the corresponding details page by clicking on the electric water heater 3.

[0123] For example, Figure 6 Provide a schematic diagram of the voice assistant interaction interface display method. Figure 2 ,like Figure 5 As shown. Figure 6 This is a detailed interface. Module 601 displays the name of the target smart device, such as electric water heater 3; Module 602 displays the installation location of the target smart device, such as the first-floor living room; Module 603 displays all the preset voice control commands and operation guidelines for the target smart device.

[0124] S205. In response to the user's triggering of the first rating control and the second control, the user jumps from the details interface to the rating details interface. The rating details interface displays a rating level receiving control and a rating content input control. The details interface also displays the first rating control and the second control, with the second control used to enter the rating details interface.

[0125] The purpose of this step is to allow users to evaluate the functionality of smart devices.

[0126] Understandably, when a user triggers the second control, they will be taken to the rating details screen. This screen can display a rating level receiving control and a rating content input control, allowing users to rate their experience and fill in specific rating content.

[0127] For example, Figure 7 Provide a schematic diagram of the voice assistant interaction interface display method. Figure 3 ,like Figure 6 As shown. Figure 7 This is another type of details interface. Module 701 displays the first rating control, and module 702 displays the second control, which is used to access the rating details interface. Due to limited screen space, therefore, from... Figure 5 Slide to Figure 6 During the process, the first rating control and the second control will appear gradually.

[0128] For example, Figure 8 Provide a schematic diagram of the voice assistant interaction interface display method. Figure 4 ,like Figure 7 As shown. Figure 8 The rating details interface includes a rating level receiving control 801 and a rating content input control 802.

[0129] S206. Based on the rating level receiving control and the rating content input control, obtain the user's rating result.

[0130] The purpose of this step is to collect user feedback.

[0131] Understandably, the rating control allows users to select a rating level, such as a star rating, which can intuitively reflect the user's overall satisfaction level.

[0132] Secondly, the evaluation input control allows users to enter more detailed evaluation text, including user experience, advantages and disadvantages, etc., which can provide more specific feedback.

[0133] Therefore, by using the rating level receiving control and the rating content input control, we can not only obtain macro-level satisfaction data, but also obtain micro-level detailed feedback, forming a comprehensive and three-dimensional user evaluation result. This avoids the one-sidedness of single-dimensional feedback and provides a more accurate direction for product optimization.

[0134] S207. Based on the evaluation results and the user's historical information, construct the user profile.

[0135] Historical information includes, but is not limited to: user habits, command preferences, and frequently used devices.

[0136] The purpose of this step is to integrate user reviews and historical information to build a comprehensive and concrete user profile.

[0137] Understandably, evaluation results can characterize user satisfaction with smart devices, while historical information can characterize user behavior patterns and preferences. Therefore, by combining evaluation results with users' historical information, we can not only reconstruct users' actual usage behavior but also capture their subjective experiences and needs.

[0138] S208. Based on the user profile's functional preferences, generate the content of the next voice assistant interaction interface to be displayed to the user.

[0139] The purpose of this step is to generate content that better suits the user's needs and interests for the next interaction with the voice assistant, based on the user's functional preferences in the user profile.

[0140] It is understandable that different users have different functional preferences for smart devices. Therefore, customizing the interface based on preferences can avoid displaying generic and undifferentiated content, allowing users to quickly find the commands they need and reducing operating costs.

[0141] S209, Display the voice interaction entry point.

[0142] Understandably, displaying a voice interaction entry point can provide users with a convenient and intuitive way to start voice interaction, lower the operational threshold for users to use voice assistant applications, enable users to quickly and easily establish a connection with the voice assistant, and then carry out voice interaction operations, improve the efficiency and experience of users using voice assistant applications, and encourage users to use voice assistants more frequently to meet their diverse needs.

[0143] S210: Based on the voice interaction interface, receive supplementary voice control commands input by the user.

[0144] The purpose of this step is to receive supplementary voice commands from the user through the voice interaction interface.

[0145] Understandably, users have complex and diverse needs for controlling smart devices, and a single initial preset command cannot cover all usage scenarios. The existence of a voice interaction interface allows users to supplement existing commands with personalized voice control commands based on their actual operating needs, thereby achieving more precise and detailed control of the device and better meeting the diverse usage needs of users.

[0146] S211. Integrate the supplementary voice control commands into the content of the next voice assistant interaction interface to obtain the integrated content of the next voice assistant interaction interface.

[0147] Understandably, by integrating the user's supplementary voice control commands into the next voice assistant interaction interface, the user's personalized control needs can be transformed into preset interface content, allowing the user to see their previously added commands the next time they use the voice assistant interaction interface.

[0148] S212. Synchronize the content of the next integrated voice assistant interaction interface to the server.

[0149] The purpose of this step is to synchronize the user-customized voice assistant interaction interface content to the server, ensuring that users can directly control smart devices by triggering commands in the interface via voice when using the voice assistant in the future.

[0150] This embodiment provides a method for displaying a voice assistant interaction interface. It receives voice control commands from a user to a smart device and, if the voice control commands fail to control the device, verifies the user's identity. Based on the verified identity, it displays a voice assistant interaction interface matching that identity. Furthermore, if the user triggers the first control in the voice assistant interaction interface, they can view all voice control command operation instructions for the device. Users can input feedback through evaluation controls presented in the interface. A user profile is generated based on user history information and evaluation results, and the content of the next displayed voice assistant interaction interface is adjusted according to functional preferences. In addition, the voice interaction entry allows users to supplement voice commands, updating these commands to the next interface and synchronizing them to the server.

[0151] This method solves the problem in existing technologies where users need to consult paper manuals because they are unsure how to operate smart devices. By automatically displaying a personalized voice assistant interface through voice control and identity matching, it improves the ease of use of the device and the user experience, achieving a more intelligent and convenient user interaction method.

[0152] Figure 9 This is a schematic diagram of the structure of a voice assistant interactive interface display device provided in this application. Figure 9As shown, this application provides a voice assistant interactive interface display device, the voice assistant interactive interface display device 400 including:

[0153] Receiver module 401 is used to receive voice control commands from users to smart devices;

[0154] The recognition module 402 is used to identify the user's identity based on the voice control command when the smart device cannot be controlled by the voice control command.

[0155] The presentation module 403 is used to present at least one of the following preset voice control command operation guidelines on the identity-matched voice assistant interaction interface: preset voice control command operation guidelines matching keywords related to voice control commands, preset voice control command operation guidelines that the user has used frequently in the past, and high-frequency voice control command operation guidelines of smart devices obtained based on big data.

[0156] Optionally, the device may also include: a control module 404;

[0157] The control module 404, upon receiving a trigger from a user on any preset voice control command displayed in the voice assistant's interactive interface, controls the smart device corresponding to that preset voice control command to execute the corresponding process; or,

[0158] If the control module 404 receives a new voice control command from the user, and the new voice control command matches the corresponding command in the preset voice control command operation guide in the voice assistant interaction interface, it is also used to control the smart device corresponding to the new voice control command to execute the corresponding process.

[0159] Optionally, the device may also include: a processing module 405;

[0160] Processing module 405 is used to perform feature extraction processing on voice control commands to obtain voiceprint features;

[0161] The device also includes: a matching module 406;

[0162] The matching module 406 is used to match the voiceprint features with a preset user voiceprint feature database to determine the user's identity.

[0163] Optionally, the device may also include: an access module 407;

[0164] Entering module 407 is used to respond to the user's triggering of the first control, and jump from the voice assistant interaction interface to the details interface. The details interface presents the following content: the name of the smart device, the installation location, and all preset voice control command operation guides for the smart device. The details interface supports swiping to turn pages.

[0165] Optionally, module 407 is also used to respond to the user's triggering of the first rating control and the second control, and jump from the details interface to the rating details interface, in which the rating level receiving control and the rating content input control are displayed;

[0166] The device also includes: a determination module 408;

[0167] The determination module 408 is used to obtain the user's evaluation result based on the evaluation level receiving control and the evaluation content input control.

[0168] Optionally, the device may also include: a building module 409;

[0169] Module 409 is used to build user profiles based on evaluation results and user history information;

[0170] The device also includes: a generation module 410;

[0171] The generation module 410 is used to generate the content of the next voice assistant interaction interface to be displayed to the user based on the functional preferences in the user profile.

[0172] Optionally, the device may also include: a display module 411;

[0173] Display module 411 is used to display the voice interaction entry point;

[0174] The receiving module 401 is also used to receive supplementary voice control commands input by the user based on the voice interaction entry point;

[0175] The device also includes: integration module 412;

[0176] The integration module 412 is used to integrate the supplementary voice control commands into the content of the next voice assistant interaction interface, so as to obtain the integrated content of the next voice assistant interaction interface.

[0177] The device also includes: a synchronization module 413;

[0178] Synchronization module 413 is used to synchronize the content of the next integrated voice assistant interaction interface to the server.

[0179] Its implementation principle and technical effect are similar to the implementation methods of each part in the aforementioned voice assistant interaction interface display method, and will not be repeated here.

[0180] Figure 10 This is a schematic diagram of the structure of a voice assistant interactive interface display device provided in this application. Figure 10As shown, this application provides a voice assistant interactive interface display device 500, which includes: a receiver 501, a transmitter 502, a processor 503, and a memory 504.

[0181] Receiver 501 is used to receive instructions and data;

[0182] Transmitter 502 is used to send commands and data;

[0183] Memory 504 is used to store instructions executed by the computer;

[0184] Processor 503 is used to execute computer execution instructions stored in memory 504 to implement the various steps of the test method in the above embodiments. For details, please refer to the relevant descriptions in the foregoing test method embodiments.

[0185] Optionally, the memory 504 can be either standalone or integrated with the processor 503.

[0186] When the memory 504 is set up independently, the electronic device also includes a bus for connecting the memory 504 and the processor 503.

[0187] The implementation principle and technical effects of the electronic device provided in this embodiment can be found in the foregoing embodiments, and will not be repeated here.

[0188] This application also provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the method of any of the foregoing embodiments.

[0189] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the method of any of the foregoing embodiments.

[0190] The integrated modules described above, implemented as software functional modules, can be stored in a computer-readable storage medium. These software functional modules, stored in a storage medium, include several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute some steps of the methods of the various embodiments of this application.

[0191] It should be understood that the aforementioned processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. A general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the application can be directly manifested as being executed by a hardware processor, or executed by a combination of hardware and software modules within the processor. The memory may include high-speed RAM, and may also include non-volatile memory (NVM), such as at least one disk storage device, and may also be a USB flash drive, external hard drive, read-only memory, disk, or optical disc, etc.

[0192] The aforementioned storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The storage medium can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0193] An exemplary storage medium is coupled to a processor, allowing the processor to read information from and write information to the storage medium. Alternatively, the storage medium can be an integral part of the processor. Both the processor and the storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and storage medium can exist as discrete components in an electronic device or host device.

[0194] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0195] The above are merely preferred embodiments of this application. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. A method for displaying a voice assistant interactive interface, characterized in that, Applied to a terminal device, the method includes: Receive user voice control commands for smart devices; If the voice control commands fail to control the smart device, the user's identity is identified based on the voice control commands. The identity-matched voice assistant interaction interface presents at least one of the following preset voice control command operation guidelines: preset voice control command operation guidelines matching keywords related to the voice control command, preset voice control command operation guidelines that the user has used frequently in the past, and high-frequency voice control command operation guidelines of the smart device obtained based on big data.

2. The method according to claim 1, characterized in that, During the process of displaying the voice assistant interaction interface on the screen of the terminal device, the method further includes: If the system receives a trigger from the user on any preset voice control command displayed in the voice assistant's interface, it controls the smart device corresponding to that preset voice control command to execute the corresponding process; or, If a new voice control command is received from the user, and the new voice control command matches the corresponding command in the preset voice control command operation guide in the voice assistant interaction interface, the smart device corresponding to the new voice control command will be controlled to execute the corresponding process.

3. The method according to claim 1, characterized in that, The process of identifying the user's identity based on the voice control commands includes: The voice control commands are subjected to feature extraction processing to obtain voiceprint features; The voiceprint features are matched with a preset user voiceprint feature database to determine the user's identity.

4. The method according to any one of claims 1-3, characterized in that, The voice assistant interaction interface also presents a first control, which is used to enter the details interface upon receiving a trigger operation. The method further includes: In response to the user's triggering of the first control, the user is redirected from the voice assistant interaction interface to the details interface, which displays the following: the name of the smart device, its installation location, and all preset voice control command operation instructions for the smart device. The details interface supports swiping to turn pages.

5. The method according to claim 4, characterized in that, The details interface also presents a first rating control and a second control, the second control being used to access the rating details interface, and the method further includes: In response to the user's triggering of the first rating control and the second control, the user is redirected from the details interface to the rating details interface, which displays a rating level receiving control and a rating content input control. The user's evaluation result is obtained based on the evaluation level receiving control and the evaluation content input control.

6. The method according to claim 5, characterized in that, After obtaining the user's evaluation results, the process also includes: Based on the evaluation results and the user's historical information, a user profile of the user is constructed; Based on the user profile's functional preferences, generate the content for the next voice assistant interaction interface to be displayed to the user.

7. The method according to claim 6, characterized in that, After generating the content of the next voice assistant interaction interface to be displayed to the user, the method further includes: Display the voice interaction entry point; Based on the aforementioned voice interaction interface, supplementary voice control commands input by the user are received; The supplementary voice control commands are integrated into the content of the next voice assistant interaction interface to obtain the integrated content of the next voice assistant interaction interface. The integrated content of the next voice assistant interaction interface will be synchronized to the server.

8. A voice assistant interactive interface display device, characterized in that, Applied to terminal devices, including: The receiving module is used to receive voice control commands from users to smart devices; The recognition module is used to identify the user's identity based on the voice control command when the voice control command cannot control the smart device; The presentation module is used to present at least one of the following preset voice control command operation guidelines on the identity-matched voice assistant interaction interface: preset voice control command operation guidelines matching keywords related to the voice control command, preset voice control command operation guidelines that the user has used frequently in the past, and high-frequency voice control command operation guidelines of the smart device obtained based on big data.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program, when executed, performs the method of any one of claims 1 to 7.

10. An electronic device comprising a memory and a processor, characterized in that, The memory stores a computer program, and the processor is configured to execute the method of any one of claims 1 to 7 through the computer program.

Images