An interface display method, system, device and storage medium of a voice assistant

Abstract

This invention provides a method, system, device, and storage medium for displaying a voice assistant interface. The method includes, during the running of a voice assistant control on a client, jumping from the display interface of the currently running application to the display interface of a specified application based on a received jump instruction, and displaying the voice assistant control at a first specified position on the display interface of the specified application; the specified application sends a voice assistant control display message to a voice assistant service; the voice assistant service, based on the received voice assistant control display message, notifies other applications on the client to hide the voice assistant control on their display interfaces; this allows the voice assistant control to jump between different display interfaces, improving the interactivity of the voice assistant control and enhancing the fun of the in-vehicle infotainment system.

Description

Technical Field

[0001] This invention relates to the field of voice control display technology, and in particular to a method, system, device and storage medium for displaying the interface of a voice assistant. Background Technology

[0002] As people's living standards improve, the prevalence of smart terminals is increasing. Input methods for smart terminals include manual input and voice input. With the increasing maturity of voice interaction technology, the application scenarios for voice assistants are becoming more and more widespread. Voice assistants can engage in intelligent dialogue and real-time question-and-answer interactions with users; they can also recognize users' voice commands, causing the smart terminal to execute the corresponding events.

[0003] However, in existing technologies, when displaying the voice assistant application interface, a full-screen display mode is generally used, or multi-window technology is employed to control the form of the voice assistant, making it float in a specific position on the display interface, and the display position cannot be moved or changed. The first display scheme affects the display of other applications on the smart terminal, resulting in a poor user experience; while the second display scheme does not affect the display of other applications on the smart terminal, the voice assistant is relatively independent of the various applications running on the smart terminal, resulting in poor interactivity of the voice assistant. Summary of the Invention

[0004] To address the aforementioned problems, the present invention aims to provide a method, system, device, and storage medium for displaying the interface of a voice assistant, which enables the voice assistant control to jump between different display interfaces and improves the interactivity of the voice assistant control.

[0005] In a first aspect, embodiments of the present invention provide a method for displaying the interface of a voice assistant, including:

[0006] During the running of the voice assistant control on the client, according to the received jump instruction, the display interface of the currently running application jumps to the display interface of the specified application, and the voice assistant control is displayed at the first specified position on the display interface of the specified application.

[0007] The specified application sends a voice assistant control display message to the voice assistant service;

[0008] The voice assistant service, based on the received voice assistant control display message, notifies other applications on the client to hide the voice assistant control on their display interface.

[0009] As an improvement to the above solution, the interface display method of the voice assistant further includes:

[0010] All applications on the client obtain the voice assistant control package built into the client in order to integrate the voice assistant control into the corresponding application;

[0011] The application that integrates the voice assistant control sends a registration request to the voice assistant service built into the client.

[0012] The voice assistant service registers each application according to the registration request, thereby binding the application to the voice assistant control.

[0013] As an improvement to the above solution, the interface display method of the voice assistant further includes:

[0014] The voice assistant control recognizes the collected user voice information and generates the jump instruction; wherein, the jump instruction includes: an interface jump instruction for instructing the opening of a specified application and a control jump instruction for instructing the display of the voice assistant control at a first specified position;

[0015] Then, the step of jumping from the display interface of the currently running application to the display interface of the specified application according to the received jump instruction, and displaying the voice assistant control at a first specified position on the display interface of the specified application, includes:

[0016] The voice assistant control switches the display interface of the currently running application on the client to the display interface of the specified application according to the interface jump instruction.

[0017] After the jump to the display interface of the specified application is completed, the specified application displays the voice assistant control at the first specified position on its display interface according to the control jump instruction.

[0018] As an improvement to the above solution, the interface display method of the voice assistant further includes:

[0019] Obtain user gestures for the voice assistant control in the currently displayed interface to generate control commands for the voice assistant control;

[0020] According to the control instructions of the voice assistant control, the voice assistant control is moved to the end position of the corresponding user operation gesture on the current display interface.

[0021] As an improvement to the above solution, the interface display method of the voice assistant further includes:

[0022] When the application integrates the voice assistant control, a second specified location is configured on its display interface to show or hide the voice assistant control.

[0023] As an improvement to the above solution, the interface display method of the voice assistant further includes:

[0024] The voice assistant service sends a voice assistant control display instruction to the cloud platform;

[0025] The cloud platform forwards the voice assistant control display command to the currently opened application on the client.

[0026] The currently opened application responds to the voice assistant control display command and displays the voice assistant control at a second specified position on its display interface.

[0027] As an improvement to the above solution, the interface display method of the voice assistant further includes:

[0028] Based on the rhythm data sensed by the client, the voice assistant control is dynamically displayed in the display interface of the currently opened application according to the rhythm data.

[0029] As an improvement to the above solution, the interface display method of the voice assistant further includes:

[0030] The voice assistant control obtains the attribute parameters of the target object in the display interface of the specified application in real time, and displays the attribute parameters on the voice assistant control.

[0031] As an improvement to the above solution, when the display interface of the specified application is a map navigation interface, the target object is generated in the display interface of the specified application based on the location information of the electric vehicle associated with the client.

[0032] As an improvement to the above solution, the interface display method of the voice assistant further includes:

[0033] The voice assistant control moves with the target object within the display interface of the specified application.

[0034] As an improvement to the above solution, the interface display method of the voice assistant further includes:

[0035] The voice assistant control obtains the interface parameters of the specified application's display interface;

[0036] Retrieve the control shape corresponding to the interface parameters from the preset control shape library;

[0037] The voice assistant control takes on a shape corresponding to the interface parameters in the display interface of the specified application.

[0038] Secondly, embodiments of the present invention provide a voice assistant interface display system, including: at least one application installed on a client, a voice assistant control, and a voice assistant service;

[0039] During the process of running the voice assistant control on the client, the voice assistant control is used to jump from the display interface of the currently running application to the display interface of the specified application according to the received jump instruction, and to display the voice assistant control at a first specified position on the display interface of the specified application.

[0040] The specified application is used to send voice assistant control display messages to the voice assistant service;

[0041] The voice assistant service is used to notify other applications on the client to hide the voice assistant control on their display interface based on the received voice assistant control display message.

[0042] Thirdly, embodiments of the present invention provide a voice assistant interface display device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor executes the computer program to implement the voice assistant interface display method as described in the first aspect.

[0043] Fourthly, embodiments of the present invention provide a computer-readable storage medium, the computer-readable storage medium including a stored computer program, wherein, when the computer program is executed, it controls the device where the computer-readable storage medium is located to perform the interface display method of the voice assistant as described in the first aspect.

[0044] Compared to existing technologies, the beneficial effects of this invention are as follows: This invention can jump the client from the display interface of the currently running application to the display interface of a specified application, and display the voice assistant control at a first specified position on the display interface of the specified application; then, the specified application sends a voice assistant control display message to the voice assistant service, informing the voice assistant service of its display status change, and the voice assistant service then notifies other applications to hide the voice assistant control on their display interfaces; ensuring that the voice assistant control is displayed only on the display interface of one application, allowing the voice assistant control to jump between different display interfaces, improving the interactivity of the voice assistant control, increasing the fun of the in-vehicle system, and improving the user experience of the voice assistant control. Attached Figure Description

[0045] To more clearly illustrate the technical solution of the present invention, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0046] Figure 1 This is a flowchart of a voice assistant interface display method provided in an embodiment of the present invention;

[0047] Figure 2 This is a schematic diagram of the interface display system of the voice assistant provided in an embodiment of the present invention;

[0048] Figure 3 This is a schematic diagram of the interface display system of another voice assistant provided in an embodiment of the present invention;

[0049] Figure 4 This is a schematic diagram of a voice assistant interface display system provided in an embodiment of the present invention;

[0050] Figure 5 This is a schematic diagram of an interface display device for a voice assistant provided in an embodiment of the present invention. Detailed Implementation

[0051] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0052] Example 1

[0053] Please see Figure 1 This is a flowchart of a voice assistant interface display method provided by an embodiment of the present invention. The voice assistant interface display method is executed by a client, which can be a smart terminal such as a mobile phone, tablet, or computer, or a vehicle-mounted terminal with a touch screen / display screen, such as an in-vehicle display. Specifically, it includes:

[0054] S1: During the running of the voice assistant control on the client, according to the received jump instruction, jump from the display interface of the currently running application to the display interface of the specified application, and display the voice assistant control at the first specified position on the display interface of the specified application.

[0055] S2: The specified application sends a voice assistant control display message to the voice assistant service;

[0056] S3: The voice assistant service, based on the received voice assistant control display message, notifies other applications on the client to hide the voice assistant control on their display interface.

[0057] In this embodiment of the invention, all applications on the client side pre-register with the voice assistant service. The voice assistant service can then monitor the display status of the voice assistant controls integrated into each registered application and control the display / hiding of these controls on the corresponding display interfaces. Specifically, a status interface can be set in the voice assistant service. This interface receives voice assistant control display messages sent by applications and notifies other applications to hide their voice assistant controls. Simultaneously, the status interface can also monitor changes in the display of the voice assistant controls integrated into each registered application.

[0058] When it's necessary to jump to a specific location on the display screen of a designated application, the user can trigger the corresponding jump command via voice or gesture. This jumps the client from the currently running application's display screen to the designated application's display screen, where the voice assistant control is displayed at a first designated location. Then, the designated application sends a voice assistant control display message to the voice assistant service, informing it of the change in display status. The voice assistant service then notifies other applications to hide the voice assistant control on their respective display screens. This dynamic association between the voice assistant control and the application allows the voice assistant control to jump between different display screens and be displayed at any location on different screens, enhancing the interactivity of the voice assistant control, increasing the fun of the in-vehicle system, and improving the overall user experience.

[0059] In one alternative embodiment, all applications on the client obtain a voice assistant control package built into the client to integrate the voice assistant control into the respective applications;

[0060] The application that integrates the voice assistant control sends a registration request to the voice assistant service built into the client.

[0061] The voice assistant service registers each application according to the registration request, thereby binding the application to the voice assistant control.

[0062] It should be noted that the voice assistant control package includes an interface for calling the voice assistant control, and the voice assistant control package is pre-stored in the client's voice control library. The application can display the voice assistant control on its display interface by loading the voice assistant control package. The display position of the voice assistant control on the application's display interface can be customized by each application, or determined by user-input voice information or gestures.

[0063] like Figure 2 As shown, the display process of the voice assistant control for the application installed on the client is as follows:

[0064] Step 1: Integrate the voice assistant control package into each application;

[0065] Step 2: Each application needs to connect to and register the voice assistant service;

[0066] Step 3: When the application displays the voice assistant control, it notifies the voice assistant service of its display status through the voice assistant service's status interface;

[0067] Step 4: Other applications hide their own voice assistant controls after receiving the status change notification.

[0068] In one optional embodiment, the interface display method of the voice assistant further includes:

[0069] The voice assistant control recognizes the collected user voice information and generates the jump instruction; wherein, the jump instruction includes: an interface jump instruction for instructing the opening of a specified application and a control jump instruction for instructing the display of the voice assistant control at a first specified position;

[0070] Then, the step of jumping from the display interface of the currently running application to the display interface of the specified application according to the received jump instruction, and displaying the voice assistant control at a first specified position on the display interface of the specified application, includes:

[0071] The voice assistant control switches the display interface of the currently running application on the client to the display interface of the specified application according to the interface jump instruction.

[0072] After the jump to the display interface of the specified application is completed, the specified application displays the voice assistant control at the first specified position on its display interface according to the control jump instruction.

[0073] For example, if a user inputs the voice message "Open XXX application, jump to the top left corner," the voice assistant control will control the client to open the XXX application and switch from the display interface of the currently running application to the display interface of the XXX application. At the same time, the voice assistant control will be displayed in the top left corner of the XXX application's display interface, and the voice assistant service will be notified of the change in its display state. This will cause other applications besides the XXX application to hide the voice assistant control, ensuring that the voice assistant control can be displayed only on the display interface of the currently opened application among all applications on the client, thus guaranteeing that the voice assistant control can jump between different display interfaces.

[0074] Furthermore, the interface display method of the voice assistant also includes:

[0075] Based on the rhythm data sensed by the client, the voice assistant control is dynamically displayed in the display interface of the currently opened application according to the rhythm data.

[0076] The rhythm data can be heart rate change data sensed by sensors on the client, rhythm data corresponding to music played on the client, or beat data corresponding to user gestures on the client's touchscreen. The voice assistant control can then play corresponding dynamic effects based on the rhythm data. For example, in a driver health application, when the voice assistant control receives heart rate change data from sensors, it dynamically displays the data in the currently open application's display interface according to the rhythm corresponding to the heart rate change data.

[0077] In one optional embodiment, the interface display method of the voice assistant further includes:

[0078] Obtain user gestures for the voice assistant control in the currently displayed interface to generate control commands for the voice assistant control;

[0079] According to the control instructions of the voice assistant control, the voice assistant control is moved to the end position of the corresponding user operation gesture on the current display interface.

[0080] For example, a user can drag the voice assistant control on the current display screen to move the voice assistant control to different positions, or the user can determine the jump position of the voice assistant control by clicking on the current display screen.

[0081] In one optional embodiment, the interface display method of the voice assistant further includes:

[0082] When the application integrates the voice assistant control, a second specified location is configured on its display interface to show or hide the voice assistant control.

[0083] Furthermore, the voice assistant service sends a voice assistant control display instruction to the cloud platform;

[0084] The cloud platform forwards the voice assistant control display command to the currently opened application on the client.

[0085] The currently opened application responds to the voice assistant control display command and displays the voice assistant control at a second specified position on its display interface.

[0086] like Figure 3 As shown, the display position of the voice assistant control can be controlled through a pre-defined open interface or a cloud platform interface (such as the MQTT service interface): The specific process is as follows:

[0087] Step 1: The application integrates a voice library and MQTT service to receive voice commands and commands issued by the cloud platform, respectively.

[0088] Step 2: Integrate the voice assistant control package and the layout of the preset voice assistant controls.

[0089] Step 3: After receiving the instruction, display the voice assistant control according to the preset layout position.

[0090] The display scheme in this embodiment is mainly applied to third-party developed applications. Taking a video website's app as an example, the voice assistant service can send a voice assistant control display instruction to the cloud platform to the video website's app. After receiving the voice assistant control display instruction, the video website's app can jump to a preset layout position (i.e., the second specified position) according to the instruction. By setting an open interface, such as an MQTT service interface, it can be a scenario pre-configured by engineers internally, and a port open to third-party platforms externally, thereby ensuring compatibility with third-party developed applications and improving the display compatibility of the voice assistant control.

[0091] In one optional embodiment, the interface display method of the voice assistant further includes:

[0092] The voice assistant control obtains the attribute parameters of the target object in the display interface of the specified application in real time, and displays the attribute parameters on the voice assistant control.

[0093] The target object can be selected by the user on the current display interface, or generated on the current display interface based on data collected by sensors or positioning modules on the mobile terminal associated with the client. The attribute parameters can be basic information of the target object (e.g., name, ID), or dynamic information collected from external sources (e.g., location information, heart rate information, speed information, etc.).

[0094] Furthermore, when the display interface of the specified application is a map navigation interface, the target object is generated in the display interface of the specified application based on the location information of the electric vehicle associated with the client.

[0095] In one optional embodiment, the interface display method of the voice assistant further includes:

[0096] The voice assistant control moves with the target object within the display interface of the specified application.

[0097] In one optional embodiment, the interface display method of the voice assistant further includes:

[0098] The voice assistant control obtains the interface parameters of the specified application's display interface;

[0099] Retrieve the control shape corresponding to the interface parameters from the preset control shape library;

[0100] The voice assistant control takes on a shape corresponding to the interface parameters in the display interface of the specified application.

[0101] Taking a map navigation interface as an example, the voice assistant control can identify electric vehicles on the map navigation interface and move along the navigation route of the electric vehicle. Simultaneously, it can read vehicle information uploaded to the client, such as location and speed, and also read traffic information along the navigation route on the map navigation interface, displaying the read location, speed, and traffic information in text form on the voice assistant control.

[0102] Furthermore, different control shapes can be pre-matched for different display interfaces. For example, several control shapes can be pre-defined, such as arrows, fingers, circles, etc., without specific limitations in this embodiment of the invention. Simultaneously, one interface type corresponds to one control shape. The interface parameters are used to indicate the type of the corresponding display interface (e.g., map interface, health information interface, voice interaction interface, etc.). The interface parameters may include the interface layout and the text content of the interface. The voice assistant control can identify the interface type of the corresponding display interface based on the interface parameter information, and then match the corresponding control shape based on the identified interface type, so that the voice assistant control is displayed on the display interface with the matched control shape.

[0103] In this embodiment of the invention, the voice assistant control can take on different shapes in each application, or integrate text on the voice assistant control, or move with the target object on the display interface, thereby enriching the functions of the voice assistant control on the display interface, enhancing the correlation between the voice assistant control and the display interface, and further increasing the fun of the voice assistant control.

[0104] Compared with the prior art, the beneficial effects of the embodiments of the present invention are as follows:

[0105] 1. When the display interface of a specified application is opened and the voice assistant control is displayed at a first specified position on the display interface of the specified application, the specified application sends a voice assistant control display message to the voice assistant service to inform the voice assistant service of the change in its display state. The voice assistant service then notifies other applications to hide the voice assistant control on their display interfaces. This ensures that the voice assistant control can only be displayed on the display interface of the currently opened application among all applications on the client, allowing the voice assistant control to jump between different display interfaces, improving the interactivity of the voice assistant control, enhancing the fun of the in-vehicle system, and improving the user experience of the voice assistant control.

[0106] 2. Each application is pre-registered and bound to the voice assistant control, so that it can adaptively jump to different locations according to different display interfaces;

[0107] 3. When the voice assistant control is pre-matched to one of the display interfaces, it will perform rhythmic beats on that display interface to achieve dynamic display of the voice assistant control;

[0108] 4. The voice assistant control can also take on different shapes in each application, or integrate text on the voice assistant control, or move with the target object on the display interface, thereby enriching the functionality of the voice assistant control on the display interface and further enhancing the fun of the voice assistant control.

[0109] 5. The voice assistant control can be displayed on the interface of third-party developed applications, offering greater compatibility.

[0110] It should be noted that the working principle and technical effect of the voice assistant interface display system described in this embodiment are the same as those of the voice assistant interface display method described in the first embodiment, and will not be repeated here.

[0111] Example 2

[0112] like Figure 4 As shown, this embodiment of the invention provides a voice assistant interface display system, including: at least one application installed on a client, a voice assistant control, and a voice assistant service;

[0113] During the process of running the voice assistant control on the client, the voice assistant control is used to jump from the display interface of the currently running application to the display interface of the specified application according to the received jump instruction, and to display the voice assistant control at a first specified position on the display interface of the specified application.

[0114] The specified application is used to send voice assistant control display messages to the voice assistant service;

[0115] The voice assistant service is used to notify other applications on the client to hide the voice assistant control on their display interface based on the received voice assistant control display message.

[0116] In one optional embodiment, all applications on the client are configured to obtain a voice assistant control package built into the client in order to integrate the voice assistant control into the corresponding application.

[0117] The application, which integrates the voice assistant control, is used to send a registration request to the voice assistant service built into the client.

[0118] The voice assistant service is used to register each of the applications according to the registration request, so as to bind the applications to the voice assistant control.

[0119] In one optional embodiment, the voice assistant control is used to recognize the collected user voice information and generate the jump instruction; wherein, the jump instruction includes: an interface jump instruction for instructing the opening of a specified application and a control jump instruction for instructing the display of the voice assistant control at a first specified location;

[0120] Then, the voice assistant control is used to switch the display interface of the currently running application on the client to the display interface of the specified application according to the interface jump instruction;

[0121] After the user completes the jump to the display interface of the specified application, the user will display the voice assistant control at the first specified position on the display interface of the specified application according to the control jump instruction.

[0122] In one alternative embodiment, based on the rhythm data sensed by the client, the voice assistant control is used to dynamically display the rhythm data in the display interface of the currently opened application according to the rhythm data.

[0123] In one optional embodiment, the client is configured to acquire user gestures for the voice assistant control in the currently displayed interface, in order to generate voice assistant control control instructions;

[0124] The voice assistant control is used to move to the end position of the corresponding user operation gesture on the current display interface according to the control command of the voice assistant control.

[0125] In one alternative embodiment, when the application integrates the voice assistant control, a second designated location for showing or hiding the voice assistant control is configured on its display interface.

[0126] In one optional embodiment, the voice assistant service is used to send voice assistant control display instructions to the cloud platform;

[0127] The cloud platform is used to forward the voice assistant control display command to the currently opened application of the client;

[0128] The currently opened application is configured to display the voice assistant control at a second specified position on its display interface in response to the voice assistant control display instruction.

[0129] In one optional embodiment, the voice assistant control is used to obtain the attribute parameters of a target object in the display interface of a specified application in real time, and display the attribute parameters on the voice assistant control.

[0130] Furthermore, when the display interface of the specified application is a map navigation interface, the target object is generated in the display interface of the specified application based on the location information of the electric vehicle associated with the client.

[0131] In one alternative embodiment, the voice assistant control is configured to follow the target object as it moves within the display interface of a specified application.

[0132] In one optional embodiment, the voice assistant control is used to obtain interface parameters of the display interface of a specified application;

[0133] The voice assistant control is used to obtain the control shape corresponding to the interface parameters from a preset control shape library;

[0134] The voice assistant control is used to display a control shape corresponding to the interface parameters in the display interface of a specified application.

[0135] It should be noted that the principle and technical effect of the voice assistant interface display system described in this embodiment of the invention are the same as those in Embodiment 1, and will not be described in detail here.

[0136] Example 3

[0137] Please see Figure 5 This invention provides a voice assistant interface display device, including at least one processor 11, such as a CPU, at least one network interface 14 or other user interface 13, a memory 15, and at least one communication bus 12, which is used to enable communication between these components. The user interface 13 may optionally include a USB interface and other standard interfaces, or a wired interface. The network interface 14 may optionally include a Wi-Fi interface and other wireless interfaces. The memory 15 may include high-speed RAM, or it may also include non-volatile memory, such as at least one disk storage device. The memory 15 may optionally include at least one storage device located remotely from the aforementioned processor 11.

[0138] In some implementations, memory 15 stores executable modules or data structures, or subsets thereof, or extended sets thereof:

[0139] Operating system 151 contains various system programs used to implement various basic business functions and handle hardware-based tasks;

[0140] Program 152.

[0141] Specifically, the processor 11 is used to call the program 152 stored in the memory 15 to execute the interface display method of the voice assistant described in the above embodiments, for example... Figure 1 Step S1 is shown.

[0142] For example, the computer program may be divided into one or more modules / units, which are stored in the memory and executed by the processor to complete the present invention. The one or more modules / units may be a series of computer program instruction segments capable of performing a specific function, which describe the execution process of the computer program in the interface display device of the voice assistant.

[0143] The interface display device of the voice assistant can be a computing device such as a VCU, ECU, or BMS. The interface display device of the voice assistant may include, but is not limited to, a processor and a memory. Those skilled in the art will understand that the schematic diagram is merely an example of the interface display device of the voice assistant and does not constitute a limitation on the interface display device of the voice assistant. It may include more or fewer components than illustrated, or combine certain components, or use different components.

[0144] The processor 11 may be a microcontroller unit (MCU), a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor. The processor 11 is the control center of the voice assistant's interface display device, connecting various parts of the entire voice assistant's interface display device via various interfaces and lines.

[0145] The memory 15 can be used to store the computer programs and / or modules. The processor 11 implements various functions of the voice assistant's interface display device by running or executing the computer programs and / or modules stored in the memory and calling the data stored in the memory. The memory 15 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the mobile phone (such as audio data, phonebook, etc.). In addition, the memory 15 may include high-speed random access memory, and may also include non-volatile memory, such as hard disk, memory, plug-in hard disk, smart media card (SMC), secure digital card (SD) card, flash card, at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0146] If the module / unit integrated into the interface display device of the voice assistant is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of the present invention can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc.

[0147] Example 4

[0148] This invention provides a computer-readable storage medium including a stored computer program, wherein the computer program, when running, controls the device where the computer-readable storage medium is located to execute the interface display method of a voice assistant as described in any one of the first embodiments.

[0149] It should be noted that the device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Furthermore, in the accompanying drawings of the device embodiments provided by this invention, the connection relationships between modules indicate that they have communication connections, which can be specifically implemented as one or more communication buses or signal lines. Those skilled in the art can understand and implement this without any creative effort.

[0150] The above description represents the preferred embodiments of the present invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of the present invention, and these improvements and modifications are also considered to be within the scope of protection of the present invention.

Claims

1. A method for displaying the interface of a voice assistant, characterized in that, include: During the running of the voice assistant control on the client, according to the received jump instruction, the display interface of the currently running application jumps to the display interface of the specified application, and the voice assistant control is displayed at the first specified position on the display interface of the specified application. The specified application sends a voice assistant control display message to the voice assistant service; The voice assistant service, based on the received voice assistant control display message, notifies other applications on the client to hide the voice assistant control on their display interface; it also includes: All applications on the client obtain the voice assistant control package built into the client in order to integrate the voice assistant control into the corresponding application; The application that integrates the voice assistant control sends a registration request to the voice assistant service built into the client. The voice assistant service registers each application according to the registration request, thereby binding the application to the voice assistant control.

2. The interface display method for a voice assistant as described in claim 1, characterized in that, Also includes: The voice assistant control recognizes the collected user voice information and generates the jump instruction; wherein, the jump instruction includes: an interface jump instruction for instructing the opening of a specified application and a control jump instruction for instructing the display of the voice assistant control at a first specified position; Then, the step of jumping from the display interface of the currently running application to the display interface of the specified application according to the received jump instruction, and displaying the voice assistant control at a first specified position on the display interface of the specified application, includes: The voice assistant control switches the display interface of the currently running application on the client to the display interface of the specified application according to the interface jump instruction. After the jump to the display interface of the specified application is completed, the specified application displays the voice assistant control at the first specified position on its display interface according to the control jump instruction.

3. The interface display method for a voice assistant as described in claim 1, characterized in that, Also includes: Obtain user gestures for the voice assistant control in the currently displayed interface to generate control commands for the voice assistant control; According to the control instructions of the voice assistant control, the voice assistant control is moved to the end position of the corresponding user operation gesture on the current display interface.

4. The interface display method for a voice assistant as described in claim 1, characterized in that, Also includes: When the application integrates the voice assistant control, a second specified location is configured on its display interface to show or hide the voice assistant control.

5. The interface display method for a voice assistant as described in claim 4, characterized in that, Also includes: The voice assistant service sends a voice assistant control display instruction to the cloud platform; The cloud platform forwards the voice assistant control display command to the currently opened application on the client. The currently opened application responds to the voice assistant control display command and displays the voice assistant control at a second specified position on its display interface.

6. The interface display method for a voice assistant as described in claim 1, characterized in that, Also includes: Based on the rhythm data sensed by the client, the voice assistant control is dynamically displayed in the display interface of the currently opened application according to the rhythm data.

7. The interface display method for a voice assistant as described in claim 1, characterized in that, Also includes: The voice assistant control obtains the attribute parameters of the target object in the display interface of the specified application in real time, and displays the attribute parameters on the voice assistant control.

8. The interface display method for a voice assistant as described in claim 7, characterized in that, When the display interface of the specified application is a map navigation interface, the target object is generated in the display interface of the specified application based on the location information of the electric vehicle associated with the client.

9. The interface display method for a voice assistant as described in claim 7, characterized in that, Also includes: The voice assistant control moves with the target object within the display interface of the specified application.

10. The interface display method for a voice assistant as described in claim 1, characterized in that, Also includes: The voice assistant control obtains the interface parameters of the specified application's display interface; Retrieve the control shape corresponding to the interface parameters from the preset control shape library; The voice assistant control takes on a shape corresponding to the interface parameters in the display interface of the specified application.

11. A voice assistant interface display system, characterized in that, include: At least one application, a voice assistant control, and a voice assistant service installed on the client; During the process of running the voice assistant control on the client, the voice assistant control is used to jump from the display interface of the currently running application to the display interface of the specified application according to the received jump instruction, and to display the voice assistant control at a first specified position on the display interface of the specified application. The specified application is used to send voice assistant control display messages to the voice assistant service; The voice assistant service is used to notify other applications on the client to hide the voice assistant control on their display interface based on the received voice assistant control display message; All applications on the client are used to obtain the voice assistant control package built into the client, so as to integrate the voice assistant control into the corresponding application; the application that integrates the voice assistant control is used to send a registration request to the voice assistant service built into the client; the voice assistant service is used to register each application according to the registration request, so as to bind the application to the voice assistant control.

12. A voice assistant interface display device, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor executes the computer program to implement the interface display method of the voice assistant as described in any one of claims 1-10.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored computer program, wherein, when the computer program is executed, it controls the device on which the computer-readable storage medium is located to perform the interface display method of the voice assistant as described in any one of claims 1-10.

Images