Voice assistant control method, device and equipment, readable storage medium and chip

Abstract

The invention relates to the technical field of terminal equipment, and provides a voice assistant control method and device, equipment, a readable storage medium and a chip. The method is applied to the terminal equipment, and comprises the following steps: displaying a first state identifier which is used for indicating that a voice assistant is in a state capable of being awakened through a first control operation; in response to the first control operation, awakening a voice assistant; wherein the first control operation is a control operation in a first area at the bottom of the display interface. According to the voice assistant control method provided by the embodiment of the invention, the operation process is simple, and both hands are easy to touch the operation area in the operation process, so that the man-machine interaction experience arousing the mobile phone voice assistant is more humanized, and the user experience is improved. The problems that the operation process of an existing voice assistant awakening mode is tedious, and man-machine usability exists under large-screen operation are solved.

Description

Technical Field

[0001] The present application relates to the technical field of terminal devices, and in particular, to a control method, device, equipment, readable storage medium and chip for a voice assistant. Background Art

[0002] With the development of speech recognition technology, many terminal devices are added with voice assistants (such as YOYO, Xiaoyi, etc.) to help users complete the human-computer interaction process with the terminal device. The voice assistant is usually in a hidden state (such as a sleep state, an exit state or a background running state). Before using the voice assistant, the user needs to wake it up first.

[0003] Currently, the user can wake up the voice assistant by long pressing the power button, saying the wake-up word or clicking on the voice assistant icon. However, with the development of the trend of large screens for terminal devices, there are problems with the usability of the current human-computer interaction experience for waking up the voice assistant. For example, it is not easy to reach the power button with both hands in the large screen interaction experience. Summary of the Invention

[0004] The present application provides a control method, device, equipment, readable storage medium and chip for a voice assistant, which solves the problems of the cumbersome operation process of the existing wake-up method for the voice assistant and the human-computer usability under large screen operations.

[0005] To achieve the above object, the present application adopts the following technical solutions:

[0006] In a first aspect, a control method for a voice assistant is provided, which is applied to a terminal device. The method includes: displaying a first status identifier, where the first status identifier is used to indicate that the voice assistant is in a state where it can be woken up by a first control operation; in response to the first control operation, waking up the voice assistant; where the first control operation is a control operation within a first area at the bottom of the display interface.

[0007] In this embodiment, when the terminal device displays the first status identifier, the user can wake up the voice assistant by performing the first control operation within the first area at the bottom of the display interface. This process is simple to operate, and the operation area is easily accessible by both hands, thus making the human-computer interaction experience of waking up the voice assistant more user-friendly and improving the user experience.

[0008] In some embodiments, the method further includes: hiding the first status identifier after waking up the voice assistant.

[0009] In some embodiments, the method further includes: in response to a second control operation, exiting the voice assistant and redisplaying the first status identifier; where the second control operation is a control operation within the first area.

[0010] In this embodiment, both the first control operation and the second control operation are control operations within the first area at the bottom of the display interface, so that during both the process of waking up the voice assistant and the process of exiting the voice assistant, it is easy for the user to reach with both hands during operation.

[0011] In addition, in this embodiment, the display or non-display of the first status identifier corresponds to the display status of the voice assistant. That is, when the voice assistant is woken up, the first status identifier is in a hidden state, and when the voice assistant exits, the first status identifier is redisplayed. In this way, the user can have a strong perception of the control process of the voice assistant.

[0012] In some embodiments, the first control operation is a sliding operation in the first area in the first direction.

[0013] Optionally, the first control operation can also be a double-tap, long-press, or other control operations in the first area.

[0014] In some embodiments, when the first control operation is a sliding operation in the first area in the first direction, the second control operation is a sliding operation in the first area in the second direction; wherein, the second direction is opposite to the first direction.

[0015] In some implementation manners, the first control operation can be a slide from right to left in the first area, and the second control operation can be a slide from left to right in the first area; or, the first control operation can be a slide from left to right in the first area, and the second control operation can be a slide from right to left in the first area.

[0016] In some embodiments, after the first status identifier is displayed and before the voice assistant is woken up in response to the first control operation, the method further includes: in response to an operation of switching the application interface in the first direction or the second direction, switching the current display interface to the display interface of the first application and hiding the first status identifier; after the switching is completed, redisplaying the first status identifier.

[0017] In this embodiment, the operation of switching the application interface in the first direction or the second direction can be the same operation as the first control operation or the second control operation. In this case, in order to prevent conflicts between the operation of switching the application and the operation of controlling the voice assistant, the terminal device can identify the operation purpose of the user by the operation direction of the control operation. Exemplarily, if the terminal device identifies that the user needs to switch the application interface according to the operation direction of the user's control operation (for example, the second direction), the application interface is switched in response to this control operation; if the terminal device identifies that the user needs to wake up the voice assistant according to the operation direction of the user's control operation (for example, the first direction), the voice assistant is woken up in response to this control operation.

[0018] In some other embodiments, the operation of switching the application interface in the first direction or the second direction may be an operation different from the first control operation or the second control operation, such as different operation areas, different touch methods, and so on.

[0019] In some embodiments, after the switching is completed, the first status identifier is redisplayed, including: after switching to the last application in the first direction or the second direction, the first status identifier is redisplayed.

[0020] In this embodiment, the process of switching the application interface is integrated with the process of controlling the voice assistant, so that when the terminal device redisplay the first status identifier after the application switching is completed, the user can wake up the voice assistant through the first control operation.

[0021] In some other embodiments, after the switching is completed, the first status identifier is redisplayed, including: after switching to the display interface of the first application and no control operation is received within a preset time, the first status identifier is redisplayed.

[0022] In this embodiment, after the terminal device switches to the display interface of the first application and recognizes that there is no human-computer interaction between the user and the terminal device within the preset time, it is determined that the user's current application interface switching action has been completed. At this time, the terminal device locks the application to the current first application and redisplay the first status identifier. The user can wake up the voice assistant through the first control operation during the running of the first application.

[0023] In still some other embodiments, after the switching is completed, the first status identifier is redisplayed, including: after switching to the display interface of the first application and a control operation on the first application is received within a preset time, the first status identifier is redisplayed.

[0024] In this embodiment, after the terminal device switches to the display interface of the first application and receives any control operation on the current interface where the first application is located, the terminal device determines the current first application as the target application to be switched. At this time, the first status identifier is redisplayed. The user can wake up the voice assistant through the first control operation during the running of the first application.

[0025] In some embodiments, displaying the first status identifier includes: displaying the first status identifier in the top status bar of the display interface of the terminal device.

[0026] In this embodiment, the first status identifier may be a graphic mark with a specific style, so that when the user sees the graphic mark with the specific style, they can perceive that this is the corresponding identifier indicating that the voice assistant is in a state that can be awakened through the first control operation.

[0027] In some embodiments, the first region is a region including a navigation bar, and a first status identifier is displayed, including: displaying the first status identifier near the navigation bar in the first region.

[0028] Among them, the navigation bar refers to a horizontal line set at the bottom of the display interface of the terminal device. In response to a user's sliding operation on the corresponding operation area of the navigation bar, the terminal device can quickly switch the applications running in the terminal device, or implement functions such as portable access and start single-handed operation.

[0029] In this embodiment, the first status identifier can be a simple regular icon. Because it is displayed near the navigation bar, the user can perceive that this simple regular icon is used to indicate that the voice assistant is in a state that can be awakened by the first control operation.

[0030] In some embodiments, when the terminal device is in the portrait display mode, the first region is the region at the bottom of the display interface in the portrait display mode; when the terminal device is in the landscape display mode, the first region is the region at the bottom of the display interface in the landscape display mode.

[0031] In this embodiment, the position of the first region is related to the display mode of the terminal device, so that the human-computer interaction experience of controlling the voice assistant is more user-friendly and the user experience is improved.

[0032] In some embodiments, in response to the first control operation, waking up the voice assistant includes: in response to the first control operation, displaying the voice user interface of the voice assistant; or, in response to the first control operation, displaying a second status identifier, and the second status identifier is used to indicate that the voice assistant is in a wake-up state for receiving voice commands.

[0033] In some embodiments, the terminal device is a folding screen device, or the terminal device is a tablet computer.

[0034] When applying the control method of the voice assistant provided in this embodiment to large-screen devices such as folding screen devices or tablet computers, the first region is easily accessible in the human-computer interaction scenario of the large-screen device, which can solve the problem of inconvenience in waking up the voice assistant by interacting with the screen with both hands in the large-screen experience, and improve the problem of poor usability of waking up the voice assistant on large-screen mobile phones / tablets.

[0035] In some embodiments, the first control operation is a left sliding operation or a right sliding operation.

[0036] In this embodiment, the sliding operation method is easier to operate and improves the interaction experience.

[0037] In some embodiments, the awakened voice assistant is displayed at a position on the display interface corresponding to the sliding direction of the first control operation.

[0038] In this embodiment, the awakened voice assistant is displayed at a position on the display interface corresponding to the sliding direction of the first control operation. For example, when the right hand (left hand) slides to the left, it appears on the right side of the screen; when the left hand (right hand) slides to the right, it appears on the left side of the screen, so that the user can strongly perceive the process of the control operation and improve the user's operation experience.

[0039] In a second aspect, a control device for a voice assistant is provided, which is applied to a terminal device. The device includes: a display module for displaying a first status identifier, which is used to indicate that the voice assistant is in a state where it can be awakened by a first control operation; a wake-up module for waking up the voice assistant in response to the first control operation; wherein the first control operation is a control operation within a first area at the bottom of the display interface.

[0040] In a third aspect, a terminal device is provided, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the control method of the voice assistant shown in the first aspect is implemented.

[0041] In a fourth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the control method of the voice assistant shown in the first aspect is implemented.

[0042] In a fifth aspect, a chip is provided. The chip includes a processor and a memory, and a computer program is stored in the memory. When the computer program is executed by the processor, the control method of the voice assistant shown in the first aspect is implemented.

[0043] It can be understood that the beneficial effects of the above second aspect to fifth aspect can refer to the relevant descriptions in the first aspect above, and will not be repeated here. Description of the Drawings

[0044] Figure 1 It is a schematic diagram of a voice user interface provided by an embodiment of the present application;

[0045] Figure 2A It is a schematic diagram of a scenario for waking up a voice assistant provided by an embodiment of the present application;

[0046] Figure 2B It is a schematic diagram of a scenario for waking up a voice assistant provided by another embodiment of the present application;

[0047] Figure 2C It is a schematic diagram of a scenario for waking up a voice assistant provided by still another embodiment of the present application;

[0048] Figure 3 It is a schematic diagram of the structure of a terminal device provided by an embodiment of the present application;

[0049] Figure 4 Schematic flowchart of a control method for a voice assistant provided by an embodiment of the present application;

[0050] Figure 5A Schematic diagram of a terminal device in the vertical screen display mode provided by an embodiment of the present application;

[0051] Figure 5B Schematic diagram of a terminal device in the horizontal screen display mode provided by an embodiment of the present application;

[0052] Figure 6A Schematic diagram of the positions of the first status identifier and the first area in the vertical screen display mode provided by an embodiment of the present application;

[0053] Figure 6B Schematic diagram of the positions of the first status identifier and the first area in the horizontal screen display mode provided by an embodiment of the present application;

[0054] Figure 7A Schematic diagram of a non-application interface of a foldable mobile phone provided by an embodiment of the present application;

[0055] Figure 7B Schematic diagram of an application interface of a foldable mobile phone provided by an embodiment of the present application;

[0056] Figure 8A Schematic diagram of the display effect of waking up the voice assistant in the non-application interface of a foldable mobile phone provided by an embodiment of the present application;

[0057] Figure 8B Schematic diagram of the display effect of exiting the voice assistant in the non-application interface of a foldable mobile phone provided by an embodiment of the present application;

[0058] Figure 9A Schematic diagram of the display effect of waking up the voice assistant in the application interface of a foldable mobile phone provided by an embodiment of the present application;

[0059] Figure 9B Schematic diagram of the display effect of exiting the voice assistant in the application interface of a foldable mobile phone provided by an embodiment of the present application;

[0060] Figure 10A Schematic diagram of a scenario for invoking the function of switching to an application program running through a navigation bar provided by an embodiment of the present application;

[0061] Figure 10B Schematic diagram of a scenario for switching between various opened application programs provided by an embodiment of the present application;

[0062] Figure 10C Schematic diagram of a scenario for switching between various opened application programs provided by another embodiment of the present application;

[0063] Figure 11A Schematic diagram of the scenario where the first status indicator is redisplayed on the right side of the navigation bar provided by an embodiment of the present application;

[0064] Figure 11B Schematic diagram of the scenario where the first status indicator is redisplayed on the right side of the navigation bar provided by another embodiment of the present application;

[0065] Figure 12A Schematic diagram of the non - application interface of a tablet computer provided by an embodiment of the present application;

[0066] Figure 12B Schematic diagram of the application interface of a tablet computer provided by an embodiment of the present application;

[0067] Figure 13A Schematic diagram of the display effect of waking up the voice assistant on the non - application interface of a tablet computer provided by an embodiment of the present application;

[0068] Figure 13B Schematic diagram of the display effect of exiting the voice assistant on the non - application interface of a tablet computer provided by an embodiment of the present application;

[0069] Figure 14A Schematic diagram of the display effect of waking up the voice assistant on the application interface of a tablet computer provided by an embodiment of the present application;

[0070] Figure 14B Schematic diagram of the display effect of exiting the voice assistant on the application interface of a tablet computer provided by an embodiment of the present application;

[0071] Figure 15A Schematic diagram of the non - application interface of a mobile phone provided by an embodiment of the present application;

[0072] Figure 15B Schematic diagram of the application interface of a mobile phone provided by an embodiment of the present application;

[0073] Figure 16A Schematic diagram of the display effect of waking up the voice assistant on the non - application interface of a mobile phone provided by an embodiment of the present application;

[0074] Figure 16B Schematic diagram of the display effect of exiting the voice assistant on the non - application interface of a mobile phone provided by an embodiment of the present application;

[0075] Figure 17A Schematic diagram of the display effect of waking up the voice assistant on the application interface of a mobile phone provided by an embodiment of the present application;

[0076] Figure 17B Schematic diagram of the display effect of exiting the voice assistant on the application interface of a mobile phone provided by an embodiment of the present application;

[0077] Figure 18 It is a schematic structural diagram of a control device for a voice assistant provided by an embodiment of the present application;

[0078] Figure 19 It is a schematic structural diagram of a chip provided by an embodiment of the present application. Detailed implementation manners

[0079] The technical solutions provided by the embodiments of the present application will be described below with reference to the accompanying drawings.

[0080] It should be understood that in the description of the embodiments of the present application, unless otherwise specified, " / " means "or". For example, A / B may represent A or B; herein, "and / or" is merely a description of the relationship between associated objects, indicating that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone.

[0081] In this embodiment, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of such features. In the description of this embodiment, unless otherwise specified, the meaning of "a plurality" is two or more.

[0082] The technical solutions provided by the embodiments of the present application will be described below with reference to the accompanying drawings.

[0083] Human-computer interaction (HCI) refers to the information exchange process between a human and a computer using a graphical interface, dialogue language, gesture, or other interaction methods to complete a specific task. Currently, terminal devices such as mobile phones and tablets widely use a graphical user interface (GUI) to implement the human-computer interaction process with users.

[0084] With the development of speech recognition technology, many terminal devices have added voice assistants (such as YOYO, Xiaoyi, etc.) to help users complete the human-computer interaction process with the terminal device. Taking YOYO as an example of a voice assistant, after the user wakes up YOYO in a terminal device such as a mobile phone, YOYO and the user can communicate via a voice user interface (VUI), as shown in Figure 1 shown. During the voice communication, YOYO can answer each query issued by the user.

[0085] The "Voice Assistant" involved in the embodiments of this application can also be referred to as "Intelligent Voice", "Digital Assistant", "Virtual Assistant", "Intelligent Automation Assistant", or "Automatic Digital Assistant", etc. The "Voice Assistant" can be understood as an information processing system that can recognize natural language inputs in voice form and / or text form to infer the user's intention, and perform corresponding actions based on the inferred user intention. The system can output responses to the user's input in audible (e.g., voice) and / or visual forms.

[0086] Exemplarily, after the terminal device wakes up the Voice Assistant, the user can ask the Voice Assistant questions, such as "Where am I now?". Based on the user's current location, the Voice Assistant can answer "You are near ******." The user can also request the Voice Assistant to perform tasks, such as "Call Mike." In response, the Voice Assistant can confirm the request by saying "Okay, right away", and the Voice Assistant performs the task of calling the contact "Mike". In addition to providing voice responses and performing preset actions, the Voice Assistant can also provide responses in other visual or audio forms (e.g., as text, prompts, music, videos, animations, etc.). It can be understood that the user and the Voice Assistant can also perform other types of interactions, such as chatting, games, knowledge Q&A, etc., and the interaction forms are not limited, and the embodiments of this application do not make limitations in this regard.

[0087] The Voice Assistant is usually in a hidden state (e.g., sleep state, exit state, or background running state). Before using the Voice Assistant, the user needs to wake it up first. The following will illustrate different ways for the user to wake up the Voice Assistant with some specific examples.

[0088] In some embodiments, the user wakes up the Voice Assistant by saying the wake-up word. Exemplarily, as shown in Figure 2A the user says "Xiaoyi, Xiaoyi" to the terminal device. The terminal device responds to this voice command and wakes up the Voice Assistant. After the Voice Assistant is woken up, it can respond to the wake-up word "Xiaoyi, Xiaoyi" input by the user and start receiving voice commands input by the user.

[0089] It should be noted that for the way provided in this embodiment to wake up the Voice Assistant, the terminal device needs to enable the voice word wake-up function of the Voice Assistant in advance and set the wake-up word before the user can wake up the Voice Assistant by saying the wake-up word.

[0090] In other embodiments, when the icon of the Voice Assistant is displayed on the display interface of the terminal device, the user wakes up the Voice Assistant by clicking on the Voice Assistant icon. Exemplarily, as shown in Figure 2BAs shown in [Figure X], the voice assistant icon is located on the secondary interface of the terminal device (i.e., the interface displayed after swiping left on the main interface of the terminal device). The terminal device wakes up the voice assistant in response to the user's click operation on the voice assistant icon.

[0091] It should be noted that in this embodiment, the user needs to query the voice assistant icon in the list of various application programs installed on the terminal device, and then, after querying the voice assistant icon, perform a click operation on the voice assistant icon to wake up the voice assistant. When the voice assistant icon is located on the main interface or the secondary interface of the terminal device, the voice assistant icon is relatively easy to be queried. However, when the voice assistant icon is located on the second interface of the main interface or the secondary interface (i.e., the interface displayed after performing a second operation on the main interface or the secondary interface), for example, the voice assistant icon is located in a certain classification management component in the display interface, then the user needs to query the classification management component and query the voice assistant icon in the classification management component, and then, after querying the voice assistant icon, perform a click operation on the voice assistant icon to wake up the voice assistant.

[0092] In some other embodiments, the user wakes up the voice assistant by long pressing the power button. Refer to Figure 2C As shown in [Figure X], after the user long presses the power button for 0.5 s, the terminal device wakes up the voice assistant in response to the user's operation.

[0093] It should be noted that in this embodiment, the terminal device needs to turn on the shortcut for waking up the voice assistant by long pressing the power button in the settings in advance.

[0094] Based on the above description, it can be seen that in the current human-computer interaction experience of waking up the voice assistant, there are problems such as cumbersome operation processes. And with the development of the trend of large screens for terminal devices, the current voice assistant wake-up methods have problems with usability in some application scenarios. For example, the method of waking up the voice assistant by long pressing the power button has situations where it is difficult for both hands to reach the power button in the large screen interaction experience (such as in a game scenario where both hands are required to operate the display interface), thus affecting the user experience.

[0095] Therefore, the embodiment of the present application provides a control method for a voice assistant. Through this method, when the terminal device displays the first status indicator, in response to the user's first control operation in the first area at the bottom of the display interface, the voice assistant can be woken up, solving the problems of cumbersome operation processes in the existing wake-up methods and the human-computer usability problems under large screen operations, making the human-computer interaction experience of waking up the voice assistant more user-friendly and improving the user experience.

[0096] In this application, the terminal device can be a mobile phone, a tablet computer (Pad), a computer with wireless transceiver function, a smart TV, a wearable device (such as a smart watch), a smart home device with a display screen, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), and other terminal devices. The specific type of the terminal device is not limited in the embodiments of this application.

[0097] Figure 3 It is a schematic structural diagram of the terminal device provided by the embodiments of this application. The terminal device includes a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charging management module 340, a power management module 341, a battery 342, antenna 1, antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, a headphone interface 370D, a sensor module 380, a button 390, a motor 391, an indicator 392, a camera 393, a display screen 394, and a subscriber identification module (SIM) card interface 395, etc.

[0098] It can be understood that the structure schematically shown in the embodiments of this application does not constitute a specific limitation on the terminal device. In other embodiments of this application, the terminal device may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware.

[0099] The processor 310 may include one or more processing units. For example, the processor 310 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors. Among them, the controller may be the nerve center and command center of the terminal device. The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.

[0100] A memory may also be provided in the processor 310 for storing instructions and data. In some embodiments, the memory in the processor 310 is a cache memory. This memory can save the instructions or data that the processor 310 has just used or recycled. If the processor 310 needs to use this instruction or data again, it can be directly called from the memory. This avoids repeated accesses, reduces the waiting time of the processor 310, and thus improves the efficiency of the system.

[0101] The charging management module 340 is used to receive charging input from a charger. Among them, the charger may be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 340 may receive the charging input of the wired charger through the USB interface 330. In some embodiments of wireless charging, the charging management module 340 may receive the wireless charging input through the wireless charging coil of the terminal device. While charging the battery 342, the charging management module 340 can also supply power to the terminal device through the power management module 341.

[0102] The power management module 341 is used to connect the battery 342, the charging management module 340 and the processor 310. The power management module 341 receives the input from the battery 342 and / or the charging management module 340 and supplies power to the processor 310, the internal memory 321, the external memory, the display screen 394, the camera 393, and the wireless communication module 360, etc. The power management module 341 can also be used to monitor parameters such as the battery capacity, the number of battery cycles, and the battery health status (leakage, impedance).

[0103] The wireless communication function of the terminal device can be implemented through Antenna 1, Antenna 2, Mobile Communication Module 350, Wireless Communication Module 360, Modulation and Demodulation Processor, and Baseband Processor, etc.

[0104] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the terminal device can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, Antenna 1 can be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0105] Mobile Communication Module 350 can provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the terminal device. Mobile Communication Module 350 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. Mobile Communication Module 350 can receive electromagnetic waves through Antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit them to the Modulation and Demodulation Processor for demodulation. Mobile Communication Module 350 can also amplify the signal modulated by the Modulation and Demodulation Processor and convert it into electromagnetic waves through Antenna 1 for radiation.

[0106] In some embodiments, at least some functional modules of Mobile Communication Module 350 can be arranged in Processor 310. In some embodiments, at least some functional modules of Mobile Communication Module 350 and at least some modules of Processor 310 can be arranged in the same device.

[0107] The Modulation and Demodulation Processor can include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the Baseband Processor for processing. After being processed by the Baseband Processor, the low-frequency baseband signal is transmitted to the Application Processor. The Application Processor outputs sound signals through an audio playback device (not limited to Speaker 370A, Receiver 370B, etc.), or displays images or videos through Display Screen 394. In some embodiments, the Modulation and Demodulation Processor can be an independent device. In some other embodiments, the Modulation and Demodulation Processor can be independent of Processor 310 and arranged in the same device as Mobile Communication Module 350 or other functional modules.

[0108] The wireless communication module 360 can provide solutions for wireless communications applied to the terminal device, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 360 can be one or more devices integrating at least one communication processing module. The wireless communication module 360 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 310. The wireless communication module 360 can also receive the signals to be sent from the processor 310, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation.

[0109] The camera 393 is used to capture still images or videos. In some embodiments, the terminal device may include one or N cameras 393, where N is a positive integer greater than 1.

[0110] The display screen 394 is used to display images, videos, etc., such as various device management interfaces in the embodiments of the present application. The display screen 394 includes a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device may include one or N display screens 394, where N is a positive integer greater than 1.

[0111] The external memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to implement the storage capacity expansion of the terminal device. The external memory card communicates with the processor 310 through the external memory interface 320 to achieve the data storage function. For example, files such as music and videos are saved in the external memory card.

[0112] The internal memory 321 can be used to store computer-executable program codes, and the executable program codes include instructions. The processor 310 executes various functional applications and data processing of the terminal device by running the instructions stored in the internal memory 321. The internal memory 321 can include a program storage area and a data storage area. Among them, the program storage area can store an operating system and application programs required for at least one function (such as a sound playback function, an image playback function, etc.). The data storage area can store data created during the use of the terminal device (such as audio data, phone book, etc.).

[0113] In addition, the internal memory 321 can include high-speed random access memory, and can also include non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0114] The terminal device can implement audio functions through the audio module 370, the speaker 370A, the receiver 370B, the microphone 370C, the headphone interface 370D, and the application processor, etc.

[0115] The audio module 370 is used to convert digital audio signals into analog audio signals for output, and is also used to convert analog audio inputs into digital audio signals. The audio module 370 can also be used to encode and decode audio signals. In some embodiments, the audio module 370 can be disposed in the processor 310, or some functional modules of the audio module 370 can be disposed in the processor 310.

[0116] The speaker 370A, also known as the "loudspeaker", is used to convert audio electrical signals into sound signals. The terminal device can listen to music through the speaker 370A, or listen to hands-free calls. For example, the speaker can play the comparison and analysis results provided by the embodiments of the present application.

[0117] The receiver 370B, also known as the "earpiece", is used to convert audio electrical signals into sound signals. When the terminal device answers a call or a voice message, the voice can be listened to by bringing the receiver 370B close to the human ear.

[0118] The microphone 370C, also known as a "microphone" or "transmitter", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak close to the microphone 370C with their mouth to input the sound signal into the microphone 370C. The terminal device can be provided with at least one microphone 370C. In some other embodiments, the terminal device can be provided with two microphones 370C, which can not only collect sound signals but also implement a noise reduction function. In some other embodiments, the terminal device can also be provided with three, four or more microphones 370C to collect sound signals, reduce noise, identify the sound source, and implement functions such as directional recording.

[0119] In some embodiments, the terminal device can receive ultrasonic signals sent by other electronic devices through the microphone 370C and identify the frequency and reception intensity of the ultrasonic signals through the processor 310.

[0120] The headphone jack 370D is used to connect a wired headphone. The headphone jack 370D can be a USB interface 330, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0121] The sensor module 380 can include a pressure sensor 380A, a gyroscope sensor 380B, a barometric pressure sensor 380C, a magnetic sensor 380D, an acceleration sensor 380E, a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, an ambient light sensor 380L, a bone conduction sensor 380M, etc.

[0122] The keys 390 include a power-on key, volume keys, etc. The keys 390 can be mechanical keys or touch keys. The terminal device can receive key inputs to generate key signal inputs related to the user settings and function controls of the terminal device.

[0123] The motor 391 can generate vibration prompts. The motor 391 can be used for incoming call vibration prompts or touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, etc.) can correspond to different vibration feedback effects. For touch operations applied to different areas of the display screen 394, the motor 391 can also correspond to different vibration feedback effects.

[0124] The indicator 392 can be an indicator light, which can be used to indicate the charging status and power change of the terminal device, and can also be used to indicate messages, missed calls, notifications, etc.

[0125] The SIM card interface 395 is used to connect to the SIM card. The SIM card can be inserted into or removed from the SIM card interface 395 to achieve contact and separation from the terminal device. The terminal device can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 395 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 395 at the same time. The types of multiple cards can be the same or different.

[0126] Based on the structural features of the terminal device provided in the above embodiments, the control method of the voice assistant provided in this embodiment will be specifically described below. The control method of the voice assistant provided in this embodiment includes the wake-up process and the exit process of the voice assistant. First, the wake-up process of the voice assistant will be introduced below.

[0127] Figure 4 It is a schematic flowchart of the control method of the voice assistant provided in an embodiment of the present application. This method is applied to a terminal device and relates to the wake-up process of the voice assistant. Refer to Figure 4 As shown, this method includes the following steps S401 to S402.

[0128] S401, the terminal device displays a first status identifier, which is used to indicate that the voice assistant is in a state where it can be awakened by a first control operation.

[0129] Among them, the first status identifier can be a graphic mark with a specific style; it can also be a simple regular icon, which can be displayed in the status bar or near the navigation bar. The specific display method can be set according to the actual situation, and this embodiment does not limit this. It should be understood that the navigation bar refers to a horizontal line set at the bottom of the display interface of the terminal device. The terminal device can quickly switch the running applications in the terminal device or achieve functions such as portable access and start single-handed operation in response to the user's sliding operation on the corresponding operation area of the navigation bar.

[0130] In some embodiments, the terminal device displays the first status identifier in the status bar. In this case, the first status identifier can be a graphic mark with a specific style, such as a reduced style of the voice assistant icon. When the status bar is displayed in the display interface of the terminal device, the first status identifier can be displayed accordingly. That is to say, the first status identifier can be displayed in all display interfaces when the terminal device displays the status bar.

[0131] In some other embodiments, the terminal device displays the first status identifier near the navigation bar. In this case, the first status identifier can be a simple regular icon, such as a solid or hollow circular icon. When the navigation bar is displayed in the display interface of the terminal device, the first status identifier can be displayed accordingly.

[0132] It should be noted that when the terminal device is configured to display the first status identifier near the navigation bar, the first status identifier can be displayed when the navigation bar appears but the corresponding function of the navigation bar is not activated. Exemplarily, when the terminal device responds to a sliding operation of the user on the corresponding operation area of the navigation bar and activates the function of switching applications through the navigation bar, at this time, the navigation bar is in the state of activating the corresponding function of the navigation bar, and in this case, the first status identifier is hidden. When the terminal device responds to a sliding operation of the user on the area where the navigation bar is located and completes the switching of applications, at this time, the navigation bar is in the state of not activating the corresponding function of the navigation bar, and in this case, the first status identifier is redisplayed. For example, when the terminal device responds to a sliding operation of the user on the corresponding operation area of the navigation bar and redisplay the first status identifier after switching to the last application in the first direction or the second direction; or, after switching to any application in the application, if no control operation is received within a preset time (for example, 5s), the first status identifier is redisplayed; or, after switching to any application in the application, if a control operation on the application is received within the preset time, the first status identifier is redisplayed.

[0133] It can be seen that when the first status identifier appears in the status bar as a graphic mark of a specific style, it is used to indicate that the voice assistant is in a state where it can be awakened by the first control operation. When the first status identifier appears as a simple regular icon at a specific position, it can also be used to indicate that the voice assistant is in a state where it can be awakened by the first control operation. That is to say, the first status identifier can indicate the wake-up method of the voice assistant both through its own graphic mark feature and through the specific position where it appears.

[0134] S402, the terminal device wakes up the voice assistant in response to the first control operation.

[0135] In this embodiment, the first control operation is a control operation within the first area at the bottom of the display interface. Among them, the position of the first area is related to the display mode of the terminal device. Exemplarily, if the terminal device is in Figure 5A the portrait display mode shown in, then the first area is a bar area at the bottom of the display interface in the portrait display mode. If the terminal device is in Figure 5BWhen in the landscape display mode shown, the first area is a bar-shaped area at the bottom of the display interface in the landscape display mode. In practical applications, the coverage range of the first area can be set according to the size of the device and specific control operations, and this embodiment does not limit this. Optionally, the first area can be a coverage area from one side to the other side at the bottom of the display interface.

[0136] It should be noted that when the terminal device is an electronic device with obvious long and short sides such as a mobile phone or a tablet computer, its portrait display mode and landscape display mode can be the corresponding portrait or landscape states. When the terminal device is an electronic device with indistinguishable long and short sides such as a large-screen mobile phone or a folding mobile phone, its portrait display mode can be the display state of the terminal device in the first holding direction, and the landscape display mode can be the display state of the terminal device in the second holding direction, where the first holding direction is different from the second holding direction. That is to say, the first area can be adaptively adjusted according to the holding state of the terminal device.

[0137] In this embodiment, the first control operation can be a double-click operation, a long-press operation, or a swipe operation within the first area, etc., and this embodiment does not limit this. In practical applications, it can be set according to other operation types configured by the terminal device within the first area. Optionally, the specific type of the first control operation can be set on the principle that the first control operation does not conflict with the operation types currently configured within the first area, or interact and integrate with the existing operation types configured within the first area (for example, by swiping within the corresponding operation area of the navigation bar, the function of starting the application running through the navigation bar switch is activated).

[0138] It should be understood that when the terminal device displays a navigation bar in the display interface, the terminal device can switch the running application according to the user's swipe operation within the corresponding operation area of the navigation bar, and the navigation bar will not disappear with the switching of the application. And there is an overlapping situation or the areas where the two are located are the same between the corresponding operation area of the navigation bar and the first area in the embodiment of the present application. Based on this situation, in order to make the function of waking up the voice assistant of the terminal device independent of the function of waking up the application running through the navigation bar switch of the current terminal device, the swipe direction for waking up the voice assistant is restricted in this embodiment.

[0139] In some embodiments, the terminal device may determine whether the user needs to activate the function of switching the running application through the navigation bar or wake up the voice assistant according to the sliding direction of the sliding operation performed by the user in the first area. For example, when the first control operation is a sliding operation, it can be set as a sliding operation in the first area in the first direction. If the terminal device receives a sliding operation in the first area in the first direction, the voice assistant is woken up; if the terminal device receives a sliding operation in the first area in the second direction, the function of switching the running application through the navigation bar is activated, where the first direction and the second direction are opposite.

[0140] In this embodiment, waking up the voice assistant includes displaying a voice user interface on the display interface of the terminal device, or displaying a second status identifier (also called a voice collection control) on the display interface of the terminal device, and the second status identifier is used to indicate that the voice assistant is in the wake-up state of receiving voice commands. When the voice user interface or the second status identifier is displayed on the display interface of the terminal device, it indicates that the voice assistant is in the wake-up state.

[0141] Optionally, after waking up the voice assistant, the terminal device hides the first status identifier.

[0142] As can be seen from the above, in this embodiment, by displaying the first status identifier on the display interface of the terminal device, the user is reminded that the voice assistant is in a state that can be woken up through the first control operation, so that when there is an icon indication of the voice assistant, the user can wake up the voice assistant through the first control operation. And the first control operation is a control operation in the first area at the bottom of the display interface, the operation process is simple, and both hands are easy to touch during the operation process, which can be applied to most usage scenarios. Through the control method of the voice assistant provided in this embodiment, the human-computer interaction experience of waking up the mobile phone voice assistant can be made more user-friendly, thereby improving the user experience.

[0143] The above is the wake-up process of the voice assistant provided in this embodiment. Next, the exit process of the voice assistant is introduced.

[0144] In this embodiment, after waking up the voice assistant, the terminal device exits the voice assistant in response to a second control operation.

[0145] Among them, the second control operation is a control operation in the first area at the bottom of the display interface. Specifically, the second control operation can be a double-click operation, a long-press operation, a sliding operation, etc. in the first area.

[0146] In some embodiments, the second control operation corresponds to the first control operation. Exemplarily, when the first control operation is a double-tap operation within the first region, the second control operation is also a double-tap operation within the first region; when the first control operation is a long-press operation within the first region, the second control operation is also a long-press operation within the first region; when the first control operation is a sliding operation in the first region in a first direction, the second control operation is a sliding operation in the first region in a second direction, where the first direction and the second direction are opposite to each other.

[0147] In some embodiments, if the terminal device hides the first status identifier after waking up the voice assistant, the terminal device redisplaysthe first status identifier after exiting the voice assistant in response to the second control operation.

[0148] Through the control method of the voice assistant provided by the embodiments of the present application, after the terminal device displays the first status identifier, it can wake up the voice assistant in response to the first control operation within the first region, and can also exit the voice assistant in response to the second control operation within the first region after waking up the voice assistant. This operation process is simple and easy to reach with both hands during the operation process, solving the problems of the cumbersome operation process of the existing voice assistant wake-up methods and the human-computer usability problem under large-screen operations.

[0149] Taking the terminal device configured to display the first status identifier on the right side of the navigation bar, and the first control operation being a sliding operation in the first direction within the first region at the bottom of the display interface as an example, when the control method of the voice assistant provided by the embodiments of the present application is applied to different types of electronic devices (for example, applied to large-screen electronic devices such as foldable mobile phones and tablet computers, or applied to small-screen electronic devices such as ordinary straight mobile phones), its specific control process will be explained in detail.

[0150] In this embodiment, the first region is a strip-shaped region at the bottom of the display interface of the terminal device from one side to the other side and including the navigation bar. It should be understood that in the display interface of the terminal device, the position of the navigation bar is switched with the display mode of the terminal device. For example, when the terminal device is in the portrait display mode, the navigation bar is located at the center of the bottom of the screen in the portrait display mode, which can be considered as the side close to the short side of the terminal device; when the terminal device is in the landscape display mode, the navigation bar is located at the center of the bottom of the screen in the landscape display mode, which can be considered as the side close to the long side of the terminal device. That is to say, the positions of the first status identifier and the first region are switched with the position of the navigation bar. For details, please refer to Figure 6A and Figure 6B as shown.

[0151] In this embodiment, the display interface of the terminal device includes an application interface and a non-application interface. Among them, the application interface refers to the relevant interface displayed after the application program is opened. Or rather, the application interface is the relevant interface displayed when the application program runs in the foreground in response to the user's operation on its application icon. For example, the audio playback interface of an audio application, the recording interface of a recording application, or the call interface of a call application, etc. It can be understood that the application interface is related to a specific application program, and different application programs usually have different application interfaces. The non-application interface is other interfaces except the application interface, such as the desktop, and the system-level setting interface displayed by the terminal device in response to the user's operation of swiping down from the upper part to the lower part of the screen of the terminal device, or in response to the user's operation of swiping up from the lower part to the upper part of the screen of the terminal device. The specific type of the non-application interface in the embodiments of the present application is not limited.

[0152] Example 1, the control method of the voice assistant is applied to the control process of terminal devices with large screens such as folding screen mobile phones and tablet computers.

[0153] Figure 7A It is a schematic diagram of the non-application interface of a folding screen mobile phone provided by an embodiment of the present application. Figure 7B It is a schematic diagram of the application interface of a folding screen mobile phone provided by an embodiment of the present application. As Figure 7A and Figure 7B shown, in the non-application interface / application interface of the folding screen mobile phone, the solid circular icon displayed at the bottom of the display interface and on the right side of the navigation bar is the first status identifier, and the bar-shaped area from one side to the other side at the bottom of the display interface of the folding screen mobile phone including the navigation bar is the first area. That is to say, the navigation bar and the first status identifier on the right side of the navigation bar can be displayed in the application interface of the folding screen mobile phone or in the non-application interface of the folding screen mobile phone. When the first status identifier is in the display state, it indicates that the voice assistant is in a state where it can be awakened by the first control operation at this time.

[0154] In one implementation, the folding screen mobile phone wakes up or exits the voice assistant in the non-application interface in response to the user's sliding operation in the first area. Refer to Figure 8A shown, it is a schematic diagram of the display effect of waking up the voice assistant in the non-application interface provided by an embodiment of the present application. The folding screen mobile phone responds to the user's sliding operation from right to left in the first area, and the voice assistant slides into the screen from the right edge and displays the voice user interface in the right area of the display interface. The voice user interface includes a voice collection control and the voice chat content between the user and the voice assistant. At this time, the voice assistant is in the wake-up state, and the first status identifier located on the right side of the navigation bar is absorbed into the navigation bar and is in the hidden state. Refer to Figure 8BAs shown in the figure, it is a schematic diagram of the display effect of exiting the voice assistant on a non-application interface provided by an embodiment of the present application. After the voice assistant is invoked and displayed in the right area of the screen, in response to the user's left-to-right sliding operation in the first area, the folding screen mobile phone slides the voice assistant out of the screen from the right edge. At this time, the voice assistant is in an exited state, and the first status identifier on the right side of the navigation bar is released from the navigation bar and redisplayed on the right side of the navigation bar.

[0155] In another implementation, the folding screen mobile phone wakes up or exits the voice assistant in the application interface in response to the user's sliding operation in the first area. Figure 9A and Figure 9B shows a schematic diagram of the display effect of waking up the voice assistant in the application interface. As shown in Figure 9A and Figure 9B In the application interface of the photo, in response to the user's right-to-left sliding operation in the first area, the folding screen mobile phone wakes up the voice assistant; after the voice assistant is invoked, in response to the user's left-to-right sliding operation in the first area, the folding screen mobile phone exits the voice assistant. The specific process is as shown in the foregoing embodiment and will not be elaborated in this embodiment. It should be noted that the method of waking up or exiting the voice assistant by the folding screen mobile phone in the application interface can be applied to any application installed on it. When the navigation bar appears, the folding screen mobile phone can wake up or exit the voice assistant in response to the user's sliding operation in the first area.

[0156] Optionally, in other implementation manners of this embodiment, when the folding screen mobile phone wakes up the voice assistant in response to the user's sliding operation, the voice assistant can also slide into the screen from other directions of the screen and display the voice user interface at the corresponding position of the sliding-in direction. For example, the voice assistant slides into the screen from the bottom of the screen and displays the voice user interface at the bottom position of the screen. At this time, the voice user interface can be displayed in a half-screen mode, and the folding screen mobile phone can switch it to a full-screen mode in response to the user's operation. In practical applications, it can be set according to specific application scenarios, and this embodiment does not limit this.

[0157] The following will give a detailed explanation of the control process for the folding screen mobile phone to determine whether the user needs to start the function of switching and running applications through the navigation bar or wake up the voice assistant according to the sliding direction of the sliding operation performed by the user in the first area.

[0158] In some embodiments, the folding-screen mobile phone wakes up the voice assistant in response to a user's swiping operation in a first direction (e.g., from right to left) within a first area; the folding-screen mobile phone starts the function of switching the applications running in the terminal device through the navigation bar in response to a user's swiping operation in a second direction (e.g., from left to right) within the first area, where the first direction is opposite to the second direction. Optionally, the folding-screen mobile phone can also start the function of switching the applications running in the terminal device through the navigation bar in response to a user's swiping operation in a first direction (e.g., from right to left) within the first area; the folding-screen mobile phone wakes up the voice assistant in response to a user's swiping operation in a second direction (e.g., from left to right) within the first area.

[0159] In this way, the terminal device can make the operation of waking up the voice assistant independent of the operation of invoking the function of switching the running applications through the navigation bar by limiting the swiping method, thereby avoiding conflicts between the two during the startup and running processes.

[0160] In one implementation manner of this embodiment, the folding-screen mobile phone starts the function of switching the applications running in the terminal device through the navigation bar in response to a user's swiping operation in a second direction (e.g., from left to right) within the first area. At this time, the first status identifier disappears, that is, it is in a hidden state, and the folding-screen mobile phone enters the process of switching applications according to the user's swiping operation in the first direction or the second direction. Exemplarily, refer to Figure 10A As shown, the folding-screen mobile phone invokes the function of switching the running applications through the navigation bar according to the user's swiping operation from left to right within the corresponding operation area of the navigation bar. At the same time, the folding-screen mobile phone switches the current display interface to the display interface of the first application in response to this swiping operation from left to right, where the first application is the application that the folding-screen mobile phone displayed before the current display interface. In this case, the folding-screen mobile phone can switch the opened applications in response to the user's swiping operation (which can be swiping from right to left or from left to right) within the first area. The display process can be referred to Figure 10B and Figure 10C As shown in, the user can switch back and forth among the camera, video application, and photo application by swiping left and right to determine the target application that needs to be operated finally.

[0161] In this implementation manner, during the process of the folding-screen mobile phone switching applications in response to the user's swiping operation within the corresponding operation area of the navigation bar, the first status identifier is in the last position in the order of the applications to be switched. Exemplarily, combined with Figure 10B As shown in, if the camera application is the last application in the switching order of the folding-screen mobile phone, then while the folding-screen mobile phone displays the camera application, the first status identifier is redisplayed on the right side of the navigation bar.

[0162] It should be noted that during the process of the folding-screen mobile phone switching applications in response to the user's sliding operation within the corresponding operation area of the navigation bar, there may be a last application in the first direction, or there may be applications in the second direction. In this case, when the folding-screen mobile phone displays the last application in the first direction and / or the last application in the second direction, the first status identifier is redisplayed on the right side of the navigation bar.

[0163] In another implementation manner of this embodiment, after the folding-screen mobile phone evokes the application programs switched and run through the navigation bar in response to the user's sliding operation in the second direction (for example, from left to right) within the first area, at this time, the navigation bar is used to switch applications by sliding left and right. After the terminal device switches to any application in the application programs in response to the user's sliding operation in the first direction or the second direction, if no control operation is received within a preset time (for example, 5 seconds), the first status identifier is redisplayed on the right side of the navigation bar, and the display process is shown in Figure 11A as shown in

[0164] In this implementation manner, when the terminal device recognizes that there is no human-computer interaction between the user and the terminal device within the preset time, it is determined that the user's current application switching action has been completed. At this time, the terminal device locks the application to the current application and redisplay the first status identifier on the right side of the navigation bar. The user can wake up the voice assistant during the running of the current application.

[0165] In yet another implementation manner of this embodiment, after the folding-screen mobile phone evokes the application programs switched and run through the navigation bar in response to the user's sliding operation in the second direction (for example, from left to right) within the first area, at this time, the navigation bar is used to switch applications by sliding left and right. After the terminal device switches to any application in the application programs in response to the user's sliding operation in the first direction or the second direction, if a control operation on the application is received within the preset time, such as clicking on Photo 1 in the photo application, the first status identifier is redisplayed on the right side of the navigation bar, and the display process is shown in Figure 11B as shown in

[0166] In this implementation manner, during the process of the terminal device switching applications according to the user's operation, when receiving any operation on the interface of the current application by the user, the terminal device determines the current application as the target application to be switched, and at this time, the first status identifier is redisplayed. The user can wake up the voice assistant during the running of the current application.

[0167] In this embodiment, the folding-screen mobile phone coordinates and integrates the interactive operation of invoking / quitting the voice assistant through a sliding operation with the interactive operation of sliding the navigation bar to switch applications. This not only ensures that there is no conflict between the two during startup and operation, but also enables the first status identifier to be displayed at an appropriate time when switching applications, making the human-computer interaction experience of the terminal device more user-friendly and thus improving the user experience.

[0168] The above is the process of the coordinated integration of sliding to switch applications in the corresponding operation area of the navigation bar and sliding to wake up the voice assistant in the first area when the terminal device is a folding-screen mobile phone. When the terminal device is other large-screen electronic devices such as a tablet computer or a terminal device with a relatively small screen such as a mobile phone, the method provided in the above embodiment is also applicable. And for large-screen devices, its usability is stronger.

[0169] Figure 12A FIG. is a schematic diagram of the non-application interface of a tablet computer provided by an embodiment of the present application. Figure 12B FIG. is a schematic diagram of the application interface of a tablet computer provided by an embodiment of the present application. Refer to Figure 12A And Figure 12B As shown in, in the non-application interface or application interface of the tablet computer, the first status identifier is displayed on the right side of the navigation bar.

[0170] In some embodiments, in response to the user's sliding operation in the first area, the tablet computer wakes up or quits the voice assistant in the non-application interface, and the display effect is shown in Figure 13A And Figure 13B Shown.

[0171] In some other embodiments, in response to the user's sliding operation in the first area, the tablet computer wakes up or quits the voice assistant in the application interface, and the display effect is shown in Figure 14A And Figure 14B Shown.

[0172] In this embodiment, for the detailed process of the tablet computer waking up or quitting the voice assistant in the application interface or non-application interface in response to the user's sliding operation in the first area, reference can be made to the content shown in the foregoing embodiment of the folding-screen mobile phone, and this embodiment will not be elaborated.

[0173] As can be seen from the above, when the control method of the voice assistant provided by the embodiment of the present application is applied to large-screen devices (such as folding-screen mobile phones, tablet computers), by swiping left and right to display the corresponding first area at the bottom of the interface, the function of invoking / quitting the voice assistant can be realized. This first area is easily accessible in the human-computer interaction scenario of large-screen devices, solving the problem of inconvenience in using both hands to interact with the screen to wake up the voice assistant in the large-screen experience, improving the poor usability of waking up the voice assistant on large-screen mobile phones / tablets, and the larger the screen of the adapted terminal device, the stronger the usability of its human-computer interaction.

[0174] Example 2. The control method of the voice assistant is applied to the control process of terminal devices with relatively small screens, such as ordinary straight-bar mobile phones.

[0175] Figure 15A It is a schematic diagram of the non-application interface of the mobile phone provided by an embodiment of the present application. Figure 15B It is a schematic diagram of the application interface of the mobile phone provided by an embodiment of the present application. Refer to Figure 15A and Figure 15B As shown in

[0176] In some embodiments, the mobile phone wakes up or exits the voice assistant in the non-application interface in response to a user's sliding operation in the first area. For the display effect, refer to Figure 16A and Figure 16B shown.

[0177] In other embodiments, the mobile phone wakes up or exits the voice assistant in the application interface in response to a user's sliding operation in the first area. For the display effect, refer to Figure 17A and Figure 17B shown.

[0178] Based on the differences in device structures between ordinary straight-bar mobile phones, folding-screen mobile phones, and tablet computers, when waking up the voice assistant on an ordinary straight-bar mobile phone, the mobile phone responds to a user's sliding operation in the first area, and can control the voice assistant to slide into the screen from the bottom edge of the screen and display the voice user interface in a semi-screen display state in the bottom area of the display interface. The voice user interface includes a voice collection control, a screen switching control, and the voice chat content between the user and the voice assistant. The screen switching control is used for the user to switch the voice user interface from the semi-screen display state to the full-screen display state after operating (such as swiping up) the screen switching control. Optionally, based on the particularity of the relatively small-screen ordinary straight-bar mobile phone, after the mobile phone wakes up the voice assistant in response to a user's sliding operation in the first area, at this time, the first area is the area where the voice user interface is located; refer to Figure 16B and Figure 17B shown. When the voice assistant is invoked, the mobile phone exits the voice assistant in response to a user's sliding operation from left to right within the area where the voice user interface is located.

[0179] The above is the control process when the control method of the voice assistant provided by the embodiment of the present application is applied to different types of terminal devices. As can be seen from the above, through the method provided by this embodiment, when the first status identifier is displayed on the terminal device, the user can wake up or exit the voice assistant through the control operation in the first area at the bottom of the display interface, and this control process will not conflict with the existing control operations. The operation process of this method is simple and can be applied to most application scenarios, thereby improving the user's human-computer interaction experience.

[0180] It should be understood that the magnitudes of the sequence numbers of the steps in the above embodiments do not mean the order of execution. The execution order of each process should be determined according to its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

[0181] The embodiment of the present application also provides a control device for a voice assistant, which is applied to a terminal device. Refer to Figure 18 As shown, the device includes a display module 1801 and a wake-up module 1802.

[0182] Specifically, the display module 1801 is configured to display a first status identifier, and the first status identifier is used to indicate that the voice assistant is in a state that can be woken up by a first control operation.

[0183] The wake-up module 1802 is configured to wake up the voice assistant in response to the first control operation.

[0184] Wherein, the first control operation is a control operation within the first area at the bottom of the display interface.

[0185] The embodiment of the present application also provides a terminal device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it is configured to execute the control method of the voice assistant shown in the above respective embodiments.

[0186] The embodiment of the present application also provides a chip. Refer to Figure 19 As shown, the chip includes a processor and a memory, and a computer program is stored in the memory. When the computer program is executed by the processor, it implements the control method of the voice assistant in the above respective embodiments.

[0187] The embodiment of the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the control method of the voice assistant provided in the above respective embodiments.

[0188] An embodiment of this application also provides a computer program product, which includes a computer program. When the computer program runs on a terminal device, the terminal device implements the control method of the voice assistant provided in the above embodiments.

[0189] It should be understood that the processor mentioned in the embodiments of this application may be a central processing unit (CPU), or may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor, or the processor may also be any conventional processor, etc.

[0190] It should also be understood that the memory mentioned in the embodiments of this application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchlink DRAM (SLDRAM), and direct rambus RAM (DR RAM).

[0191] In the embodiments provided in the present application, the division of each framework or module is only a logical function division. In actual implementation, there may be other division methods. For example, multiple frameworks or modules can be combined or integrated into another system, or some features can be ignored or not executed.

[0192] In addition, in each embodiment of the present application, the functional modules can be integrated in a processing module, or each module can exist physically alone, or two or more modules can be integrated in one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules.

[0193] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the above-described systems, devices, and units can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated herein.

[0194] The reference to "one embodiment" or "some embodiments" etc. described in the specification of the present application means that specific features, structures, or characteristics described in connection with the embodiment are included in one or more embodiments of the present application. Thus, the statements "in one embodiment", "in some embodiments", "in other some embodiments", "in still other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "include", "comprise", "have" and their variants all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0195] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A control method for a voice assistant, characterized in that, Applied to a terminal device, the method includes: Display a first status identifier, which is used to indicate that the voice assistant is in a state where it can be awakened by a first control operation; In response to the first control operation, wake up the voice assistant; Wherein, the first control operation is a control operation within a first area at the bottom of the display interface.

2. The method according to claim 1, wherein The method further includes: After waking up the voice assistant, hide the first status identifier.

3. The method according to claim 1 or 2, characterized in that The method further includes: In response to a second control operation, exit the voice assistant and redisplay the first status identifier; Wherein, the second control operation is a control operation within the first area.

4. The method according to any one of claims 1-3, characterized in that The first control operation is a sliding operation in the first area in a first direction.

5. The method according to claim 4, wherein The second control operation is a sliding operation in the first area in a second direction; wherein, the second direction is opposite to the first direction.

6. The method according to any one of claims 1-5, characterized in that, After displaying the first status identifier and before waking up the voice assistant in response to the first control operation, the method further includes: In response to an operation of switching the application interface in the first direction or the second direction, switch the current display interface to the display interface of a first application and hide the first status identifier; After the switching is completed, redisplay the first status identifier.

7. The method according to claim 6, wherein The redisplaying the first status identifier after the switching is completed includes: After switching to the last application in the first direction or the second direction, redisplay the first status identifier.

8. The method according to claim 6, characterized in that, The redisplaying the first status identifier after the switching is completed includes: After switching to the display interface of the first application and no control operation is received within a preset time, redisplay the first status identifier.

9. The method according to claim 6, wherein The redisplaying the first status identifier after the switching is completed includes: After switching to the display interface of the first application and a control operation for the first application is received within a preset time, redisplay the first status identifier.

10. The method according to any one of claims 1-9, characterized in that, The displaying the first status identifier includes: Display the first status identifier in the top status bar of the display interface of the terminal device.

11. The method according to any one of claims 1-9, characterized in that, The first area is an area including a navigation bar, and the displaying the first status identifier includes: Display the first status identifier near the navigation bar in the first area.

12. The method according to any one of claims 1-11, characterized in that When the terminal device is in the portrait display mode, the first area is the area at the bottom of the display interface in the portrait display mode; When the terminal device is in the landscape display mode, the first area is the area at the bottom of the display interface in the landscape display mode.

13. The method according to any one of claims 1-12, characterized in that, The waking up the voice assistant in response to the first control operation includes: In response to the first control operation, display the voice user interface of the voice assistant; or, In response to the first control operation, display a second status identifier, which is used to indicate that the voice assistant is in a wake-up state for receiving voice commands.

14. The method according to any one of claims 1 to 13, characterized in that, The terminal device is a foldable screen device, or the terminal device is a tablet computer.

15. The method according to any one of claims 1-14, characterized in that, The first control operation is a left swipe operation or a right swipe operation.

16. The method according to any one of claims 1 to 15, characterized in that, The awakened voice assistant is displayed at a position on the display interface corresponding to the swipe direction of the first control operation.

17. A control device for a voice assistant, characterized in that, Applied to a terminal device, the apparatus includes: A display module, configured to display a first status identifier for indicating that the voice assistant is in a state where it can be awakened by a first control operation; An awakening module, configured to awaken the voice assistant in response to the first control operation; Wherein, the first control operation is a control operation within a first area at the bottom of the display interface.

18. A terminal device, characterized in that, It includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the method described in any one of claims 1-16 is implemented.

19. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in any one of claims 1-16 is implemented.

20. A chip, characterized in that, The chip includes a processor and a memory, and a computer program is stored in the memory. When the computer program is executed by the processor, the method described in any one of claims 1-16 is implemented.

Images