Display device and device wake-up method for display device

Abstract

The present application relates to a display device and a device wake-up method for a display device. When a display device is in a screen-off state and a first state, a user voice is collected, and when it is recognized that the user voice contains a wake word, whether the display device is in a loudspeaker mode is detected. When the display device is in the loudspeaker mode, in the screen-off state, a silent mode is turned off or an audio to be played of a wake-up prompt tone is played back after the volume is increased, or after the display device is adjusted to be in a screen-on state, a pop-up window is displayed on an intermediate page. According to the display device, in a loudspeaker mode, a wake-up prompt tone with an appropriate volume is played back or a pop-up window is displayed, thereby reducing disturbance to a user when the user is prompted that the display device is woken up.

Description

Display device and device wake-up method for display device

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese patent application No. 202310793945.2, filed on June 29, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present application relates to the technical field of display devices, and in particular to a display device and a device wake-up method for the display device. Background Art

[0004] A display device refers to a terminal device capable of outputting a specific display image. These devices can include smart TVs, mobile terminals, smart advertising screens, projectors, and other terminal devices. Taking smart TVs as an example, they are based on Internet application technology, feature an open operating system and chip, and possess an open application platform. They enable two-way human-computer interaction and integrate multiple functions, including audio, video, entertainment, and data, to meet the diverse and personalized needs of users.

[0005] The display device is equipped with a far-field voice control function. After recognizing the user's input of the wake-up word (Wake word), the display device is awakened and plays a wake-up prompt tone. If the display device is in speaker mode and is in silent mode or the volume is 0, it is difficult for the user to accurately identify that the display device is in speaker mode because the display device is in the screen-off state. At this time, if the display device is awakened, it is easy to disturb the user. Moreover, if the display device is limited to silent mode or the volume is 0 and the wake-up prompt tone is not played, it is easy for the user to mistakenly believe that the display device is not awakened.

[0006] Summary of the Invention

[0007] According to some embodiments of the present application, a display device may include: a display, configured to be in a screen-off state; a speaker, configured to be in a silent mode or the display device is in a non-silent mode and the current system volume is 0; a sound collector, configured to collect user voice; a memory, configured to store computer instructions and / or data associated with the display device, at least one processor, connected to the display, the speaker, the sound collector and the memory, configured to execute the computer instructions to enable the display device to execute: when recognizing that the user voice includes a wake-up word, detecting whether it is in speaker mode; if it is in the speaker mode, controlling the display to maintain the screen-off state and canceling the silent mode, and after canceling the silent mode, controlling the speaker to play the to-be-played audio of the wake-up prompt sound at a first volume.

[0008] According to some embodiments of the present application, a display device may include: a display, configured to be in a screen-off state; a speaker, configured to be in a non-silent mode and the current system volume is 0; a sound collector, configured to collect user voice; when recognizing that the user voice includes a wake-up word, detecting whether it is in speaker mode; if it is in the speaker mode, controlling the display to maintain the screen-off state, and increasing the system volume to a second volume, and playing the to-be-played audio of the wake-up prompt sound at the second volume.

[0009] According to some embodiments of the present application, a display device may include: a display, configured to be in a screen-off state; a speaker, configured to be in a first state, wherein the first state is that the display device is in silent mode or the display device is in non-silent mode and the current system volume is 0; a sound collector, configured to collect user voice; a memory, configured to store computer instructions and / or data associated with the display device, at least one processor, connected to the display, the speaker, the sound collector and the memory, configured to execute the computer instructions to enable the display device to execute: when recognizing that the user voice contains a wake-up word, detecting whether it is in speaker mode; if it is in speaker mode, adjusting the display to a bright screen state, and controlling the display to display an intermediate page, and displaying a pop-up window on the intermediate page according to the first state, wherein the intermediate page is black, and the pop-up window is used to prompt the user that the display device has been awakened.

[0010] According to some embodiments of the present application, a device wake-up method for a display device is provided, wherein the display device is in a screen-off state and a silent mode; the method may include: collecting user voice; upon recognizing that the user voice includes a wake-up word, detecting whether the device is in a speaker mode; if the device is in the speaker mode, maintaining the screen-off state and releasing the silent mode, and after releasing the silent mode, playing the to-be-played audio of the wake-up prompt sound at a first volume.

[0011] According to some embodiments of the present application, a device wake-up method for a display device is provided, wherein the display device is in a screen-off state, in a non-silent mode, and the current system volume is 0; the method may include: collecting user voice; upon recognizing that the user voice includes a wake-up word, detecting whether the device is in speaker mode; if the device is in speaker mode, maintaining the screen-off state, and increasing the system volume to a second volume, and playing the audio to be played of the wake-up prompt sound at the second volume.

[0012] According to some embodiments of the present application, a device wake-up method for a display device is provided, wherein the display device is in a screen-off state and a first state, wherein the first state is that the display device is in silent mode or the display device is in non-silent mode and the current system volume is 0; the method may include: upon recognizing that the user voice contains a wake-up word, detecting whether the device is in speaker mode; if the device is in speaker mode, adjusting the screen to a bright state and displaying a middle page, and displaying a pop-up window on the middle page according to the first state, wherein the middle page is black, and the pop-up window is used to prompt the user that the display device has been awakened. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] FIG1 is a usage scenario of a display device according to some embodiments of the present application;

[0014] FIG2 is a configuration block diagram of a control device according to some embodiments of the present application;

[0015] FIG3 is a configuration diagram of a display device according to some embodiments of the present application;

[0016] FIG4 is a diagram illustrating an operating system configuration of a display device according to some embodiments of the present application;

[0017] FIG5 is a flowchart of a display device adjusting the volume of a wake-up prompt tone according to the signal-to-noise ratio of a user's voice and the current system volume in some embodiments of the present application;

[0018] FIG6 is a flowchart showing a device identifying a wake-up word according to some embodiments of the present application;

[0019] FIG7 is a flow chart showing how to calculate the wake-up value of a user's voice according to a display device usage model in some embodiments of the present application;

[0020] FIG8 is a schematic diagram of a model for calculating a wake-up value of a user's voice by a display device according to some embodiments of the present application;

[0021] FIG9 is a schematic diagram of a model for calculating a wake-up value of a user's voice by a display device according to some embodiments of the present application;

[0022] FIG10 is a flowchart illustrating a display device adjusting the amplitude of the wake-up prompt tone according to the signal-to-noise ratio of the user's voice and the current system volume in some embodiments of the present application;

[0023] FIG11 is a flowchart illustrating a display device adjusting the amplitude of the wake-up prompt tone according to the signal-to-noise ratio of the user's voice and the current system volume in some embodiments of the present application;

[0024] FIG12 is a logic determination diagram of a display device adjusting the amplitude of the wake-up prompt tone according to the signal-to-noise ratio of the user's voice and the current system volume in some embodiments of the present application;

[0025] FIG13 is a schematic diagram of a pop-up window containing information for prompting a user to adjust the system volume according to some embodiments of the present application;

[0026] FIG14 is a flowchart of a display device adjusting the volume of a wake-up prompt sound according to a difference between a wake-up value and a wake-up value threshold and a current system volume according to some embodiments of the present application;

[0027] FIG15 is a flowchart illustrating a display device adjusting the amplitude of an audio wake-up prompt tone according to a difference between a wake-up value and a wake-up value threshold and a current system volume in some embodiments of the present application;

[0028] FIG16 is a flowchart illustrating a display device adjusting the amplitude of an audio wake-up prompt tone according to a difference between a wake-up value and a wake-up value threshold and a current system volume in some embodiments of the present application;

[0029] FIG17 is a logic determination diagram of a display device adjusting the amplitude of the wake-up prompt tone according to the difference between the wake-up value and the wake-up value threshold and the current system volume in some embodiments of the present application;

[0030] FIG18 is a schematic diagram of a first-style pop-up window and a second-style pop-up window of different sizes according to some embodiments of the present application;

[0031] FIG19 is a schematic diagram of a first-style pop-up window and a second-style pop-up window displayed in different positions according to some embodiments of the present application;

[0032] FIG20 is a schematic diagram of a first-style pop-up window and a second-style pop-up window of different sizes and display positions according to some embodiments of the present application;

[0033] FIG21 is a flowchart illustrating a display device adjusting the volume of a wake-up prompt tone according to a difference between a wake-up value and a wake-up value threshold, a signal-to-noise ratio of a user's voice, and a current system volume in some embodiments of the present application;

[0034] FIG22 is a flowchart illustrating a display device adjusting the amplitude of the wake-up prompt tone according to the difference between the wake-up value and the wake-up value threshold, the signal-to-noise ratio of the user's voice, and the current system volume in some embodiments of the present application;

[0035] FIG23 is a flowchart illustrating a display device adjusting the amplitude of the wake-up prompt tone according to the difference between the wake-up value and the wake-up value threshold, the signal-to-noise ratio of the user's voice, and the current system volume in some embodiments of the present application;

[0036] FIG24 is a logic judgment diagram of a display device adjusting the amplitude of the wake-up prompt tone according to the difference between the wake-up value and the wake-up value threshold, the signal-to-noise ratio of the user's voice, and the current system volume in some embodiments of the present application;

[0037] FIG25 is a flowchart of a wake-up response when a display device is in a screen-on state and in a first state according to some embodiments of the present application;

[0038] FIG26 is a schematic diagram of a pop-up window containing first information according to some embodiments of the present application;

[0039] FIG27 is a flow chart showing second information according to some embodiments of the present application;

[0040] FIG28 is a schematic diagram of a pop-up window containing first information and second information according to some embodiments of the present application;

[0041] FIG29 is a flowchart showing the release of a silent mode of a display device according to some embodiments of the present application;

[0042] FIG30 is a flowchart showing the release of a silent mode of a display device according to some embodiments of the present application;

[0043] FIG31 is a schematic diagram of a pop-up window containing third information according to some embodiments of the present application;

[0044] FIG32 is a flowchart of a wake-up response when a display device is in a screen-on state and in a silent mode according to some embodiments of the present application;

[0045] FIG33 is a flowchart of a wake-up response when the display device is in a screen-on state, in a non-silent mode, and the current system volume is 0 according to some embodiments of the present application;

[0046] FIG34 is a flowchart showing how a display device responds to a wake-up word when in speaker mode and silent mode according to some embodiments of the present application;

[0047] FIG35 is a flowchart showing how a display device responds to a wake-up word when in speaker mode, in non-silent mode, and when the current system volume is 0 according to some embodiments of the present application;

[0048] FIG36 is a schematic diagram showing a display device playing a wake-up prompt tone and a first prompt message according to some embodiments of the present application;

[0049] FIG37 is a schematic diagram showing a display device playing a wake-up prompt tone, a first prompt message, and a second prompt message according to some embodiments of the present application;

[0050] FIG38 is a flowchart showing how a display device responds to a wake-up word when in speaker mode and in a first state according to some embodiments of the present application;

[0051] Figure 39 is a schematic diagram of the middle page and pop-up window in some embodiments of the present application. DETAILED DESCRIPTION

[0052] The following embodiments are described in detail, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numbers in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following embodiments are not intended to represent all possible implementations consistent with the present application. They are merely examples of systems and methods consistent with certain aspects of the present application, as detailed in the claims.

[0053] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0054] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0055] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0056] The display device provided in the embodiments of this application can have various implementation forms, such as a smart TV, laser projection equipment, monitor, electronic bulletin board, electronic table, etc., or a device with a display screen such as a mobile phone, tablet computer, smart watch, etc. Figures 1 and 2 illustrate a specific embodiment of the display device of this application.

[0057] FIG1 is a schematic diagram of a usage scenario of a display device according to some embodiments of the present application. As shown in FIG1 , a user can operate a display device 200 through a control device 100. The display device 200 can obtain network data from a server 300 or a live broadcast signal via a satellite. The user can also control the display device 200 through voice. For example, the user can wake up the display device 200 by issuing a wake-up word. The awakened display device 200 then activates the far-field voice service and responds to the user's voice commands issued within a certain period of time.

[0058] FIG2 is a block diagram of a configuration of a control device 100 according to some embodiments of the present application. In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device 200 may include infrared protocol communication, Bluetooth protocol communication, or at least one of other short-range communication methods, controlling the display device 200 wirelessly or wiredly. A user may control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, etc. The control device 100 may include a mute button for turning on and off mute mode. In mute mode, the display device 200 does not change the amplitude of the audio data, i.e., retains the current system volume, and after decoding the audio data, does not transmit the decoded audio data to the speakers for playback. When the display device 200 is not in mute mode, the user inputs a control command to the display device 200 using the mute button, and the display device 200 recognizes the control command as turning on mute mode. In response to the control command, the display device 200 retains the current system volume and, after decoding the audio data, does not transmit the decoded audio data to the speakers. When the display device 200 is in mute mode, the user inputs a control command to the display device 200 using the mute key, and the display device 200 recognizes the control command as unmute mode. In response to the control command, the display device 200 transmits the decoded audio data to the speaker and plays the audio at the retained current system volume. The control device 100 may also include a volume key for adjusting the volume of the played audio. If the user inputs a command to lower the volume using the volume key, the display device 200, in response to the command, reduces the amplitude of the decoded audio data after decoding the audio data and transmits the audio data with the reduced amplitude to the speaker for playback. If the user inputs a command to increase the volume using the volume key, the display device 200, in response to the command, increases the amplitude of the decoded audio data after decoding the audio data and transmits the audio data with the increased amplitude to the speaker for playback. In some embodiments, if the user adjusts the volume to 0 using the volume key, the display device 200, after decoding the audio data, adjusts the amplitude of the decoded audio data to 0 and transmits the audio data with the zero amplitude to the speaker for playback.

[0059] FIG3 is a configuration block diagram of a display device 200 according to some embodiments of the present application.

[0060] The display apparatus 200 may include at least one of a tuner 210 , a communicator 220 , a detector 230 , an external device interface 240 , at least one processor 250 , a display 260 , an audio output interface 270 , a memory, a power supply, and a user interface 280 .

[0061] In some embodiments, the display device 200 can establish the transmission and reception of control signals and data signals with the control device 100 or the server 300 through the communication device 220. In some embodiments, the detector 230 may include a sound collector. The display device 200 can collect user voice through the sound collector and transmit the collected user voice to at least one processor 250 for processing. In some embodiments, the at least one processor 250 and the tuner 210 can be located in different split devices, that is, the tuner 210 can also be in an external device of the main device where the at least one processor 250 is located, such as an external set-top box. In some embodiments, the at least one processor 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The at least one processor 250 controls the overall operation of the display device 200. In some embodiments, at least one processor 250 may include a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a random access memory (RAM), a read-only memory (ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.

[0062] For example, the processor can recognize the user's voice through the central processing unit and the audio processor. If the user's voice is recognized to contain a wake-up word, the audio of the wake-up prompt sound can be processed and the processed audio of the wake-up prompt sound can be transmitted to the audio output interface 270 for playback, such as playing through a speaker.

[0063] In some embodiments, the display 260 may include a display screen component for presenting images, a driver component for driving the image display, a component for receiving image signals output by at least one processor 250, and a component for displaying video content, image content, and a menu control interface, as well as a user control UI interface. In some embodiments, the display 260 may be a liquid crystal display, an OLED display, or a projection display, or may be a projection device and projection screen. In some embodiments, a user may enter user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the GUI. Alternatively, the user may enter user commands by inputting specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors. In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user, which converts information between its internal form and a form acceptable to the user. A common form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed graphically. It can be an interface element such as an icon, window, control, etc. displayed on the display screen of an electronic device, where the control may include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc.

[0064] Referring to FIG. 4 , in some embodiments, the operating system of the display device 200 is divided into four layers: from top to bottom, the application layer (hereinafter referred to as the "application layer"), the application framework layer (hereinafter referred to as the "framework layer"), the Android runtime and system library layer (hereinafter referred to as the "system runtime layer"), and the kernel layer. In some embodiments, at least one application runs in the application layer. These applications can be window programs, system settings programs, or clock programs that come with the operating system, such as a live broadcast application for playing live programs; or they can be applications developed by third-party developers.

[0065] Based on the operating system shown in Figure 4, when the display device 200 plays audio, the audio management module (Audio Manager) in the framework layer determines the audio stream (Stream) type, decodes the audio pulse modulation coding (Pulse-Code Modulation, PCM) data, and passes the decoded audio to the audio track object created in the system runtime layer through the audio track (Audio Track) interface corresponding to the audio stream type, and processes and outputs the audio through the audio track object. When the audio track object processes the audio, the audio hardware device that outputs the audio is determined by the audio policy maker (Audio Policy Service) object, and the processed audio is transmitted to the audio hardware device through the audio policy executor (Audio Flinger) object, and the audio is input through the audio hardware device. The audio playback path is composed of the audio management module, the audio track object and the audio hardware device. It can be seen from the above process of playing audio that the audio playback path corresponds to the audio stream type of the audio.

[0066] The audio played by the display device 200 can be divided into (Voice Call), music (Music), ringtone (Ring), alarm (Alarm), Bluetooth physical link (Bluetooth Synchronous Connection Oriented), etc. according to the scene. In some embodiments, the display device 200 is configured with an audio stream type, such as the music type (Stream_Music). Therefore, the audio management module will uniformly determine the audio of different scenes as the Stream_Music type, and call the audio track object to process and output the audio through the audio track interface corresponding to the Stream_Music type. In other words, the audio of different scenes is played through the same playback path.

[0067] The display device 200 adjusts the volume through the audio management module, wherein the audio management module adjusts the volume of the corresponding playback path based on the audio stream type. For example, the audio management module adjusts the volume of the playback channel corresponding to the audio stream type by calling the audio stream volume adjustment method (adjustStreamVolume). When the display device 200 is configured with an audio stream type, the display device 200 adjusts the volume of the playback channel corresponding to the audio stream type through the audio management module. For example, an audio stream type configured by the display device 200 is the Stream_Music type, and the audio management module increases the volume by calling adjustStreamVolume(AudioManager.STREAM_MUSIC, AudioManager.ADJUST_RAISE, AudioManager.FLAG), or decreases the volume by calling adjustStreamVolume(AudioManager.STREAM_MUSIC, AudioManager.ADJUST_DECREASE, AudioManager.FLAG). Since the audio of different scenes are all played through the playback path, the display device 200 does not adjust the volume of the audio of different scenes separately, but adjusts the volume of the audio of different scenes uniformly. In this case, the volume adjusted by the display device 200 is equivalent to adjusting the system volume.

[0068] The audio played by the display device 200 may include a wake-up prompt tone. The display device 200 is awakened after recognizing the user input of the wake-up word and plays the wake-up prompt tone to prompt the user to wake up. Based on the above correspondence between audio and playback path, and the correspondence between playback path and volume, it can be seen that the display device 200 plays the wake-up prompt tone according to the system volume. If the system volume is high, the volume of the wake-up prompt tone is also high, and if the system volume is low, the volume of the wake-up prompt tone is also low.

[0069] When the user wakes up the display device 200 by far-field voice, the display device 200 will be awakened in response to the wake-up word spoken by the user. The response method of the display device 200 after being awakened and the volume of the wake-up prompt sound will affect the user's experience of using the display device 200. In different scenarios, such as the noisiness of the environment in which the display device 200 is located, the working state of the display device 200, etc., the response method of the display device 200 after being awakened and the appropriate volume of the wake-up prompt sound are different. The display device 200 needs to adjust the response method after being awakened and the volume of the wake-up prompt sound according to different scenarios. Combined with the following embodiments, the response method of the display device 200 after being awakened and the volume of the wake-up prompt sound are explained.

[0070] After the display device 200 is awakened, the audio of the wake-up prompt sound is played. The effect of the wake-up prompt sound played by the display device 200 heard by the user will be affected by the noisiness of the environment in which the display device 200 is located and the current system volume of the display device 200. For example, when the environment in which the display device 200 is located is relatively noisy, if the current system volume of the display device 200 is relatively low, the volume of the wake-up prompt sound played by the display device 200 is also relatively low. At this time, the user is not easy to perceive the wake-up prompt sound, causing the user to mistakenly believe that the display device 200 is not awakened. When the environment in which the display device 200 is located is relatively quiet, if the current system volume of the display device 200 is relatively high, the volume of the wake-up prompt sound played by the display device 200 is also relatively high. At this time, the wake-up prompt sound with a relatively high volume is relatively abrupt in the environment and is likely to disturb the user.

[0071] To solve the above problem, the display device 200 can adjust the volume of the wake-up prompt sound according to the process shown in FIG5 . The specific steps may include some or all of the following steps:

[0072] S501: Collect user voice.

[0073] After the far-field voice function is activated, the display device 200 collects the user's voice through the sound collector.

[0074] S502: When it is recognized that the user voice contains the wake-up word, the signal-to-noise ratio of the user voice and the current system volume are obtained.

[0075] The display device 200 may identify whether the user's voice contains the wake-up word according to the process shown in FIG6 . The specific steps may include some or all of the following steps:

[0076] S601: Calculate a wake-up value corresponding to the user's voice.

[0077] The wake-up value is used to represent the degree of similarity between the user's voice and the standard voice of the wake-up word. The wake-up value can be a value between 0 and 1. The higher the wake-up value of the user's voice, the more similar the user's voice is to the standard voice of the wake-up word, and the higher the probability that the display device 200 will be awakened. The lower the wake-up value of the user's voice, the less similar the user's voice is to the standard voice of the wake-up word, and the lower the probability that the display device 200 will be awakened.

[0078] The display device 200 can calculate the wake-up value of the user's voice through a model. The model can be a neural network model, such as a model based on a Convolutional Neural Network (CNN), a model based on a Recurrent Neural Network (RNN), or a model based on a Deep Neural Network (DNN). The model can be pre-trained through user voice samples and standard voices of wake-up words, and can iteratively train the model based on the accuracy of the user voice actually collected by the display device 200 and the wake-up results to improve the accuracy of the model and the degree of fit to the user.

[0079] The display device 200 can calculate the wake-up value of the user's voice using the model according to the process shown in FIG. 7. The specific steps may include some or all of the following steps:

[0080] S701, input the user's voice into the model to obtain the score of each syllable in the user's voice.

[0081] S702, use the model to calculate the wake-up value corresponding to the user's voice according to the scores of each syllable in the user's voice.

[0082] Taking the model shown in FIG. 8 and taking the wake-up word as "Hisense Xiaoju" as an example, an exemplary description is made for steps S601-S602. The display device 200 inputs the user's voice into the model in real time, and the model sequentially recognizes each syllable according to the received user's voice. Among them, when the model recognizes each syllable, a decoding network based on the phoneme transition probability calculates the score of the syllable. The score of each syllable is used to represent the similarity probability value, that is, the degree of similarity, with the syllable in the corresponding position in the standard voice of the wake-up word. For example, when the model recognizes that the first syllable in the user's voice is "Hai", and the syllable ranked first in the standard voice of the wake-up word is "Hai", the model calculates the similarity probability value between "Hai" in the user's voice and "Hai" in the standard voice of the wake-up word as p 33 , and obtains the score corresponding to "Hai" in the user's voice, that is, p 00 . The process of the model calculating the scores of "Xin", "Xiao", and "Ju" in the user's voice is similar to the process of calculating the score of "Hai", which will not be elaborated here. Taking the scores of "Xin", "Xiao", and "Ju" as p 11 , p 22 , p 33 . The model calculates the wake-up value corresponding to the user's voice according to the scores of each syllable in the user's voice. For example, the model can calculate the forward and backward transition probability values between each syllable in the user's voice and other syllables, and perform weighted calculation according to the scores of each syllable and the forward and backward transition probability values between each syllable to obtain a weighted value, and use this weighted value as the wake-up value of the user's voice.

[0083] Taking the model shown in FIG. 9 and taking the wake-up word as "Hisense Xiaoju" as an example, steps S601-S602 are exemplarily described. The model may include an input layer, a hidden layer, and an output layer. The display device 200 inputs the user voice to the input layer of the model in real time. The model divides the user voice into n voice segments at the input layer, such as voice segments x1-x n . Based on different training methods and training degrees of the model, the voice segments divided by the model for the user voice at the input layer are also different. For example, the input layer can divide the user voice into 4 voice segments according to syllables. Among them, x1 corresponds to "Hai", x2 corresponds to "Xin", x3 corresponds to "Xiao", and x4 corresponds to "Ju". The model calculates the probability values mapped to different targets for the voice segments x1-x n at the hidden layer based on the classification decoding method. The targets of the hidden layer may include "Hisense Xiaoju" and other voices. That is, the probability value P1 that the user voice is Hisense Xiaoju and the probability value P2 that the user voice is other voices can be obtained through the hidden layer. The hidden layer transmits the calculated probability values to the output layer for output. Among them, the probability value P1 that the user voice is Hisense Xiaoju can be used as the wake-up value of the user voice.

[0084] The display device 200 can also use other models to calculate the wake-up value of the user voice, which is not limited here.

[0085] S602, determine whether the user voice contains a wake-up word according to the wake-up value and the wake-up value threshold.

[0086] The wake-up value threshold is the lowest wake-up value for the user voice to wake up the display device 200. When the wake-up value of the user voice is greater than or equal to the wake-up value threshold, it is determined that the user voice contains a wake-up word, the display device 200 is awakened, and the audio of the wake-up prompt sound is played. When the wake-up value of the user voice is less than the wake-up value threshold, it is determined that the user voice does not contain a wake-up word, and the display device is not awakened.

[0087] When the wake-up value of the user voice is greater than or equal to the wake-up value threshold, that is, after the display device 200 determines to play the audio of the wake-up prompt sound, the display device 200 obtains the signal-to-noise ratio of the user voice and the current system volume to determine the volume of the wake-up prompt sound to be played according to the signal-to-noise ratio of the user voice and the current system volume.

[0088] The signal-to-noise ratio of the user voice is used to characterize the degree of noise in the environment where the display device 200 is located. The higher the signal-to-noise ratio of the user voice, the lower the degree of noise in the environment where the display device 200 is located, that is, the quieter the environment where the display device 200 is located. The lower the signal-to-noise ratio of the user voice, the higher the degree of noise in the environment where the display device 200 is located, that is, the noisier the environment where the display device 200 is located.

[0089] The user voice acquired by the display device 200 may include a first voice and a second voice, the first voice is located before the second voice, the duration of the first voice and the second voice is equal, the first voice is the ambient sound that does not contain the wake-up word, and the second voice is the voice corresponding to the wake-up word. The display device 200 obtains the signal-to-noise ratio of the user voice by calculating the ratio of the volume or energy of the second voice and the first voice. The higher the ratio, the higher the signal-to-noise ratio, and the lower the ratio, the lower the signal-to-noise ratio. The display device 200 can obtain the signal-to-noise ratio of the user voice through a model, which may belong to the same model as the model for calculating the wake-up value, or may belong to a different model from the model for calculating the wake-up value.

[0090] The display device 200 can obtain the current system volume through the system standard interface, for example: intcurrentVolume=mAudioManager.getStreamVolume(AudioManager.STREAM_MUSIC).

[0091] S503: Adjust the amplitude of the wake-up prompt tone audio according to the signal-to-noise ratio and the current system volume to obtain the to-be-played audio of the wake-up prompt tone.

[0092] The volume of the wake-up prompt tone is adjusted in combination with the noise level of the environment in which the display device 200 is located and the current system volume of the display device 200. Based on the above analysis of the playback channel of the audio played by the display device 200, in order not to affect the volume of other audio except the audio of the wake-up prompt tone, the display device 200 does not adjust the volume of the playback channel (i.e., the system volume), but adjusts the amplitude of the audio of the wake-up prompt tone to achieve the effect of adjusting the volume of the wake-up prompt tone separately. When the system volume is the same, the smaller the amplitude of the audio of the wake-up prompt tone, the smaller the volume of the wake-up prompt tone output by the display device 200, and the larger the amplitude of the audio of the wake-up prompt tone, the larger the volume of the wake-up prompt tone output by the display device 200.

[0093] The display device 200 may adjust the amplitude of the wake-up prompt tone according to the process shown in FIG10 . The specific steps may include some or all of the following steps:

[0094] S1001: Obtain the audio of the wake-up prompt tone.

[0095] The display device 200 may pre-store a copy of the wake-up prompt tone audio locally, and the display device 200 may obtain the wake-up prompt tone audio from the local storage. The display device 200 may not pre-store the wake-up prompt tone audio, but obtain the wake-up prompt tone audio from the server 300.

[0096] S1002: Adjust the amplitude of the wake-up prompt tone audio according to the signal-to-noise ratio and the current system volume to obtain the audio to be played of the wake-up prompt tone.

[0097] The display device 200 dynamically adjusts the amplitude of the wake-up prompt tone audio according to the signal-to-noise ratio and the current system volume to obtain the wake-up prompt tone audio to be played. For example, the amplitude of the wake-up prompt tone audio is adjusted by adjusting the gain of the wake-up prompt tone audio.

[0098] Based on the above method of adjusting the amplitude of the wake-up prompt tone audio itself, it is convenient to set a finer amplitude adjustment granularity, so that the volume of the wake-up prompt tone can be more accurately tailored to the current environment.

[0099] The display device 200 may adjust the amplitude of the wake-up prompt tone according to the process shown in FIG11 . The specific steps may include some or all of the following steps:

[0100] S1101: Determine the amplitude of the audio to be played of the wake-up prompt tone according to the signal-to-noise ratio and the current system volume.

[0101] The display device 200 may pre-store multiple preset audios for the wake-up prompt sound locally, each preset audio corresponding to an amplitude, and the display device 200 may obtain pre-stored audios of the wake-up prompt sound with different amplitudes from the local storage. Instead of pre-stored audios for the wake-up prompt sound, the display device 200 may arrange multiple preset audios for the wake-up prompt sound on the server 300, each preset audio corresponding to an amplitude, and the display device 200 may obtain pre-stored audios of the wake-up prompt sound with different amplitudes from the server 300.

[0102] Different preset audios of the wake-up prompt tone can be distinguished according to the specific amplitude values, and the file name of the preset audio of the wake-up prompt tone may include the specific amplitude value, such as "wake-up prompt tone -3dB". Therefore, the display device 200 can identify the corresponding amplitude value based on the file name of the preset audio. The display device 200 can determine the specific amplitude value of the to-be-played audio of the wake-up prompt tone to be played based on the signal-to-noise ratio and the current system volume. For example, the signal-to-noise ratio and the current system volume have a corresponding relationship with the specific amplitude value of the to-be-played audio of the wake-up prompt tone, and the display device 200 can determine the specific amplitude value based on the corresponding relationship.

[0103] Different preset audios of the wake-up prompt tone can be distinguished according to the size of the amplitude, and the file name of the preset audio of the wake-up prompt tone may include the size of the amplitude, such as "wake-up prompt tone-small amplitude". Therefore, the display device 200 can identify the corresponding size of the amplitude based on the file name of the preset audio. The display device 200 can determine the size of the amplitude of the audio to be played of the wake-up prompt tone to be played based on the signal-to-noise ratio and the current system volume. For example, the signal-to-noise ratio and the current system volume have a corresponding relationship with the size of the amplitude of the audio to be played of the wake-up prompt tone, and the display device 200 can determine the size of the amplitude based on the corresponding relationship.

[0104] S1102: Obtain a preset audio of the wake-up prompt tone with a corresponding amplitude according to the amplitude of the audio to be played of the wake-up prompt tone.

[0105] After determining the amplitude of the to-be-played audio of the wake-up prompt tone, the display device 200 may obtain a preset audio of the wake-up prompt tone having a corresponding amplitude.

[0106] Based on the above method of directly obtaining the pre-stored audio based on the amplitude of the audio to be played for the wake-up prompt tone and adjusting the amplitude of the audio of the wake-up prompt tone, the audio to be played for the wake-up prompt tone can be obtained more quickly, thereby improving the efficiency of playing the wake-up prompt tone.

[0107] 12 , the process of the display device 200 adjusting the amplitude of the audio of the wake-up prompt tone according to the signal-to-noise ratio and the current system volume is described.

[0108] The display device 200 sets a first signal-to-noise ratio threshold and a second signal-to-noise ratio threshold, as well as a first volume threshold and a second volume threshold, wherein the first signal-to-noise ratio threshold is greater than the second signal-to-noise ratio threshold, and the first volume threshold is greater than the second volume threshold.

[0109] The display device 200 may execute step S1201 to determine whether the signal-to-noise ratio of the user's voice is greater than or equal to a first signal-to-noise ratio threshold.

[0110] When the signal-to-noise ratio of the user voice is greater than or equal to the first signal-to-noise ratio threshold, the display device 200 may execute step S1202 to determine whether the current system volume is greater than or equal to the first volume threshold.

[0111] When the signal-to-noise ratio of the user voice is greater than or equal to the first signal-to-noise ratio threshold and the current system volume is greater than or equal to the first volume threshold, the display device 200 may execute step S1203 to reduce the amplitude of the audio of the wake-up prompt tone to obtain the audio to be played of the wake-up prompt tone.

[0112] The signal-to-noise ratio of the user's voice is greater than or equal to the first signal-to-noise ratio threshold, indicating that the environment in which the display device 200 is located is less noisy, that is, the environment in which the display device 200 is located is relatively quiet. The current system volume is greater than or equal to the first volume threshold, indicating that if the display device 200 uses the current system volume to directly play the audio of the wake-up prompt sound, the volume of the wake-up prompt sound will be relatively large. At this time, the display device 200 plays the wake-up prompt sound at a relatively high volume in a relatively quiet environment, which is likely to cause a strong sense of intrusion to the user. In order to solve this problem, the amplitude of the audio of the wake-up prompt sound is reduced to lower the volume of the wake-up prompt sound, thereby reducing the disturbance to the user.

[0113] When the signal-to-noise ratio of the user voice is greater than or equal to the first signal-to-noise ratio threshold and the current system volume is less than the first volume threshold, the display device 200 may execute step S1204 and not adjust the amplitude of the audio of the wake-up prompt tone.

[0114] The signal-to-noise ratio of the user's voice is greater than or equal to the first signal-to-noise ratio threshold, indicating that the environment in which the display device 200 is located is relatively quiet. The current system volume is less than the first volume threshold, indicating that if the display device 200 directly plays the audio of the wake-up prompt tone using the current system volume, the volume of the wake-up prompt tone will not be too loud. In this relatively quiet environment, the wake-up prompt tone at this volume will not cause excessive intrusion to the user. Therefore, the display device 200 does not need to adjust the volume of the wake-up prompt tone, and the display device 200 does not adjust the amplitude of the audio of the wake-up prompt tone.

[0115] When the signal-to-noise ratio of the user voice is less than the first signal-to-noise ratio threshold, the display device 200 may execute step S1205 to determine whether the signal-to-noise ratio of the user voice is greater than or equal to the second signal-to-noise ratio threshold.

[0116] When the signal-to-noise ratio of the user voice is less than the first signal-to-noise ratio threshold and the signal-to-noise ratio of the user voice is greater than or equal to the second signal-to-noise ratio threshold, the display device 200 may execute step S1204 and not adjust the amplitude of the audio of the wake-up prompt tone.

[0117] If the signal-to-noise ratio of the user's voice is less than the first signal-to-noise ratio threshold and greater than or equal to the second signal-to-noise ratio threshold, the noise level of the environment in which display device 200 is located is moderate. Therefore, display device 200 is considered to directly play the wake-up reminder tone at the current system volume. In this environment, the volume of the wake-up reminder tone is sufficient to alert the user without causing excessive intrusion. Therefore, display device 200 does not need to adjust the volume of the wake-up reminder tone, nor does it adjust the amplitude of the wake-up reminder tone.

[0118] When the signal-to-noise ratio of the user voice is less than the second signal-to-noise ratio threshold, the display device 200 may execute step S1206 to determine whether the current system volume is less than the second volume threshold.

[0119] When the signal-to-noise ratio of the user voice is less than the second signal-to-noise ratio threshold and the current system volume is greater than or equal to the second volume threshold, the display device 200 may execute step S1204 and not adjust the amplitude of the audio of the wake-up prompt tone.

[0120] The signal-to-noise ratio of the user's voice is less than the second signal-to-noise ratio threshold, indicating that the environment in which the display device 200 is located is relatively noisy, that is, the environment in which the display device 200 is located is relatively noisy. The current system volume is greater than or equal to the second volume threshold, indicating that if the display device 200 uses the current system volume to directly play the audio of the wake-up prompt tone, the volume of the wake-up prompt tone will not be too low. At this time, the display device 200 plays the wake-up prompt tone at a volume that is not too low in a noisy environment, which can also satisfy the user's perception of the wake-up prompt tone. Therefore, the display device 200 does not need to adjust the volume of the wake-up prompt tone, and the display device 200 does not adjust the amplitude of the audio of the wake-up prompt tone.

[0121] When the signal-to-noise ratio of the user voice is less than the second signal-to-noise ratio threshold and the current system volume is less than the second volume threshold, the display device 200 may execute step S1207 to increase the amplitude of the audio of the wake-up prompt tone to obtain the audio to be played of the wake-up prompt tone.

[0122] The signal-to-noise ratio of the user's voice is less than the second signal-to-noise ratio threshold, indicating that the environment in which the display device 200 is located is relatively noisy, that is, the environment in which the display device 200 is located is relatively noisy. The current system volume is less than the second volume threshold, indicating that if the display device 200 uses the current system volume to directly play the audio of the wake-up prompt tone, the volume of the wake-up prompt tone will be relatively low. At this time, the display device 200 plays the wake-up prompt tone at a relatively low volume in a relatively noisy environment, which may easily cause the user to be unable to perceive the wake-up prompt tone, thereby mistakenly believing that the display device 200 has not been awakened. In order to solve this problem, the amplitude of the audio of the wake-up prompt tone is increased to increase the volume of the wake-up prompt tone, thereby improving the user's perception of the wake-up prompt tone.

[0123] S504: Play the waiting audio of the wake-up prompt tone at the current system volume.

[0124] After obtaining the audio to be played of the wake-up prompt sound based on step S503, the display device 200 plays the audio to be played of the wake-up prompt sound at the current system volume. The volume of the wake-up prompt sound is affected by the current system volume and the volume of the audio to be played of the wake-up prompt sound itself.

[0125] When the current system volume is less than the third volume threshold, the display device 200 displays a pop-up window and displays a prompt message within the pop-up window, which prompts the user that the current system volume is too low, resulting in the volume of the wake-up prompt tone being too low, and that the system volume can be increased, wherein the third volume threshold is less than or equal to the second volume threshold. Taking the display device 200 as a television as an example, when the current system volume is less than the third volume threshold, the display device 200 may display a pop-up window 1301 as shown in ① of Figure 13, which may include a prompt message such as "The system volume is too low, please increase the system volume."

[0126] When the current system volume is greater than the fourth volume threshold, the display device 200 displays a pop-up window and displays a prompt message within the pop-up window, which informs the user that the current system volume is too high, causing the volume of the wake-up prompt tone to be too loud, and that the system volume can be lowered. The fourth volume threshold is greater than or equal to the first volume threshold. For example, if the display device 200 is a television, when the current system volume is less than the third volume threshold, the display device 200 may display a pop-up window 1302 as shown in FIG. 13 ②. The pop-up window 1302 may include a prompt message, such as "The system volume is too high. Please lower the system volume."

[0127] After the display device 200 is awakened, the audio of the wake-up prompt sound is played. The effect of the wake-up prompt sound played by the display device 200 on the user will be affected by whether the user really wants to wake up the display device 200 and the current system volume of the display device 200. If the user wakes up the display device 200 by mistake with a high probability, and the current system volume of the display device 200 is high, the volume of the wake-up prompt sound played by the display device 200 will also be high. The high-volume wake-up prompt sound will make the user clearly aware that the display device 200 has been awakened. When the display device 200 is awakened by mistake, the user's normal use of the display device 200 is affected. If the user wakes up the display device 200 by mistake with a low probability, and the current system volume of the display device 200 is low, the volume of the wake-up prompt sound played by the display device 200 will also be low. The low-volume wake-up prompt sound will make it difficult for the user to perceive that the display device 200 has been awakened. When the display device 200 is not awakened by mistake, it is easy for the user to mistakenly believe that the display device 200 has not been awakened.

[0128] To solve the above problem, the display device 200 can adjust the volume of the wake-up prompt sound according to the process shown in FIG14 . The specific steps may include some or all of the following steps:

[0129] S1401: Collect user voice.

[0130] S1402: Calculate a wake-up value corresponding to the user's voice.

[0131] Steps S1401-S1402 are similar to steps S501 and S601, and steps S701-S702, and are not described in detail here.

[0132] S1403: When the wake-up value is greater than or equal to the wake-up value threshold, obtain the difference between the wake-up value and the wake-up value threshold and the current system volume.

[0133] The difference between the wake-up value and the wake-up value threshold is used to represent the probability of the display device 200 being falsely awakened. The larger the difference between the wake-up value and the wake-up value threshold, the smaller the probability of the display device 200 being falsely awakened, and the smaller the difference between the wake-up value and the wake-up value threshold, the greater the probability of the display device 200 being falsely awakened.

[0134] The process of the display device 200 obtaining the current system volume can be referred to step S502 and will not be described in detail here.

[0135] S1404: Adjust the amplitude of the wake-up prompt tone audio according to the difference between the wake-up value and the wake-up value threshold and the current system volume to obtain the audio to be played of the wake-up prompt tone.

[0136] The display device 200 may adjust the amplitude of the wake-up prompt tone according to the process shown in FIG15 . The specific steps may include some or all of the following steps:

[0137] S1501: Obtain the audio of the wake-up prompt tone.

[0138] Step S1501 may refer to step S1001 and will not be described in detail here.

[0139] S1502: Adjust the amplitude of the wake-up prompt tone audio according to the difference between the wake-up value and the wake-up value threshold and the current system volume to obtain the audio to be played of the wake-up prompt tone.

[0140] The display device 200 dynamically adjusts the amplitude of the wake-up prompt tone audio based on the difference between the wake-up value and the wake-up value threshold and the current system volume to obtain the wake-up prompt tone audio to be played. For example, the amplitude of the wake-up prompt tone audio is adjusted by adjusting the gain of the wake-up prompt tone audio.

[0141] Based on the above method of adjusting the amplitude of the wake-up prompt tone audio itself, it is convenient to set a finer amplitude adjustment granularity, so that the volume of the wake-up prompt tone can be more accurately tailored to the current environment.

[0142] The display device 200 may adjust the amplitude of the wake-up prompt tone according to the process shown in FIG16 . The specific steps may include some or all of the following steps:

[0143] S1601: Determine the amplitude of the audio to be played of the wake-up prompt tone according to the difference between the wake-up value and the wake-up value threshold and the current system volume.

[0144] The preset audio of the wake-up prompt sound and the preset method of the preset audio can refer to step S1001. The display device 200 can determine the amplitude of the audio to be played of the wake-up prompt sound to be played based on the difference between the wake-up value and the wake-up value threshold and the current system volume.

[0145] S1602: Obtain a preset audio of the wake-up prompt tone with a corresponding amplitude according to the amplitude of the audio to be played of the wake-up prompt tone.

[0146] Step S1602 may refer to step S1102 and will not be described in detail here.

[0147] 17 , the process of the display device 200 adjusting the amplitude of the audio of the wake-up prompt sound according to the difference between the wake-up value of the user voice and the wake-up value threshold and the current system volume is described.

[0148] The display device 200 sets a first difference threshold and a second difference threshold, as well as a first volume threshold and a second volume threshold, wherein the first difference threshold is smaller than the second difference threshold, and the first volume threshold is larger than the second volume threshold.

[0149] The display device 200 may execute step S1701 to determine whether a difference between the wake-up value of the user voice and the wake-up value threshold is less than a first difference threshold.

[0150] When the difference is less than the first difference threshold, the display device 200 may execute step S1702 to determine whether the current system volume is greater than the first volume threshold.

[0151] When the difference is less than the first difference threshold and the current system volume is greater than the first volume threshold, the display device 200 may execute step S1703 to reduce the amplitude of the audio of the wake-up prompt tone to obtain the audio to be played of the wake-up prompt tone.

[0152] If the difference is less than the first difference threshold, it means that the display device 200 is more likely to be mistakenly awakened. If the current system volume is greater than the first volume threshold, it means that if the display device 200 uses the current system volume to directly play the audio of the wake-up prompt tone, the volume of the wake-up prompt tone will be higher. At this time, if the display device 200 is likely to be mistakenly awakened, playing the wake-up prompt tone at a higher volume can easily cause a strong sense of intrusion to the user. In order to solve this problem, the amplitude of the audio of the wake-up prompt tone is reduced to lower the volume of the wake-up prompt tone, thereby reducing the disturbance to the user.

[0153] When the difference is less than the first difference threshold and the current system volume is less than or equal to the first volume threshold, the display device 200 may execute step S1704 and not adjust the amplitude of the audio of the wake-up prompt tone.

[0154] The difference is less than the first volume threshold, indicating that the display device 200 is more likely to be mistakenly awakened. The current system volume is less than or equal to the first volume threshold, indicating that if the display device 200 directly plays the audio of the wake-up prompt tone using the current system volume, the volume of the wake-up prompt tone will not be too loud. At this time, when the display device 200 is likely to be mistakenly awakened, the wake-up prompt tone is played at a volume that is not too loud, and the wake-up prompt tone at this volume will not cause excessive intrusion to the user. Therefore, the display device 200 does not need to adjust the volume of the wake-up prompt tone, and the display device 200 does not adjust the amplitude of the audio of the wake-up prompt tone.

[0155] When the difference is greater than or equal to the first difference threshold, the display device 200 may execute step S1705 to determine whether the difference is greater than or equal to the second difference threshold.

[0156] When the difference is greater than or equal to the first difference threshold and less than the second difference threshold, the display device 200 may execute step S1704 and not adjust the amplitude of the audio of the wake-up prompt tone.

[0157] If the difference is greater than or equal to the first difference threshold and less than the second difference threshold, it can be considered that within the threshold range, it is difficult for display device 200 to accurately determine whether the awakening of display device 200 is in accordance with the user's intention. In this case, if it is impossible to accurately determine whether the awakening of display device 200 is in accordance with the user's intention, display device 200 does not adjust the volume of the wake-up prompt tone, and the display device 200 does not adjust the audio amplitude of the wake-up prompt tone to reduce the data processing process.

[0158] When the difference is greater than or equal to the second difference threshold, the display device 200 may execute step S1706 to determine whether the current system volume is less than the second volume threshold.

[0159] When the difference is greater than or equal to the second difference threshold and the current system volume is greater than or equal to the second volume threshold, the display device 200 may execute step S1704 and not adjust the amplitude of the audio of the wake-up prompt tone.

[0160] If the difference is greater than or equal to the second difference threshold, it means that the probability of the display device 200 being mistakenly awakened is low. If the current system volume is greater than or equal to the second volume threshold, it means that if the display device 200 uses the current system volume to directly play the audio of the wake-up prompt tone, the volume of the wake-up prompt tone will not be too low. When the display device 200 is mistakenly awakened with a small probability, the wake-up prompt tone is played at a volume that is not too low, and the wake-up prompt tone at this volume will not cause excessive intrusion to the user. Therefore, the display device 200 does not need to adjust the volume of the wake-up prompt tone, and the display device 200 does not adjust the amplitude of the audio of the wake-up prompt tone.

[0161] When the difference is greater than or equal to the second difference threshold and the current system volume is less than the second volume threshold, the display device 200 may execute step S1707 to increase the amplitude of the audio of the wake-up prompt tone to obtain the audio to be played of the wake-up prompt tone.

[0162] If the difference is greater than or equal to the second difference threshold, it means that the probability of the display device 200 being mistakenly awakened is low. If the current system volume is less than the second volume threshold, it means that if the display device 200 uses the current system volume to directly play the audio of the wake-up prompt tone, the volume of the wake-up prompt tone will be relatively low. When the display device 200 is mistakenly awakened with a small probability, playing the wake-up prompt tone at a relatively low volume may easily cause the user to be unable to perceive the wake-up prompt tone, thereby mistakenly believing that the display device 200 has not been awakened. In order to solve this problem, the amplitude of the audio of the wake-up prompt tone is increased to increase the volume of the wake-up prompt tone, thereby improving the user's perception of the wake-up prompt tone.

[0163] S1405: Control the speaker to play the waiting audio of the wake-up prompt tone at the current system volume.

[0164] After obtaining the audio to be played of the wake-up prompt sound based on step S1404, the display device 200 plays the audio to be played of the wake-up prompt sound at the current system volume. The volume of the wake-up prompt sound is affected by the current system volume and the volume of the audio to be played of the wake-up prompt sound itself.

[0165] When the current system volume is less than the third volume threshold, the display device 200 displays a pop-up window and displays a prompt message in the pop-up window, which prompts the user that the current system volume is too low, resulting in the volume of the wake-up prompt tone being too low, and that the system volume can be increased. The third volume threshold is less than or equal to the second volume threshold. The pop-up window displayed by the display device 200 can refer to the pop-up window 1301 shown in FIG. 13 (1), and is not further described here.

[0166] When the current system volume is greater than the fourth volume threshold, the display device 200 displays a pop-up window and displays a prompt message in the pop-up window, which prompts the user that the current system volume is too high, causing the volume of the wake-up prompt tone to be too loud, and that the system volume can be lowered. The fourth volume threshold is greater than or equal to the first volume threshold. The pop-up window displayed by the display device 200 can be referred to as pop-up window 1302 shown in FIG. 13 ②, and is not described here in detail.

[0167] The display device 200 determines the style of the displayed pop-up window according to the difference between the wake-up value of the user voice and the wake-up value threshold.

[0168] When the difference is less than the first difference threshold, the display device 200 displays a pop-up window of the first style. When the difference is greater than or equal to the second difference threshold, the display device 200 displays a pop-up window of the second style. When the difference is greater than or equal to the first difference threshold and less than the second difference threshold, either the first style pop-up window or the second style pop-up window can be displayed. The second style pop-up window is easier for the user to perceive than the first style pop-up window.

[0169] For example, the second-style pop-up window is larger than the first-style pop-up window. Taking the display device 200 as a television and the current system volume being less than the third volume threshold as an example, the first-style pop-up window displayed by the display device 200 may be a pop-up window 1801 as shown in ① in FIG18 , and the second-style pop-up window displayed by the display device 200 may be a pop-up window 1802 as shown in ② in FIG18 . Both pop-up window 1801 and pop-up window 1802 may include prompt information, such as “The system volume is too low, please increase the system volume.” The size of pop-up window 1802 is larger than that of pop-up window 1801, so that the displayed pop-up window 1801 is less likely to be noticed by the user, and the displayed pop-up window 1802 is more likely to be noticed by the user.

[0170] For another example, the second-style pop-up window is displayed more obviously than the first-style pop-up window. Taking the display device 200 as a television and the current system volume being less than the third volume threshold as an example, the first-style pop-up window displayed by the display device 200 may be a pop-up window 1901 as shown in ① in FIG19 , and the second-style pop-up window displayed by the display device 200 may be a pop-up window 1902 as shown in ② in FIG19 . Both pop-up window 1901 and pop-up window 1902 may include prompt information, such as “The system volume is too low, please increase the system volume.” The size of pop-up window 1901 and pop-up window 1902 may be the same. Pop-up window 1901 is displayed in the lower right corner of the screen, and pop-up window 1902 is displayed in the center of the screen, so that the displayed pop-up window 1901 is less likely to be noticed by the user, and the displayed pop-up window 1902 is more likely to be noticed by the user.

[0171] For another example, the second-style pop-up window is larger in size than the first-style pop-up window and is displayed in a more obvious position. Taking the display device 200 as a television and the current system volume being less than the third volume threshold as an example, the first-style pop-up window displayed by the display device 200 may be the pop-up window 2001 shown in ① of FIG20 , and the second-style pop-up window displayed by the display device 200 may be the pop-up window 2002 shown in ② of FIG20 . Both the pop-up window 2001 and the pop-up window 2002 may include prompt information, such as “The system volume is too low, please increase the system volume.” The size of the pop-up window 2001 may be smaller than that of the pop-up window 2002 and may be the same. The pop-up window 2001 is displayed in the lower right corner of the screen, and the pop-up window 2002 is displayed in the center of the screen, so that the displayed pop-up window 2001 is less likely to be noticed by the user and the displayed pop-up window 2002 is more likely to be noticed by the user.

[0172] The display device 200 may adjust the volume of the wake-up prompt tone based on the probability of being falsely awakened, the current system volume, and the noise level of the surrounding environment.

[0173] The display device 200 may adjust the volume of the wake-up prompt tone according to the process shown in FIG21 , and the specific steps may include some or all of the following steps:

[0174] S2101, collecting user voice.

[0175] S2102: Calculate a wake-up value corresponding to the user's voice.

[0176] Steps S2101-S2102 are similar to steps S501 and S601, and steps S701-S702, and are not described in detail here.

[0177] S2103: When the wake-up value is greater than or equal to the wake-up value threshold, obtain the difference between the wake-up value and the wake-up value threshold, the signal-to-noise ratio of the user voice, and the current system volume.

[0178] The difference between the wake-up value and the wake-up value threshold is used to represent the probability of the display device 200 being falsely awakened. The larger the difference between the wake-up value and the wake-up value threshold, the smaller the probability of the display device 200 being falsely awakened, and the smaller the difference between the wake-up value and the wake-up value threshold, the greater the probability of the display device 200 being falsely awakened.

[0179] The process of the display device 200 obtaining the signal-to-noise ratio of the user voice and the current system volume can be referred to step S502 and will not be described in detail here.

[0180] S2104 : Adjust the amplitude of the wake-up prompt tone audio according to the difference between the wake-up value and the wake-up value threshold, the signal-to-noise ratio of the user voice, and the current system volume to obtain the audio to be played of the wake-up prompt tone.

[0181] The display device 200 may adjust the amplitude of the wake-up prompt tone according to the process shown in FIG22 . The specific steps may include some or all of the following steps:

[0182] S2201: Obtain the audio of the wake-up prompt tone.

[0183] Step S2201 can refer to step S1001 and will not be repeated here.

[0184] S2202: Adjust the amplitude of the wake-up prompt tone audio according to the difference between the wake-up value and the wake-up value threshold, the signal-to-noise ratio of the user voice, and the current system volume to obtain the audio to be played of the wake-up prompt tone.

[0185] The display device 200 dynamically adjusts the amplitude of the wake-up reminder audio based on the difference between the wake-up value and the wake-up value threshold, the signal-to-noise ratio of the user's voice, and the current system volume to obtain the wake-up reminder audio to be played. For example, the amplitude of the wake-up reminder audio is adjusted by adjusting the gain of the wake-up reminder audio.

[0186] Based on the above method of adjusting the amplitude of the wake-up prompt tone audio itself, it is convenient to set a finer amplitude adjustment granularity, so that the volume of the wake-up prompt tone can be more accurately tailored to the current environment.

[0187] The display device 200 may adjust the amplitude of the wake-up prompt tone according to the process shown in FIG23 . The specific steps may include some or all of the following steps:

[0188] S2301: Determine the amplitude of the to-be-played audio of the wake-up prompt tone according to the difference between the wake-up value and the wake-up value threshold, the signal-to-noise ratio of the user voice, and the current system volume.

[0189] The preset audio of the wake-up prompt sound and the preset method of the preset audio can refer to step S1101. The display device 200 can determine the amplitude of the audio to be played of the wake-up prompt sound to be played based on the difference between the wake-up value and the wake-up value threshold, the signal-to-noise ratio of the user voice and the current system volume.

[0190] S2302: Obtain a preset audio of the wake-up prompt tone with a corresponding amplitude according to the amplitude of the to-be-played audio of the wake-up prompt tone.

[0191] Step S2302 may refer to step S1102 and will not be described in detail here.

[0192] 24 , the process of the display device 200 adjusting the amplitude of the audio of the wake-up prompt sound according to the difference between the wake-up value of the user voice and the wake-up value threshold, the current system volume, and the signal-to-noise ratio of the user voice is described.

[0193] The display device 200 sets a first difference threshold and a second difference threshold, a first signal-to-noise ratio threshold and a second signal-to-noise ratio threshold, and a first volume threshold and a second volume threshold, wherein the first difference threshold is smaller than the second difference threshold, the first signal-to-noise ratio threshold is greater than the second signal-to-noise ratio threshold, and the first volume threshold is greater than the second volume threshold.

[0194] The display device 200 may execute step S2401 to determine whether a difference between the wake-up value of the user voice and the wake-up value threshold is less than a first difference threshold.

[0195] When the difference is less than the first difference threshold, the display device 200 may execute step S2402 to determine whether the signal-to-noise ratio of the user voice is greater than or equal to the first signal-to-noise ratio threshold.

[0196] When the signal-to-noise ratio of the user voice is greater than or equal to the first signal-to-noise ratio threshold, the display device 200 may execute step S2403 to determine whether the current system volume is greater than or equal to the first volume threshold.

[0197] When the signal-to-noise ratio of the user voice is greater than or equal to the first signal-to-noise ratio threshold and the current system volume is greater than or equal to the first volume threshold, the display device 200 may execute step S2404 to reduce the amplitude of the audio of the wake-up prompt tone to obtain the audio to be played of the wake-up prompt tone.

[0198] The difference is less than the first difference threshold, indicating that the probability of the display device 200 being mistakenly awakened is high. The signal-to-noise ratio of the user's voice is greater than or equal to the first signal-to-noise ratio threshold, indicating that the environment in which the display device 200 is located is relatively quiet. The current system volume is greater than or equal to the first volume threshold, indicating that if the display device 200 uses the current system volume to directly play the audio of the wake-up prompt sound, the volume of the wake-up prompt sound will be relatively large. In a relatively quiet environment, when the display device 200 is likely to be mistakenly awakened, playing the wake-up prompt sound at a relatively large volume can easily cause a strong sense of intrusion to the user. In order to solve this problem, the amplitude of the audio of the wake-up prompt sound is reduced to lower the volume of the wake-up prompt sound, thereby reducing disturbance to the user.

[0199] When the signal-to-noise ratio of the user voice is greater than or equal to the first signal-to-noise ratio threshold and the current system volume is less than the first volume threshold, the display device 200 may execute step S2405 without adjusting the amplitude of the audio of the wake-up prompt tone.

[0200] If the difference is less than the first difference threshold, it means that the probability of the display device 200 being mistakenly awakened is high. The signal-to-noise ratio of the user's voice is greater than or equal to the first signal-to-noise ratio threshold, which means that the environment in which the display device 200 is located is relatively quiet. The current system volume is less than the first volume threshold, which means that if the display device 200 uses the current system volume to directly play the audio of the wake-up prompt sound, the volume of the wake-up prompt sound will not be too loud. In a relatively quiet environment, when the display device 200 is likely to be mistakenly awakened, it plays the wake-up prompt sound at a volume that is not too loud, and the sense of intrusion caused to the user will not be too strong. The display device 200 does not need to adjust the volume of the wake-up prompt sound.

[0201] When the signal-to-noise ratio of the user voice is less than the first signal-to-noise ratio threshold, the display device 200 may execute step S2405 and not adjust the amplitude of the audio of the wake-up prompt tone.

[0202] The signal-to-noise ratio of the user's voice is less than the first signal-to-noise ratio threshold, indicating that the environment in which the display device 200 is located is not too quiet. In an environment that is not too quiet, if the display device 200 is in a high probability of being mistakenly awakened, if the audio of the wake-up prompt sound is played directly at a higher volume, the sense of intrusion caused to the user will not be too strong. Therefore, the display device 200 does not need to lower the volume of the wake-up prompt sound. If the audio of the wake-up prompt sound is played directly at a lower volume, due to the high probability of being mistakenly awakened, even if the user's perception of the wake-up prompt sound is weak, the probability of affecting the user is also low. Therefore, the display device 200 does not need to increase the volume of the wake-up prompt sound. Therefore, the display device 200 does not need to adjust the volume of the wake-up prompt sound.

[0203] When the difference is greater than or equal to the first difference threshold, the display device 200 may execute step S2406 to determine whether the difference is less than the second difference threshold.

[0204] When the difference is less than the second difference threshold, the display device 200 may execute step S2405 and not adjust the amplitude of the audio of the wake-up prompt tone.

[0205] If the difference is greater than or equal to the first difference threshold and less than the second difference threshold, it can be considered that within the threshold range, it is difficult for display device 200 to accurately determine whether the awakening of display device 200 is in accordance with the user's intention. In this case, if it is impossible to accurately determine whether the awakening of display device 200 is in accordance with the user's intention, display device 200 does not adjust the volume of the wake-up prompt tone, and the display device 200 does not adjust the audio amplitude of the wake-up prompt tone to reduce the data processing process.

[0206] When the difference is greater than or equal to the second difference threshold, the display device 200 may execute step S2407 to determine whether the signal-to-noise ratio of the user voice is greater than or equal to the second signal-to-noise ratio threshold.

[0207] When the signal-to-noise ratio of the user voice is less than the second signal-to-noise ratio threshold, the display device 200 may execute step S2408 to determine whether the current system volume is less than the second volume threshold.

[0208] When the signal-to-noise ratio of the user voice is less than the second signal-to-noise ratio threshold and the current system volume is less than the second volume threshold, the display device 200 may execute step S2409 to increase the amplitude of the audio of the wake-up prompt tone to obtain the audio to be played of the wake-up prompt tone.

[0209] The difference is greater than or equal to the second difference threshold, indicating that the probability of the display device 200 being mistakenly awakened is low. The signal-to-noise ratio of the user's voice is less than the second signal-to-noise ratio threshold, indicating that the noise level of the environment in which the display device 200 is located is relatively high, that is, the environment in which the display device 200 is located is relatively noisy. The current system volume is less than the second volume threshold, indicating that if the display device 200 uses the current system volume to directly play the audio of the wake-up prompt tone, the volume of the wake-up prompt tone will be relatively low. In a noisy environment, when the display device 200 is mistakenly awakened with a small probability, playing the wake-up prompt tone at a relatively low volume can easily cause the user to be unable to perceive the wake-up prompt tone, thereby mistakenly believing that the display device 200 has not been awakened. In order to solve this problem, the amplitude of the audio of the wake-up prompt tone is increased to increase the volume of the wake-up prompt tone, thereby improving the user's perception of the wake-up prompt tone.

[0210] When the signal-to-noise ratio of the user voice is less than the second signal-to-noise ratio threshold and the current system volume is greater than or equal to the second volume threshold, the display device 200 may execute step S2405 without adjusting the amplitude of the audio of the wake-up prompt tone.

[0211] The difference is greater than or equal to the second difference threshold, indicating that the probability of the display device 200 being mistakenly awakened is low. The signal-to-noise ratio of the user's voice is less than the second signal-to-noise ratio threshold, indicating that the noise level of the environment in which the display device 200 is located is relatively high, that is, the environment in which the display device 200 is located is relatively noisy. The current system volume is greater than or equal to the second volume threshold, indicating that if the display device 200 uses the current system volume to directly play the audio of the wake-up prompt sound, the volume of the wake-up prompt sound will not be too small. In a noisy environment, when there is a small probability of being mistakenly awakened, the display device 200 plays the wake-up prompt sound at a volume that is not too small, and it is believed that the user can also perceive the wake-up prompt sound. Therefore, the display device 200 does not need to adjust the volume of the wake-up prompt sound, and the display device 200 does not adjust the amplitude of the audio of the wake-up prompt sound.

[0212] When the signal-to-noise ratio of the user voice is greater than or equal to the second signal-to-noise ratio threshold, the display device 200 may execute step S2405 and not adjust the amplitude of the audio of the wake-up prompt tone.

[0213] The signal-to-noise ratio of the user's voice is greater than or equal to the second signal-to-noise ratio threshold, indicating that the environment in which the display device 200 is located is not too noisy. In an environment that is not too noisy, when the display device 200 is mistakenly awakened with a small probability, if the audio of the wake-up prompt sound is directly played at a higher volume, the user's perception of the wake-up prompt sound can be enhanced due to the small probability of being mistakenly awakened. Therefore, the display device 200 does not need to lower the volume of the wake-up prompt sound. If the audio of the wake-up prompt sound is directly played at a lower volume, the user can also perceive it because the environment is not too noisy. Therefore, the display device 200 does not need to increase the volume of the wake-up prompt sound. Therefore, the display device 200 does not need to adjust the volume of the wake-up prompt sound.

[0214] S2105: Control the speaker to play the to-be-played audio of the wake-up prompt tone at the current system volume.

[0215] After obtaining the audio to be played of the wake-up prompt sound based on step S2104, the display device 200 plays the audio to be played of the wake-up prompt sound at the current system volume. The volume of the wake-up prompt sound is affected by the current system volume and the volume of the audio to be played of the wake-up prompt sound itself.

[0216] When the current system volume is less than the third volume threshold, the display device 200 displays a pop-up window and displays a prompt message in the pop-up window, which prompts the user that the current system volume is too low, resulting in the volume of the wake-up prompt tone being too low, and that the system volume can be increased. The third volume threshold is less than or equal to the second volume threshold. The pop-up window displayed by the display device 200 can refer to the pop-up window 1301 shown in FIG. 13 (1), and is not further described here.

[0217] When the current system volume is greater than the fourth volume threshold, the display device 200 displays a pop-up window and displays a prompt message in the pop-up window, which prompts the user that the current system volume is too high, causing the volume of the wake-up prompt tone to be too loud, and that the system volume can be lowered. The fourth volume threshold is greater than or equal to the first volume threshold. The pop-up window displayed by the display device 200 can be referred to as pop-up window 1302 shown in FIG. 13 ②, and is not described here in detail.

[0218] The display device 200 determines the style of the displayed pop-up window according to the difference between the wake-up value of the user voice and the wake-up value threshold.

[0219] When the difference is less than the first difference threshold, the display device 200 displays a pop-up window of the first style. When the difference is greater than or equal to the second difference threshold, the display device 200 displays a pop-up window of the second style. When the difference is greater than or equal to the first difference threshold and less than the second difference threshold, either the pop-up window of the first style or the pop-up window of the second style can be displayed. Among them, the pop-up window of the second style is easier for the user to perceive than the pop-up window of the first style. The pop-up window of the first style and the pop-up window of the second style can be referred to Figures 18, 19 and 20, which are not described here.

[0220] The operating state of the display device 200 may include a first state, which may include the display device 200 being in silent mode and the display device 200 being in non-silent mode and the current system volume being 0. When the display device 200 is in the first state, if the display device 200 is awakened, due to the limitations of the first state, when the display device 200 plays the wake-up prompt tone, the speaker does not make any sound. Since the user cannot perceive the wake-up prompt tone, it is easy for the user to mistakenly believe that the display device 200 is not responding. Even if the user perceives that the display device 200 has been awakened, it cannot quickly determine whether the speaker is silent because it is in silent mode or the current system volume is 0, making it impossible to quickly make the speaker sound.

[0221] To solve the above problem, the display device 200 may perform a wake-up response according to the process shown in FIG25 . The specific steps may include some or all of the following steps:

[0222] S2501, when the screen is in the bright screen state and in the first state, collecting user voice.

[0223] S2502: When it is recognized that the user voice contains a wake-up word, a pop-up window is displayed according to the first state.

[0224] Step S2501 is similar to step S501, and the process of identifying the wake-up word in step S2502 is similar to steps S601-S602, which will not be repeated here.

[0225] The task manager of the display device 200 stores a volume status table, which is used to record the current system volume, whether the silent mode is enabled, etc. The first flag bit in the volume status table is used to indicate whether the silent mode is enabled. For example, if the value of the first flag bit is 1, the silent mode is enabled; if the value of the first flag bit is 0, the silent mode is disabled. By identifying the value of the first flag bit, it can be determined whether the display is in silent mode. For example, if the value of the first flag bit is 1, the display is in silent mode; if the value of the first flag bit is 0, the display is in non-silent mode.

[0226] The display device 200 performs a process of obtaining the audio to be played of the wake-up prompt sound when the wake-up value is greater than or equal to the wake-up value threshold.

[0227] The display device 200 may identify whether it is in silent mode before obtaining the audio to be played for the wake-up prompt tone. If the display device 200 identifies that it is in silent mode, it does not obtain the audio to be played for the wake-up prompt tone; if the display device 200 identifies that it is in non-silent mode, it obtains the audio to be played for the wake-up prompt tone.

[0228] The display device 200 can identify whether it is in silent mode during the process of obtaining the audio to be played for the wake-up prompt tone. For example, obtaining the audio to be played for the wake-up prompt tone and identifying whether it is in silent mode are respectively executed in two parallel processes / threads. If the display device 200 identifies that it is in silent mode, the execution of obtaining the audio to be played for the wake-up prompt tone is terminated; if the display device 200 identifies that it is in non-silent mode, the execution of obtaining the audio to be played for the wake-up prompt tone is executed. In this way, when it is identified that it is in silent mode, the computing resources of the display device 200 can be avoided from being continuously occupied. It is also possible to quickly obtain the audio to be played for the wake-up prompt tone when it is identified that it is in non-silent mode.

[0229] After the display device 200 completes the process of obtaining the audio to be played for the wake-up prompt tone, it can identify whether it is in silent mode. Therefore, when the display device 200 identifies that it is in silent mode, once the silent mode is released, it can directly use the audio to be played for the wake-up prompt tone after being awakened, thereby improving the efficiency of playing the wake-up prompt tone after releasing the silent mode.

[0230] If the display device 200 recognizes the wake-up word, a pop-up window is displayed to prompt the user that he has been awakened.

[0231] In some embodiments, when the display device 200 is in silent mode, the display device 200 responds to the wake-up word and is in the awake state, displays a pop-up window, does not release silent mode, and does not adjust the system volume. While in the awake state, the display device 200 can respond to other far-field voice commands from the user and interact with the user. This pop-up window is used to notify the user that they have been awakened and are in silent mode.

[0232] The pop-up window may include prompt information, which may include information for prompting the display device 200 to be awakened and in silent mode (for ease of distinction, referred to as the first information). Taking the display device 200 as a TV as an example, the display device 200 may display a pop-up window 2601 as shown in Figure 26, and the pop-up window 2601 may include the first information, such as "awakened, currently in silent mode". Thus, when the display device 200 is awakened when it is in silent mode, although the wake-up prompt tone played is silent, the user can be prompted through a pop-up window that he has been awakened and that he is currently in silent mode, so that the user knows that the reason for being awakened but without the wake-up prompt tone is that he is in silent mode.

[0233] The display device 200 determines the style of the displayed pop-up window based on the difference between the wake-up value of the user voice and the wake-up value threshold. When the difference is less than the first difference threshold, the display device 200 displays a pop-up window of the first style. When the difference is greater than or equal to the second difference threshold, the display device 200 displays a pop-up window of the second style. When the difference is greater than or equal to the first difference threshold and less than the second difference threshold, the display device 200 can display a pop-up window of the first style or a pop-up window of the second style. The pop-up window of the second style is more easily perceived by the user than the pop-up window of the first style. The pop-up window of the first style and the pop-up window of the second style can be referred to Figures 18, 19 and 20. The difference is that the first information is displayed in the pop-up window, which is not described here.

[0234] The display device 200 may also display a prompt message in a pop-up window based on the current system volume. The prompt message may also include information for prompting the user to adjust the system volume (for ease of distinction, referred to as the second information). The display device 200 may display the second information according to the process shown in FIG27 , which may include some or all of the following steps:

[0235] S2701: Get the current system volume.

[0236] The current system volume is the system volume before the display device 200 turns on the silent mode. The process of the display device 200 obtaining the current system volume can be referred to step S502 and will not be described in detail here.

[0237] S2702: Display second information in a pop-up window according to the current system volume.

[0238] The display device 200 sets a first volume threshold and a second volume threshold, wherein the first volume threshold is greater than the second volume threshold.

[0239] When the current system volume is greater than or equal to the first volume threshold, the second information is used to prompt the user to lower the system volume.

[0240] The previous system volume is greater than or equal to the first volume threshold, indicating that the system volume of the display device 200 is relatively high. After unmuting, the display device 200 will play audio at the relatively high volume, which can easily disturb the user. In order to solve this problem, the display device 200 displays a second message to prompt the user that the current system volume is relatively high and that the system volume can be lowered. Taking the display device 200 as a TV as an example, the display device 200 can display a pop-up window 2801 as shown in ① in Figure 28. The pop-up window 2801 may include a first message, such as "Awake, currently in silent mode". The pop-up window 2801 may also include a second message, such as "The volume is relatively high, it is recommended to lower it".

[0241] When the current system volume is less than the second volume threshold, the second information is used to prompt the user to increase the system volume.

[0242] The previous system volume is less than the second volume threshold, indicating that the system volume of the display device 200 is low. After unmuting, the display device 200 will play audio at the lower volume, which may not be easily perceived by the user. In order to solve this problem, the display device 200 displays a second message to prompt the user that the current system volume is low and the system volume can be increased. Taking the display device 200 as a TV as an example, the display device 200 can display a pop-up window 2802 as shown in ② in Figure 28. The pop-up window 2802 may include a first message, such as "Awake, currently in silent mode". The pop-up window 2802 may also include a second message, such as "The volume is low, it is recommended to increase it".

[0243] After displaying the pop-up window, the display device 200 can play the audio sound after canceling the silent mode.

[0244] The display device 200 can cancel the mute mode according to the process shown in FIG29 . The specific process is as follows:

[0245] S2901 , in response to a volume adjustment instruction from a user, canceling the mute mode and adjusting the current system volume to obtain an adjusted system volume.

[0246] The volume adjustment instruction may be a volume increase instruction or a volume decrease instruction. Taking the control device 100 as a remote controller as an example, the user may input the volume adjustment instruction via the volume key on the remote controller.

[0247] In response to the volume adjustment instruction, the display device 200 transmits the decoded audio data to the speaker for playback, thereby releasing the mute mode. In response to the volume adjustment instruction, the display device 200 also adjusts the current system volume. For example, if the volume adjustment instruction is a volume increase instruction, the system volume is increased. If the volume adjustment instruction is a volume decrease instruction, the system volume is decreased.

[0248] S2902: Play audio at the adjusted system volume.

[0249] After the display device 200 is released from mute mode, the system volume is the adjusted system volume, and the display device 200 plays audio at the adjusted system volume. For example, if the current system volume is 2 and the volume adjustment instruction is a volume increase instruction, such as increasing the volume by 1, the display device 200 responds to the volume increase instruction and releases mute mode. After the mute mode is released, the audio is played at the volume of 3.

[0250] After the display device 200 cancels the mute mode, the system volume is adjusted in response to a volume adjustment instruction input again by the user.

[0251] Based on the above method of canceling the mute mode, the user does not need to enter an additional mute cancellation command. The mute mode can be canceled directly while adjusting the system volume, which makes the user operation more convenient and smoother.

[0252] The display device 200 can cancel the mute mode according to the process shown in FIG30 . The specific process is as follows:

[0253] S3001: In response to a release instruction input by a user, release the silent mode.

[0254] The release command is used to indicate the end of mute mode. For example, if control device 100 is a remote control, a user can input a control command using the mute button on the remote control. Display device 200 responds to the control command and, upon recognizing that the device is in mute mode, determines that the control command is a release command. In response to the release command, display device 200 transmits the decoded audio data to the speaker for playback, thereby ending mute mode.

[0255] S3002: Play audio at the current system volume.

[0256] After the display device 200 cancels the mute mode, it plays the audio at the current system volume. After the display device 200 cancels the mute mode, it can adjust the system volume in response to a volume adjustment instruction input again by the user.

[0257] The display device 200 can also adjust the system volume in response to the user's volume adjustment instruction before step S3001 to obtain the adjusted system volume. At this time, the display device 200 is still in silent mode. After the user completes adjusting the system volume, the user inputs a release instruction. After the display device 200 is unmuted, it plays the audio at the current system volume, which is actually the adjusted system volume. Therefore, if the current system volume is too loud or too low, the user can adjust the system volume to an appropriate volume before actually playing the audio, so that after the display device 200 is unmuted, the audio can be played directly at the appropriate volume to ensure the user's listening quality.

[0258] In other embodiments, when the display device 200 is in silent mode, the display device 200 responds to the wake-up word and is in an incompletely awakened state, displays a pop-up window, does not cancel the silent mode, and does not adjust the system volume. The incompletely awakened state means that the display device 200 responds to the wake-up word, starts the pop-up window function, and after displaying the pop-up window, exits the interaction with the user and does not respond to other far-field voice commands of the user. The pop-up window is used to prompt the user that the user is currently in silent mode and needs to be woken up again after the silent mode is canceled. In this way, it is possible to avoid destroying the silent mode set by the user, and to prompt the user through a less intrusive pop-up window, and to avoid the impact of the silent mode on the display device 200 responding to the user's far-field voice commands by requiring it to wake up again after canceling the silent mode, thereby improving the far-field voice interaction effect between the display device 200 and the user.

[0259] In other embodiments, when the display device 200 is in silent mode, the display device 200 responds to the wake-up word, is in a wake-up state, automatically cancels the silent mode, displays a pop-up window, and adjusts the system volume to a preset volume. The display device 200 is in a wake-up state and can interact with the user in response to other far-field voice commands of the user. The pop-up window is used to prompt the user that he has been awakened and is in silent mode, but the silent mode has been canceled. The preset volume can be the default system volume or the system volume saved when the silent mode is started. In this way, the display device 200 does not play the wake-up prompt sound, but uses a pop-up window as a transition to prompt the user that he has been awakened to avoid disturbing the user. Moreover, the display device 200 can continue to interact with the user without the user waking up again.

[0260] In some embodiments, when the display device 200 is not in a muted state and the current system volume is 0, the display device 200 responds to the wake-up word and enters an awake state, displays a pop-up window, and does not adjust the system volume. The pop-up window serves to notify the user that the device has been awakened and that the system volume is 0. At this point, the display device 200 is awake and can respond to other far-field voice commands from the user to interact with the user.

[0261] The pop-up window may include prompt information, which may include information for prompting that the display device 200 is awakened and the current system volume is 0 (for ease of distinction, referred to as the third information). Taking the display device 200 as a television as an example, the display device 200 may display a pop-up window 3101 as shown in Figure 31, and the pop-up window 3101 may include the third information, such as "Awake, current system volume is 0".

[0262] In other embodiments, when the display device 200 is in a non-muted state and the current system volume is 0, the display device 200 responds to the wake-up word and is in an incomplete wake-up state, displays a pop-up window, and does not adjust the system volume. The incomplete wake-up state means that the display device 200 responds to the wake-up word, starts the pop-up window function, and after displaying the pop-up window, exits the interaction with the user and does not respond to other far-field voice commands of the user. The pop-up window is used to prompt the user that the system volume is 0 and that it needs to be woken up again after increasing the volume. In this way, the user can be prompted through a less intrusive pop-up window, and by needing to wake up again after increasing the volume, the impact of the system volume of 0 on the display device 200 responding to the user's far-field voice commands can be avoided, thereby improving the far-field voice interaction effect between the display device 200 and the user.

[0263] In other embodiments, when the display device 200 is in a non-mute state and the current system volume is 0, the display device 200 responds to the wake-up word, is in an awake state, automatically increases the system volume to a preset volume, and displays a pop-up window. The pop-up window is used to prompt the user that he has been awakened, and the system volume is 0, but it has currently been increased to the first volume. The first volume can be the default system volume, or it can be the system volume saved when the silent mode is started. At this point, the display device 200 is in an awake state and can interact with the user in response to other far-field voice commands of the user. In this way, the display device 200 does not play the wake-up prompt sound, but uses a pop-up window as a transition to prompt the user that he has been awakened, so as not to disturb the user. Moreover, the display device 200 can continue to interact with the user without the user waking up again.

[0264] The display device 200 may also perform a wake-up response according to the process shown in FIG32 , and the specific steps may include some or all of the following steps:

[0265] S3201: When the screen is on and in silent mode, collect user voice.

[0266] S3202: When it is recognized that the user voice contains the wake-up word, the silent mode is released, and after the silent mode is released, the to-be-played audio or prompt voice of the wake-up prompt sound is played at the first volume.

[0267] Step S3201 is similar to step S501, and the process of identifying the wake-up word in step S3202 is similar to steps S601-S602, which will not be repeated here.

[0268] In some embodiments, when the display device 200 is in silent mode, the display device 200 responds to the wake-up word, enters the awake state, automatically exits silent mode, and plays the wake-up prompt tone at a first volume. The first volume can be the default system volume or the system volume value saved when silent mode is activated. In this way, the display device 200 can interact well with the user through the wake-up prompt tone, and the display device 200 can continue to interact with the user without the user waking up again.

[0269] In other embodiments, when the display device 200 is in silent mode, the display device 200 responds to the wake-up word and is in an incomplete wake-up state, cancels the silent mode, and after canceling the silent mode, plays the prompt voice at a preset volume, and after playing the first prompt voice, restores the silent mode to maintain the silent mode. The incomplete wake-up state means that the display device 200 responds to the wake-up word, starts the first prompt voice playback function, and after playing the first prompt voice, exits the interaction with the user and does not respond to other far-field voice commands of the user. The preset volume value can be the default system volume or the system volume value saved when the silent mode is started. The prompt voice is used to remind the user that it is currently in silent mode and needs to be woken up again after canceling the silent mode. In this way, it is possible to avoid destroying the silent mode set by the user, and to prompt the user through the first prompt voice with a stronger sense of interaction, and to avoid the impact of the silent mode on the display device 200 responding to the user's far-field voice commands by requiring it to wake up again after canceling the silent mode, thereby improving the far-field voice interaction effect between the display device 200 and the user.

[0270] The display device 200 can increase the system volume based on the signal-to-noise ratio (SNR) of the user's voice. If the SNR of the user's voice is greater than a specified SNR threshold, the system volume is increased by a first amount, resulting in a lower volume. If the SNR of the user's voice is less than the specified SNR threshold, the system volume is increased by a second amount, which is greater than the first amount, resulting in a higher volume. The display device 200 can also increase the system volume based on the difference between the wake-up value of the user's voice and the wake-up value threshold. If the difference is greater than a specified difference threshold, the system volume is increased by the first amount, resulting in a higher volume. If the SNR of the user's voice is less than a specified difference threshold, the system volume is increased by a second amount, which is less than the first amount, resulting in a lower volume. The display device 200 can also increase the system volume based on the SNR of the user's voice and the difference between the wake-up value of the user's voice and the wake-up value threshold. If the difference is greater than the specified difference threshold and the SNR of the user's voice is less than the specified SNR threshold, the system volume is increased by the first amount, resulting in a higher volume. If the difference is less than the specified difference threshold and the signal-to-noise ratio of the user voice is greater than the specified signal-to-noise ratio threshold, the system volume is increased by a second amount, the second amount is less than the first amount, and the first volume is relatively low.

[0271] The display device 200 may also perform a wake-up response according to the process shown in FIG33 , and the specific steps may include some or all of the following steps:

[0272] S3301: When the screen is on, in non-mute mode, and the current system volume is 0, collect user voice.

[0273] S3302: When it is recognized that the user voice contains the wake-up word, the system volume is increased to a preset volume, and the to-be-played audio or prompt voice of the wake-up prompt sound is played at the preset volume.

[0274] Step S3301 is similar to step S501, and the process of identifying the wake-up word in step S3302 is similar to steps S601-S602, which will not be repeated here.

[0275] In some embodiments, when the display device 200 is not in a muted state and the current system volume is 0, the display device 200 responds to the wake-up word and enters a wake-up state, automatically increases the system volume to a preset volume, and plays the wake-up prompt tone at the preset volume. The third volume can be the default system volume. In this way, the display device 200 can interact well with the user through the wake-up prompt tone, and the display device 200 can continue to interact with the user without the user waking up again.

[0276] In other embodiments, when the display device 200 is in a non-muted state and the current system volume is 0, the display device 200 is in an incompletely awakened state in response to the wake-up word, automatically increases the system volume to a preset volume, and plays the prompt voice at the preset volume. The incompletely awakened state means that the display device 200 responds to the wake-up word, starts the prompt voice playback function, and after playing the prompt voice, exits the interaction with the user and does not respond to other far-field voice commands of the user. The preset volume can be the default system volume. The prompt voice is used to prompt the user that the system volume is 0 and that it needs to be woken up again after increasing the volume. In this way, the user can be prompted by a first prompt voice with a stronger sense of interaction, and by needing to wake up again after increasing the system volume, the influence of the system volume of 0 on the display device 200 responding to the user's far-field voice commands can be avoided, thereby improving the far-field voice interaction effect between the display device 200 and the user.

[0277] The operating modes of the display device 200 may include a speaker mode. When the display device 200 is in speaker mode, the display is in a screen-off state, but sounds can be played. When the display device 200 is in speaker mode, if the display device 200 is in the first state when it is awakened, the wake-up prompt sound is not played due to the limitation of the first state, and the user may mistakenly believe that the display device 200 is not awakened.

[0278] To solve the above problem, the display device 200 can respond to the wake-up word according to the process shown in FIG34 . The specific process is as follows:

[0279] S3401: When the screen is off and in silent mode, collect user voice.

[0280] S3402: When the user's voice is recognized to include a wake-up word, detect whether the device is in speaker mode.

[0281] Step S3401 is similar to step S501, and the process of identifying the wake-up word in step S3402 is similar to steps S601-S602, which will not be repeated here.

[0282] The display device 200 can determine whether it is in speaker mode by identifying the status of the audio service. If the audio service is started, it is in audio mode. If the audio service is turned off, it is in non-speaker mode. The display device 200 can also identify whether it is in speaker mode based on device status information. For example, the display device 200 obtains device status information through the device management module, and the device status information may include a flag bit for the speaker mode. When the flag bit carries the number 1, the display device 200 is in speaker mode. When the flag bit is empty or carries the number 0, the display device 200 is in non-speaker mode. The display device 200 can also identify whether it is in speaker mode based on other methods, which are not limited here.

[0283] The display device 200 performs a process of obtaining the audio to be played of the wake-up prompt sound when the wake-up value is greater than or equal to the wake-up value threshold.

[0284] The display device 200 can identify whether it is in speaker mode before obtaining the audio to be played for the wake-up prompt tone. If the display device 200 identifies that it is in non-speaker mode, it does not obtain the audio to be played for the wake-up prompt tone. If the display device 200 identifies that it is in speaker mode, it obtains the audio to be played for the wake-up prompt tone. This can avoid occupying the computing resources of the display device 200 when it is in non-speaker mode.

[0285] The display device 200 can identify whether it is in speaker mode during the process of obtaining the audio to be played for the wake-up prompt tone. For example, obtaining the audio to be played for the wake-up prompt tone and identifying whether it is in speaker mode are respectively executed in two parallel processes / threads. If the display device 200 identifies that it is in non-speaker mode, the execution of obtaining the audio to be played for the wake-up prompt tone is terminated; if the display device 200 identifies that it is in speaker mode, the execution of obtaining the audio to be played for the wake-up prompt tone is executed. In this way, when it is identified that it is in non-speaker mode, the computing resources of the display device 200 can be avoided from being continuously occupied. It is also possible to quickly obtain the audio to be played for the wake-up prompt tone when it is identified that it is in speaker mode.

[0286] After the display device 200 completes the process of obtaining the audio to be played for the wake-up prompt tone, it can identify whether it is in speaker mode. Therefore, when the display device 200 identifies that it is not in speaker mode, once it enters a working mode capable of playing the wake-up prompt tone, it can directly use the audio to be played for the wake-up prompt tone after being awakened, thereby improving the efficiency of playing the wake-up prompt tone.

[0287] S3403: If the device is in speaker mode, keep the screen off and cancel the mute mode. After canceling the mute mode, play the waiting audio of the wake-up prompt tone at the first volume.

[0288] The display device 200 remains in the screen-off state and responds to the user's voice by playing a wake-up prompt sound to prompt the user that he has been awakened.

[0289] Before playing the audio to be played for the wake-up prompt sound, the display device 200 obtains the audio to be played for the wake-up prompt sound.

[0290] The display device 200 can obtain the audio to be played of the wake-up prompt sound with a specified amplitude, and the specified amplitude is less than the amplitude threshold. The display device 200 plays the audio to be played of the wake-up prompt sound at the current system volume or the default system volume. Since the amplitude of the audio to be played of the wake-up prompt sound is less than the amplitude threshold, the volume of the audio to be played of the wake-up prompt sound played at the current system volume or the default system volume is also relatively small. The display device 200 directly obtains the audio to be played of the wake-up prompt sound with a specified amplitude, which can effectively improve the efficiency of obtaining the audio to be played of the wake-up prompt sound, and thereby improve the efficiency of playing the audio to be played of the wake-up prompt sound.

[0291] The display device 200 can adjust the amplitude of the audio of the wake-up prompt sound according to the first volume and the relevant parameters of the user's voice to obtain the audio to be played of the wake-up prompt sound. Among them, the relevant parameters of the user's voice may include the signal-to-noise ratio of the user's voice and / or the difference between the wake-up value of the user's voice and the wake-up value threshold. The display device 200 responds to the user's wake-up while reducing the sense of intrusion to the user. The display device 200 dynamically obtains the audio to be played of the wake-up prompt sound according to the first volume and the relevant parameters of the user's voice, so that the volume of the played wake-up prompt sound can be more in line with the user's needs and improve the user's experience.

[0292] The display device 200 can also respond to the wake-up word according to the process shown in FIG35 . The specific process is as follows:

[0293] S3501: When the screen is off, in non-mute mode, and the current system volume is 0, collect user voice.

[0294] S3502: When the user's voice is recognized to contain a wake-up word, detect whether the device is in speaker mode.

[0295] Steps S3501 and S3502 are similar to steps S3401 and S3402 and are not described in detail here.

[0296] S3503: If the device is in speaker mode, keep the screen off and increase the system volume to the second volume to play the waiting audio of the wake-up prompt tone at the second volume.

[0297] If it is in the speaker mode, the display device 200 keeps the screen off and responds to the user's voice by playing a wake-up prompt sound to prompt the user that he has been awakened.

[0298] The display device 200 first increases the system volume to a second volume, which may be a default system volume.

[0299] In some embodiments, the second volume can be less than a preset volume threshold. The display device 200 can determine the second volume based on relevant parameters of the user's voice. The relevant parameters of the user's voice may include the signal-to-noise ratio of the user's voice and / or the difference between the wake-up value of the user's voice and the wake-up value threshold. Because the second volume is less than the volume threshold, the system volume of the audio of the wake-up prompt sound played by the display device 200 is also lower. The display device 200 can respond to the user's wake-up while reducing the sense of intrusion to the user.

[0300] Based on steps S3401-S3403, or based on steps S3501-S3503, after playing the audio of the wake-up prompt tone, the display device 200 also plays a prompt message through the speaker according to the current system volume. The prompt message may include information for prompting the user to adjust the system volume (for ease of distinction, referred to as the first prompt message). The current system volume is the system volume of the audio of the wake-up prompt tone.

[0301] In which, when the current system volume is greater than or equal to the first volume threshold, the first prompt message is used to prompt the user to lower the system volume. When the current system volume is less than the second volume threshold, the first prompt message is used to prompt the user to increase the system volume. In which, the first volume threshold is greater than the second volume threshold. Taking the display device 200 as a TV as an example, the display device 200 can play a wake-up prompt sound when it is awakened in the screen-off state and the first state as shown in ① in Figure 36. If the current system volume is greater than or equal to the first volume threshold, the first prompt message is also played, such as "The system volume is too high, it is recommended to lower the system volume." The display device 200 can play a wake-up prompt sound when it is awakened in the screen-off state and the first state as shown in ② in Figure 36. If the current system volume is less than the second volume threshold, the first prompt message is also played, such as "The system volume is too low, it is recommended to increase the system volume."

[0302] After playing the wake-up prompt sound, the display device 200 may also play a prompt message, which may include information for reminding the user that the user is currently in speaker mode (for ease of distinction, referred to as the second prompt message). The prompt message played by the display device 200 may include the first prompt message and the second prompt message.

[0303] Taking the display device 200 as a television as an example, the display device 200 can, as shown in ① in Figure 37, play a wake-up prompt sound when it is awakened when it is in the screen-off state and the first state. If the current system volume is greater than or equal to the first volume threshold, a first prompt message is also played, such as "The system volume is too high, it is recommended to lower the system volume." The display device 200 can also play a second prompt message, such as "Currently in speaker mode." The display device 200 can, as shown in ② in Figure 37, play a wake-up prompt sound when it is in the screen-off state and the first state. If the current system volume is less than the second volume threshold, the first prompt message is also played, such as "The system volume is too low, it is recommended to increase the system volume." The display device 200 can also play a second prompt message, such as "Currently in speaker mode." In this way, the user can quickly determine the reason why the display device 200 is currently in the screen-off state.

[0304] In some embodiments, if the display device 200 is in silent mode, the display device 200 is in an incompletely awakened state in response to the wake-up word, maintains the screen-off state, cancels the silent mode, and plays the prompt voice at the first volume after canceling the silent mode, and after playing the prompt voice, restores the silent mode. The incompletely awakened state means that the display device 200 responds to the wake-up word, starts the prompt voice playback function, and after playing the prompt voice playback function, exits the interaction with the user and does not respond to other far-field voice commands of the user. The first volume can be the default system volume or the system volume saved when the silent mode is started. The prompt voice is used to prompt the user that he is in speaker mode, in silent mode, and needs to be woken up again after canceling the silent mode.

[0305] In other embodiments, if the display device 200 is in a non-silent mode and the current system volume is 0, the display device 200 is in an incomplete awakening state in response to the wake-up word, maintains the screen-off state, increases the system volume to the first volume, and plays the prompt voice at the first volume, and after playing the prompt voice, readjusts the system volume to 0. The incomplete awakening state means that the display device 200 responds to the wake-up word, starts the prompt voice playback function, and after playing the prompt voice playback function, exits the interaction with the user and does not respond to other far-field voice commands of the user. The first volume can be the default system volume. The prompt voice is used to prompt the user that the user is in speaker mode, is in non-silent mode but the current system volume is 0, and needs to be woken up again after increasing the volume.

[0306] The display device 200 can also respond to the wake-up word according to the process shown in FIG38 . The specific process is as follows:

[0307] S3801, when the screen is in the off state and in the first state, collecting user voice.

[0308] S3802: When the user's voice is recognized to contain a wake-up word, detect whether the device is in speaker mode.

[0309] Step S3801 is similar to step S501, and the process of identifying the wake-up word in step S3802 is similar to steps S601-S602, which will not be repeated here.

[0310] S3803: If the device is in speaker mode, the display is adjusted to a bright screen state, the middle page is displayed, and a pop-up window is displayed on the middle page according to the first state.

[0311] The display device 200 is in the awake state in response to the wake-up word. The display device 200 powers on the display and adjusts the display to the bright screen state. The display device 200 does not exit the speaker mode. In order to simulate the screen-off state when in the speaker mode in the bright screen state, the display device 200 displays the middle page. Referring to Figure 39, the display device 200 displays the middle page 3901. The middle page 3901 is black. When the middle page 3901 is displayed, it looks like the display device 200 is in the screen-off state. At this time, a pop-up window is displayed on the middle page. As shown in Figure 39, a pop-up window 3902 is displayed on the middle page 3901. The pop-up window is used to prompt the user that he has been awakened and is in the speaker mode and the first state. The pop-up window can be small in size and displayed in a non-center position such as the top corner or frame of the display to reduce the sense of intrusion to the user on the basis of prompting the user.

[0312] In some embodiments, if the first state is that the display device 200 is in silent mode, the display device 200 is adjusted to a bright screen state, silent mode is released, the system volume is adjusted to a preset volume, the intermediate page is displayed, and a pop-up window is displayed on the intermediate page. The preset volume can be the default system volume or the system volume saved when silent mode is turned on. The pop-up window is used to prompt the user that the current state is speaker mode and silent mode, but that silent mode has been released.

[0313] In other embodiments, if the first state is that the display device 200 is in non-mute mode and the current system volume is 0, the display device 200 is adjusted to a bright screen state, the system volume is adjusted to a preset volume, the intermediate page is displayed, and a pop-up window is displayed on the intermediate page. The preset volume can be the default system volume. The pop-up window is used to prompt the user that the current state is speaker mode, the system volume is 0, but the volume has been increased.

[0314] When the display device 200 displays the intermediate page after being awakened, the display device 200 may respond to other far-field voice commands of the user.

[0315] In some embodiments, the display device 200 exits the intermediate page and displays the video page in response to a user's far-field voice command to play a video. For example, if the far-field voice command is "Play Movie A," the display device 200 exits the intermediate page and displays the video of Movie A in response to the far-field voice command.

[0316] In other embodiments, the display device 200 maintains the display of the middle page and plays the audio in response to a far-field voice command from the user instructing the user to play the audio. For example, if the far-field voice command is "Play Song B," the display device 200 maintains the display of the middle page and plays the audio of Song B in response to the far-field voice command.

[0317] In other embodiments, the display device 200, in response to a user's far-field voice command instructing the user to play audio, adjusts the display to a screen-off state and plays the audio. For example, if the far-field voice command is "today's weather," the display device 200, in response to the far-field voice command, adjusts the display to a screen-off state and plays weather-related audio.

[0318] In other embodiments, the display device 200 is in an incompletely awake state in response to the wake-up word.

[0319] If the first state is that the display device 200 is in silent mode, the display device 200 is in an incompletely awakened state in response to the wake-up word, adjusts to a bright screen state, does not cancel silent mode, does not adjust the system volume, displays an intermediate page, and displays a pop-up window on the intermediate page. The incompletely awakened state means that the display device 200 activates the pop-up window function in response to the wake-up word, and after displaying the pop-up window, exits interaction with the user and does not respond to other far-field voice commands of the user. The pop-up window is used to remind the user that the current state is speaker mode and silent mode, and needs to be awakened again after canceling the silent mode.

[0320] If the first state is that the display device 200 is in non-silent mode and the system volume is 0, the display device 200 is in an incomplete wake-up state in response to the wake-up word, adjusts to a bright screen state, does not adjust the system volume, displays an intermediate page, and displays a pop-up window on the intermediate page. The incomplete wake-up state means that the display device 200 activates the pop-up window function in response to the wake-up word, and after displaying the pop-up window, exits interaction with the user and does not respond to other far-field voice commands of the user. The pop-up window is used to remind the user that the current state is speaker mode and the system volume is 0, and that it needs to be woken up again after increasing the volume.

[0321] For ease of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion of some embodiments is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The above embodiments are selected and described to better explain the content of this disclosure, thereby enabling those skilled in the art to better use the embodiments.

Claims

1. A display device, comprising: The display is configured to be: in a screen-off state; The speaker is configured to be in a silent mode or the display device is in a non-silent mode and the current system volume is 0; The sound collector is configured to: collect user voice; a memory configured to store computer instructions and / or data associated with the display device; At least one processor is connected to the display, the speaker, the sound collector and the memory, and is configured to execute the computer instructions to enable the display device to perform: When recognizing that the user voice includes a wake-up word, detecting whether the user is in a speaker mode; If it is in the speaker mode, the display is controlled to maintain the screen-off state and the silent mode is released, and after the silent mode is released, the speaker is controlled to play the audio to be played of the wake-up prompt sound at the first volume. 2 . The display device according to claim 1 , wherein the first volume is a default system volume or a system volume when in the silent mode.

3. The display device according to claim 1, if it is in the speaker mode, when executing the control of the display to maintain the screen-off state and release the silent mode, and after releasing the silent mode, controlling the speaker to play the to-be-played audio of the wake-up prompt sound at a first volume, the at least one processor is further configured to execute the computer instructions to enable the display device to execute: Obtaining the to-be-played audio of the wake-up prompt tone with a specified amplitude, where the specified amplitude is less than an amplitude threshold; The speaker is controlled to play the to-be-played audio of the wake-up prompt tone with the specified amplitude.

4. The display device according to claim 1, if it is in the speaker mode, when the display is controlled to maintain the screen-off state and the silent mode is released, and after the silent mode is released, the speaker is controlled to play the to-be-played audio of the wake-up prompt sound at a first volume, the at least one processor is further configured to execute the computer instructions to enable the display device to execute: According to the first volume and the relevant parameters of the user voice, the amplitude of the audio of the wake-up prompt sound is adjusted to obtain the audio to be played of the wake-up prompt sound, wherein: The parameters related to the user voice include a signal-to-noise ratio of the user voice, and / or a difference between the wake-up value and the wake-up value threshold.

5. The display device according to any one of claims 1 to 4, if in the speaker mode, then controlling the display to maintain the screen-off state and releasing the silent mode, and after releasing the silent mode, controlling the speaker to play the to-be-played audio of the wake-up prompt sound at a first volume, the at least one process is further configured to execute the computer instruction to enable the display device to execute: Controlling the speaker to play a first prompt message, where the first prompt message is used to prompt a user to adjust the system volume; in, When the current system volume is greater than or equal to a first volume threshold, the first prompt information is used to prompt the user to lower the system volume; When the current system volume is less than a second volume threshold, the first prompt information is used to prompt the user to increase the system volume, and the second volume threshold is less than the first volume threshold.

6. A display device comprising: The display is configured to be: in a screen-off state; The speaker is configured as: in non-mute mode and the current system volume is 0; The sound collector is configured to: collect user voice; When recognizing that the user voice includes a wake-up word, detecting whether the user is in a speaker mode; If it is in the speaker mode, the display is controlled to maintain the screen-off state, and the system volume is increased to the second volume, and the audio to be played of the wake-up prompt sound is played at the second volume.

7. A display device, comprising: The display is configured to be: in a screen-off state; The speaker is configured to be in a first state, wherein the display device is in a silent mode or the display device is in a non-silent mode and the current system volume is 0; The sound collector is configured to: collect user voice; a memory configured to store computer instructions and / or data associated with the display device; At least one processor is connected to the display, the speaker, the sound collector and the memory, and is configured to execute the computer instructions to enable the display device to perform: When recognizing that the user voice contains a wake-up word, detecting whether the user is in speaker mode; If it is in the speaker mode, the display is adjusted to the bright screen state, and the display is controlled to display the middle page, and a pop-up window is displayed on the middle page according to the first state, wherein the middle page is black, and the pop-up window is used to prompt the user that the display device has been awakened.

8. The display device according to claim 7, after controlling the display to display the intermediate page, the at least one processor is further configured to execute the computer instructions to enable the display device to execute: In response to a far-field voice command from a user indicating to play a video, controlling the display to exit the intermediate page and display a page of the video; Alternatively, in response to a far-field voice instruction from a user to play audio, the display is controlled to keep displaying the intermediate page, or the display is adjusted to the screen-off state, and the speaker is controlled to play the audio.

9. A device wake-up method for a display device, wherein the display device is in a screen-off state and a silent mode; The method comprises: Collect user voice; When recognizing that the user voice includes a wake-up word, detecting whether the user is in a speaker mode; If the device is in the speaker mode, the screen is kept in the off state, the silent mode is released, and after the silent mode is released, the audio to be played of the wake-up prompt sound is played at the first volume.

10. A device wake-up method for a display device, wherein the display device is in a screen-off state, in a non-mute mode, and the current system volume is 0; the method comprises: Collect user voice; When recognizing that the user voice includes a wake-up word, detecting whether the user is in a speaker mode; If the device is in the speaker mode, the screen is kept in the off state, and the system volume is increased to the second volume, and the audio to be played of the wake-up prompt sound is played at the second volume.

11. A device wake-up method for a display device, wherein the display device is in a screen-off state and a first state, wherein the first state is that the display device is in a silent mode or the display device is in a non-silent mode and the current system volume is 0; the method comprises: When recognizing that the user voice contains a wake-up word, detecting whether the user is in speaker mode; If it is in the speaker mode, the screen is adjusted to a bright state, and the middle page is displayed, and a pop-up window is displayed on the middle page according to the first state, wherein the middle page is black, and the pop-up window is used to prompt the user that the display device has been awakened.

Images