A display device and a standby method, and a far-field voice control method.

Abstract

This application provides a display device and a standby method, as well as a far-field voice control method. When the display device is switched from a power-on state to a standby state, the main chip is powered off while the voice chip remains powered on. The voice chip performs a first wake-up task, that is, it recognizes a wake-up command sent by the user and, in response to the recognized wake-up command, instructs the main chip to power on and start. This ensures far-field voice control functionality in standby mode and avoids power consumption by the main chip. Furthermore, when the display device is woken from standby mode by a user's wake-up command, the main chip further executes a voice service to identify the type of voice command and, based on the type of voice command, accurately controls whether the display needs to be turned on, so that the display is only turned on when needed, thereby precisely controlling power consumption after standby mode is activated.

Description

Technical Field

[0001] This application relates to the field of intelligent display device technology, and in particular to a display device and a standby method, and a far-field voice control method. Background Technology

[0002] Display devices refer to terminal devices capable of outputting specific display images, such as smart TVs, mobile terminals, smart advertising screens, and projectors. Taking smart TVs as an example, smart TVs are television products based on Internet application technologies, possessing open operating systems and chips, and having open application platforms. They enable two-way human-computer interaction and integrate multiple functions such as audio-visual, entertainment, and data to meet diverse and personalized user needs.

[0003] With the development of intelligent technology, various artificial intelligence (AI) technologies have emerged, among which voice control technology is a relatively mature and widely used technology. Voice control technology has been widely applied in the field of display devices, such as televisions, speakers, smart boxes, automobiles, and shopping mall guide robots. Display devices are configured with far-field voice control functionality, meaning users can control the display device to perform corresponding tasks by sending voice commands within a certain range. This effectively simplifies user operation of the display device and improves the user experience. Far-field voice control is implemented through a voice chip and a main chip. The voice chip collects the voice data sent by the user and transmits the collected voice data to the main chip. The main chip then executes the wake-up service and voice service in the voice application. Specifically, the main chip identifies the wake word in the voice data through the wake-up service and, upon recognition, initiates the voice service. The main chip also identifies the instruction information in the voice data through the voice service to execute corresponding tasks based on that instruction information, such as displaying the corresponding user interface or playing audio data.

[0004] To reduce the power consumption of display devices, they can be put into standby mode. However, standby mode means that all components in the display device are powered off to avoid power consumption. Based on the above implementation process of far-field voice control, if the main chip is powered off, far-field voice control will not be possible. To ensure that far-field voice control can still be used normally in standby mode, existing display devices must keep the main chip powered on and operate, creating the illusion of standby mode by turning off the monitor. Even then, the main chip still consumes power. Moreover, to enhance user interaction, when a standby display device is woken up by voice, it will directly turn on the monitor to display the interface, resulting in additional power consumption when the monitor is not needed. Summary of the Invention

[0005] This application provides a display device and a standby method, as well as a far-field voice control method. In standby mode, the display device can power off the main chip to avoid power consumption generated by the main chip. Furthermore, when the display device is woken up via far-field voice function in standby mode, the display is only turned on when needed, thus precisely controlling power consumption after standby activation.

[0006] In a first aspect, this application provides a display device, comprising:

[0007] The monitor is configured to be on for displaying the user interface within a window;

[0008] The controller is configured as follows:

[0009] Receive standby command;

[0010] In response to the standby command, the display is turned off;

[0011] The main chip is powered off while the voice chip remains powered on to put the display device into a standby state. In the standby state, the voice chip is used to perform a first wake-up service. The first wake-up service refers to recognizing a wake-up command sent by the user and responding to the wake-up command by instructing the main chip to power on and start. The wake-up command refers to voice data containing a wake-up word.

[0012] In one implementation, the controller powers off the main chip while keeping the voice chip powered on, thereby putting the display device into a standby state, and is configured as follows:

[0013] Determine whether a target application with a lock icon exists, the lock icon indicating that the corresponding application is running;

[0014] If the target application exists, wait for the target application to finish running, and after the target application finishes running, remove the lock flag and power off the main chip;

[0015] If the target application does not exist, the main chip is powered off.

[0016] In one implementation, the controller is configured to power off the main chip as follows:

[0017] Adjust each kernel module in the kernel layer to a hibernation state, where the hibernation state of the kernel module means that the kernel module is powered off;

[0018] Adjust the user space to a frozen state, whereby the user space is not responding to the application's data read / write tasks;

[0019] The main chip is put into a sleep state, which means that the main chip is powered off.

[0020] Secondly, this application also provides a display device, comprising:

[0021] The display is configured to be off in standby mode, wherein the main chip of the display device is powered off and the voice chip is powered on in standby mode;

[0022] The controller, in the standby state, is configured as follows:

[0023] The first wake-up service is executed through the voice chip. The first wake-up service refers to recognizing the wake-up command sent by the user and responding to the wake-up command by instructing the main chip to power on and start. The wake-up command refers to voice data containing a wake-up word.

[0024] After the main chip is powered on, the main chip executes a second wake-up service and a voice service in the voice application. The second wake-up service refers to recognizing and responding to the wake-up command sent by the user. The voice service refers to recognizing and responding to the voice command sent by the user. The voice command refers to voice data containing instruction information. The voice service also includes determining the display state of the display based on the category of the voice command. The display state is either on or off.

[0025] In one implementation, the controller performs a first wake-up service via a voice chip and is configured as follows:

[0026] Receive voice data sent by the user;

[0027] Identify whether the voice data contains the wake word;

[0028] If the wake word is included, the voice data is determined to be the wake-up command, and in response to the wake-up command, the main chip is instructed to power on and start up.

[0029] If the wake word is not included, the voice data is discarded.

[0030] In one implementation, the controller performs a first wake-up service via a voice chip and is configured as follows:

[0031] In response to the wake-up command, the main chip is instructed to power on and start up, so as to adjust each kernel module in the kernel layer to boot mode and adjust the user space to unfreeze mode. The boot mode of the kernel module refers to the kernel module powering on and starting up, and the unfreeze mode refers to the user space responding to the data read and write tasks of the application.

[0032] In one implementation, after the main chip powers on, the controller executes the voice service through the main chip and is configured as follows:

[0033] Based on the indication information in the voice command, the category of the voice command is determined, wherein the display is turned on in response to a voice command of the first category, and the display is turned off in response to a voice command of the second category;

[0034] A first identifier is generated based on the first category of voice commands, and a second identifier is generated based on the second category of voice commands;

[0035] The display is turned on based on the first identifier, or the display is turned off based on the second identifier.

[0036] In one implementation, the controller, based on the first identifier, turns on the display and is configured to:

[0037] Based on the first identifier, the display is turned on and the window is set to an active state, which means that the window is operable in response to a non-power-on command and displays the corresponding user interface;

[0038] The voice application is marked with a lock flag to indicate that the voice application is running and to prevent the display device from being switched to the standby state.

[0039] The controller, based on the second identifier, turns off the display and is configured to:

[0040] Based on the second identifier, keep the display off and set the window to an inactive state, meaning the window is not operable and does not respond to the non-power-on command;

[0041] After waiting for a specified time, the display device is adjusted to the standby state, wherein the voice application does not have the lock icon.

[0042] Thirdly, this application also provides a standby method applied to a display device, wherein the display of the display device is configured to be on for displaying a user interface within a window, the method comprising:

[0043] Receive standby command;

[0044] In response to the standby command, the display is turned off;

[0045] The main chip is powered off while the voice chip remains powered on to put the display device into a standby state. In the standby state, the voice chip is used to perform a first wake-up service. The first wake-up service refers to recognizing a wake-up command sent by the user and responding to the wake-up command by instructing the main chip to power on and start. The wake-up command refers to voice data containing a wake-up word.

[0046] Fourthly, this application also provides a far-field voice control method applied to a display device, wherein the display of the display device is configured to be off in a standby state, wherein in the standby state, the main chip of the display device is powered off and the voice chip is powered on, and the method includes:

[0047] The first wake-up service is executed through the voice chip. The first wake-up service refers to recognizing the wake-up command sent by the user and responding to the wake-up command by instructing the main chip to power on and start. The wake-up command refers to voice data containing a wake-up word.

[0048] After the main chip is powered on, the main chip executes a second wake-up service and a voice service in the voice application. The second wake-up service refers to recognizing and responding to the wake-up command sent by the user. The voice service refers to recognizing and responding to the voice command sent by the user. The voice command refers to voice data containing instruction information. The voice service also includes determining the display state of the display based on the category of the voice command. The display state is either on or off.

[0049] As can be seen from the above technical solution, when the display device is switched from power-on to standby mode, the main chip is powered off while the voice chip remains powered on. The voice chip performs the first wake-up task, recognizing the wake-up command sent by the user and instructing the main chip to power on in response. This ensures far-field voice control functionality in standby mode and avoids excessive power consumption by the main chip. Furthermore, when the display device is woken from standby mode by the user's wake-up command, the main chip further executes voice services to identify the type of voice command and accurately control whether the display needs to be turned on based on the command type. This ensures the display is only turned on when necessary, thus precisely controlling power consumption after startup from standby. Attached Figure Description

[0050] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0051] Figure 1This application illustrates the usage scenario of the display device.

[0052] Figure 2 This is a hardware configuration block diagram of the control device in the embodiments of this application;

[0053] Figure 3 This is a hardware configuration block diagram of the control device in the embodiments of this application;

[0054] Figure 4 This is a hardware configuration diagram of the display device in the embodiments of this application;

[0055] Figure 5 This is a software configuration diagram of the display device in the embodiments of this application;

[0056] Figure 6 This is a schematic diagram illustrating the interaction between a user and a display device via far-field voice control in an embodiment of this application.

[0057] Figure 7 This is a flowchart illustrating the standby method in an embodiment of this application;

[0058] Figure 8 This is a schematic diagram of the process by which the main chip is powered off based on the running status of each application during the standby process of the display device in this embodiment of the application.

[0059] Figure 9 This is a schematic diagram of the main chip power-off process during the standby process of the display device in this application embodiment;

[0060] Figure 10 This is an interactive diagram illustrating a user sending a standby command to a display device via a remote control, as shown in an embodiment of this application.

[0061] Figure 11 This is a schematic diagram illustrating the display device turning off the display in response to a standby command in an embodiment of this application;

[0062] Figure 12 This is a flowchart illustrating the background power-off process after the display device turns off the monitor in an embodiment of this application.

[0063] Figure 13 This is a schematic diagram illustrating the process of waking up a display device in standby mode via far-field voice control in an embodiment of this application.

[0064] Figure 14 This is a flowchart illustrating the process of identifying wake-up commands in an embodiment of this application;

[0065] Figure 15 This is a flowchart illustrating different types of voice commands in an embodiment of this application;

[0066] Figure 16This is a flowchart illustrating the process of setting the window state based on the first identifier in an embodiment of this application.

[0067] Figure 17 This is a flowchart illustrating the process of setting the window state based on the second identifier in an embodiment of this application.

[0068] Figure 18 This is a schematic diagram illustrating the interaction between a user and the display device via voice wake-up using the far-field voice control function in an embodiment of this application.

[0069] Figure 19 This is a schematic diagram illustrating the process of the display device performing a wake-up service in the background in an embodiment of this application;

[0070] Figure 20 This is a schematic diagram illustrating the process of the display device using echo cancellation technology to process voice data in the background in an embodiment of this application;

[0071] Figure 21 This is a schematic diagram illustrating the process by which the display device identifies the type of voice command in the background to control the display to turn on or off in an embodiment of this application.

[0072] Figure 22 This is a schematic diagram illustrating a display device keeping the display off based on a second identifier in an embodiment of this application.

[0073] Figure 23 This is a schematic diagram illustrating the display device turning on the display based on a first identifier in an embodiment of this application. Detailed Implementation

[0074] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0075] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0076] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0077] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0078] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0079] Figure 1 This is a schematic diagram illustrating a usage scenario of the display device according to an embodiment. For example... Figure 1 As shown, the display device 200 can communicate with the server 300 via the Internet, and the user can operate the display device 200 through the control device 100.

[0080] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via a wired connection. Users can control the display device 200 by inputting control commands through at least one method, such as buttons on the remote control, voice input, or control panel input.

[0081] In some embodiments, the control device 100 may also be a mobile terminal, such as a mobile phone. Communication between the mobile terminal and the display device 200 includes Internet Protocol (IP) communication or Bluetooth protocol communication, as well as at least one of other short-range and long-range communication methods. Users can control the display device 200 by inputting user commands through at least one method such as buttons, voice input, or control panel input on the mobile terminal. Figure 2 An exemplary configuration block diagram of a control device 100, exemplified by a remote control, is shown. Figure 2 As shown, the control device 100 includes a controller, a communication interface, a user input / output interface, a memory, and a power supply.

[0082] Figure 3 An exemplary configuration block diagram of a control device 100, taking a mobile terminal as an example, is shown. Figure 3 As shown, the control device 100 includes at least one of the following components: radio frequency (RF) circuit, memory, display unit, camera, sensor, audio circuit, wireless Fidelity (Wi-Fi) circuit, processor, Bluetooth circuit, and power supply.

[0083] Figure 4 A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is shown.

[0084] In some embodiments, the display device 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0085] In some embodiments, the communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the control device 100 or the server 300 through the communicator 220.

[0086] In some embodiments, the external device interface 240 may include, but is not limited to, one or more interfaces such as: High Definition Multimedia Interface (HDMI), analog or data high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple interfaces mentioned above.

[0087] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0088] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations via various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the display 260, the controller 250 can perform operations related to the object selected by the user command.

[0089] In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the GUI. Alternatively, the user can input user commands by inputting specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0090] In some embodiments, a "user interface" is the medium through which an application or operating system interacts and exchanges information with a user, enabling the conversion between the internal form of information and a form acceptable to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0091] See Figure 5 In some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Layer"), and the kernel layer.

[0092] In some embodiments, at least one application runs in the application layer. These applications may be Windows programs, system settings programs, or clock programs that come with the operating system; they may also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0093] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications in the application layer. Applications can access system resources and obtain system services during execution through the API interface.

[0094] like Figure 5As shown, the application framework layer in this embodiment includes managers, content providers, etc., wherein the managers include at least one of the following modules: ActivityManager, which interacts with all activities running in the system; LocationManager, which provides access to system location services for system services or applications; PackageManager, which retrieves various information related to application packages currently installed on the device; NotificationManager, which controls the display and clearing of notification messages; and WindowManager, which manages icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0095] To facilitate user control of the display device, a far-field voice control function is configured. This function is implemented through a voice chip and a main chip. The process of implementing far-field voice control through the voice chip and main chip in the display device can be found in [reference needed]. Figure 6The diagram illustrates the interaction between the user and the display device. When the display device is powered on, all components are fully functional and can operate normally. The display device executes a voice data acquisition service through a voice chip. The voice chip calls the microphone's hardware interface through this service to acquire voice data sent by the user, such as "hey." The voice chip directly transmits the acquired voice data "hey" to the main chip, which processes it. The main chip starts a far-field voice control application (hereinafter referred to as the voice application) in its main process and first calls a wake-up service to recognize and respond to the received voice data "hey." In this application, the wake-up service called by the voice application in the powered-on state is referred to as the second wake-up service. The voice application recognizes the wake-up word in the voice data "hey" by calling the second wake-up service, and after recognizing the wake-up word "hey," it starts the voice service. The voice chip continues to collect voice data sent by the user, such as "play audio 1," through the microphone via the voice data acquisition service. The voice chip directly transmits the acquired voice data "play audio 1" to the main chip, which processes it. The main chip recognizes and responds to the received voice data "Play Audio 1" by calling the voice service through the voice application. The voice application, upon recognizing that the voice data contains the instruction "Play Audio 1," calls the corresponding service, such as the audio playback service, to access the microphone's hardware interface and play the audio data corresponding to "Audio 1." Therefore, the implementation of far-field voice control relies on the main chip in the display device being powered on. To reduce power consumption, when the display device is in standby mode, directly powering off the main chip would prevent the user from using far-field voice control; the user would be unable to wake the display device to respond to subsequent voice commands. Thus, to ensure normal user access to far-field voice control in standby mode, the main chip must remain powered on and in working mode. Therefore, even in standby mode, the main chip in existing display devices still consumes power.

[0096] To avoid power consumption generated by the main chip in the display device during standby mode, embodiments of this application provide a standby method, such as... Figure 7 The flowchart shown below illustrates the specific process as follows:

[0097] S701, Receive standby command.

[0098] The display device 200 is powered on, meaning its monitor is turned on and used to display the user interface within a window. Furthermore, all components within the display device 200 (including the main chip, voice chip, etc.) are powered on and operational.

[0099] In one implementation, the user sends a standby command to the display device 200 via a control device 100, such as a remote control or a mobile phone. For example, the user sends a command containing a "standby" key value to the display device 200 by pressing the "standby" button on the remote control. The display device 200 determines that the received command is a standby command by recognizing that the received command contains the "standby" key value.

[0100] In one implementation, the user utilizes the far-field voice control function provided by the display device 200 to control the display device 200 to enter a standby state by sending voice commands. For example, the display device 200 collects voice data sent by the user, such as "hey," through a voice chip and transmits the voice data to the main chip. The main chip, through a wake-up service, recognizes that the voice data contains the wake-up word "hey," determines that the voice data is a wake-up command, and initiates the voice service in response to the wake-up command. The voice chip continues to collect voice data sent by the user, such as "standby," and transmits the voice data to the main chip. The main chip, through a voice service, recognizes that the voice data contains the indication information "standby," determining that the voice data is a standby command.

[0101] S702. In response to the standby command, turn off the display.

[0102] After receiving a standby command, the display device 200, in response to the standby command, first terminates the power supply to the monitor to turn it off. Specifically, the display device 200 receives and identifies a "standby" key value through a window management service. Based on the "standby" key value, the window management service generates a corresponding power button event "standby" and notifies the power management service of this power button event "standby". Based on this "standby" event, the power management service first disconnects the power supply to the monitor to turn it off.

[0103] Therefore, when the display device 200 receives the standby command, it immediately turns off the monitor, so that users can intuitively feel the monitor quickly changing from being on to being off. This allows users to experience the high efficiency of the display device 200 in responding to standby commands and improves the user experience.

[0104] Furthermore, after the display device 200 responds to the standby command and turns off the display, the display will no longer generate power consumption, thereby quickly reducing the overall power consumption of the display device 200 and saving energy.

[0105] S703. Power off the main chip while keeping the voice chip powered on, so as to put the display device into standby mode.

[0106] In this embodiment, the standby state of the display device 200 refers to the state where the main chip of the display device 200 is powered off while the voice chip remains powered on. The power-off process of the main chip occurs after the display is turned off, so the user cannot perceive the power-off process and therefore will not perceive the corresponding time consumption. From the user's perspective, this effectively improves the response speed of the display device 200 to standby commands. Simultaneously, in this embodiment, to ensure that the display device 200 can still provide far-field voice control functionality to the user in standby mode, the voice chip is configured to perform not only the original voice data acquisition service but also a wake-up service in standby mode. For distinction, in this embodiment, the wake-up service performed by the voice chip in standby mode is referred to as the first wake-up service. When the display device 200 is in standby mode, the voice chip calls the microphone's hardware interface through the voice data acquisition service to collect voice data sent by the user. It then calls the first wake-up service to identify whether the voice data contains a wake-up word. If a wake-up word is detected, the voice data is determined to be a wake-up command, and in response, the main chip is instructed to power on and start. After the main chip powers on and starts, it continues to execute the second wake-up service and voice service. Therefore, in standby mode, by keeping the voice chip powered on to ensure the normal operation of its voice data acquisition service and the first wake-up service, the main chip can be woken from standby mode to continue executing voice services, thus ensuring the normal operation of the far-field voice control function. Furthermore, in standby mode, the main chip can be powered off to avoid power consumption by the main chip.

[0107] In this embodiment, the display device 200 changes from a power-on state to a standby state, which essentially means adjusting the operation mode of each module in the display device 200 from a powered-on operating mode to a power-off sleep mode. To avoid the display device 200 directly powering off each module in response to a standby command, leading to data instability, after receiving the standby command, the display device 200 gradually powers down the main chip based on the running state of the applications in each thread. (Refer to...) Figure 8 The flowchart shown is as follows:

[0108] S801. Determine whether there is a target application with a lock icon, wherein the lock icon is used to indicate that the corresponding application is in a running state.

[0109] S802. If the target application exists, wait for the target application to finish running, and after the target application finishes running, remove the lock flag and power off the main chip.

[0110] S803. If the target application does not exist, power off the main chip.

[0111] When the main chip is powered on and running, its corresponding main process runs various applications. For example, taking a data recording application as an example, when the display device 200 is playing video 1, it starts the data recording application in the main process to record the playback information of video 1, such as playback parameters and playback progress. As another example, taking an update application as an example, when the display device 200 is updating the operating system version or the application version, it starts the update application in the main process to download the latest version of the system and application and replace the old version with the latest version.

[0112] If the display device 200 responds to a standby command by directly powering off the main chip, thus terminating the main process and all running applications, it will cause these applications to be unable to complete their tasks, resulting in incomplete data and program errors. For example, if a data recording application is terminated directly in response to a standby command, the recorded playback information will be incomplete. If the device restarts and attempts to play video 1 from the last playback position, the incomplete playback information will prevent accurate positioning to the actual playback position during standby. For instance, if the recorded playback position is n seconds before the actual playback position, the video data corresponding to those n seconds will be repeatedly played, causing the user to repeatedly watch video 1 and reducing the user experience. Similarly, if an update application is terminated directly in response to a standby command, the system and application updates will be incomplete. Upon restarting, with two versions of the operating system and applications (the older version and the incomplete new version), the display device 200 will need time to determine which version to use. If it determines to use the new version, the incomplete version will prevent it from running properly, thus affecting the user experience. Moreover, at this time, the database will contain data corresponding to two versions simultaneously, occupying additional storage space. If the version is updated again after booting up, the data corresponding to the new version will be downloaded repeatedly, which will not only further occupy additional storage space, but also cause the repeatedly downloaded version data to become corrupted, affecting the normal operation of the system and applications.

[0113] To avoid the aforementioned problems, before powering down the main chip in response to a standby command, the display device 200 first determines whether a target application is currently running. In this embodiment, a lock flag can be used to identify the target application. The lock flag indicates that the corresponding application is running and power-off is prohibited. The main chip can identify the running target application by recognizing the lock flag. For example, after each application starts in the main process, it requests a power lock from the power management service, carrying a lock flag to indicate that the application is running and power-off is prohibited, thus preventing the display device 200 from directly terminating the target application in response to a standby command. For instance, after a data logging application starts in the main process, it requests a power lock from the kernel layer to generate a lock flag, which indicates that the data logging application is running and power-off is prohibited. Similarly, after an update application starts in the main process, it requests a power lock from the kernel layer to generate a lock flag, which indicates that the update application is running and power-off is prohibited.

[0114] After the display device 200 turns off the monitor, it generates corresponding status information for the monitor, such as the off state, and notifies each kernel module in the kernel layer that the monitor has been powered off and its hardware interface is inaccessible. The main chip identifies whether a target application (an application with a lock flag) exists in the main process. If a target application exists, it is marked, and the main chip is switched from an active state to an idle state to wait for these target threads to finish running. In this embodiment, the idle state of the main chip means that the main chip is powered on and running, but this power-on operation is a low-power operation mode, that is, some functions are turned off, such as network connection functions, audio playback functions, and screen display functions, while the functions corresponding to the target applications are retained, such as data read and write functions. That is, only the currently running target application is executed, and no new instructions (except power-off instructions and power-on instructions) are responded to. This avoids other instructions initiated by the user at this time from affecting the power-off process of the main chip, and thus avoids affecting the standby process of the display device 200. Each target application continues to run, and after completion, it unlocks, that is, it requests the kernel layer to clear the power lock to remove the lock flag on the target application. The main chip can periodically check whether the marked target application has a lock flag to determine if the target application has finished running. Alternatively, the target application can notify the user of the completion result after running. For example, a data logging application removes the lock flag after recording the playback information of the currently playing video 1 to indicate that the data logging application has finished running. Similarly, an update application removes the lock flag after completing the system and application update to indicate that the update application has finished running.

[0115] Once the display device 200 detects that the target application does not currently exist, it can power off the main chip. In this embodiment, refer to... Figure 9 The process shown will power off the main chip. The specific process is as follows:

[0116] S901. Adjust each kernel module in the kernel layer to a hibernation state, wherein the hibernation state of the kernel module means that the kernel module is powered off.

[0117] S902. Adjust the user space to a frozen state, wherein the frozen state of the user space means that the user space does not respond to the application's data read and write tasks.

[0118] S903. Adjust the main chip to a sleep state, whereby the main chip is powered off.

[0119] When the target application is not present in the main process, the "standby" event is invoked at the power hardware interface layer. Information about the "standby" event, such as its cause and duration, is recorded at the power hardware interface layer. This standby event is then sent to the kernel layer, causing all kernel modules to switch from a working state to a hibernation state (i.e., powering off each kernel module) to terminate the kernel layer's operation. Furthermore, the user space is frozen, preventing it from performing data write and read tasks, thus terminating the application layer's operation. At this point, all modules under the main chip's control, as well as the user space, are in a hibernation state and no longer perform tasks. The main chip can then be powered off and enter hibernation mode, at which point the display device 200 enters a true standby state.

[0120] An example of the standby process of the aforementioned display device 200 can be provided for reference. Figures 10-12 The diagram illustrates the standby interaction between the user and the display device 200. (See diagram for example.) Figure 10 As shown, display device 200 is currently in a working state, that is, the monitor of display device 200 is turned on, and the window displays as shown. Figure 10 The user interface shown is a landscape view. The user sends a standby command to the display device 200 by operating the control device 100, for example, by pressing the "standby" button on the remote control. The standby command contains a "standby" key value to control the display device 200 to enter standby mode.

[0121] like Figure 11 As shown, the display device 200 receives the standby command and identifies the "standby" key value in the standby command through the window management service. Confirming the command as a standby command, the window management service processes the broadcast of the "standby" key value, generates a power button event "standby," and notifies the power management service of this event. Based on this power button event, the power management service first disconnects the power supply to the display, such as... Figure 12As shown, when the monitor is off, it enters a closed state and no longer consumes power.

[0122] Therefore, when the display device 200 receives the standby command, it immediately turns off the monitor, so that users can intuitively feel the monitor quickly changing from a lit screen to a lit screen, allowing users to experience the high efficiency of the display device 200 in responding to standby commands, thereby improving the user experience.

[0123] After the display device 200 turns off the monitor, it disconnects the main chip but keeps the voice chip powered on. For example... Figure 11 As shown, the power management service generates corresponding status information based on the current state of the display, i.e., the off state, and broadcasts this status information to each kernel module in the kernel layer to notify each kernel module that the display is powered off, the display's hardware interface is unreachable, and to notify each kernel module to enter a hibernation state. The main chip identifies whether the target application, i.e., the application with a lock flag, exists in the main process. If the target application exists, the main chip is switched to idle mode, i.e., the main chip is powered on, some functions are disabled, only the target application is supported, and it no longer responds to new commands (except for power-off and power-on commands), thus entering a low-power mode. After the target application finishes running, the lock flag of the target application is removed. When the target application does not exist in the main process... The power hardware interface layer calls the "standby" event, which records the information of the "standby" event and notifies the kernel layer of the "standby" event. This causes each kernel module in the kernel layer to change from working state to hibernation state, thereby terminating the operation of the kernel layer. Furthermore, the user space is adjusted to a frozen state to terminate the operation of the application layer. Finally, the main chip is powered off to adjust to hibernation state, and the display device 200 truly enters standby state.

[0124] Therefore, power loss of the main chip will not affect the operation of the corresponding applications in each module, effectively avoiding problems such as incomplete data and program errors when the display device 200 responds to standby commands, thus effectively ensuring the operating effect of the display device 200 after restarting. Moreover, in response to standby commands, the display device 200 can power off the main chip while keeping the voice chip powered on, allowing the display device 200 to enter a true standby state. At this time, the display device 200 can still run wake-up services and voice command response services through voice applications to wake up the display device 200 via far-field voice functionality, and further respond to voice commands after successfully waking up the main chip. Thus, in standby mode, the display device 200 can further power off the main chip to reduce the power consumption generated by the main chip, thereby effectively reducing the overall power consumption of the display device 200 without affecting the far-field voice control function of the display device 200 in standby mode.

[0125] Based on the above standby process, when the display device 200 is in standby mode (i.e., the main chip is powered off while the voice chip remains powered on), the display device 200 can collect and recognize the wake-up command sent by the user through the voice chip, and respond to the wake-up command by instructing the main chip to power on again to start the voice application. The main chip then executes the second wake-up service and voice service to ensure the normal operation of the far-field voice control function. The process of the display device 200 adjusting from standby mode to power-on mode can be found in [reference needed]. Figure 13 The boot process shown is as follows:

[0126] S1301, Execute the first wake-up service through the voice chip.

[0127] In the standby state of the display device 200 provided in this embodiment, the display device 200 can execute the first wake-up service through the voice chip. If the environment in which the display device 200 is located is relatively noisy, the voice data collected by the voice chip will be more complex. For example, in a shopping mall environment, the display device 200 can collect voice data generated by passing crowds, audio data generated by other audio devices, and audio data played by the display device 200 itself (for convenience, these are also collectively referred to as voice data). All of these voice data can interfere with the recognition of the real wake-up command. In order to accurately execute the wake-up service and avoid voice data that responds to the wake-up command, one can refer to... Figure 14 The process shown is for recognizing voice commands. The specific process is as follows:

[0128] S1401, Receive the voice data sent by the user.

[0129] S1402. Identify whether the voice data contains the wake word.

[0130] S1403. If the wake-up word is included, the voice data is determined to be the wake-up command, and in response to the wake-up command, the main chip is instructed to power on and start.

[0131] S1404. If the wake word is not included, the voice data is discarded.

[0132] The voice chip calls the microphone's hardware interface through a voice data acquisition service to collect all voice data. This voice data acquisition process ensures the comprehensiveness of the voice data collected by the chip, preventing the omission of important voice data, such as low-volume, short-syllable voice data containing wake words. This improves the effectiveness of accurately recognizing wake-up commands based on the acquired voice data.

[0133] The voice chip identifies wake-up words in the voice data through a first wake-up service. For example, the first wake-up service retrieves all specified wake-up words, or wake-up words specific to the standby state, by calling a wake-up word library. All specified wake-up words refer to words that can enable wake-up functionality both when the display device 200 is in standby and operating states, such as "hey" or "hi." Wake-up words specific to the standby state refer to words that can enable wake-up functionality when the display device 200 is in standby mode, such as "wake up." These standby-state wake-up words will not enable wake-up functionality when the display device 200 is in operating state; that is, the display device 200 in operating state will not respond to these standby-state wake-up words.

[0134] In this embodiment, echo cancellation technology can be used to further improve the accuracy of the voice chip in recognizing wake words. Specifically, when the wake-up service starts, a first audio recording thread and a second audio recording thread are created. The first audio recording thread is used to record the voice data collected by the microphone, and the second audio recording thread is used to record the audio data played by the display device 200, i.e., the echo signal. By comparing the voice data collected by the first audio recording thread and the echo signal collected by the second audio recording thread, the data that differs from the echo signal is extracted. This different data corresponds to voice data that may contain a wake word. Furthermore, by analyzing whether the different voice data contains a wake word, it is possible to identify whether the collected voice data contains a wake word. When the display device 200 is in standby mode, the audio playback module of the display device 200 used to play audio data is also in sleep mode, i.e., the echo signal collected by the second audio recording thread is empty. Therefore, the data that differs from the echo signal is the voice data collected by the first audio recording thread.

[0135] Furthermore, when the display device 200 is in standby mode, the voice chip can be configured not to use echo cancellation technology to recognize wake words. This improves the wake-up speed of the display device 200 in standby mode, resulting in a faster response to user-sent wake-up commands and enhanced user experience.

[0136] The voice chip compares keywords identified from the voice data with wake words in a retrieved wake word library. If a matching wake word exists, the keyword is considered a wake word, meaning the voice data contains one. If no matching wake word exists, the keyword is not considered a wake word, meaning the voice data does not contain one. Based on this wake word recognition process, if the voice chip detects a wake word in the voice data, it determines the voice data as a wake-up command and, in response, instructs the main chip to power on. If the voice chip does not detect a wake word, the voice data is invalid; the voice chip discards the voice data, remains in standby mode, and continues to collect and recognize the next voice data.

[0137] The voice chip responds to the wake-up command, instructing the main chip to power on and start up, so as to adjust each kernel module in the kernel layer to boot mode and adjust the user space to unfreeze mode. The boot mode of the kernel module refers to the kernel module powering on and starting up, and the unfreeze mode refers to the user space responding to the application's data read and write tasks.

[0138] The system notifies all kernel modules in the kernel layer to power on and start in a specified order, transitioning from hibernation to a boot state to wake up the kernel layer and enable its normal operation. Simultaneously, the user space is brought to a thawed state, allowing it to perform data read and write tasks, thus enabling the application layer to run normally. After all kernel modules and user space are successfully woken up, the system notifies the power hardware interface layer of the boot status (boot status), which records the boot reason and notifies the power management module of the boot event. The power management module then sends a boot status notification based on this event, restoring power to the kernel layer and application layer.

[0139] In this embodiment, the wake-up process of the display device 200 does not include the startup process of the display. That is, the display device 200 does not directly turn on the display in response to the wake word. The display remains in the off state to avoid turning on the display when it is not needed, thus generating additional power consumption.

[0140] S1302. After the main chip is powered on, the second wake-up service and the voice service in the voice application are executed through the main chip. The second wake-up service refers to recognizing and responding to the wake-up command sent by the user. The voice service refers to recognizing and responding to the voice command sent by the user. The voice command refers to voice data containing instruction information. The voice service also includes determining the display state of the display based on the category of the voice command. The display state is either on or off.

[0141] In this embodiment, when the main chip executes the voice service in response to a voice command, it further determines whether the display needs to be turned on based on the category of the voice command. Voice commands are divided into two categories. Voice commands of the first category require the display to be turned on; for example, a voice command instructing the playback of video data requires the display to be turned on and belongs to the first category. Voice commands of the second category do not require the display to be turned on; for example, a voice command instructing the playback of audio data does not require the display to be turned on and belongs to the second category. Therefore, the display device 200 accurately determines whether the display needs to be turned on by identifying the category corresponding to the voice command.

[0142] Furthermore, to ensure the accuracy of display control based on voice command categories, the voice command categories can be labeled, as can be referenced. Figure 15 The marking process shown is as follows:

[0143] S1501. Based on the indication information in the voice command, determine the category of the voice command, wherein the display is turned on in response to a voice command of the first category, and the display is turned off in response to a voice command of the second category.

[0144] S1502. Generate a first identifier based on the first type of voice command, and generate a second identifier based on the second type of voice command.

[0145] S1503. Based on the first identifier, turn on the display, or based on the second identifier, turn off the display.

[0146] Voice commands contain instruction information used to indicate specific actions and objects. For example, the voice data is "Play video 1". The main chip, through the voice service, can recognize that the voice data contains the instruction information "Play video 1", which indicates the action of "playing" and the object of "video 1". Based on the recognized instruction information, the main chip, through the voice service, can further determine the category corresponding to the voice command. For example, by comparing the keywords in the instruction information with category words in the category dictionary, the category corresponding to the voice command is determined. The category words in the category dictionary are designated words that can indicate categories, and each category word has a mapping relationship with the indicated category. For example, the category word "image" corresponds to the category "second category"; the category word "audio" corresponds to the category "second category"; and the category word "video" corresponds to the category "first category". The voice service, by comparing the keywords with the category words, determines the category word that matches the keyword, and further determines the corresponding category, i.e., the category corresponding to the voice command, based on the mapping relationship between the category word and the indicated category. For example, the keyword "video1" in the instruction message, by comparing various category words, determines that the matching category word is "video". Furthermore, based on the mapping relationship between "video" and "first category", the category corresponding to this voice command is determined to be "first category", meaning the monitor needs to be turned on. Similarly, the keyword "audio2" in the instruction message, by comparing various category words, determines that the matching category word is "audio". Furthermore, based on the mapping relationship between "audio" and "second category", the category corresponding to this voice command is determined to be "second category", meaning the monitor does not need to be turned on.

[0147] Different identifiers are generated based on the different categories of voice commands to distinguish between them. In this embodiment, a first identifier marks the first category, and a second identifier marks the second category. Specifically, the first and second identifiers can be carried in corresponding flag positions. By identifying the flag positions, the identifiers can be accurately identified, thereby determining the category of the voice command. In one implementation, the first and second identifiers are located in the same flag position, but their specific contents are different. Therefore, by identifying the specific identifier carried in the flag position, the category corresponding to the voice command can be accurately determined. In another implementation, the first and second identifiers are located in different flag positions. For example, the first identifier is located in the first flag position (screen-on flag position), and the second identifier is located in the second flag position (screen-off flag position). By identifying the flag position where an identifier exists, it is determined which identifier is carried. For example, if an identifier is identified in the first flag position, it is determined that the first identifier is carried; or, if an identifier is identified in the second flag position, it is determined that the second identifier is carried. Furthermore, the category corresponding to the voice command is determined based on the identifier. In this implementation, the specific contents of the first and second identifiers can be the same or different.

[0148] If the first identifier is recognized, the voice command can be determined to correspond to the first category, and the display will be turned on; if the second identifier is recognized, the voice command can be determined to correspond to the second category, and the display will not be turned on.

[0149] If the first identifier is recognized, you can refer to... Figure 16 The process shown further configures the window state, and the specific process is as follows:

[0150] S1601. Based on the first identifier, turn on the display and set the window to an active state. The active state means that the window is operable in response to a non-power-on command and displays the corresponding user interface.

[0151] S1602. Mark the voice application with a lock flag to indicate that the voice application is in running state and prevent the display device from being adjusted to the standby state.

[0152] Typically, voice commands for the display need to be enabled. After the display is turned on, the probability of the user interacting with the display device 200 again is relatively high; that is, the probability of the user sending commands to the display device 200 again is relatively high. Therefore, the display device 200 needs to keep the display on and remain responsive to any user commands.

[0153] Based on the second identifier, after the display device 200 turns on the monitor, it sets the window to an active state. In this active state, the window is operable, meaning the user can issue commands based on the user interface displayed within the window. For example, the user can send control commands containing arbitrary key values ​​through the control device 100, or send voice commands containing arbitrary keywords, to prevent the display device 200 from missing responses to user commands and improve the user's experience in controlling the display device 200.

[0154] To prevent the display device 200 from automatically entering standby mode, after the main chip powers on and starts the voice application, it requests a power lock for the voice application at the kernel level. This lock flag indicates that the voice application is running and power failure is prohibited. The lock flag of the voice application effectively prevents the display device 200 from entering standby mode. If the display device 200 needs to enter standby mode again, a standby command needs to be resent to actively instruct it to enter standby mode. Upon receiving this standby command, the lock flag of the voice application will be cleared, allowing the main chip to enter sleep mode.

[0155] If the second identifier is detected, you can refer to... Figure 17 The process shown further configures the window state, and the specific process is as follows:

[0156] S1701. Based on the second identifier, keep the display off and set the window to an inactive state, the inactive state meaning that the window is not operable and does not respond to the non-power-on command.

[0157] S1702. After waiting for a specified time, the display device is adjusted to the standby state, wherein the voice application does not have the lock icon.

[0158] Typically, voice commands that don't require turning on the display have a relatively short response time. For example, the voice command "Play audio 1" will cause the display device 200 to respond by simply playing the audio data corresponding to audio 1, without needing to turn on the display. Since the playback duration of audio 1 is usually short, the response time of the display device 200 is also relatively short. Furthermore, the probability of a user sending another command while the display is off is low, meaning the probability of the user interacting with the display device 200 again is low. Therefore, after responding to the second type of voice command, the display device 200 will be in an idle state with no tasks to execute. Although the display is off and does not consume power, the main chip is powered on and consuming power. In this state, the user may forget or unintentionally issue a standby command again, causing the main chip to remain powered on and continuously consume power. To avoid the power consumption generated by the main chip in this state and reduce the overall power consumption of the display device 200, the main chip can be configured to automatically enter the standby process described above after responding to a voice command.

[0159] Based on the first identifier, when the monitor is kept off, windows are simultaneously set to an inactive state, meaning they are unresponsive and will not respond to any non-power-on commands. For example, although the monitor is off, after the main chip powers on, it may generate a corresponding user interface by default, such as the main desktop. If the window were active, the user could issue control commands to the window to operate the user interface. Therefore, although the user cannot see changes to the user interface because the monitor is off, the background has already completed the response process for the control commands, resulting in resource waste. To avoid this problem, windows are set to an inactive state, such as graying out the window, making it unresponsive. In this case, even if the user sends a control command to the display device 200, such as sending the key value "menu" to the display device 200 via remote control, the display device 200 will not respond to that key value to generate the corresponding user interface. The display device 200 only turns on the monitor when the user sends a power-on command. For example, a user sends the key value "power on" to the display device 200 via remote control, and the display device 200 responds to the key value by turning on the monitor. Alternatively, the user sends the voice command "turn on the monitor" to the display device 200, and the display device 200 responds to the voice command by turning on the monitor. Furthermore, the display device 200 re-activates the window so that it can respond normally to various commands sent by the user after the monitor is turned on.

[0160] In order to enable the display device 200 to automatically enter the standby process after responding to the voice command, the voice application does not have a lock icon during the response process, that is, the voice application does not restrict the display device 200 from entering the standby process.

[0161] Furthermore, to prevent the main chip from repeatedly powering on and off in a short period of time, a waiting time, such as 10 seconds, is configured for the main chip to automatically enter standby mode. After responding to a voice command, the main chip waits for 10 seconds before automatically entering standby mode. During this waiting time, the display device 200 can receive power-on commands, new voice commands, etc. (all of which are commands that can wake up the main chip again, i.e., commands that cause the main chip to restart from a power outage). This prevents the main chip from responding to the above commands and restarting again in a short period of time after automatically entering standby mode and then powering off, thus protecting the main chip. It also effectively avoids the time consumed by the main chip restarting after receiving the above commands in a short period of time, thereby improving the response speed of the display device 200.

[0162] While the main chip is waiting to automatically enter standby mode and the display device 200 is turned on and maintaining its working state, the voice application will use echo cancellation technology to identify the user's voice command issued again. Since the display device 200 currently has a voice command being executed, i.e., audio data being played, echo cancellation technology can accurately extract the data that differs between the received voice data and the currently playing audio data (re-sampled signal). Based on this difference, the wake-up word and command information can be accurately identified, thus accurately responding to semantic commands. The specific implementation process of the echo cancellation technology can be referred to above and will not be repeated here.

[0163] Based on the above process, when the display device 200 is in standby mode, it can execute voice data acquisition service and first wake-up service through the voice chip. After recognizing the wake-up command sent by the user, it instructs the main chip to power on and start up, and the main chip continues to execute the second wake-up service and voice service in the voice application. Furthermore, the main chip identifies the category corresponding to the voice command through the voice service, and accurately controls the display to turn on or off based on the category of the voice command, thereby precisely controlling the power consumption after standby startup.

[0164] An example of the standby startup process of the aforementioned display device 200 can be provided for reference. Figures 18-23 The diagram illustrates the user's interaction with the display device 200 during standby startup. Figure 18 As shown, the display device 200 is in standby mode, meaning the monitor is off, the main chip is powered off, and the voice chip is powered on, performing the first wake-up service. The process by which the display device 200 enters standby mode can be found in the standby process and examples disclosed above, and will not be repeated here.

[0165] like Figure 19 As shown, in the voice chip, the voice data acquisition service is first activated. This service calls the microphone hardware interface to acquire voice data sent by the user, such as "wake up." Then, the first wake-up service is activated to identify the wake word in "wake up." By comparing keywords in the voice data with wake words in the wake word library, it can be determined that the voice data contains the wake word "wake up." Based on this wake word, the first wake-up service determines that the voice data is a wake-up command and, in response, instructs the main chip to power on and start.

[0166] The system notifies all kernel modules in the kernel layer to power on and start in a specified order, transitioning from hibernation to a boot state to wake up the kernel layer and enable its normal operation. Simultaneously, the user space is brought to a thawed state, allowing it to perform data read and write tasks, thus enabling the application layer to run normally. After all kernel modules and user space are successfully woken up, the system notifies the power hardware interface layer of the boot status (boot status), which records the boot reason and notifies the power management module of the boot event. The power management module then sends a boot status notification based on this event, restoring power to the kernel layer and application layer.

[0167] After the main chip powers on, it executes the second wake-up service and voice service in the voice application, while the voice chip continues to handle voice data acquisition. The voice chip continues to collect voice data sent by the user, such as "Play audio 1," and transmits this data directly to the main chip. The main chip then recognizes and responds to the voice command through the voice service. (See reference...) Figure 20 .

[0168] The voice application is launched, creating a first audio recording thread, the microphone's Audio Recoder, to capture voice data sent by the user, such as "Play Audio 1". A second audio recording thread is created, the audio Recoder for the re-acquired signal, to capture audio data played by the display device 200. Echo cancellation technology is employed to extract the different data, "Play Audio 1", by comparing the voice data "Play Audio 1" with the re-acquired signal, and further identify the instruction information "Play Audio 1" within "Play Audio 1".

[0169] like Figure 21 As shown, the voice application determines the category of the voice command based on the recognized instruction information and generates a corresponding identifier. In this example, based on the instruction information "Play audio 1", the voice application determines that the voice command belongs to the second category, meaning that the display does not need to be turned on. Therefore, it carries a second identifier in the second flag bit (screen off flag bit) to identify that the voice command belongs to the second category. The voice application sends the corresponding identifier to the window management service and the power management service. The window service sets the window to an inactive state, i.e., an inoperable state, based on the second identifier in the screen off flag bit. The power management service does not supply power to the display, such as... Figure 22 As shown, the display remains off. Simultaneously, the voice application does not request a power lock at the kernel level; that is, the voice application does not carry a lock flag. Therefore, the display device 200 will automatically enter standby mode after a specified time, such as 10 seconds.

[0170] In another example, unlike the previous one, the voice command is "Play Video 1." This voice command contains the instruction "Play Video 1." The voice application can determine that this voice command belongs to the first category, meaning the display needs to be turned on. It then carries a first identifier in the first flag (screen-on flag) to indicate that the voice command belongs to the first category. The voice application sends the corresponding identifier to the window management service and the power management service. Based on the first identifier in the screen-on flag, the window service recognizes that the display needs to be turned on, sets the window to an active state (operable state), and allows it to respond to power-on commands and various non-power-on commands. The power management service supplies power to the display, such as... Figure 23 As shown, the monitor is on, displaying the user interface corresponding to "Video 1". Simultaneously, the voice application requests a power lock at the kernel level, meaning the voice application carries a lock flag. This prevents the display device 200 from automatically entering standby mode.

[0171] Based on the above process, when the display device 200 is in standby mode, it can execute voice data acquisition service and first wake-up service through the voice chip. After recognizing the wake-up command sent by the user, it instructs the main chip to power on and start up, and the main chip continues to execute the second wake-up service and voice service in the voice application. Furthermore, the main chip identifies the category corresponding to the voice command through the voice service, and accurately controls the display to turn on or off based on the category of the voice command, thereby precisely controlling the power consumption after standby startup.

[0172] Similar parts between the embodiments provided in this application can be referred to mutually. The specific implementation methods provided above are only a few examples under the overall concept of this application and do not constitute a limitation on the scope of protection of this application. For those skilled in the art, any other implementation methods extended from the solution of this application without creative effort shall fall within the scope of protection of this application.

Claims

1. A display device, characterized by comprising: include: The monitor is configured to be on for displaying the user interface within a window; The controller is configured as follows: Receive standby command; In response to the standby command, the display is turned off; The main chip is powered off while the voice chip remains powered on to put the display device into a standby state. In this standby state, the voice chip performs a first wake-up service, which involves recognizing a wake-up command sent by the user and, in response to the wake-up command, instructing the main chip to power on and start. The wake-up command is voice data containing a wake-up word. After the main chip powers on and starts, it keeps the display off, launches a voice application, and determines the display state based on the type of the recognized voice command. The voice application supports a voice service, which is used to recognize and respond to the voice commands sent by the user. If the voice command is identified as belonging to the first category, the display is turned on and the window is set to an active state, meaning that the window is operable to display the corresponding user interface in response to a non-power-on command; and the voice application is marked with a lock flag to indicate that the voice application is in a running state and to prevent the display device from being adjusted to the standby state. If the voice command is identified as belonging to the second category, the display remains off, and the window is set to an inactive state, meaning that the window is not operable and does not respond to the non-power-on command; and after waiting for a specified time, the display device is adjusted to the standby state, wherein the voice application does not have the lock icon.

2. The display device according to claim 1, characterized in that, The controller powers off the main chip while keeping the voice chip powered on, thus putting the display device into standby mode, and is configured as follows: Determine whether a target application with the lock icon exists, the lock icon being used to indicate that the corresponding application is in the running state; If the target application exists, wait for the target application to finish running, and after the target application finishes running, remove the lock flag and power off the main chip; If the target application does not exist, the main chip is powered off.

3. The display device according to claim 2, characterized in that, The controller is configured to power off the main chip and is set to: Adjust each kernel module in the kernel layer to a hibernation state, where the hibernation state of the kernel module means that the kernel module is powered off; Adjust the user space to a frozen state, whereby the user space is not responding to the application's data read / write tasks; The main chip is put into a sleep state, which means that the main chip is powered off.

4. A display device, characterized in that, include: The display is configured to be off in standby mode, wherein the main chip of the display device is powered off and the voice chip is powered on in standby mode; The controller, in the standby state, is configured as follows: The first wake-up service is executed through the voice chip. The first wake-up service refers to recognizing the wake-up command sent by the user and responding to the wake-up command to instruct the main chip to power on and start the voice application, and keeping the display off. The wake-up command refers to voice data containing a wake-up word. The voice application supports voice services. After the voice application is launched, the main chip executes the voice service to recognize and respond to the voice commands sent by the user. The voice commands refer to voice data containing instruction information. The voice service is also used to determine the display status of the display based on the category of the voice command, wherein the display status is either on or off. If the voice command is identified as belonging to the first category, the display is turned on and the window is set to an active state, meaning that the window is operable to display the corresponding user interface in response to a non-power-on command; and the voice application is marked with a lock flag to indicate that the voice application is in a running state and to prevent the display device from being adjusted to the standby state. If the voice command is identified as belonging to the second category, the display remains off, and the window is set to an inactive state, meaning that the window is not operable and does not respond to the non-power-on command; and after waiting for a specified time, the display device is adjusted to the standby state, wherein the voice application does not have the lock icon.

5. The display device according to claim 4, characterized in that, The controller executes the first wake-up service via the voice chip and is configured as follows: Receive voice data sent by the user; Identify whether the voice data contains the wake word; If the wake word is included, the voice data is determined to be the wake-up command, and in response to the wake-up command, the main chip is instructed to power on and start up. If the wake word is not included, the voice data is discarded.

6. The display device according to claim 4, characterized in that, The controller executes the first wake-up service via the voice chip and is configured as follows: In response to the wake-up command, the main chip is instructed to power on and start up, so as to adjust each kernel module in the kernel layer to boot mode and adjust the user space to unfreeze mode. The boot mode of the kernel module refers to the kernel module powering on and starting up, and the unfreeze mode refers to the user space responding to the data read and write tasks of the application.

7. The display device according to claim 4, characterized in that, After the main chip powers on, the controller executes the voice service through the main chip and is configured as follows: Based on the indication information in the voice command, the category of the voice command is determined, wherein the display is turned on in response to a voice command of the first category, and the display is turned off in response to a voice command of the second category; A first identifier is generated based on the first category of voice commands, and a second identifier is generated based on the second category of voice commands; The display is turned on based on the first identifier, or the display is turned off based on the second identifier.

8. A standby method, characterized in that, Applied to a display device, wherein the display of the display device is configured to be on for displaying a user interface within a window, the method includes: Receive standby command; In response to the standby command, the display is turned off; The main chip is powered off while the voice chip remains powered on to put the display device into a standby state. In this standby state, the voice chip performs a first wake-up service, which involves recognizing a wake-up command sent by the user and, in response to the wake-up command, instructing the main chip to power on and start. The wake-up command is voice data containing a wake-up word. After the main chip powers on and starts, it keeps the display off, launches a voice application, and determines the display state based on the type of the recognized voice command. The voice application supports a voice service, which is used to recognize and respond to the voice commands sent by the user. If the voice command is identified as belonging to the first category, the display is turned on and the window is set to an active state, meaning that the window is operable to display the corresponding user interface in response to a non-power-on command; and the voice application is marked with a lock flag to indicate that the voice application is in a running state and to prevent the display device from being adjusted to the standby state. If the voice command is identified as belonging to the second category, the display remains off, and the window is set to an inactive state, meaning that the window is not operable and does not respond to the non-power-on command; and after waiting for a specified time, the display device is adjusted to the standby state, wherein the voice application does not have the lock icon.

9. A far-field voice control method, characterized in that, Applied to a display device, wherein the display of the display device is configured to be off in a standby state, wherein in the standby state, the main chip of the display device is powered off and the voice chip is powered on, the method includes: The first wake-up service is executed through the voice chip. The first wake-up service refers to recognizing the wake-up command sent by the user and responding to the wake-up command to instruct the main chip to power on and start the voice application, and keeping the display off. The wake-up command refers to voice data containing a wake-up word. The voice application supports voice services. After the voice application is launched, the main chip executes the voice service to recognize and respond to the voice commands sent by the user. The voice commands refer to voice data containing instruction information. The voice service is also used to determine the display status of the display based on the category of the voice command, wherein the display status is either on or off. If the voice command is identified as belonging to the first category, the display is turned on and the window is set to an active state, meaning that the window is operable to display the corresponding user interface in response to a non-power-on command; and the voice application is marked with a lock flag to indicate that the voice application is in a running state and to prevent the display device from being adjusted to the standby state. If the voice command is identified as belonging to the second category, the display remains off, and the window is set to an inactive state, meaning that the window is not operable and does not respond to the non-power-on command; and after waiting for a specified time, the display device is adjusted to the standby state, wherein the voice application does not have the lock icon.

Images