A method for prompting wake-up response and a display device
By introducing a subprocessor in the smart TV to determine whether the voice data is a wake-up word and triggering the main processor to turn on, the problem of long wake-up process time and silent information in the prior art is solved, and faster response and better user experience are achieved.
Patent Information
- Application Number
- CN202211447616.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-03-16
- Publication Date
- 2025-05-27
- Estimated Expiration
- 2041-03-16
AI Technical Summary
During the wake-up process of existing smart TVs, the low-power small core recognizes the wake-up word and notifies the main chip to be turned on, resulting in a long process time without any prompt information, resulting in a poor user experience.
It provides a display device, including a main processor, a subprocessor and an indicator. The subprocessor receives voice data input by the user and determines whether it is a wake-up word. If so, it triggers the main processor to enter the on state and controls the indicator to turn on, providing a response prompt.
The subprocessor determines whether the voice data is a wake-up word in advance and triggers the main processor to turn on, shortening the time of the wake-up process and providing response prompts through indicators, improving the user experience.
Smart Images

Figure CN115775560B_ABST
Abstract
Description
[0001] This application is a divisional application of a domestic application (application number: 202110281719.7, application date: 2021-03-16, invention name: A wake-up response prompt method and display device). Technical Field
[0002] The present application relates to the field of sound processing technology, and in particular to a wake-up response prompt method and display device. Background Art
[0003] With the continuous development of voice recognition technology and smart home, voice recognition technology is widely used. When a smart TV is in standby mode, users can use voice recognition technology to wake up the smart TV, that is, wake up the smart TV through far-field voice commands, so that the smart TV enters the power-on state from the standby state.
[0004] The traditional smart TV wake-up process is: first, the user's voice is recognized for the wake-up word, and then the wake-up word is input into the wake-up model for wake-up confirmation. In order to reduce power consumption, the wake-up word recognition is usually processed by a small core with low power consumption. The wake-up confirmation process through the wake-up model is completed by the main chip. After the main chip confirms that the wake-up is successful, it controls the screen to light up and enter the power-on state. If it is a false wake-up, the smart TV will enter the standby state again.
[0005] However, after the low-power small core recognizes the wake-up word, it notifies the main chip to turn on and confirm the user's voice wake-up. After the confirmation is successful, the display will light up. This process takes a long time and there is no prompt information during the whole process. As a result, after the user inputs the voice, it takes a long time to get a response, resulting in a poor user experience. Summary of the invention
[0006] The present application provides a sound output method and a display device for a display device, which are used to solve the problem that if the existing display device is not connected to a dedicated speaker that can filter bass audio data, it cannot achieve the purpose of outputting bass alone, resulting in a poor user audio-visual experience.
[0007] In a first aspect, this embodiment provides a display device, including:
[0008] Main processor;
[0009] an indicator, used to indicate the startup state of the main processor;
[0010] Subprocessors that perform:
[0011] Receiving voice data input by a user, and when the voice data is a wake-up word, triggering the main processor to enter an on state, and controlling the indicator to turn on;
[0012] When the voice data is not a wake-up word, the main processor is not triggered to enter the on state, and the indicator is not controlled to turn on.
[0013] In a second aspect, this embodiment provides a processor, including:
[0014] Main processor;
[0015] Subprocessors that perform:
[0016] Receiving voice data input by a user, and when the voice data is a wake-up word, triggering the main processor to enter an on state, and controlling an indicator to turn on, the indicator being used to prompt the on state of the main processor;
[0017] When the voice data is not a wake-up word, the main processor is not triggered to enter the on state, and the indicator is not controlled to turn on.
[0018] In a third aspect, the present embodiment provides a method for prompting a wake-up response, the method being applied to a sub-processor of a display device, the display device further comprising a main processor and an indicator, wherein the indicator is used to indicate a power-on state of the main processor, the method comprising:
[0019] Receiving voice data input by a user, and when the voice data is a wake-up word, triggering the main processor to enter an on state, and controlling the indicator to turn on;
[0020] When the voice data is not a wake-up word, the main processor is not triggered to enter the on state, and the indicator is not controlled to turn on.
[0021] In a fourth aspect, the present embodiment provides a method for prompting a wake-up response, the method being applied to a main processor of a display device, the display device further comprising a sub-processor and an indicator, wherein the indicator is used to indicate a power-on state of the main processor, the method comprising:
[0022] Receive a trigger instruction sent by the sub-processor and enter an on state, wherein the trigger instruction is generated by the sub-processor after receiving voice data input by the user and determining that the voice data is a wake-up word, and the sub-processor controls the indicator to turn on;
[0023] The voice data is received, and whether the voice data is a target wake-up word is determined according to a wake-up model. When the voice data is a target wake-up word, a display screen is controlled to light up.
[0024] The display device provided in the embodiment of the present application includes a main processor, a sub-processor and an indicator. The sub-processor first receives the voice data input by the user. When the voice data is a wake-up word, the main processor is triggered to enter the on state and the indicator is controlled to turn on. When the voice data is not a wake-up word, the main processor is not triggered to enter the on state, and the indicator is not controlled to turn on. The prompt method of the embodiment of the present application can determine whether the voice data is a wake-up word through the sub-processor after receiving the voice data. If it is a wake-up word, the controller is turned on and a response is made. Compared with the solution of confirming the wake-up and then responding in the prior art, this process takes less time, so the user does not need to wait for a long time to get a response, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0026] Figure 1 shows a usage scenario of a display device according to some embodiments;
[0027] Figure 2 shows a hardware configuration block diagram of a control device 100 according to some embodiments;
[0028] Figure 3 shows a hardware configuration block diagram of a display device 200 according to some embodiments;
[0029] Figure 4 shows a software configuration diagram in a display device 200 according to some embodiments;
[0030] Figure 5 shows an icon control interface display diagram of an application in a display device 200 according to some embodiments;
[0031] Figure 6 A schematic diagram of a hardware configuration of a display device 200 according to some embodiments is shown;
[0032] Figure 7 shows a prompting method signaling diagram for a wake-up response according to some embodiments;
[0033] Figure 8 A signaling diagram of another prompting method for a wake-up response according to some embodiments is shown. DETAILED DESCRIPTION
[0034] In order to make the purpose and implementation method of the present application clearer, the exemplary implementation method of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.
[0035] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.
[0036] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.
[0037] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.
[0038] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.
[0039] Figure 1 Schematic diagram of a usage scenario of a display device according to an embodiment. Figure 1 As shown, the display device 200 also performs data communication with the server 400 , and the user can operate the display device 200 through the smart device 300 or the control apparatus 100 .
[0040] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and at least one of other short-range communication methods, to control the display device 200 wirelessly or wired. The user may control the display device 200 by inputting user commands through at least one of buttons on the remote controller, voice input, and control panel input.
[0041] In some embodiments, the smart device 300 may include any one of a mobile terminal 300A, a tablet computer, a computer, a laptop computer, an AR / VR device, etc.
[0042] In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 may be controlled using an application running on the smart device.
[0043] In some embodiments, the smart device 300 and the display device may also be used to communicate data.
[0044] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the display device 200, or the user's voice command control can be received through a voice control device set outside the display device 200.
[0045] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be one cluster or multiple clusters, and may include one or more types of servers.
[0046] In some embodiments, the software steps executed by a step execution subject can be migrated to another step execution subject in data communication with it as needed for execution. Exemplarily, the software steps executed by a server can be migrated to a display device in data communication with it as needed for execution, and vice versa.
[0047] Figure 2 Schematically shows a block diagram of a configuration of the control device 100 according to an exemplary embodiment. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive input operation instructions from the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200.
[0048] In some embodiments, the communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module.
[0049] In some embodiments, the user input / output interface 140 includes at least one of a microphone, a touch pad, a sensor, a button, or alternative modules.
[0050] Figure 3 A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is shown.
[0051] In some embodiments, the display apparatus 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.
[0052] In some embodiments, the controller includes a central processing unit, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output.
[0053] In some embodiments, the display 260 includes a display screen component for presenting images, and a driving component for driving image display, for receiving image signals output from a controller, and for displaying video content, image content, and a menu control interface component and a user control UI interface.
[0054] In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
[0055] In some embodiments, the tuner-demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
[0056] In some embodiments, the communicator 220 is a component for communicating with an external device or server according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.
[0057] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.
[0058] In some embodiments, the external device interface 240 may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by the above multiple interfaces.
[0059] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0060] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example: In response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 can perform operations related to the object selected by the user command.
[0061] In some embodiments, the object may be any one of the selectable objects, such as a hyperlink, an icon or other operable controls. Operations related to the selected object include: displaying a page, document, image, etc. connected to the hyperlink, or executing a program corresponding to the icon.
[0062] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM Random Access Memory (RAM), ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.
[0063] CPU processor. Used to execute operating system and application instructions stored in the memory, and to execute various applications, data and content according to various interactive instructions received from external input, so as to finally display and play various audio and video content. CPU processor may include multiple processors. For example, it includes a main processor and one or more sub-processors.
[0064] In some embodiments, the graphics processor is used to generate various graphic objects, such as at least one of icons, operation menus, and user input command display graphics. The graphics processor includes an operator, which performs operations by receiving various interactive instructions input by the user and displays various objects according to display attributes; and a renderer, which renders various objects obtained based on the operator, and the rendered objects are used to be displayed on the display.
[0065] In some embodiments, the video processor is used to receive an external video signal and perform at least one of the following video processing operations, such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis, according to a standard codec protocol of the input signal, to obtain a signal that can be directly displayed or played on the display device 200.
[0066] In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, and a display formatting module. The demultiplexing module is used to demultiplex the input audio and video data stream. The video decoding module is used to process the demultiplexed video signal, including decoding and scaling. The image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator according to the user input or itself with the scaled video image to generate an image signal for display. The frame rate conversion module is used to convert the input video frame rate. The display formatting module is used to receive the video output signal after frame rate conversion and change the signal to conform to the display format signal, such as outputting an RGB data signal.
[0067] In some embodiments, the audio processor is used to receive an external audio signal, perform decompression and decoding according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in a speaker.
[0068] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.
[0069] In some embodiments, "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. A common form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, or control displayed on a display screen of an electronic device, wherein a control may include at least one of icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements.
[0070] In some embodiments, the user interface 280 is an interface that can be used to receive control input (such as a physical button on the display device body, or other interfaces).
[0071] In some embodiments, the system of the display device may include a kernel, a command parser (shell), a file system, and an application. The kernel, shell, and file system together form the basic operating system structure, which allows users to manage files, run programs, and use the system. After power-on, the kernel starts, activates the kernel space, abstracts the hardware, initializes hardware parameters, etc., runs and maintains virtual memory, schedulers, signals, and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. After startup, the application is compiled into machine code to form a process.
[0072] See also Figure 4 In some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.
[0073] In some embodiments, at least one application is running in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. provided by the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.
[0074] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.
[0075] like Figure 4As shown, in the embodiment of the present application, the application framework layer includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager (ActivityManager) is used to interact with all activities running in the system; a location manager (Location Manager) is used to provide system services or applications with access to system location services; a package manager (Package Manager) is used to retrieve various information related to the application package currently installed on the device; a notification manager (NotificationManager) is used to control the display and clearing of notification messages; a window manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers, and desktop components on the user interface.
[0076] In some embodiments, the activity manager is used to manage the life cycle of each application and the common navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes (for example, reducing the display window, shaking the display, distorting the display, etc.).
[0077] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.
[0078] In some embodiments, the kernel layer is a layer between hardware and software. Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
[0079] In some embodiments, after the display device is started, the interface of the preset video-on-demand program can be directly entered. The interface of the video-on-demand program can be as follows: Figure 5 As shown in , at least a navigation bar 510 and a content display area located below the navigation bar 510 are included, and the content displayed in the content display area changes with the change of the selected control in the navigation bar. The program in the application layer can be integrated into the video-on-demand program and displayed through a control in the navigation bar, or further displayed after the application control in the navigation bar is selected.
[0080] In some embodiments, after the display device is started, it can directly enter the display interface of the last selected signal source, or the signal source selection interface, where the signal source can be a preset video on demand program, or at least one of an HDMI interface, a live TV interface, etc. After the user selects a different signal source, the display can display the content obtained from different signal sources.
[0081] With the continuous development of voice recognition technology and smart home, the requirements for user experience in human-computer interaction are getting higher and higher. The distance of human-computer voice dialogue is no longer limited to the near field, and far-field voice recognition is becoming more and more popular. One of the most widely used functions of far-field voice is the wake-up of display devices. When the display device is in standby mode, the display device can be awakened by a far-field voice command, so that the display device can enter the power-on state from the standby state.
[0082] The wake-up process of the display device is: first recognize the wake-up word of the user's voice, and then input the wake-up word into the wake-up model for confirmation. At present, the standby wake-up of the display device relies on the display device main chip to recognize the wake-up word. However, the main chip has high computing power, and computing power and power consumption are strongly related. Therefore, if the main chip is used to recognize the wake-up word before the actual wake-up, it will generate a large power consumption during the wake-up stage.
[0083] In order to solve the above problems, a low-power small core can be used to first recognize the wake-up word. After the small core successfully recognizes the wake-up word, the wake-up word is input into the main chip for confirmation of the wake-up model. After the main chip confirms that the wake-up is successful, the control screen lights up and enters the power-on state. If it is a false wake-up, the display device will enter the standby state again.
[0084] However, after the small core recognizes the wake-up word, it notifies the main chip to turn on the main chip, and then the user's voice wake-up confirmation can be performed. After the wake-up confirmation is successful, the display will light up. The overall process takes a long time, and there is no prompt information during the whole process. As a result, after the user inputs the voice, it takes a long time to get a response, resulting in a poor user experience.
[0085] In order to solve the above problems, the present application provides a display device such as Figure 6 The hardware configuration diagram of the display device in the embodiment is shown. When the user tries to wake up the display device in the embodiment of the present application, after inputting the voice data, the system converts the voice data into voice text. If the voice text is a wake-up word, a response can be obtained without waiting for a long time.
[0086] The display device 200 includes a sound collector 230A for collecting voice data input by a user. The sound collector 230A further includes a signal receiving circuit, a signal processing circuit, and a signal output circuit. A voice recognition module may be provided between the sound collector and the processor 250A for converting the voice data input by the user into voice text.
[0087] The display device also includes a processor 250A and an indicator 290, and the processor 250A includes a main processor 250A-1 and a sub-processor 250A-2. The main processor is used to confirm the wake-up word using the wake-up model, and the sub-processor is used to determine whether the voice data voice text input by the user is a wake-up word. The indicator is used to indicate the current state of the main processor, and the current state includes a sleep state and an on state. Here, if the indicator is turned on, it indicates that the main processor is in an on state. On the contrary, if the indicator is turned off, it indicates that the main processor is in a closed sleep state. It can also be that if the indicator flashes, it indicates that the main processor is in an on state. If the indicator does not flash and is only turned on, it indicates that the main processor is in a sleep state. The embodiment of the present application only requires the indicator to have two different states that can be clearly distinguished by the human eye, which are used to indicate the sleep state and the on state of the main processor respectively. The specific state to indicate is not limited by this application.
[0088] In some embodiments, the computing power and power consumption of the processor are strongly correlated. The sub-processor is only used to recognize the wake-up word, so the computing power requirement is low and the power consumption is also low. The main processor needs to use a larger wake-up model to confirm the wake-up of the voice data, so the computing power requirement is high and the power consumption is also high. Therefore, the main processor can be a SOC chip (System-on-a-Chip), and the sub-processor can be a DSP (Digital Signal Processing) chip or an ARM CORTEX-M4 (an embedded processor developed by the British ARM company).
[0089] In the embodiment of the present application, the sub-processor may be integrated on the main processor or may be separated from the main processor, which is not limited in the embodiment of the present application.
[0090] In some embodiments, the initial state of the display device is that the main processor is in a dormant state. The low-power sub-processor can be kept turned on. After receiving the voice text, the sub-processor determines whether the text message voice text is a wake-up word. If the text message voice text is a wake-up word, the main processor is triggered to enter the on state from the dormant state, and the control indicator indicates that the current state of the main processor is the on state, and the user is prompted by the indicator that the wake-up behavior is valid. The display device of this embodiment can respond without waiting for the main processor to determine whether the text message is the target wake-up word, and the user waits for a response for a shorter time, thereby improving the user experience.
[0091] In addition, when the main processor enters the power-on state from the sleep state, it does not control the display screen to light up. It needs further wake-up confirmation to control the display screen to light up.
[0092] In some embodiments, if the voice text is not a wake-up word, the main processor is not triggered to enter the on state from the sleep state, and the control indicator still indicates that the current state of the main processor is the sleep state. The user can understand through the indicator that the current wake-up behavior is invalid.
[0093] In some embodiments, the indicator may be a common LED light, and the action of indicating that the main processor is turned on is that the LED lights up. The indicator may also be a marquee, and the action of indicating that the main processor is turned on is that the marquee flashes.
[0094] Exemplarily, the sub-processor receives the voice text "Hello, Hisense", and determines whether the voice text "Hello, Hisense" is a wake-up word. If the voice text "Hello, Hisense" is a wake-up word, the main processor is triggered to enter the on state from the sleep state, and the LED light is controlled to light up. If the voice text "Hello, Hisense" is not a wake-up word, the main processor is not triggered to enter the on state from the sleep state, and the main processor remains in the sleep state. At the same time, the LED light is not controlled to light up, and the LED light remains off. Therefore, the user can quickly understand whether the wake-up action is effective through the status of the LED light.
[0095] In some embodiments, when the voice text is a wake-up word, after the main processor is triggered to enter the power-on state from the sleep state, the main processor receives the voice text from the sub-processor and inputs the voice text into the wake-up model. The wake-up model determines whether the voice text is the target wake-up word. If the voice text is the target wake-up word, the display screen is controlled to light up, and the home page can be displayed after lighting up. Among them, the wake-up model can be a pre-trained neural network-based speech recognition model.
[0096] In some embodiments, if the voice text is not the target wake-up word, the display screen is not controlled to light up, the main processor re-enters the sleep state from the on state, and the main processor controls the indicator to indicate that the current state of the main processor is the sleep state.
[0097] Exemplarily, the voice text "Hello, Hisense" is sent to the main processor, and the main processor determines whether the voice text "Hello, Hisense" is the target wake-up word according to the wake-up model. If the voice text "Hello, Hisense" is the target wake-up word, the display screen is controlled to light up. At the same time, the LED can be controlled to turn off, or the LED can be controlled to remain on. If the voice text "Hello, Hisense" is not the target wake-up word, the display screen is not controlled to light up, and the LED is controlled to turn off. The user can understand from the prompt that the wake-up action is invalid. By turning off the LED to feedback to the user that it is a false wake-up, the impact on the user is also smaller than turning off the screen after lighting up the screen.
[0098] The present application embodiment provides a method for prompting a wake-up response, such as Figure 7 The signaling diagram of the wake-up response prompting method shown in the figure, the method comprises the following steps:
[0099] Step 1: The sub-processor receives voice text, and when the voice text is a wake-up word, sends a trigger instruction to the main processor to trigger the main processor to enter the on state from the sleep state, and sends a control instruction to the indicator to control the indicator to indicate that the current state of the main processor is the on state.
[0100] Step 2: When the voice text is not a wake-up word, no trigger instruction is sent to the main processor, and no control instruction is sent to the indicator. Then the main processor is not triggered to enter the on state, and the indicator still indicates that the current state of the main processor is the sleep state.
[0101] In the above method embodiment, after the user inputs voice data, a response can be made without waiting for the main processor to determine whether the voice text corresponding to the voice data is the target wake-up word. The user waits for a response for a shorter time, thereby improving the user experience.
[0102] Based on the above method embodiment, the present application embodiment provides another method for prompting a wake-up response, such as Figure 8 The signaling diagram of the wake-up response prompting method shown in the figure, the method comprises the following steps:
[0103] Step 1: The sub-processor receives voice text, and when the voice text is a wake-up word, sends a trigger instruction to the main processor to trigger the main processor to enter the on state from the sleep state, and sends a control instruction to the indicator to control the indicator to indicate that the current state of the main processor is the on state.
[0104] Step 2: The sub-processor sends the voice text to the main processor. After receiving the voice text, the main processor determines whether the voice text is the target wake-up word according to the wake-up model. If the voice text is the target wake-up word, the display screen is controlled to light up. If the voice text is not the target wake-up word, the display screen is not controlled to light up. The main processor returns to the sleep state from the on state, and the control indicator indicates that the current state of the main processor is the sleep state.
[0105] In the above method embodiment, after determining that the voice text is a wake-up word, the main processor is triggered to enter the on state from the sleep state, and the control indicator indicates that the current state of the main processor is the on state. The main processor further determines whether the voice text is the target wake-up word, that is, whether the wake-up is successful, rather than a false wake-up. If the wake-up is successful, the display screen is controlled to light up. If it is a false wake-up, the display screen is not controlled to light up. Therefore, the above method embodiment can not only shorten the time the user waits for a response, but also, in the case of a false wake-up, through the different states indicated by the indicator, effectively prompt the user that the wake-up action is a false wake-up.
[0106] The same or similar contents between the various embodiments of the present application can be referenced to each other, and the relevant embodiments will not be described in detail.
[0107] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
[0108] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.
Claims
1. A display device, It is characterized in that include: monitor; A main processor, used to control the display screen to be on or off, wherein the main processor can be in one of a dormant state and an on state; an indicator, the indicator being able to present a first state or a second state, for indicating whether the main processor is currently in an on state or a dormant state; A sound collector, used to receive voice data input by the user; Subprocessors that perform: When the main processor is in a sleep state and the display is in a black screen state, in response to received voice data, when the voice data contains a wake-up word, triggering the main processor to enter a power-on state from the sleep state, and controlling the indicator to present a first state, while the display remains in a black screen state; After triggering the main processor to enter the on state from the sleep state, the main processor is used to execute: Determine whether the voice data contains the target wake-up word according to the wake-up model, and if so, control the display screen to light up.
2. The display device according to claim 1, It is characterized in that The determining, according to the wake-up model, whether the voice data contains a target wake-up word further includes: If not, the display is kept black, and the indicator is controlled to switch from the first state to the second state to indicate that the current state of the main processor returns to the sleep state.
3. The display device according to claim 1, It is characterized in that One end of the sub-processor is connected to the sound collector for communication, and the other end of the sub-processor is connected to the main processor for communication, wherein the sub-processor is always in an on state.
4. A display device, It is characterized in that include: monitor; A main processor, used to control the display screen to light up or go dark; An indicator, the indicator can present a first state or a second state, and is used to indicate whether the main processor is started and running; A sound collector, used to receive voice data input by the user; A sub-processor, one end of which is communicatively connected to the sound collector, and the other end of which is communicatively connected to the main processor, for executing: When the display device is in a standby state, in response to received voice data, determining whether the voice data contains a wake-up word, wherein when the display device is in a standby state, the main processor is in a dormant state, the display screen is black, and the indicator is in a second state; If the wake-up word is included, triggering the main processor to start running, so that the main processor determines for the second time whether the wake-up word is the target wake-up word; Among them, after the main processor starts running, it controls the indicator to present a first state and the display to remain in a black screen; until the main processor determines that the wake-up word is the target wake-up word, it controls the display to light up the screen.
5. The display device according to claim 4, It is characterized in that When the display device executes the process of including the wake-up word, triggering the main processor to start running, so that the main processor secondarily determines whether the wake-up word is a target wake-up word, specifically including: When the main processor starts running, the indicator is controlled to present a first state, and the display remains black; If the main processor determines that the wake-up word is the target wake-up word, controlling the display to light up the screen; If the main processor determines that the wake-up word is not the target wake-up word, the main processor switches back to the sleep mode, controls the indicator to be in the second state, and keeps the display black.
6. The display device according to claim 4, It is characterized in that The sub-processor is always in an on state when the display device is in a standby state.
7. A method for prompting a wake-up response, the method being applied to a main processor of a display device, It is characterized in that The display device further includes a display, a sub-processor, an indicator, and a sound collector, wherein the indicator can present a first state or a second state, for indicating whether the main processor is currently in an on state or a dormant state, and the method includes: receiving a trigger instruction sent by the sub-processor, entering the on state from the sleep state, while keeping the display screen black, wherein the trigger instruction is generated by the sub-processor after receiving the voice data input by the user and determining that the voice data contains a wake-up word, and at the same time, the sub-processor controls the indicator to present a first state to indicate that the current state of the main processor is the on state; receiving the voice data, determining whether the voice data includes a target wake-up word according to a wake-up model, and controlling a display screen to light up when the voice data includes the target wake-up word, and controlling the indicator to present a second state; When the voice data does not contain the target wake-up word, the indicator is controlled to be off to indicate that the current state of the main processor is a sleep state, while keeping the display screen black.
Citation Information
Patent Citations
Methods and apparatus for self-diagnosing electronic price labels
CA2323285A1
Voice wake-up method and electronic equipment
CN109979438A