A display device, a control device, and a device wake-up method.

Abstract

This application provides a display device, a control device, and a device wake-up method. The method responds to a ranging command input by the control device, sends a feedback signal to the control device, receives distance parameters from the control device, determines the amplitude of an audio array based on the distance parameters, and adjusts the configuration parameters of a sound acquisition unit based on the audio array amplitude. When the display device is in standby mode, it acquires wake-up audio data, performs wake-up voice recognition on the wake-up audio data, and wakes up the display device. This application obtains the distance parameters between the user and the display device through the control device and dynamically adjusts the amplitude of the audio array of the sound acquisition unit based on the distance parameters, improving the sound acquisition unit's sound reception effect at different distances, thereby improving the accuracy of voice wake-up of the display device.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device, a control device, and a device wake-up method. Background Technology

[0002] When the display device does not receive control commands for a period of time, it will enter standby mode to save power. In standby mode, the user can wake up the display device by speaking a wake-up word. The display device will acquire the user's wake-up word audio through the microphone array and perform wake-up word recognition. If the recognition is successful, the display device will wake up, switching from standby mode to working mode.

[0003] Users can speak the wake word from anywhere within the area where the display device is located, so the distance between the sound source and the microphone array is not fixed. When the user is far from the display device, if the microphone array has a low amplitude, the wake word audio received by the display device may be unclear, thus affecting the voice wake-up effect of the display device. Summary of the Invention

[0004] This application provides a display device, a control device, and a device wake-up method to solve the problem of unclear wake-up audio data caused by the variable distance between the user and the display device.

[0005] In a first aspect, some embodiments of this application provide a display device, including a display, a sound acquisition unit, and a controller, wherein the display is configured to display a user interface, the sound acquisition unit is configured to acquire audio data, and the controller is configured to:

[0006] In response to a ranging command input by the user through the control device, a feedback signal is sent to the control device;

[0007] The distance parameter is received from the control device. The distance parameter is calculated by the control device based on the signal time difference, which is the time difference between the time point when the control device sends the ranging command and the time point when it receives the feedback signal.

[0008] The audio array amplitude is determined based on the distance parameter, and the configuration parameters of the sound acquisition device are adjusted based on the audio array amplitude.

[0009] When the display device is in standby mode, wake-up audio data is acquired through an adjusted sound acquisition device, and the similarity value between the wake-up audio data and a preset wake-up word is calculated;

[0010] If the similarity value is greater than or equal to the similarity value threshold, the display is controlled to show the user interface.

[0011] In some embodiments, the feedback signal includes a request to acquire signal light speed parameters and distance parameters, and the controller is configured to send the feedback signal to the control device.

[0012] Send a request to the control device to obtain signal light speed parameters and distance parameters, so that the control device responds to the distance parameter acquisition request and calculates the distance parameters based on the signal light speed parameters and the signal time difference;

[0013] Obtain the distance parameters sent by the control device.

[0014] In some embodiments, the ranging command is a command generated by the display device in response to the power-on process. Before the controller executes the request to send the signal light speed parameter and distance parameter acquisition request to the control device, it is further configured to:

[0015] Get the boot time;

[0016] Delay parameters are generated based on the power-on duration;

[0017] The control device generates a feedback interval for the distance parameter acquisition request based on the delay parameter, so that the control device sends the distance parameter to the display device after the feedback interval has elapsed.

[0018] In some embodiments, the feedback signal further includes a stop counting signal, and the controller is configured to send the feedback signal to the control device as follows:

[0019] The control device sends the termination counting signal to the control device so that the control device outputs the current number of pulses of the counter and calculates the signal time difference based on the number of pulses. The counter is created when the control device sends the ranging command, and the number of pulses is the number of counting pulses input to the counter by the clock oscillator.

[0020] In some embodiments, the controller is configured to acquire distance parameters sent by the control device.

[0021] The distance analog signal obtained by the control device performing signal encoding on the distance parameter is acquired;

[0022] The distance analog signal is amplified to obtain a level-coded signal;

[0023] The distance parameter is obtained by performing binary decoding on the level-encoded signal.

[0024] In some embodiments, the controller is configured to determine the audio array amplitude based on the distance parameter as follows:

[0025] Get the range of distance parameters;

[0026] The target parameter range is determined within the range of the distance parameters based on the distance parameters.

[0027] The amplitude of the audio array is determined based on the target parameter range.

[0028] In some embodiments, the controller is further configured to:

[0029] Acquire sample audio data played within the distance parameter range, and acquire the audio energy amplitude of the sample audio data;

[0030] The audio array amplitude within the range of the distance parameter is adjusted based on the amplitude difference between the audio energy amplitude and the energy amplitude threshold.

[0031] In some embodiments, a memory is further included, the memory storing a speech recognition model, wherein the controller is configured to perform a similarity calculation between the wake-up audio data and a preset wake-up word.

[0032] The wake-up audio data is input into the speech recognition model to obtain wake-up text data;

[0033] Extract the text features of the wake-up text data;

[0034] Calculate the cosine similarity between the text features and the reference text features, where the reference text features are the text features of the preset wake word;

[0035] The similarity value is calculated based on the cosine similarity.

[0036] In a second aspect, this application provides a control device for sending control commands to the display device described in the first aspect to control the display device. The control device includes a button assembly, including at least one control button for generating control commands, a communication interface configured to send control commands to the display device, and a processor configured to:

[0037] A ranging command is generated in response to a click event of the ranging button, and the ranging command is sent to the display device through the communication interface;

[0038] Receive the feedback signal generated by the display device in response to the ranging command, and calculate the signal time difference based on the time point of sending the ranging command and the time point of receiving the feedback signal;

[0039] Calculate the distance parameters based on the signal time difference;

[0040] The distance parameter is sent to the display device so that the display device determines the amplitude of the audio array based on the distance parameter, adjusts the configuration parameters of the sound collector based on the amplitude of the audio array, and acquires wake-up audio data through the adjusted sound collector when the display device is in standby mode, calculates the similarity value between the wake-up audio data and the preset wake-up word, and controls the display to display the user interface when the similarity value is greater than or equal to the similarity value threshold.

[0041] Thirdly, this application provides a device wake-up method, applied to the display device described in the first aspect, the method comprising:

[0042] In response to a ranging command input by the user through the control device, a feedback signal is sent to the control device;

[0043] The distance parameter is received from the control device. The distance parameter is calculated by the control device based on the signal time difference, which is the time difference between the time point when the control device sends the ranging command and the time point when it receives the feedback signal.

[0044] The audio array amplitude is determined based on the distance parameter, and the configuration parameters of the sound acquisition device are adjusted based on the audio array amplitude.

[0045] When the display device is in standby mode, wake-up audio data is acquired through an adjusted sound acquisition device, and the similarity value between the wake-up audio data and a preset wake-up word is calculated;

[0046] If the similarity value is greater than or equal to the similarity value threshold, the display is controlled to show the user interface.

[0047] As can be seen from the above technical solutions, this application provides a display device, a control device, and a device wake-up method. The method responds to a ranging command input by the control device, sends a feedback signal to the control device, receives distance parameters sent by the control device, determines the audio array amplitude based on the distance parameters, and adjusts the configuration parameters of the sound collector based on the audio array amplitude. When the display device is in standby mode, it acquires wake-up audio data, performs wake-up voice recognition on the wake-up audio data, and wakes up the display device. This application obtains the distance parameters between the user and the display device through the control device and dynamically adjusts the audio array amplitude of the sound collector based on the distance parameters, improving the sound collection effect of the sound collector at different distance positions, thereby improving the accuracy of voice wake-up of the display device. Attached Figure Description

[0048] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0049] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application;

[0050] Figure 2 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application;

[0051] Figure 3 This is a schematic diagram of the hardware configuration of the control device provided in some embodiments of this application;

[0052] Figure 4 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application;

[0053] Figure 5 A schematic diagram illustrating the process of a display device performing device wake-up provided in some embodiments of this application;

[0054] Figure 6 This is a flowchart illustrating the sending of control commands to a display device according to some embodiments of this application;

[0055] Figure 7 A flowchart illustrating how a display device receives distance parameters transmitted by a control device, provided in some embodiments of this application;

[0056] Figure 8 A flowchart illustrating the calculation of distance parameters by a control device provided in some embodiments of this application;

[0057] Figure 9 A flowchart illustrating how a display device receives distance parameters delayed from a control device, provided in some embodiments of this application;

[0058] Figure 10 Timing diagrams for transmitting distance parameters between display devices and control devices provided in some embodiments of this application;

[0059] Figure 11 A flowchart for calculating the amplitude of an audio array in a display device provided in some embodiments of this application;

[0060] Figure 12 A flowchart illustrating the calculation of signal time difference by a control device provided in some embodiments of this application;

[0061] Figure 13This is a schematic diagram illustrating the adjustment of configuration parameters when the user is away from the display device in some embodiments of this application;

[0062] Figure 14 This is a schematic diagram illustrating the adjustment of configuration parameters when a user approaches a display device in some embodiments of this application. Detailed Implementation

[0063] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0064] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0065] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0066] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0067] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0068] In this embodiment, the display device 200 generally refers to a device with screen display and data processing capabilities. For example, the display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0069] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1As shown, a user can operate the display device 200 via touch operation, a mobile terminal 300, and a control device 100. The control device 100 receives user input commands and converts them into control commands that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0070] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.

[0071] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application that controls the display device 200.

[0072] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0073] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0074] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.

[0075] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0076] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0077] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.

[0078] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication device 220 with WiFi functionality. When the display device 200 supports Bluetooth connectivity, it needs to have a communication device 220 with Bluetooth functionality.

[0079] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.

[0080] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0081] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0082] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0083] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.

[0084] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0085] Figure 3 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of the central control device. (Example) Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0086] The control device 100 is configured to control the display device 200, and to receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0087] In some embodiments, the control device 100 may be an intelligent device. For example, the control device 100 may be equipped with various applications for controlling the display device 200 according to user needs.

[0088] In some embodiments, such as Figure 1 As shown, the mobile terminal 300 or other smart electronic devices can perform similar functions to the control device 100 after installing the application of the control display device 200.

[0089] The controller 110 includes a processor 112, RAM 113, ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the communication and cooperation between internal components and the external and internal data processing functions.

[0090] Under the control of the controller 110, the communication interface 130 enables communication of control signals and data signals with the display device 200. The communication interface 130 may include at least one of other near-field communication modules such as WiFi chip 131, Bluetooth module 132, and NFC module 133.

[0091] User input / output interface 140, wherein the input interface includes at least one of other input interfaces such as microphone 141, touchpad 142, sensor 143, and button 144.

[0092] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with the communication interface 130, such as a WiFi, Bluetooth, or NFC module, which can encode user input commands via WiFi, Bluetooth, or NFC protocols and send them to the display device 200.

[0093] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can also store various control signal instructions input by the user.

[0094] The power supply 180 is used to provide operating power support for the various components of the control device 100 under the control of the controller.

[0095] To enable user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application. The operating system also allows users to interact with the display device 200.

[0096] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0097] An operating system can be divided into different modules or levels based on the functions it implements, for example... Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.

[0098] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may contain at least one application, which may be a built-in Windows program, system settings program, or clock program of the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0099] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0100] like Figure 4 As shown, Figure 4 The diagram below illustrates the software configuration of a display device according to some embodiments of this application. In some embodiments, the system of the display device 200 can be divided into three layers, from top to bottom: the application layer, the middleware layer, and the hardware layer.

[0101] The application layer mainly includes TV applications and application frameworks. The applications are mainly browser-based applications, such as HTML5 apps, and native apps.

[0102] An application framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, and the user interface for these functions (toolbar, status bar, menu, dialog box).

[0103] Native apps can support online or offline access, push notifications, or access to local resources.

[0104] The middleware layer includes various television protocols, multimedia protocols, and system components. Middleware can use the basic services (functions) provided by system software to connect different parts of application systems or different applications on the network, achieving resource sharing and function sharing.

[0105] The hardware layer mainly includes the HAL interface, hardware, and drivers. The HAL interface is a unified interface for all TV chips, with the specific logic implemented by each chip. The drivers mainly include: audio drivers, display drivers, Bluetooth drivers, camera drivers, Wi-Fi drivers, USB drivers, HDMI drivers, sensor drivers (such as fingerprint sensors, temperature sensors, pressure sensors, etc.), and power drivers.

[0106] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0107] In some embodiments, the display device 200 can enter a standby mode after a preset period of inactivity to suspend the currently running application, thereby reducing the power consumption of the display device 200. While the display device 200 is in standby mode, the user can send a wake-up command to switch the display device 200 from standby mode to working mode. The wake-up command can be any type of control command. For example, when the user presses a button on the control device 100, the control device 100 can generate a wake-up command based on the corresponding button press and send it to the display device 200 to wake it up. Upon receiving the wake-up command, the display device 200 in standby mode switches to working mode and continues running the application from its previous program progress.

[0108] The display device 200 can also have a voice interaction function. For this purpose, the wake-up command can also be a voice command. Users can use the voice wake-up function (KWS, Keyword Spotting) to speak the wake-up word preset by the display device 200 to generate a wake-up command to wake up the display device 200.

[0109] In some embodiments, the wake-up command can also be wake-up audio data. During the process of waking up the display device 200, the controller 250 needs to perform speech recognition on the wake-up audio data, obtain the speech recognition result, and calculate the matching degree between the speech recognition result and the preset wake-up word text of the display device 200. When the matching degree is greater than or equal to the preset matching degree threshold, the controller 250 can wake up the display device 200 according to the wake-up audio data. If the matching degree is less than the preset matching degree threshold, it means that the user has spoken incorrect wake-up audio data and the display device 200 cannot be woken up.

[0110] In standby mode, display device 200 can acquire user-input wake-up audio data via a sound acquisition unit. This unit has multiple built-in microphone arrays to receive sound sources from different directions, improving the audio acquisition range of display device 200. However, in scenarios where the user is viewing display device 200, the distance between the user and the device is not fixed. As the distance changes, the amplitude of the microphone array in the sound acquisition unit remains constant, resulting in poor sound pickup. For example, when the user is relatively far from the television, the sound waves emitted by the user attenuate during propagation, reducing the energy received by the microphone array. When the user is relatively close to the television, the sound waves are directly received by the microphone array, and the higher volume may cause amplitude clipping in the microphone array. Both of these situations lead to poor sound pickup by the sound acquisition unit, resulting in unclear user-input wake-up audio data and affecting the wake-up recognition of display device 200.

[0111] To address the problem of unclear wake-up audio data caused by the variable distance between the user and the display device, this application provides a display device 200, which should include at least a display 260, a sound acquisition unit, and a controller 250. The display 260 is configured to display a user interface, the sound acquisition unit is used to acquire audio data, and the controller 250 is configured to execute a device wake-up method.

[0112] Figure 5 This is a schematic diagram illustrating the process of a display device performing device wake-up according to some embodiments of this application. See also... Figure 5 The method includes the following:

[0113] S100: In response to a ranging command input by the user through the control device, a feedback signal is sent to the control device.

[0114] like Figure 6 As shown, the control device 100 is equipped with a button assembly, which includes multiple control buttons, such as an "OK" button, an "Exit" button, and directional buttons, such as "↑", "↓", "←", and "→". The control device 100 can listen to the click events of the control buttons and generate different control commands based on the corresponding click events. For example, when a user moves the focus to select a video media asset in the display device 200, they can click the directional buttons on the control device 100 to generate a focus movement command, thereby moving the focus media asset in the display device 200.

[0115] In some embodiments, the button assembly may include a distance measurement button, which is used to generate a distance measurement command to measure the distance between the control device 100 and the display device 200. Since the user holds the control device 100 when using it, the position of the control device 100 can represent the position of the user relative to the display device 200, thereby determining the distance between the user and the display device 200.

[0116] The distance measurement button can be a standalone control button within the button assembly, or it can be another control button within the assembly. This means that the control button possesses both multimedia functions and distance measurement capabilities. For example, the "OK" button can be a distance measurement button. After the user clicks the "OK" button, a selection command can be generated based on the "OK" button to execute the corresponding interactive effect. Simultaneously, a distance measurement command is generated and sent to the display device 200 via infrared signal.

[0117] After receiving the ranging command, the display device 200 sends a feedback signal to the control device 100. The feedback signal indicates that the ranging command has been sent to the display device 200. The feedback signal can be generated synchronously after the ranging command is sent to the display device 200 and sent to the control device 100 through signal reflection.

[0118] S200: Receive distance parameters sent by the control device.

[0119] After receiving the feedback signal through the communication interface 130, the control device 100 can calculate the distance parameter based on the signal time difference. The distance parameter represents the distance between the control device 100 and the display device 200. The signal time difference is the time difference between the time when the control device 100 sends the ranging command and the time when it receives the feedback signal. Figure 7 A flowchart illustrating the calculation of signal time difference in a display device provided in some embodiments of this application. See also... Figure 7 If the time for the control device 100 to send the ranging command is a1, and the time for receiving the feedback signal is a2, then the signal time difference T is a1-a2. The control device 100 can then calculate the distance parameter based on the signal time difference.

[0120] The distance parameter needs to be calculated based on the speed of light of the signal; therefore, such as Figure 8 As shown, the feedback signal includes the signal speed parameter and the distance parameter acquisition request. After receiving the ranging command, the controller 250 can detect the signal speed parameter of the ranging command and generate a distance parameter acquisition request to request the distance parameter calculated by the control device 100.

[0121] In some embodiments, the controller 250 may send a request to acquire signal light speed parameters and distance parameters to the control device 100. After calculating the signal time difference based on the time point of receiving the feedback signal, the control device 100 may calculate the distance parameters based on the signal time difference and the following formula:

[0122] D = 1 / 2CT;

[0123] Where D is the distance parameter, C is the signal light speed parameter, and T is the signal time difference.

[0124] After calculating the distance parameters, the control device 100 can send the distance parameters to the display device 200 in response to a distance parameter acquisition request, so that the controller 250 can receive the distance parameters sent by the control device 100.

[0125] In some embodiments, the display device 200 can complete the ranging process while already powered on, that is, while powered on, it receives a ranging command sent by the control device 100 and obtains the distance parameters calculated by the control device 100 based on the feedback signal. The display device 200 can also complete the ranging process while in the process of being powered on. The state of being powered on is the state in which the display device 200 is responding to the power-on process. The user can generate a power-on command through the power-on button on the control device 100. The display device 200 can respond to the power-on command and run the power-on process. At this time, the ranging command is the command generated by the display device 200 in response to the power-on process. During the operation of the power-on process, the display device 200 can send the feedback signal generated according to the ranging command to the control device 100.

[0126] Since the power-on process of the display device 200 requires a preset duration, if the control device 100 immediately sends the distance parameters to the display device 200 after obtaining them, the display device 200 will not be powered on, resulting in failure to receive the distance parameters.

[0127] To alleviate the above problems, see Figure 9 In some embodiments, the controller 250 can obtain the power-on duration of the display device 200. The power-on duration is the time from when the display device 200 responds to a power-on command and begins running the power-on process until the process ends, during which the display device 200 is in a powered-on state. The controller 250 can generate a delay parameter based on the power-on duration. This delay parameter indicates the duration for which the control device 100 delays sending distance parameters. The delay parameter can be greater than or equal to the power-on duration to ensure that the display device 200 is in a powered-on state.

[0128] Controller 250 can generate a distance parameter based on the delay parameter to obtain the response interval duration of the request, for example, Figure 10As shown, when the power-on duration is 5 seconds, the delay parameter can be set to be greater than or equal to 5 seconds, such as 5 seconds, 6 seconds, or 7 seconds. When the display device 200 generates a distance parameter acquisition request, the feedback interval duration can be set according to the delay parameter. After responding to the distance parameter acquisition request, the control device 100 can send the distance parameter to the display device 200 after the feedback interval duration has elapsed. For example, if the feedback interval duration for the distance parameter acquisition request is 6 seconds, and the display device 200 is running the power-on program, the control device 100 calculates the distance parameter based on the signal time difference while the display device 200 is running the power-on program. After acquiring the distance parameter, the control device 100 responds to the distance parameter acquisition request by executing a delay program, the delay duration of which is the feedback interval duration. When the control device 100 delays for 5 seconds, the power-on program of the display device 200 ends, and the device is in a powered-on state. At this time, the display device 200 can receive the parameter data sent by the control device 100. When the control device 100 delays for 6 seconds, the distance parameters can be sent to the display device 200 to alleviate the problem of distance parameter reception failure caused by the display device 200 not being fully powered on, and to improve the efficiency of the display device 200 in receiving distance parameters.

[0129] S300: Determine the audio array amplitude based on the distance parameter, and adjust the configuration parameters of the sound acquisition unit based on the audio array amplitude.

[0130] After receiving the distance parameters, the display device 200 can determine the audio array amplitude based on these parameters. The audio array amplitude is used to adjust the configuration parameters of the microphone array in the sound acquisition unit to improve the microphone array's ability to pick up sound from sources at different distances. For relatively large distance parameters, the audio array amplitude can be increased; for relatively small distance parameters, the audio array amplitude can be decreased, thereby dynamically adjusting the microphone array's sound pickup capability.

[0131] To improve the accuracy of determining the amplitude of the audio array, the controller 250 can divide the distance parameter range into multiple ranges to configure the audio array amplitude for different distance parameter ranges. For example, the controller 250 can divide the distance parameter range into five ranges: d1: D ≤ 1 meter, d2: 1 meter < D ≤ 2 meters, d3: 2 meters < D ≤ 3 meters, d4: 3 meters < D ≤ 4 meters, and d5: D > 4 meters. The controller 250 can determine the target parameter range within these ranges based on the acquired distance parameters. For instance, when the distance parameter is 2.3 meters, the target parameter range can be determined as d3.

[0132] Each distance parameter range includes an audio array amplitude, corresponding to d1, d2, d3, d4, and d5. The audio array amplitude can include g1, g2, g3, g4, and g5, where g1 is the audio array amplitude for distance parameter range d1, g2 is for distance parameter range d2, g3 is for distance parameter range d3, g4 is for distance parameter range d4, and g5 is for distance parameter range d5. Because the sound waves emitted by the user attenuate during propagation, the microphone array's pickup energy decreases. Therefore, the audio matrix amplitude is larger for relatively farther distance parameter ranges. When the user is relatively close to the television, the emitted sound waves are at higher volume, causing the microphone array to clip. Therefore, the audio matrix amplitude is smaller for relatively closer distance parameter ranges. Thus, the audio matrix amplitudes of g1, g2, g3, g4, and g5 should increase sequentially, i.e., g1 < g2, g2 < g3, g3 < g4, and g4 < g5.

[0133] Continuing with the example above, when the distance parameter is 2.3 meters, the target parameter range is d3. Therefore, the audio array amplitude is the audio array amplitude corresponding to the distance parameter range d3. The controller 250 can adjust the configuration parameters of the microphone array of the sound acquisition unit according to the audio array amplitude corresponding to the distance parameter range d3 to improve the sound pickup effect of the microphone array.

[0134] In some embodiments, in order to determine the audio array amplitude for each range of distance parameters, such as Figure 11 As shown, the controller 250 can also acquire sample audio data, which is used for playback within different distance parameter ranges. The display device 200 can be set with an initial array amplitude. After receiving the sample audio data with the initial array amplitude, the display device 200 can perform audio energy analysis on the sample audio data to obtain the audio energy amplitude of the sample audio data.

[0135] To facilitate adjustment of the initial array amplitude, the controller 250 can set an energy amplitude threshold and calculate the amplitude difference between the audio energy amplitude and the energy amplitude threshold. Based on this amplitude difference, the audio array amplitude within the distance parameter range is adjusted. The amplitude difference can be positive or negative. A positive value indicates that the audio energy amplitude is greater than the energy amplitude threshold, meaning that sample audio data received within the distance parameter range is prone to causing amplitude clipping in the microphone array. Therefore, the initial array amplitude within the distance parameter range can be reduced based on the amplitude difference to obtain the desired audio array amplitude. A negative value indicates that the audio energy amplitude is less than the energy amplitude threshold, meaning that the distance parameter range is far from the display device 200. Sample audio data received within the distance parameter range attenuates, resulting in unclear audio. Therefore, the initial array amplitude within the distance parameter range can be increased based on the amplitude difference to obtain the desired audio array amplitude.

[0136] S400: When the display device is in standby mode, wake-up audio data is acquired through the adjusted sound collector, and the similarity value between the wake-up audio data and the preset wake-up word is calculated.

[0137] When the display device 200 is in standby mode, the controller 250 controls the display 260 to display the standby interface. At this time, the user can wake up the display device 200 by saying a preset wake-up word. The display device 200 can then acquire the wake-up audio data input by the user through an adjusted sound acquisition device and calculate the similarity value between the wake-up audio data and the preset wake-up word.

[0138] In some embodiments, the display device 200 further includes a memory storing a speech recognition model. The controller 250 can input wake-up audio data into the speech recognition model and perform preprocessing on the wake-up audio data sequentially through the speech recognition model to obtain the MFCC coefficients of the wake-up audio data. The preprocessing may include pre-emphasis, framing, windowing, Fast Fourier Transform (FFT), energy spectrum calculation, passing through a Mel filter bank, taking the logarithmic energy, and performing Discrete Cosine Transform (DCT) to improve the accuracy of MFCC coefficient extraction. After extracting the MFCC coefficients, the speech recognition model can output a text sequence based on the MFCC coefficients to obtain wake-up text data and extract text features from the wake-up text data. After obtaining the text features, the controller 250 can calculate the cosine similarity between the text features and reference text features, thereby calculating the similarity value between the wake-up audio data and the preset wake-up word based on the cosine similarity, where the reference text features are the text features of the preset wake-up word.

[0139] S500: If the similarity value is greater than or equal to the similarity value threshold, control the display to show the user interface.

[0140] When the similarity value is greater than or equal to the similarity threshold, it indicates that the wake-up audio data successfully wakes up the display device 200, and the controller 250 can control the display 260 to display the user interface. When the similarity value is less than the similarity threshold, it indicates that the wake-up audio data fails to wake up the display device 200, and the controller 250 can generate a prompt message based on the wake-up audio data and control the display device 200 to display the prompt message on the standby screen to inform the user that the wake-up failed.

[0141] In some embodiments, such as Figure 12As shown, the control device 100 can also create a counter to record the time difference. After sending a ranging command, the control device 100 starts the counter and inputs counting pulses to the counter via a clock oscillator. The feedback signal also includes a stop counting signal. After the display device 200 sends the feedback signal to the control device 100, the control device 100 can respond to the stop counting signal to stop the counting process of the counter. After the counting process stops, the clock oscillator stops inputting counting pulses to the counter. The control device 100 can output the current number of pulses of the counter and calculate the signal time difference according to the following formula:

[0142] T = N * (1 / F);

[0143] Where N is the current number of pulses of the counter, and F is the operating frequency of the clock oscillator.

[0144] To improve the transmission speed of parameter data, wireless transmission can be used between the control device 100 and the display device 200. Specifically, data can be transmitted via infrared signals. Therefore, before sending the distance parameters to the display device 200, the control device 100 can encode the distance parameters, converting them into infrared light signals for transmission. During this process, the processor 112 of the control device 100 encodes the distance parameters into binary signals using an infrared communication protocol, such as the NEC communication protocol, to obtain analog distance signals. This allows for the differentiation of data bits between distance parameters, and error checking is performed using the inverse of the address code and command code, effectively reducing the bit error rate during data transmission.

[0145] The processor 112 can send the encoded distance analog signal to the display device 200 via the communication interface 130. The display device 200 can receive the distance analog signal via the communication device 220 and perform operations such as signal amplification and signal detection on the distance analog signal to obtain a TTL level encoded signal, thereby improving the signal-to-noise ratio and clarity of the received distance analog signal. After receiving the level encoded signal, the controller 250 performs binary decoding on the level encoded signal to obtain the distance parameters, thus ensuring the accurate decoding and reconstruction of the distance parameter data.

[0146] In some embodiments, since the distance between the user and the display device 200 is not fixed, after the display device 200 adjusts the configuration parameters of the sound collector based on the distance parameters sent by the control device 100, the user can move a second time. At this time, the configuration parameters may not be applicable to the user's second position. Therefore, the controller 250 can also send a feedback signal to the control device 100 again to update the distance parameters based on the new control command sent by the control device 100.

[0147] Figure 13 This is a schematic diagram illustrating parameter adjustments when the user is away from the display device, as shown in an embodiment of this application. See also... Figure 13 When the user first moves to distance range d3 and adjusts the configuration parameters of the sound acquisition device, then moves to distance range d4 (moving away from display device 200), the user sends a control command to display device 200 via control device 100. Upon receiving the control command, display device 200 sends a feedback signal back to control device 200. Control device 100 updates the signal time difference based on the time of sending the control command and the time of receiving the second feedback signal. Because the user moves away from display device 200, the signal travels a longer distance, and the corresponding signal time difference increases. Therefore, controller 250 calculates the user's current location within distance range d4 based on the signal time difference and the signal speed parameter, and thus adjusts the configuration parameters of the sound acquisition device on display device 200 according to the audio array parameters within distance range d4, enabling the sound acquisition device to receive sound data from more distant sources.

[0148] Figure 14 This is a schematic diagram illustrating parameter adjustments when a user approaches the display device, as shown in an embodiment of this application. See also... Figure 14 If the user moves to the distance parameter range d2 for the second time, that is, moves closer to the display device 200, the control device 100 can update the signal time difference according to the time point of sending the control command and the time point of receiving the second feedback signal, and calculate the user's current location in the distance parameter range d2 according to the signal time difference and the signal light speed parameter. Thus, the configuration parameters of the sound collector of the display device 200 are reduced according to the audio array parameters of the distance parameter range d2, so that the sound collector can alleviate the amplitude phenomenon caused by the sound source approaching the display device 200.

[0149] In some embodiments, if the user moves a second time to the other direction of the distance parameter range d3, since the distance parameter range remains unchanged, the configuration parameters of the sound acquisition device also remain unchanged. The controller 250 can adjust the direction of the microphone array in the sound acquisition device according to the direction of receiving the control command.

[0150] It should be noted that this application only illustrates the example of two user movements. In the actual application of the display device 200, each time the user changes the distance parameter range and sends a new control command using the control device 100, the configuration parameters of the sound collector can be adjusted according to the distance parameter range where the control device 100 is located after the movement. The adjustment of the sound collector's configuration parameters can be found in the above embodiments, and will not be repeated in this embodiment.

[0151] Some embodiments of this application provide a control device 100 for sending control commands to the aforementioned display device 200. The control device 100 includes a button assembly, a communication interface 130, and a processor 112. The button assembly includes at least one control button, which a user can click to generate control commands for the display device 200 to respond to, and then send the control commands to the display device 200 via the communication interface 130. The processor is configured to generate a ranging command in response to a click event of the ranging button, and to send the ranging command to the display device 200 via the communication interface 130. After receiving the ranging command, the display device 200 sends a feedback signal to the control device 100. The processor 112 can receive the feedback signal generated by the display device 200 in response to the ranging command, calculate the signal time difference based on the time point of sending the ranging command and the time point of receiving the feedback signal, and calculate a distance parameter based on the signal time difference.

[0152] After calculating the distance parameters, the processor 112 sends the distance parameters to the display device 200 so that the display device 200 determines the audio array amplitude based on the distance parameters, adjusts the configuration parameters of the sound collector based on the audio array amplitude, and acquires wake-up audio data through the adjusted sound collector when the display device 200 is in standby mode, calculates the similarity value between the wake-up audio data and the preset wake-up word, and controls the display 260 to display the user interface when the similarity value is greater than or equal to the similarity value threshold.

[0153] The control device 100 provided in this application sends a ranging command to the display device 200 and receives feedback signals from the display device 200, calculates the signal time difference, and determines the distance parameter of the user relative to the display device 200 based on the signal time difference. This allows the display device 200 to adjust the configuration parameters of the sound collector according to the distance parameter, thereby improving the clarity of the acquired wake-up audio data and the accuracy of wake-up recognition.

[0154] Some embodiments of this application provide a device wake-up method applied to the display device 200 described above. The display device 200 should at least include a display 260, a sound collector, and a controller 250. The display 260 is configured to display a user interface, and the sound collector is configured to acquire audio data. The method includes:

[0155] S100: In response to a ranging command input by the user through the control device, a feedback signal is sent to the control device;

[0156] S200: Receive distance parameters sent by the control device, wherein the distance parameters are calculated by the control device based on the signal time difference, and the signal time difference is the time difference between the time point when the control device sends the ranging command and the time point when it receives the feedback signal;

[0157] S300: Determine the audio array amplitude based on the distance parameter, and adjust the configuration parameters of the sound acquisition unit based on the audio array amplitude;

[0158] S400: When the display device is in standby mode, wake-up audio data is acquired through the adjusted sound collector, and the similarity value between the wake-up audio data and the preset wake-up word is calculated;

[0159] S500: If the similarity value is greater than or equal to the similarity value threshold, control the display to show the user interface.

[0160] As can be seen from the above technical solutions, this application provides a display device, a control device, and a device wake-up method. The method responds to a ranging command input by the control device, sends a feedback signal to the control device, receives distance parameters sent by the control device, determines the audio array amplitude based on the distance parameters, and adjusts the configuration parameters of the sound collector based on the audio array amplitude. When the display device is in standby mode, it acquires wake-up audio data, performs wake-up voice recognition on the wake-up audio data, and wakes up the display device. This application obtains the distance parameters between the user and the display device through the control device and dynamically adjusts the audio array amplitude of the sound collector based on the distance parameters, improving the sound collection effect of the sound collector at different distance positions, thereby improving the accuracy of voice wake-up of the display device.

[0161] The same or similar parts among the various embodiments in this specification can be referred to mutually, and will not be repeated here.

[0162] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of the present invention.

[0163] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0164] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized by comprising: The application comprises: a display configured to display a user interface; a sound collector configured to acquire audio data; a controller configured to: send a feedback signal to the control device in response to a ranging instruction input by a user through the control device; receive a distance parameter sent by the control device, the distance parameter being calculated by the control device according to a signal time difference, the signal time difference being a time difference between a time point at which the control device sends the ranging instruction and a time point at which the feedback signal is received; determine an audio array amplitude value according to the distance parameter, and adjust a configuration parameter of the sound collector according to the audio array amplitude value; when the display device is in a standby mode, acquire wake-up audio data through the adjusted sound collector, and calculate a similarity value of the wake-up audio data and a preset wake-up word; if the similarity value is greater than or equal to a similarity value threshold, control the display to display the user interface; the controller configured to determine an audio array amplitude value according to the distance parameter, is further configured to: acquire a distance parameter range; determine a target parameter range in the distance parameter range according to the distance parameter; determine the audio array amplitude value according to the target parameter range; the controller is further configured to: acquire sample audio data played in the distance parameter range, and acquire an audio energy amplitude value of the sample audio data; adjust the audio array amplitude value of the distance parameter range according to an amplitude difference between the audio energy amplitude value and an energy amplitude threshold.

2. The display device of claim 1, wherein, The feedback signal comprises a signal light speed parameter and a distance parameter acquisition request, and the controller configured to send the feedback signal to the control device, is further configured to: send the signal light speed parameter and the distance parameter acquisition request to the control device, so that the control device calculates the distance parameter according to the signal light speed parameter and the signal time difference in response to the distance parameter acquisition request; acquire the distance parameter sent by the control device.

3. The display device of claim 2, wherein, The ranging instruction is an instruction generated by the display device in response to a booting process, and before the controller sends the signal light speed parameter and the distance parameter acquisition request to the control device, the controller is further configured to: acquire a booting duration; generate a delay parameter according to the booting duration; generate a feedback interval duration of the distance parameter acquisition request according to the delay parameter, so that the control device sends the distance parameter to the display device after the feedback interval duration.

4. The display device of claim 2, wherein, The feedback signal further comprises a termination counting signal, and the controller configured to send the feedback signal to the control device, is further configured to: send the termination counting signal to the control device, so that the control device outputs a current pulse number of a counter, and calculates the signal time difference according to the pulse number, the counter being created when the control device sends the ranging instruction, and the pulse number being a number of counting pulses input by a clock oscillator to the counter.

5. The display device of claim 2, wherein, The controller configured to acquire the distance parameter sent by the control device, is further configured to: acquire a distance analog signal obtained by performing signal encoding on the distance parameter by the control device; Perform signal amplification on the distance analog signal to obtain a level encoding signal; Perform binary decoding on the level encoding signal to obtain the distance parameter.

6. The display device of claim 1, wherein, Further comprising a memory storing a voice recognition model, the controller is configured to: input the wake-up audio data into the voice recognition model to obtain wake-up text data; extract text features of the wake-up text data; calculate the cosine similarity between the text features and reference text features, the reference text features being text features of the preset wake-up word; calculate the similarity value according to the cosine similarity.

7. A control device, characterized by Comprise: a key assembly comprising at least one control key for generating a control instruction; a communication interface configured to send the control instruction to a display device; a processor configured to: generate a ranging instruction in response to a click event of a ranging key, and send the ranging instruction to the display device through the communication interface; receive a feedback signal generated by the display device in response to the ranging instruction, and calculate a signal time difference according to a time point of sending the ranging instruction and a time point of receiving the feedback signal; calculate a distance parameter according to the signal time difference; send the distance parameter to the display device to enable the display device to determine an audio array amplitude value according to the distance parameter, and adjust a configuration parameter of a sound collector according to the audio array amplitude value, and when the display device is in standby mode, obtain wake-up audio data through the adjusted sound collector, calculate a similarity value between the wake-up audio data and a preset wake-up word, and control the display to display a user interface when the similarity value is greater than or equal to a similarity value threshold. The display device determines the audio array amplitude value according to the distance parameter, and is configured to: obtain a distance parameter range; determine a target parameter range in the distance parameter range according to the distance parameter; determine the audio array amplitude value according to the target parameter range. The display device is further configured to: obtain sample audio data played in the distance parameter range, and obtain an audio energy amplitude value of the sample audio data; adjust the audio array amplitude value of the distance parameter range according to the amplitude difference between the audio energy amplitude value and an energy amplitude threshold.

8. A device wake-up method, comprising: The display device comprises a display, a sound collector and a controller, the display is configured to display a user interface, the sound collector is configured to obtain audio data, and the method comprises: in response to a ranging instruction input by a user through a control device, send a feedback signal to the control device; receive a distance parameter sent by the control device, the distance parameter being calculated by the control device according to a signal time difference, the signal time difference being a time difference between a time point of sending the ranging instruction by the control device and a time point of receiving the feedback signal; determine an audio array amplitude value according to the distance parameter, and adjust a configuration parameter of the sound collector according to the audio array amplitude value; When the display device is in a standby mode, obtaining wake-up audio data through an adjusted sound collector, and calculating a similarity value of the wake-up audio data and a preset wake-up word; If the similarity value is greater than or equal to a similarity value threshold, controlling the display to display the user interface; The controller is configured to: obtain a distance parameter range; determine a target parameter range in the distance parameter range according to the distance parameter; determine the audio array amplitude value according to the target parameter range; The controller is further configured to: obtain sample audio data played in the distance parameter range, and obtain an audio energy amplitude value of the sample audio data; adjust the audio array amplitude value of the distance parameter range according to an amplitude difference between the audio energy amplitude value and an energy amplitude threshold value.

Images